All news

Microsoft Foundry Local connects local Qwen3.8-27B to GitHub Copilot

Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .

Agentic coding can move to a developer's own graphics card: code remains local, while the cloud can be reserved for more complex tasks.

Foundry Local 0.13.0 runs the model through ONNX Runtime on Nvidia GPUs and connects to Copilot through Bring Your Own Key. INT4 quantization reduces the model to about 18 GB: a graphics card with 24 GB of VRAM supports a context of up to 64,000 tokens, while 32 GB or more supports up to 262,000. Optimizations include DFlash2 speculative decoding, prefix caching and continuous batching. In Microsoft's comparison with llama.cpp on real GitHub tasks, Foundry Local delivered higher generation speed at every prompt length tested. The company notes that the local model trails frontier cloud models on complex reasoning but can work offline without sending code to an external server.