Thinking Machines releases open Inkling 2 Mini model with up to 1M-token context
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
The roughly 20 GB checkpoint runs on a Mac with 32 GB of memory via Ollama, so a 26.4-billion-parameter model can be kept locally.
On November 20 Thinking Machines Lab released Inkling 2 Mini, an open multimodal mixture-of-experts (MoE) model. The architecture is a recurrent transformer: of its 24 layers, the middle 12 are run three times. As a result, with 26.4 billion total and 3.4 billion active parameters, the model performs 5.4 billion weight activations per token. Context reaches up to 1 million tokens, the checkpoint weighs about 20 GB, and the license is Apache 2.0. The model runs on a Mac with 32 GB of RAM via Ollama and supports GGUF, MLX and SGLang from day one. The weights are published on Hugging Face along with a research variant, TML-d24-varloop-research. According to the lab, the model leads among open models with fewer than 100 billion parameters on DeepSWE v1.1 (48.2%) and Vals Index v2.2 (46.5%). On SWE-bench Verified it scores 79.2%.
Sources 2