All news

Canonical releases Inference Manager for local models with an OpenAI-compatible API

Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .

Ubuntu turns local models into an ordinary system service: applications no longer need a separate mechanism to install and run each model.

Canonical unveiled Inference Manager at Ubuntu Summit and immediately published it in the Snap Store. The utility installs local models with commands such as `inference install smollm2` and provides unified HTTP access through port 8400, compatible with the OpenAI API for existing clients. The system uses inference-snaps, works without internet access and already connects Myna dictation, desktop assistants and coding agents; SI features are opt-in and can be removed.

Sources 1