Nvidia open-sources Run:ai, its platform for allocating GPUs among SI workloads
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
A tool that large companies use to share expensive graphics cards among SI jobs can now be used and modified by anyone.
Nvidia has released the entire Run:ai platform and four standalone components as open source; the KAI Scheduler, under the Apache 2.0 license, has been contributed to the CNCF Sandbox. The platform can group jobs for simultaneous launch, share quotas evenly, account for cluster topology and let several jobs share one processor with hard memory isolation. The code of the main platform is hosted in Nvidia's DSX AI Factory organization on GitHub.
Sources 1