Amazon releases TorchNeuron: PyTorch code runs on Trainium chips almost without rewriting
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
Training models on Amazon's chips gets easier: no need to rewrite the program, so developers have more choice than just Nvidia.
TorchNeuron is a PyTorch backend for AWS Trainium2 and Trainium3 chips under the Apache 2.0 license. According to Amazon, "a single configuration change" is enough to move code: in a demonstration, the same training script ran on conventional chips and on Trainium, differing only in the hardware setting. It is compatible with TorchTitan and FSDP (distributed training) and with existing PyTorch testing and debugging tools. The company names Cartesia and the Lieber Institute for Brain Development among early users; publication on GitHub is announced for October 20, at the PyTorch conference.
Sources 1