MIPT proposes SimplexLoRA: a fine-tuning method that allocates resources across layers on its own
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
Models can be fine-tuned better at the same cost.
MIPT scientists developed SimplexLoRA, a variant of parameter-efficient fine-tuning for large language models that automatically identifies the most important layers and directs more tuning resources to them. According to the university, the method improves model quality without raising costs and adds no extra load during use. The paper will be presented at EMNLP 2026 in Budapest.
Sources 1