All news

Sber unveils Cowork Bench: 475 office tasks for testing SI agents in Russian

Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .

SI agents for office work now have an open Russian-language test, but for now its results are Sber's own figures.

According to Sberbank representatives quoted by CNews, the benchmark tests not a model's answers but an agent's ability to finish a task end to end without people: it includes 475 end-to-end tasks, 12 business functions and 26 corporate systems. According to Sber, in a test of nine solutions (eight foreign ones and GigaCowork) the share of successful runs ranged from 62% to 80%, with GigaCowork at 75.2%; the GigaCowork platform is developed by Salyut for Business, part of Sber's ecosystem.

Sources 1

Follow on Telegram