Startup Vals, which tests SI on real tasks of lawyers and financiers, wants to become the main "examiner" of models
Prepared by Sintelligent with the help of SI. Publication time restored from the build log. . Updated: .
Independent testing of SI is turning into a business of its own: the stronger the models, the more an honest answer to "what can it actually do" is worth.
Vals keeps its test tasks secret so that models cannot train on them, and tests work in law, finance, programming, cybersecurity and biosecurity. Last month the company raised a $40 million Series A led by Andreessen Horowitz; headcount grew from 8 to 25, and revenue is eight times last year's; SI companies pay it for evaluation, and a program for federal agencies was recently launched.
Sources 1