Startup Circuit Breaker Labs tests SI chats for psychological harm by simulating thousands of different users
Prepared by Sintelligent with the help of SI. Publication time restored from the build log. . Updated: .
Services are appearing that check SI interlocutors for safety in advance, and this makes such products more reliable.
The startup uses simulated users of different ages, languages and cultures to find dangerous responses and psychological harm in SI systems before launch; the main focus is mental support, coaching and journaling apps. The company was founded by siblings Shirali (CEO) and Arul Nigam after the story of Sewell Setzer, a 14-year-old who died after interacting with a Character.AI chatbot. The team has five people, clients are not disclosed; the startup is a finalist in Startup Battlefield 200 at TechCrunch Disrupt (October 13–15, San Francisco).
Sources 1