Researchers made an SI-controlled robot point a knife at a dummy hand by adding two letters to a command
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
If a model for a robot comes from an untrusted source, a hidden command can be built into it; that is why plans need to be checked before action.
According to 3DNews, scientists at Binghamton University (USA) created the MuTRAP attack: a hidden "trojan" is embedded in the language model that plans a robot's tasks. When the two letters "CF" were added to a command, a mobile robot on a Segway platform pointed the knife at a dummy human hand instead of slicing an apple. For defence, the authors presented the PROTEA platform, which checks the robot's action plan before execution.
Sources 1