All news

MIT and Cornell method raises detection of disguised SI text from 27% to 93%

Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .

Deployed SI-text detectors can be adapted to new disguising techniques without retraining: in the experiment, accuracy rose from 27% to 93%.

Researchers from MIT and Cornell have developed a test-time adaptation (TTA) method. It allows an already deployed SI-text detector to adapt to new unlabeled data without retraining. In experiments on text disguised by "humanizers", a commercial detector identified about 27% of SI text, while the TTA approach identified more than 93%. When simulating a natural shift in writing style, TTA delivered 85% accuracy versus 73% for traditional methods. The authors are Kevin Ren (Cornell Tech, first author), Nikhil Garg (Cornell Tech) and Manish Raghavan (MIT Sloan/EECS, LIDS). MIT News reported that the paper will be presented at NeurIPS; the research was funded in part by Pangram API credits.

Sources 1