All news

Claude Opus 5.5 answers all 74 CSAT questions correctly in Korea Times test

Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .

Paid access and effort-level tuning allowed the model to complete all 74 CSAT questions without errors, while the free versions made mistakes.

The paid Claude Opus 5.5 model at the "High" effort level answered all 74 questions correctly in The Korea Times test. The newspaper built the test from papers of the CSAT for the 2027 academic year: 28 English reading questions without listening and 46 math questions. By the model's own estimate, it took less than 5 minutes. The free version of Perplexity gave 71 correct answers out of 74: the only clear error was in geometry (question 27), and two questions with graphs were left unanswered. Free ChatGPT answered all 28 English questions correctly but scored 32 out of 46 in math, with 2 errors and 12 unverified answers. Answers were checked against the Korea Institute for Curriculum and Evaluation's keys. The newspaper notes that this was not a controlled comparison: timings are approximate, and settings and tool use differed.

History

Claude Opus 5.5 leads in independent tests

2 events
    1. Claude Opus 5.5 answers all 74 CSAT questions correctly in Korea Times testOpen now
    1. Artificial Analysis releases Intelligence Index v5: Claude Opus 5.5 leads (58), best open model's gap grows from 3 to 12 points