On FrontierCode 1.1, Sonnet 5.5 is a significant improvement from Sonnet 5 at 64.4%, surpassing even Fable 5.1 at extra high reasoning effort.
Anthropic reports more than 30% faster output generation and up to 30% lower cost per task than Sonnet 5, with unchanged token pricing.
FrontierCode LeaderboardBenchmarks for how well models meet the standards of high-quality production codebasesView Now →
FrontierCode 1.1 ExtendedScore
FrontierCode 1.1 ExtendedScorevsCost ($)
$0.25$0.50$1$2$5$10$20avg cost (USD) per rollout4550556065score (%)Opus 5.5Sonnet 5.5GPT-6 AstraFable 5.1SWE-2GPT-6 SolSonnet 5
Download Devin Desktop · Install Devin CLI