sonnet is a open-weight Google specialized model.
Running this yourself: can likely run on your own machine.
52.8
Quality Score
1216
Arena ELO
Unknown
Parameters
---
Context
Use this section to answer one simple question first: how much outside evidence do we have that this model performs well? Structured benchmark scores appear first, then official provider evidence, then live arena signal.
This model has normalized benchmark rows, so scores here are directly comparable across benchmark sources.
Sign in to join the discussion
9.9K
Downloads
0
Likes
Apr 2017
Released
These are recent benchmark or leaderboard claims from official provider sources. They are useful for freshness and context, but they are not treated the same as normalized independent benchmark rows.
claude-3-5-sonnet — LiveBench Scores
language: 0.5 | coding: 0.0 | instruction_following: 1.0 | Overall: 0.5
View sourceclaude-3-5-sonnet-20241022 - Arena-Hard-Auto
Arena-Hard-Auto official Gemini-2.5 judged score 33.0 with CI -2.3/1.8
View sourceOpenHands + CodeAct v2.1 (claude-3-5-sonnet-20241022) - SWE-Bench Verified
SWE-Bench Verified resolved rate 53.0
View sourceClaude-3.5-Sonnet-20241022 - LiveCodeBench
LiveCodeBench pass@1 48.7 across 1055 tasks
View sourceclaude-3-5-sonnet — LiveBench Scores
language: 0.5 | coding: 0.0 | instruction_following: 1.0 | Overall: 0.5
View sourceclaude-3-5-sonnet — LiveBench Scores
language: 0.5 | coding: 0.0 | instruction_following: 1.0 | Overall: 0.5
View source1216
ELO Score
1214 - 1218
95% Confidence
+/-2 points
113.1K
Battles
May 21, 2026
Last Updated
1018
ELO Score
1007 - 1029
95% Confidence
+/-11 points
12.3K
Battles
May 21, 2026
Last Updated