Code generation and understanding
10
Models
9
Benchmarks
5
Providers
7
Open Weight
9
Deployable Now
7 self-host
10
Structured benchmark-backed rows
0
Signal-backed rows without full normalized tables
0
Benchmark-expected rows still catching up
| # | Model | Value | Quality | Params | MATH Lvl 5 | MMLU | Arena-Hard-Auto | GAIA | $/M In | Speed | Open |
|---|---|---|---|---|---|---|---|---|---|---|---|
6 | Qwen3 Coder 30B A3B Instruct Qwen Open Weights |
| 73.1 |
| 23.3 |
| 30B |
| 89.3 |
| 70.6 |
| 33.9 |
| 44.2 |
$0.0700/M Cheapest verified |
| — |
4 | Qwen3 Next 80B A3B Instruct Qwen Open WeightsStructured | 70.8 | 24.8 | 80B | — | 81.9 | — | 44.2 | $0.0900/M Cheapest verified | — |
5 | CodeLlama 70B Meta Open WeightsStructured | 59.9 | 59.9 | 70B | — | — | — | — | Free Free | — |
9 | Qwen3 Coder Flash Qwen Open WeightsStructured | 59.5 | 21.9 | Unknown | — | — | — | 44.2 | $0.1950/M Cheapest verified | — |
7 | Devstral Medium Mistral AI Open WeightsStructured | 51.5 | 23.5 | Unknown | 70.7 | 70.8 | — | — | $0.4000/M Cheapest verified | — |
1 | GPT-5.1 Codex OpenAI SubscriptionStructured | 44.5 | 41.8 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
8 | Qwen3 Coder Plus Qwen Open WeightsStructured | 44.4 | 21.4 | Unknown | — | — | — | 44.2 | $0.6500/M Cheapest verified | — |
12 | qwen-2.5-coder-32b-instruct Qwen Open WeightsStructured | 40.0 | 15.2 | 32B | — | — | — | 4.7 | $0.6600/M Cheapest verified | — |
11 | Grok Code Fast 1 xAI SubscriptionStructured | 23.0 | 23.0 | Undisclosed | — | 79.3 | — | — | $0.2000/M Cheapest verified | — |
13 | Codex Mini OpenAI Structured | — | — | Undisclosed | — | — | — | — | $1.50/M Cheapest verified | — |