Code generation and understanding
11
Models
16
Benchmarks
6
Providers
8
Open Weight
10
Deployable Now
8 self-host
11
Structured benchmark-backed rows
0
Signal-backed rows without full normalized tables
0
Benchmark-expected rows still catching up
| # | Model | Adoption | Quality | Params | MMLU | Arena-Hard-Auto | GAIA | GPQA | $/M In | Speed | Open |
|---|---|---|---|---|---|---|---|---|---|---|---|
4 | Qwen3 Coder 30B A3B Instruct Qwen Open Weights |
| 77.4 |
| 46.9 |
| 31B |
| 70.6 |
| 33.9 |
| 44.2 |
| 51.6 |
$0.1500/M Cheapest verified |
| — |
5 | Qwen3 Next 80B A3B Instruct Qwen Open WeightsStructured | 73.2 | 45.6 | 81B | 81.9 | — | 18.3 | 73.8 | $0.0900/M Cheapest verified | — |
3 | GPT-5.1 Codex OpenAI SubscriptionStructured | 63.2 | 40.6 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
12 | CodeLlama 70B Meta Open WeightsStructured | 62.8 | 48.3 | 70B | — | — | — | — | Free Free | — |
2 | qwen-2.5-coder-32b-instruct Qwen Open WeightsStructured | 61.5 | 35.1 | 32B | — | — | 0.3 | 13.2 | $0.6600/M Cheapest verified | — |
7 | Qwen3 Coder Flash Qwen Open WeightsStructured | 57.5 | 20.9 | Unknown | — | — | 44.2 | — | $0.1950/M Cheapest verified | — |
6 | Qwen3 Coder Plus Qwen Open WeightsStructured | 57.4 | 20.6 | Unknown | — | — | 44.2 | — | $0.6500/M Cheapest verified | — |
10 | Devstral Medium Mistral AI Open WeightsStructured | 52.7 | 22.7 | Unknown | 70.8 | — | — | 49.2 | $0.4000/M Cheapest verified | — |
14 | Grok Code Fast 1 xAI SubscriptionStructured | 52.7 | 22.1 | Undisclosed | 79.3 | — | — | 72.7 | $0.2000/M Cheapest verified | — |
9 | North Mini Code Cohere Open WeightsStructured | 45.9 | 26.4 | 30B | — | — | — | 75.7 | Free Free | — |
11 | Codex Mini OpenAI Structured | — | — | Undisclosed | — | — | — | — | $1.50/M Cheapest verified | — |