Code generation and understanding
11
Models
16
Benchmarks
6
Providers
8
Open Weight
10
Deployable Now
8 self-host
11
Structured benchmark-backed rows
0
Signal-backed rows without full normalized tables
0
Benchmark-expected rows still catching up
| # | Model | Capability | Quality | Params | TerminalBench 2.0 | SWE-Bench | HumanEval | GPQA | $/M In | Speed | Open |
|---|---|---|---|---|---|---|---|---|---|---|---|
3 | GPT-5.1 Codex OpenAI Subscription |
| 62.0 |
| 41.0 |
| Undisclosed |
| 57.8 |
| 66.0 |
| — |
| — |
$1.25/M Cheapest verified |
| — |
12 | Grok Code Fast 1 xAI SubscriptionStructured | 59.4 | 22.3 | Undisclosed | 25.8 | — | 65.7 | 72.7 | $0.2000/M Cheapest verified | — |
13 | North Mini Code Cohere Open WeightsStructured | 54.7 | 37.6 | 30B | 36.0 | 67.6 | 38.8 | 75.7 | Free Free | — |
11 | CodeLlama 70B Meta Open WeightsStructured | 52.0 | 48.8 | 70B | — | 42.4 | — | — | Free Free | — |
2 | qwen-2.5-coder-32b-instruct Qwen Open WeightsStructured | 48.4 | 35.4 | 32B | — | 40.2 | — | 13.2 | $0.6600/M Cheapest verified | — |
4 | Qwen3 Next 80B A3B Instruct Qwen Open WeightsStructured | 43.5 | 46.3 | 81B | — | 42.4 | 68.4 | 73.8 | $0.1000/M Cheapest verified | — |
5 | Qwen3 Coder 30B A3B Instruct Qwen Open WeightsStructured | 39.6 | 46.4 | 31B | — | 51.6 | 40.3 | 51.6 | $0.0700/M Cheapest verified | — |
10 | Devstral Medium Mistral AI Open WeightsStructured | 38.8 | 22.9 | Unknown | — | — | 33.7 | 49.2 | $0.4000/M Cheapest verified | — |
7 | Qwen3 Coder Flash Qwen Open WeightsStructured | 36.3 | 21.2 | Unknown | — | 69.6 | — | — | $0.1950/M Cheapest verified | — |
6 | Qwen3 Coder Plus Qwen Open WeightsStructured | 34.2 | 20.8 | Unknown | — | — | — | — | $0.6500/M Cheapest verified | — |
11 | Codex Mini OpenAI Structured | — | — | Undisclosed | 43.1 | — | — | — | $1.50/M Cheapest verified | — |