Text generation and understanding
19
Models
24
Benchmarks
10
Providers
16
Open Weight
18
Deployable Now
16 self-host
19
Structured benchmark-backed rows
0
Signal-backed rows without full normalized tables
0
Benchmark-expected rows still catching up
| # | Model | Economic Footprint | Quality | Params | OCRBench | MMMU | Arena-Hard-Auto | Aider Polyglot | $/M In | Speed | Open |
|---|---|---|---|---|---|---|---|---|---|---|---|
51 | GPT-4.5 OpenAI Structured |
| 76.6 |
| 60.4 |
| Undisclosed |
| 84.5 |
| 72.1 |
| 50.0 |
| 44.9 |
$75.00/M Cheapest verified |
| — |
187 | Command R+ Cohere Open WeightsStructured | 53.6 | 60.0 | 104B | — | — | — | — | $2.50/M Cheapest verified | — |
114 | o3 OpenAI API AccessStructured | 52.8 | 46.3 | Undisclosed | — | — | 50.0 | 84.9 | $20.00/M Cheapest verified | — |
120 | llama-3.1-405b-instruct Meta Open WeightsStructured | 50.7 | 58.7 | 405B | — | — | — | — | Free Cheapest verified | — |
131 | llama-3-70b-instruct Meta Open WeightsStructured | 48.4 | 54.1 | 70B | — | — | — | — | Free Free | — |
173 | Llama 3.3 70B Meta Open WeightsStructured | 48.3 | 65.5 | 70B | — | — | — | — | $0.5400/M Cheapest verified | — |
117 | Qwen2.5-72B Alibaba Open WeightsStructured | 48.1 | 63.4 | 72B | — | — | 10.1 | — | $0.6000/M Cheapest verified | — |
51 | DeepSeek-V3 DeepSeek Open WeightsStructured | 48.0 | 76.9 | 685B | — | — | — | 74.2 | $0.2800/M Cheapest verified | 145 tok/s |
123 | DeepSeek-R1 DeepSeek Open WeightsStructured | 47.6 | 78.3 | 671B | — | — | 58.0 | 74.2 | $0.2800/M Cheapest verified | — |
81 | Gemma 3 27B | 47.2 | 63.1 | 27B | — | — | 15.0 | 4.9 | Free Cheapest verified | — |
50 | Llama 4 Maverick Meta Open WeightsStructured | 46.2 | 69.8 | 400B | — | — | — | 15.6 | Free Cheapest verified | 88 tok/s |
151 | Nemotron 70B NVIDIA Open WeightsStructured | 46.1 | 63.7 | 70B | — | — | 10.3 | — | Free Cheapest verified | — |
49 | Qwen3-235B Alibaba Open WeightsStructured | 44.3 | 77.0 | 235B | — | — | 58.4 | 59.6 | $0.8000/M Cheapest verified | 72 tok/s |
144 | grok-4 xAI SubscriptionStructured | 43.4 | 66.3 | Undisclosed | — | — | — | 79.6 | $3.00/M Cheapest verified | — |
14 | DeepSeek V3.2 Speciale DeepSeek Open WeightsStructured | 42.8 | 51.1 | Unknown | — | — | — | 74.2 | $0.2800/M Cheapest verified | — |
239 | mixtral-8x7b-instruct-v0.1 Mistral AI Open WeightsStructured | 35.8 | 37.7 | 56B | — | — | — | — | Free Free | — |
90 | QwQ 32B Qwen Open WeightsStructured | 35.4 | 49.3 | 32B | — | — | 43.5 | 26.2 | $0.1500/M Cheapest verified | — |
172 | DeepSeek-V3.2 DeepSeek Open WeightsStructured | 34.9 | 69.5 | Unknown | — | — | — | 74.2 | $0.2800/M Cheapest verified | — |
247 | mistral-7b-instruct-v0.2 Mistral AI Open WeightsStructured | 32.5 | 32.0 | 7B | — | — | — | — | Free Free | — |