Text, image, audio, and video combined
24
Models
23
Benchmarks
9
Providers
14
Open Weight
23
Deployable Now
14 self-host
24
Structured benchmark-backed rows
0
Signal-backed rows without full normalized tables
0
Benchmark-expected rows still catching up
| # | Model | Economic Footprint | Quality | Params | MMLU | GPQA | LiveBench Language | LiveBench Coding | $/M In | Speed | Open |
|---|---|---|---|---|---|---|---|---|---|---|---|
68 | Claude 3 Opus Anthropic Subscription |
| 51.1 |
| 33.6 |
| Undisclosed |
| 69.6 |
| 48.9 |
| 66.4 |
| 0.0 |
$15.00/M Cheapest verified |
| — |
29 | Claude 3.5 Haiku Anthropic SubscriptionStructured | 48.7 | 37.2 | Undisclosed | 63.4 | 40.8 | 39.5 | 50.0 | $0.8000/M Cheapest verified | — |
35 | Pixtral Large 2411 Mistral AI Open WeightsStructured | 48.1 | 33.3 | Unknown | 70.1 | 50.5 | — | — | $2.00/M Cheapest verified | — |
43 | Claude 4 Sonnet Anthropic SubscriptionStructured | 42.1 | 43.6 | Undisclosed | 90.4 | 65.0 | — | — | $3.00/M Cheapest verified | 95 tok/s |
26 | Grok 4.1 Fast xAI SubscriptionStructured | 38.3 | 42.1 | Undisclosed | 86.6 | 87.7 | — | — | $0.2000/M Cheapest verified | — |
72 | Amazon Nova Pro Amazon Structured | 36.2 | 39.4 | Undisclosed | 69.1 | 49.9 | — | — | $0.8000/M Cheapest verified | — |
79 | Claude 3.5 Sonnet v2 Anthropic SubscriptionStructured | 35.7 | 16.3 | Undisclosed | — | — | 50.0 | 0.0 | $3.00/M Cheapest verified | — |
57 | Qwen2.5 VL 32B Instruct Qwen Open WeightsStructured | 32.4 | 36.6 | 32B | — | — | — | — | $0.2000/M Cheapest verified | — |
73 | Pixtral 12B Mistral AI Open WeightsStructured | 31.4 | 32.6 | 12B | — | — | — | — | $0.1000/M Cheapest verified | — |
71 | Claude 4.5 Sonnet Anthropic SubscriptionStructured | 31.0 | 19.7 | Undisclosed | — | — | — | — | $3.00/M Cheapest verified | — |
70 | gemma-4-12B | 28.1 | 63.5 | 12B | 88.4 | 84.3 | — | — | Free Free | — |
81 | Qwen2.5-VL 7B Instruct Qwen Open WeightsStructured | 27.9 | 17.4 | 7B | — | — | — | — | $0.2000/M Cheapest verified | — |
69 | GLM OCR Z.ai Free TrialStructured | 24.9 | 43.2 | Undisclosed | — | — | — | — | — | — |
78 | Claude 4.5 Haiku Anthropic SubscriptionStructured | 22.5 | 18.7 | Undisclosed | — | — | — | — | — | — |
1 | kimi-k2.6 Moonshot AI Open WeightsStructured | — | — | Unknown | — | 90.5 | — | — | $0.6600/M Cheapest verified | — |
8 | Qwen3.6 Plus Qwen Open WeightsStructured | — | — | Unknown | — | 88.2 | — | — | $0.3250/M Cheapest verified | — |
11 | Llama 4 Maverick Meta Open WeightsStructured | — | — | Unknown | 80.9 | 67.1 | — | — | Free Cheapest verified | — |
12 | Llama 4 Scout Meta Open WeightsStructured | — | — | Unknown | 75.2 | 58.7 | — | — | Free Cheapest verified | — |
20 | Mistral Medium 3 Mistral AI Open WeightsStructured | — | — | Unknown | 76.0 | 57.8 | — | — | $0.4000/M Cheapest verified | — |
21 | Qwen3.5-27B Qwen Open WeightsStructured | — | — | 27B | — | — | — | — | $0.1950/M Cheapest verified | — |
44 | Mistral Small 3.1 24B Mistral AI Open WeightsStructured | — | — | 24B | — | — | — | — | $0.2000/M Cheapest verified | — |
50 | gemini-pro-latest | — | — | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
52 | Qwen3 VL 8B Instruct Qwen Open WeightsStructured | — | — | 8B | 68.6 | 42.7 | — | — | $0.1170/M Cheapest verified | — |
56 | qwen3-7-plus Qwen Open WeightsStructured | — | — | Unknown | — | 90.0 | — | — | $0.3200/M Cheapest verified | — |