Text, image, audio, and video combined
41
Models
24
Benchmarks
11
Providers
14
Open Weight
39
Deployable Now
14 self-host
41
Structured benchmark-backed rows
0
Signal-backed rows without full normalized tables
0
Benchmark-expected rows still catching up
| # | Model | Value | Quality | Params | MMLU | LiveCodeBench | MMMU | MMLU-PRO | $/M In | Speed | Open |
|---|---|---|---|---|---|---|---|---|---|---|---|
3 | Gemma 4 31B IT |
| 79.3 |
| 65.3 |
| 31B |
| 88.4 |
| 80.0 |
| 76.9 |
| 85.2 |
$0.1200/M Cheapest verified |
| — |
13 | Llama 4 Scout Meta Open WeightsStructured | 75.0 | 38.5 | Unknown | 75.2 | — | — | — | Free Cheapest verified | — |
51 | Qwen3 VL 8B Instruct Qwen Open WeightsStructured | 72.2 | 36.1 | 8B | 68.6 | — | — | — | $0.1170/M Cheapest verified | — |
12 | Llama 4 Maverick Meta Open WeightsStructured | 69.2 | 36.6 | Unknown | 80.9 | — | — | — | Free Cheapest verified | — |
22 | Qwen3.5-27B Qwen Open WeightsStructured | 67.8 | 42.4 | 27B | — | — | — | — | $0.1950/M Cheapest verified | — |
2 | MiniMax M3 MiniMax Ready to UseStructured | 67.2 | 62.2 | Undisclosed | — | — | — | — | $0.3000/M Cheapest verified | — |
55 | qwen3-7-plus Qwen Open WeightsStructured | 66.4 | 62.4 | Unknown | — | — | — | — | $0.3200/M Cheapest verified | — |
17 | GLM-4.6V Z.ai SubscriptionStructured | 64.4 | 49.9 | Undisclosed | — | — | — | — | $0.3000/M Cheapest verified | — |
43 | Gemini 3.1 Pro | 64.3 | 64.3 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
25 | Kimi K2.5 Moonshot AI SubscriptionStructured | 62.7 | 54.2 | Undisclosed | — | — | — | — | $0.3750/M Cheapest verified | — |
33 | Qwen3.5 Plus 2026-02-15 Qwen Free TrialStructured | 61.9 | 35.4 | Undisclosed | — | — | 84.4 | — | $0.2600/M Cheapest verified | — |
41 | Qwen3.5 Plus 2026-04-20 Qwen Free TrialStructured | 61.8 | 40.3 | Undisclosed | — | — | 84.4 | — | $0.3000/M Cheapest verified | — |
81 | GLM-OCR Z.ai Free TrialStructured | 61.5 | 61.5 | Undisclosed | — | — | — | — | — | — |
65 | Gemini 3 Pro | 60.9 | 60.9 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
1 | kimi-k2.6 Moonshot AI Open WeightsStructured | 60.6 | 80.7 | Unknown | — | 89.6 | 80.1 | — | $0.6600/M Cheapest verified | — |
53 | Claude 3 Haiku Anthropic SubscriptionStructured | 59.8 | 28.7 | Undisclosed | — | 22.5 | — | — | $0.2500/M Cheapest verified | — |
23 | Mistral Medium 3 Mistral AI Open WeightsStructured | 57.9 | 39.3 | Unknown | 76.0 | — | — | — | $0.4000/M Cheapest verified | — |
45 | Mistral Small 3.1 24B Mistral AI Open WeightsStructured | 57.5 | 33.6 | 24B | — | — | — | — | $0.2000/M Cheapest verified | — |
9 | Qwen3.6 Plus Qwen Self-HostStructured | 56.8 | 29.3 | Unknown | — | — | — | — | $0.3250/M Cheapest verified | — |
58 | GLM-4.5V Z.ai SubscriptionStructured | 54.5 | 45.0 | Undisclosed | — | — | — | — | $0.6000/M Cheapest verified | — |
57 | Gemini 2 | 52.2 | 52.2 | Undisclosed | — | 75.1 | 74.7 | — | $1.25/M Cheapest verified | — |
42 | Nova Pro 1.0 Amazon Structured | 48.8 | 37.8 | Undisclosed | — | — | — | — | $0.8000/M Cheapest verified | — |
31 | Claude 3.5 Haiku Anthropic SubscriptionStructured | 48.6 | 37.2 | Undisclosed | 63.4 | 22.5 | — | — | $0.8000/M Cheapest verified | — |
74 | Gemini 3 | 48.5 | 48.5 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
26 | Qwen2.5 VL 72B Instruct Qwen Open WeightsStructured | 47.9 | 35.1 | 72B | — | — | 68.2 | — | $0.8000/M Cheapest verified | — |
34 | Grok 4.20 xAI SubscriptionStructured | 43.9 | 39.6 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
44 | Claude 4 Sonnet Anthropic SubscriptionStructured | 43.6 | 43.6 | Undisclosed | 90.4 | — | — | — | $3.00/M Cheapest verified | 95 tok/s |
28 | Grok 4.1 Fast xAI SubscriptionStructured | 42.1 | 42.1 | Undisclosed | 86.6 | — | — | — | $0.2000/M Cheapest verified | — |
32 | Claude Sonnet 4.6 Anthropic SubscriptionStructured | 38.7 | 61.7 | Undisclosed | — | 59.4 | — | — | $3.00/M Cheapest verified | — |
15 | GPT-4o OpenAI SubscriptionStructured | 36.2 | 41.8 | Undisclosed | 88.7 | 38.3 | — | — | $2.50/M Cheapest verified | 109 tok/s |
37 | Pixtral Large 2411 Mistral AI Open WeightsStructured | 36.1 | 33.3 | Unknown | 70.1 | — | — | — | $2.00/M Cheapest verified | — |
64 | Gemini 1.5 Pro | 34.1 | 34.1 | Undisclosed | — | — | 60.6 | — | $1.25/M Cheapest verified | — |
70 | Claude 3 Opus Anthropic SubscriptionStructured | 33.6 | 33.6 | Undisclosed | 69.6 | — | — | — | $15.00/M Cheapest verified | — |
75 | Pixtral 12B Mistral AI Open WeightsStructured | 32.6 | 32.6 | 12B | — | — | 51.1 | — | $0.1000/M Cheapest verified | — |
62 | Claude Opus 4.8 Anthropic SubscriptionStructured | 30.3 | 50.3 | Undisclosed | — | 62.4 | — | — | $5.00/M Cheapest verified | — |
48 | Nova Premier 1.0 Amazon Structured | 28.3 | 21.2 | Undisclosed | 73.3 | — | — | — | $2.50/M Cheapest verified | — |
72 | Claude 4.5 Sonnet Anthropic SubscriptionStructured | 19.7 | 19.7 | Undisclosed | — | — | — | — | $3.00/M Cheapest verified | — |
79 | Claude 4.5 Haiku Anthropic SubscriptionStructured | 18.7 | 18.7 | Undisclosed | — | — | — | — | — | — |
82 | Qwen2.5-VL 7B Instruct Qwen Open WeightsStructured | 17.4 | 17.4 | 7B | — | — | — | — | $0.2000/M Cheapest verified | — |
80 | Claude 3.5 Sonnet v2 Anthropic SubscriptionStructured | 16.3 | 16.3 | Undisclosed | — | — | — | — | $3.00/M Cheapest verified | — |
52 | gemini-pro-latest | — | — | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |