Text, image, audio, and video combined
39
Models
28
Benchmarks
10
Providers
13
Open Weight
37
Deployable Now
15 self-host
39
Structured benchmark-backed rows
0
Signal-backed rows without full normalized tables
0
Benchmark-expected rows still catching up
| # | Model | Popularity | Quality | Params | MMLU | LiveBench Language | LiveBench Instruction Following | LiveBench Coding | $/M In | Speed | Open |
|---|---|---|---|---|---|---|---|---|---|---|---|
9 | GPT-4o OpenAI Subscription |
| 66.1 |
| 57.7 |
| Undisclosed |
| 88.7 |
| 74.9 |
| 100.0 |
| 0.0 |
$2.50/M Cheapest verified |
| 109 tok/s |
22 | Claude 4 Sonnet Anthropic SubscriptionStructured | 64.0 | 55.9 | Undisclosed | 90.4 | — | — | — | $3.00/M Cheapest verified | 95 tok/s |
38 | Claude 3 Haiku Anthropic SubscriptionStructured | 60.2 | 41.6 | Undisclosed | — | 33.3 | 100.0 | 0.0 | $0.2500/M Cheapest verified | — |
45 | Claude 3 Opus Anthropic SubscriptionStructured | 59.5 | 46.5 | Undisclosed | 69.6 | 66.4 | 100.0 | 0.0 | $15.00/M Cheapest verified | — |
19 | Claude 3.5 Haiku Anthropic SubscriptionStructured | 57.1 | 50.6 | Undisclosed | 63.4 | 39.5 | 100.0 | 50.0 | $0.8000/M Cheapest verified | — |
75 | Claude 4.5 Sonnet Anthropic SubscriptionStructured | 55.2 | 27.5 | Undisclosed | — | — | — | — | $3.00/M Cheapest verified | — |
3 | Gemma 4 31B IT | 54.7 | 63.1 | 31B | 88.4 | — | — | — | $0.1200/M Cheapest verified | — |
33 | Claude Sonnet 4.6 Anthropic SubscriptionStructured | 54.7 | 49.1 | Undisclosed | — | — | — | — | $3.00/M Cheapest verified | — |
29 | Gemini 3.1 Pro | 54.6 | 64.5 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
34 | Gemini 2 | 52.6 | 53.7 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
11 | Llama 4 Scout Meta Open WeightsStructured | 52.3 | 50.2 | Unknown | 75.2 | — | — | — | Free Cheapest verified | — |
18 | Qwen3 VL 8B Instruct Qwen Self-HostStructured | 49.2 | 40.5 | 8B | 68.6 | — | — | — | $0.0800/M Cheapest verified | — |
14 | Mistral Medium 3 Mistral AI Open WeightsStructured | 49.0 | 51.0 | Unknown | 76.0 | — | — | — | $0.4000/M Cheapest verified | — |
54 | Gemini 1.5 Pro | 48.9 | 34.4 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
71 | GLM-OCR Z.ai Free TrialStructured | 46.9 | 61.1 | Undisclosed | — | — | — | — | — | — |
46 | Nova Pro 1.0 Amazon Structured | 46.8 | 46.9 | Undisclosed | — | 45.4 | 100.0 | 50.0 | $0.8000/M Cheapest verified | — |
21 | Claude Opus 4.7 Anthropic SubscriptionStructured | 45.4 | 66.9 | Undisclosed | — | — | — | — | $5.00/M Cheapest verified | — |
31 | Llama 4 Maverick Meta Open WeightsStructured | 45.4 | 43.9 | Unknown | 80.9 | — | — | — | Free Cheapest verified | — |
6 | Qwen3.6 Plus Qwen Self-HostStructured | 44.4 | 45.8 | Unknown | — | — | — | — | $0.3250/M Cheapest verified | — |
79 | Claude 3.5 Sonnet v2 Anthropic SubscriptionStructured | 44.3 | 22.7 | Undisclosed | — | 50.0 | 100.0 | 0.0 | $3.00/M Cheapest verified | — |
30 | Gemini 3 Pro | 43.9 | 52.9 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
81 | Qwen2.5-VL 7B Instruct Qwen Open WeightsStructured | 43.3 | 23.7 | 7B | — | — | — | — | $0.2000/M Cheapest verified | — |
50 | Gemini 3 | 43.1 | 49.4 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
63 | Pixtral 12B Mistral AI Open WeightsStructured | 42.9 | 32.9 | 12B | — | — | — | — | $0.1000/M Cheapest verified | — |
1 | kimi-k2.6 Moonshot AI Open WeightsStructured | 42.0 | 73.7 | Unknown | — | — | — | — | $0.7300/M Cheapest verified | — |
39 | Pixtral Large 2411 Mistral AI Open WeightsStructured | 41.8 | 33.7 | Unknown | 70.1 | — | — | — | $2.00/M Cheapest verified | — |
77 | Claude 4.5 Haiku Anthropic SubscriptionStructured | 41.0 | 27.5 | Undisclosed | — | — | — | — | — | — |
57 | Qwen2.5 VL 32B Instruct Qwen Open WeightsStructured | 40.1 | 42.0 | 32B | — | — | — | — | $0.2000/M Cheapest verified | — |
76 | Mistral Small 3.1 24B Mistral AI Open WeightsStructured | 39.8 | 38.7 | 24B | — | — | — | — | $0.2000/M Cheapest verified | — |
28 | Kimi K2.5 Moonshot AI SubscriptionStructured | 39.6 | 52.9 | Undisclosed | — | — | — | — | $0.4000/M Cheapest verified | — |
47 | Qwen3.5-27B Qwen Self-HostStructured | 38.0 | 50.7 | 27B | — | — | — | — | $0.1950/M Cheapest verified | — |
40 | Qwen3.5 Plus 2026-02-15 Qwen Self-HostStructured | 37.4 | 33.5 | Undisclosed | — | — | — | — | $0.2600/M Cheapest verified | — |
42 | Qwen3.5 Plus 2026-04-20 Qwen Self-HostStructured | 36.8 | 38.5 | Undisclosed | — | — | — | — | $0.3000/M Cheapest verified | — |
5 | Grok 4.1 Fast xAI SubscriptionStructured | 36.1 | 42.7 | Undisclosed | 86.6 | — | — | — | $0.2000/M Cheapest verified | — |
62 | Nova Premier 1.0 Amazon Structured | 36.1 | 29.2 | Undisclosed | 73.3 | — | — | — | $2.50/M Cheapest verified | — |
61 | GLM-4.5V Z.ai SubscriptionStructured | 35.5 | 43.2 | Undisclosed | — | — | — | — | $0.6000/M Cheapest verified | — |
68 | GLM-4.6V Z.ai SubscriptionStructured | 34.6 | 44.9 | Undisclosed | — | — | — | — | $0.3000/M Cheapest verified | — |
37 | Grok 4.20 xAI SubscriptionStructured | 34.0 | 40.4 | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |
56 | gemini-pro-latest | — | — | Undisclosed | — | — | — | — | $1.25/M Cheapest verified | — |