Mid-size multimodal model with an industry-leading 2 million token context window using Mixture-of-Experts architecture. Excels at long-document analysis and complex reasoning.
34.4
Quality Score
1120
Arena ELO
Undisclosed
Parameters
2M
Context
Use this section to answer one simple question first: how much outside evidence do we have that this model performs well? Structured benchmark scores appear first, then official provider evidence, then live arena signal.
This model has normalized benchmark rows, so scores here are directly comparable across benchmark sources.
Sign in to join the discussion
0
Downloads
0
Likes
May 2024
Released
These are recent benchmark or leaderboard claims from official provider sources. They are useful for freshness and context, but they are not treated the same as normalized independent benchmark rows.
Gemini-1.5-Pro - Open VLM Leaderboard #113
MMMU_VAL: 60.6 | MathVista: 58.3 | OCRBench: 75.4 | MMBench_TEST_EN_V11: 74.6 | MME: 75.4 | AI2D: 79.1 | MMStar: 59.1 | HallusionBench: 45.6
View sourceGemini-1.5-Pro - Open VLM Leaderboard #113
MMMU_VAL: 60.6 | MathVista: 58.3 | OCRBench: 75.4 | MMBench_TEST_EN_V11: 74.6 | MME: 75.4 | AI2D: 79.1 | MMStar: 59.1 | HallusionBench: 45.6
View sourceGemini-1.5-Pro - Open VLM Leaderboard #113
MMMU_VAL: 60.6 | MathVista: 58.3 | OCRBench: 75.4 | MMBench_TEST_EN_V11: 74.6 | MME: 75.4 | AI2D: 79.1 | MMStar: 59.1 | HallusionBench: 45.6
View sourceGemini-1.5-Pro - Open VLM Leaderboard #113
MMMU_VAL: 60.6 | MathVista: 58.3 | OCRBench: 75.4 | MMBench_TEST_EN_V11: 74.6 | MME: 75.4 | AI2D: 79.1 | MMStar: 59.1 | HallusionBench: 45.6
View sourceGemini-1.5-Pro - Open VLM Leaderboard #113
MMMU_VAL: 60.6 | MathVista: 58.3 | OCRBench: 75.4 | MMBench_TEST_EN_V11: 74.6 | MME: 75.4 | AI2D: 79.1 | MMStar: 59.1 | HallusionBench: 45.6
View sourceGemini-1.5-Pro - Open VLM Leaderboard #113
MMMU_VAL: 60.6 | MathVista: 58.3 | OCRBench: 75.4 | MMBench_TEST_EN_V11: 74.6 | MME: 75.4 | AI2D: 79.1 | MMStar: 59.1 | HallusionBench: 45.6
View source1120
ELO Score
1109 - 1131
95% Confidence
+/-11 points
16.7K
Battles
May 20, 2026
Last Updated