GPT-4o mini Benchmark Update
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
View sourceOpenAI
Small, fast, and affordable multimodal model for lightweight tasks. Retains vision capabilities of GPT-4o at significantly reduced cost.
OpenRouter
Price record: 2026-10-25. Source: openrouter.
Confirm this specific model, usage limits, and billing terms with the provider. A subscription does not automatically include API credits.
No login needed to compare. Prices are in USD; provider charges are separate from AI Market Cap plans. Context length, caching, tools, taxes, and regional terms can change the final cost. Open weights do not mean free hosting.
34.2
Quality Score
1287
Arena ELO
Undisclosed
Parameters
128K
Context
This measures the amount of verifiable public evidence we have, not how capable the model is. A missing field means it has not been verified yet, not that its value is zero.
17 of 22 public signals
Sign in to join the discussion
0
Downloads
0
Likes
Jul 2024
Released
4/5 signals
4/4 signals
5/5 signals
1/4 signals
3/4 signals
Parameters
—
Training compute
Not reported
Dataset scale
Not reported
Base model
Not reported
Source-reported access: API access · Speculative confidence
Gaps we are still tracking
Benchmarks
21
Research
1
General
8
Recent launch, pricing, benchmark, and API signals linked to this model or its provider.
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
View sourcelanguage: 0.3 | coding: 0.5 | instruction_following: 1.0 | Overall: 0.6
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
language: 0.3 | coding: 0.5 | instruction_following: 1.0 | Overall: 0.6
LiveCodeBench pass@1 35.5 across 1055 tasks
View sourceQuality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
View sourcelanguage: 0.3 | coding: 0.5 | instruction_following: 1.0 | Overall: 0.6
View sourceGPT-Rosalind surfaced a new lead for drug discovery: could restoring cholesterol transport protect neurons from degeneration? DCTN1 is a gene linked to Perry syndrome, a rare neurodegenerative disorder. In mouse-brain data, disrupting it increased expression of genes involved in
Our latest model advances bring stronger capabilities for building and migrating software in low-resource programming languages such as COBOL, Fortran, and Visual Basic. These languages power software that banks, governments, and businesses depend on. Progress here means https://t.co/Mulo5P3iCO
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
Quality: 6.7/100 | Price: $0.262/M tokens | Output: 0 tok/s | MMLU: 0.648% | HumanEval: 0.234%
General-purpose manipulation requires reliable behavior across embodiments, objects, and task demands. We introduce HandsOn, a composable simulation platform and benchmark for cross-embodiment dexterous manipulation. It supports five robotic arms, six dexterous hands, and approximately 200 rigid, articulated, and deformable assets in randomized scenes. The benchmark pairs 18,000 curated human demonstrations with 66 human-verified tasks: Core-50 supports demonstration-based learning and execution tests, while Transfer-16 evaluates asset and relation transfer, skill composition, and deformable manipulation without target-task training demonstrations. Qualitative real-robot rollouts illustrate sim-to-real transfer. Across diffusion, vision-language-action, world-action, and prompted VLM-based methods, the best trained multi-task policy achieves 29.1% Core-50 success. Without benchmark finetuning, GPT-6 using move_eef for palm-and-finger control achieves 5.2% on Core-50 and 1.9% on Transfer-16 over 660 trials. Trained-policy stage diagnostics expose failures in contact establishment, action coordination, and maintaining achieved goals, with additional sequencing errors in composed tasks. HandsOn provides a shared basis for investigating manipulation generalization and the limits of reliable physical interaction.
LiveCodeBench pass@1 35.5 across 1055 tasks
language: 0.3 | coding: 0.5 | instruction_following: 1.0 | Overall: 0.6
language: 0.3 | coding: 0.5 | instruction_following: 1.0 | Overall: 0.6
Introducing GPT-5 for developers | OpenAI Skip to main content Research Products Business Developers Company Foundation (opens in a new window) Log in Try ChatGPT (opens in a new window) Research Products Business Developers Company Foundation (opens in a new window) Try ChatGPT (opens in a new window) Login OpenAI August 7, 2025 Product Introducing GPT‑5 for developers The best model for coding and agentic tasks. Loading… Share Introduction Introduction Coding Frontend engin
language: 0.3 | coding: 0.5 | instruction_following: 1.0 | Overall: 0.6
language: 0.3 | coding: 0.5 | instruction_following: 1.0 | Overall: 0.6
language: 0.3 | coding: 0.5 | instruction_following: 1.0 | Overall: 0.6
language: 0.3 | coding: 0.5 | instruction_following: 1.0 | Overall: 0.6
language: 0.3 | coding: 0.5 | instruction_following: 1.0 | Overall: 0.6
language: 0.3 | coding: 0.5 | instruction_following: 1.0 | Overall: 0.6