OpenAI
General-purpose realtime OpenAI model for streaming voice, multimodal assistants, and low-latency interactive applications.
---
Quality Score
---
Arena ELO
Undisclosed
Parameters
128K
Context
Use this section to answer one simple question first: how much outside evidence do we have that this model performs well? Structured benchmark scores appear first, then official provider evidence, then live arena signal.
This model has official provider benchmark evidence, but not a normalized independent benchmark table yet.
A full normalized benchmark row is not available for this model yet.
Official benchmark evidence is already available below, so this release is still being tracked while the normalized table catches up.
Sign in to join the discussion
0
Downloads
0
Likes
Aug 2025
Released
These are recent benchmark or leaderboard claims from official provider sources. They are useful for freshness and context, but they are not treated the same as normalized independent benchmark rows.
We audited SWE-Bench Pro, one of the most widely used AI coding benchmarks, and found it no longer reliably measures frontier coding capability. We find 30% of SWE-Bench Pro tasks to be broken, and ar
We audited SWE-Bench Pro, one of the most widely used AI coding benchmarks, and found it no longer reliably measures frontier coding capability. We find 30% of SWE-Bench Pro tasks to be broken, and are retracting our previous recommendation that the research community use it as
View sourceWe audited SWE-Bench Pro, one of the most widely used AI coding benchmarks, and found it no longer reliably measures frontier coding capability. We find the eval to be saturated at a ~70% noise ceilin
We audited SWE-Bench Pro, one of the most widely used AI coding benchmarks, and found it no longer reliably measures frontier coding capability. We find the eval to be saturated at a ~70% noise ceiling, and are retracting our previous recommendation that the research community
View source