Meta
Llama 3.1 405B Instruct: Meta's largest open-weights language model for complex reasoning tasks
Running this yourself: likely needs a high-memory cloud gpu.
61.5
Quality Score
1283
Arena ELO
406B
Parameters
131K
Context
This measures the amount of verifiable public evidence we have, not how capable the model is. A missing field means it has not been verified yet, not that its value is zero.
19 of 22 public signals
Use this section to answer one simple question first: how much outside evidence do we have that this model performs well? Structured benchmark scores appear first, then official provider evidence, then live arena signal.
This model has normalized benchmark rows, so scores here are directly comparable across benchmark sources.
Sign in to join the discussion
13.1K
Downloads
597
Likes
Jul 2024
Released
5/5 signals
4/4 signals
5/5 signals
3/4 signals
2/4 signals
Gaps we are still tracking
These are recent benchmark or leaderboard claims from official provider sources. They are useful for freshness and context, but they are not treated the same as normalized independent benchmark rows.
Llama 3.1 - SWE-Bench Verified
SWE-Bench Verified resolved rate 40.6
View sourceTo understand whether we're making genuine progress on reasoning, we entered our AI models in five STEM Olympiad competitions. The results: 🏅 Asian Physics Olympiad (APhO): Perfect score, theory exam
To understand whether we're making genuine progress on reasoning, we entered our AI models in five STEM Olympiad competitions. The results: 🏅 Asian Physics Olympiad (APhO): Perfect score, theory exam 🏅 International Physics Olympiad (IPhO): Perfect score, theory exam 🥇 https://t.co/fh1h8I1d3S
View sourceLlama 3.1 - SWE-Bench Verified
SWE-Bench Verified resolved rate 40.6
View sourcellama-3.1 - GAIA
GAIA score 0.7 from gaia_agent_huggingfacet
View sourcellama-3.1 - GAIA
GAIA score 0.7 from gaia_agent_huggingfacet
View source1283
ELO Score
1280 - 1285
95% Confidence
+/-3 points
63.0K
Battles
Aug 31, 2026
Last Updated