Meta
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
Running this yourself: likely needs a high-memory cloud gpu.
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors.
33.4
Quality Score
---
Arena ELO
70B
Parameters
131K
Context
Use this section to answer one simple question first: how much outside evidence do we have that this model performs well? Structured benchmark scores appear first, then official provider evidence, then live arena signal.
This model has normalized benchmark rows, so scores here are directly comparable across benchmark sources.
Sign in to join the discussion
0
Downloads
0
Likes
Jul 2024
Released
These are recent benchmark or leaderboard claims from official provider sources. They are useful for freshness and context, but they are not treated the same as normalized independent benchmark rows.
meta-llama/Llama-3.1-70B-Instruct — Open LLM Leaderboard #62
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
View sourceLlama 3.1 - SWE-Bench Verified
SWE-Bench Verified resolved rate 40.6
View sourcemeta-llama/Llama-3.1-70B-Instruct — Open LLM Leaderboard #62
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
View sourcemeta-llama/Llama-3.1-70B-Instruct — Open LLM Leaderboard #62
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
View sourceLlama 3.1 - SWE-Bench Verified
SWE-Bench Verified resolved rate 40.6
View sourcemeta-llama/Llama-3.1-70B-Instruct — Open LLM Leaderboard #62
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
View source