Meta
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
Running this yourself: likely needs a high-memory cloud gpu.
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors.
19.6
Quality Score
---
Arena ELO
70B
Parameters
131K
Context
Sign in to join the discussion
0
Downloads
0
Likes
Jul 2024
Released
Launches
6
Benchmarks
19
Open Source
1
Research
3
General
1
Recent launch, pricing, benchmark, and API signals linked to this model or its provider.
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
We’re excited to introduce Muse Spark 1.1, a significant upgrade from the first Muse Spark model we released earlier this year. Along with this release, we are launching a public preview of the new Meta Model API where developers can access Muse Spark 1.1. The model is also https://t.co/bpwPlxwWDq
View sourceAlongside the release of Muse Image, we’re sharing an early preview of Muse Video. It offers competitive performance in prompt adherence, visual fidelity, and temporal consistency. We’re investing in areas with current performance gaps, such as audio-video synchronization and https://t.co/iIFeFGLzoE
View source
We’re excited to introduce Muse Spark 1.1, a significant upgrade from the first Muse Spark model we released earlier this year. Along with this release, we are launching a public preview of the new Meta Model API where developers can access Muse Spark 1.1. The model is also https://t.co/bpwPlxwWDq
Alongside the release of Muse Image, we’re sharing an early preview of Muse Video. It offers competitive performance in prompt adherence, visual fidelity, and temporal consistency. We’re investing in areas with current performance gaps, such as audio-video synchronization and https://t.co/iIFeFGLzoE

Muse Image works as an agent rather than a direct prompt-to-image model: it invokes tools, self-refines, improves with scaled test-time compute, and pairs with Muse Spark for collaborative media generation. 🧵👇 https://t.co/zh7jHcM6Jl
Introducing Muse Image and Muse Video, the first media generation models developed by Meta Superintelligence Labs. Muse Image is our most advanced image generation model yet. It follows instructions faithfully, edits with precision, composes from multiple references, and draws https://t.co/byNpQZO1RW
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Avg: 43.4 | IFEval: 86.7 | BBH: 55.9 | MATH: 38.1 | GPQA: 14.2 | MMLU-PRO: 47.9
Reinforcement learning with verifiable rewards (RLVR) has been extended from single-domain training to multi-domain reasoning suites spanning mathematics, programming, and science. However, the training curriculum (how often each domain is sampled) is typically fixed or hand-tuned, even though reasoning skills transfer unevenly across domains. Existing learnability-based curricula adapt to where the policy is currently improving, but are blind to whether a gradient step on the selected domain benefits the remaining domains. In this paper, we propose Transfer-Aware Curriculum (TAC), a bandit-style online curriculum that prioritizes domains whose updates broadly benefit the rest of the training suite. TAC repurposes signals already produced by RL training: per-domain advantages capture local learnability, and projected gradients, taken from the GRPO step being computed, estimate cross-domain transferability via gradient-geometry alignment, at negligible cost (<1% wall-clock overhead). Across a six-domain reasoning suite, TAC achieves the best macro-averaged accuracy on both Qwen3-1.7B and Llama3.2-3B, outperforming proportional random sampling, a hand-designed schedule, and a learnability-only bandit, and improving over the last of these by up to 2.8 points (10% relative). Ablations show performance degrades sharply when the transferability term is removed, and TAC remains robust on imbalanced training mixtures where learnability-only curricula over-commit to dominant domains. Our findings establish cross-domain transferability as a key signal for curriculum design in multi-domain RLVR.
Long-horizon LLM agents can fail quietly: they settle on one reading of the evidence early, then spend the rest of the run defending it. We call this premature commitment. Final-answer scoring misses the failure mode because it sees only the answer, not whether the process has already collapsed to a stable path. We define representational commitment as cross-run hidden-state convergence at a fixed reasoning step, and use it as an early diagnostic of trajectory consistency. On Llama-3.1-70B running ReAct on HotpotQA, step-4 hidden-state similarity predicts downstream behavioral consistency (r = -0.35, partial r = -0.45), with a localized temporal and layer-wise signature. The signal replicates across Qwen-2.5-72B and Phi-3-14B, and on StrategyQA (r = -0.83). It does not track correctness: committed-wrong and committed-correct questions are not separable in activation similarity. That boundary is central to the claim. Commitment tells us whether an agent has settled, not whether it is right. A runtime monitor detects inconsistent trajectories from hidden states at AUROC up to 0.97 (0.85--0.88 under a stricter split), and a prompting intervention cuts behavioral variance by 28% against a token-matched control while leaving accuracy statistically unchanged. We also test whether the signal can route self-consistency compute; on a harder benchmark it helps only modestly and is matched by a simpler output-based baseline. The result is a diagnostic for a hidden process failure, with clear limits rather than a general accuracy lever.
Disaggregated inference architectures physically separate prefill and decode phases onto distinct GPU pools, creating competing "agents" that share a fixed hardware budget. We provide, to our knowledge, the first formal game-theoretic analysis of this architecture, using NVIDIA Dynamo as a concrete case study. We model disaggregated serving as three coupled games: a two-player resource game between prefill and decode pools, a selfish caching game over the hierarchical KV cache, and a congestion game with positive externalities for request routing. We empirically validate the latter two; the P/D resource game is treated analytically (Section 9.2). We characterize how GPU saturation induces regime transitions that shift the game's payoff structure: below saturation, selfish behavior has bounded Price of Anarchy (PoA); at saturation, superlinear latency and cache externalities drive our empirical estimator PoA-hat (defined in Section 6.4) upward. Based on this analysis, we design an adaptive controller that detects saturation transitions in real time and adjusts routing parameters accordingly, shifting from cache-affinity exploitation to load-balanced congestion avoidance. We instantiate our framework on a 3-node NVIDIA B200 cluster running Dynamo with two models, Nemotron-4-340B (TP=8, full-node workers with cross-InfiniBand KV transfers) and Llama-3.1-70B (TP=4), and find the same three-regime PoA-hat structure with the same first post-knee grid point (C=128) on both models. Adaptive routing shifts each model to a better operating point. Our strongest result is on the 70B 1P/5D topology, where PoA-hat drops 3.1x (66.4 to 21.5) in the saturated phase at a 13% throughput cost. On the 70B 1P/2D, PoA-hat drops 2.2x and TTFT P99 drops 7.6x (see Section 8.5).
Llama 3.1 70B Instruct is now available through local Ollama runtime. 8K context window listed. Meta Llama 3: The most capable openly available LLM to date
SWE-Bench Verified resolved rate 40.6