Microsoft
Phi-mini-MoE is a lightweight Mixture of Experts (MoE) model with 7.6B total parameters and 2.4B activated parameters. It is compressed and distilled from the base model shared by Phi-3.5-MoE and GRIN-MoE using the SlimMoE approach, then post-trained via supervised fine-tuning and direct preference optimization for...
Running this yourself: consumer gpu should be enough.
Live access is not confirmed for this model. No current purchase price is advertised.
No current subscription pricing is tracked for this model.
Confirm this specific model, usage limits, and billing terms with the provider. A subscription does not automatically include API credits.
No login needed to compare. Prices are in USD; provider charges are separate from AI Market Cap plans. Context length, caching, tools, taxes, and regional terms can change the final cost. Open weights do not mean free hosting.
34.0
Quality Score
---
Arena ELO
8B
Parameters
4K
Context
This measures the amount of verifiable public evidence we have, not how capable the model is. A missing field means it has not been verified yet, not that its value is zero.
16 of 22 public signals
Use this section to answer one simple question first: how much outside evidence do we have that this model performs well? Structured benchmark scores appear first, then official provider evidence, then live arena signal.
This model has official provider benchmark evidence, but not a normalized independent benchmark table yet.
A full normalized benchmark row is not available for this model yet.
Official benchmark evidence is already available below, so this release is still being tracked while the normalized table catches up.
Sign in to join the discussion
30.7K
Downloads
42
Likes
Jun 2025
Released
5/5 signals
2/4 signals
3/5 signals
3/4 signals
3/4 signals
Parameters
8B
Training compute
Not reported
Dataset scale
Not reported
Base model
Not reported
Gaps we are still tracking
Metadata sources
These are recent benchmark or leaderboard claims from official provider sources. They are useful for freshness and context, but they are not treated the same as normalized independent benchmark rows.
MAI-Image keeps climbing! Now #3 on @arena's image editing leaderboard. Our latest MAI-Image model is available in Private Preview on Microsoft Foundry. https://t.co/ib8IBXNbXA
MAI-Image keeps climbing! Now #3 on @arena's image editing leaderboard. Our latest MAI-Image model is available in Private Preview on Microsoft Foundry. https://t.co/ib8IBXNbXA
View sourcemicrosoft/Phi-mini-MoE-instruct · Hugging Face
Microsoft published benchmark or leaderboard evidence for Phi-mini-MoE-instruct.
View sourcemicrosoft/Phi-mini-MoE-instruct · Hugging Face
Microsoft published benchmark or leaderboard evidence for Phi-mini-MoE-instruct.
View source