EleutherAI
How do large language models (LLMs) develop and evolve over the course of training? How do these patterns change as models scale? To answer these questions, we introduce \textit{Pythia}, a suite of 16 LLMs all trained on public data seen in the exact same order and ranging in size from 70M to 12B parameters.
Running this yourself: can likely run on your own machine.
Live access is not confirmed for this model. No current purchase price is advertised.
No current subscription pricing is tracked for this model.
Confirm this specific model, usage limits, and billing terms with the provider. A subscription does not automatically include API credits.
No login needed to compare. Prices are in USD; provider charges are separate from AI Market Cap plans. Context length, caching, tools, taxes, and regional terms can change the final cost. Open weights do not mean free hosting.
---
Quality Score
---
Arena ELO
1B
Parameters
2K
Context
This measures the amount of verifiable public evidence we have, not how capable the model is. A missing field means it has not been verified yet, not that its value is zero.
14 of 22 public signals
Sign in to join the discussion
83.8K
Downloads
48
Likes
Mar 2023
Released
5/5 signals
0/4 signals
3/5 signals
3/4 signals
3/4 signals
Parameters
1B
Training compute
1.8e21 FLOP
Dataset scale
299.9B units
Base model
Not reported
Source-reported access: Open weights (unrestricted) · Confident confidence
Gaps we are still tracking
Start with the simple view: the cheapest reliable option, the official provider price, and the best places to try or deploy this model. The detailed table stays below if you want the full pricing breakdown.
Public pricing, no login required. Rates are in USD and billed by the provider, separately from AI Market Cap data plans. Confirm billing cycle, taxes, usage caps, and specific model availability before purchasing. A subscription does not automatically include API credits; context length, caching, and tools can change usage costs.
No pricing data available yet.