EleutherAI
We have released GPT-J-6B, 6B JAX-based (Mesh) Transformer LM (Github). GPT-J-6B performs nearly on par with 6.7B GPT-3 (or Curie) on various zero-shot down-streaming tasks. You can try out this Colab notebook or free web demo. This library also serves as an example of model parallelism with xmap on JAX.
Running this yourself: consumer gpu should be enough.
Live access is not confirmed for this model. No current purchase price is advertised.
No current subscription pricing is tracked for this model.
Confirm this specific model, usage limits, and billing terms with the provider. A subscription does not automatically include API credits.
No login needed to compare. Prices are in USD; provider charges are separate from AI Market Cap plans. Context length, caching, tools, taxes, and regional terms can change the final cost. Open weights do not mean free hosting.
---
Quality Score
---
Arena ELO
6B
Parameters
---
Context
This measures the amount of verifiable public evidence we have, not how capable the model is. A missing field means it has not been verified yet, not that its value is zero.
13 of 22 public signals
Sign in to join the discussion
289.9K
Downloads
1.5K
Likes
Mar 2022
Released
4/5 signals
0/4 signals
3/5 signals
3/4 signals
3/4 signals
Parameters
6B
Training compute
1.5e22 FLOP
Dataset scale
400.0B units
Base model
Not reported
Source-reported access: Open weights (unrestricted) · Confident confidence
Gaps we are still tracking
This section gives the plain-English basics first: what the model is, how large it is, how much context it can handle, and whether it is still actively supported.
This tells you how you can use the model in practice: whether weights are open, whether an API exists, and what kinds of input or output it supports.
Capabilities