OLMo 3 32B olmo-3-32b

allenai · olmo fully-open

unranked — no quality signals yet

params
32.2B
arch
dense
license
apache-2.0 open weights
released
Nov 2025
train compute
1.1e+24 FLOP

# architecture

attn shared GQA 40q/8kv feed-forward (dense) every parameter, every token out ×64 layers 32.2B — no routing
layers
64
d_model
5120
heads
40q / 8kv
head dim
128
vocab
100278
family
olmo3

signal path of one layer, generated from the registry's structured fields — dimension lines quote the model's real numbers; an MoE trace forks at the router, a dense trace runs straight through. Geometry fields come from the repo's config.json.

# trend

collecting history — trends appear after a few daily runs.

# where to run

no known API providers — download the weights from Hugging Face and run them yourself.

source aliases
epoch
Olmo 3
openrouter
allenai/olmo-3-1125-32b