Phi 4 phi-4

microsoft · microsoft

#107 overall

params
14.7B
arch
dense
context
16k
license
mit open weights
released
Dec 2024
downloads/30d
368.3k

# architecture

attn shared GQA 40q/10kv feed-forward (dense) every parameter, every token out ×40 layers ctx 16,384 14.7B — no routing
layers
40
d_model
5120
heads
40q / 10kv
head dim
128
vocab
100352
family
phi3

signal path of one layer, generated from the registry's structured fields — dimension lines quote the model's real numbers; an MoE trace forks at the router, a dense trace runs straight through. Geometry fields come from the repo's config.json.

# why ranked

Overall: #107 — score 4.0 ● low — a single signal; treat with caution

signalweightinput (0–100)
aa_intelligence 0.70 5.7
bench_composite 0.30 0.0

benchmark panel evidence:

complete panelscore (0–100)
aa-math-v10.0

full methodology

# trend

OGM score · last 82 days
OGM score over 82 days
overall rank (up is better)
Overall rank over 82 days

methodology changed during this history window; score movement across that boundary is not model movement. See methodology v6.

# benchmarks

benchmarkscoresourcedate
AA Intelligence Index 5.9 Artificial Analysis —
AA Math Index 18.0 Artificial Analysis —
Arena-hard 0.8 / 1 LLM Stats —

# where to run

providerquantctx$/M in$/M out$/M cacheprice srctpsuptime✓
Featherless — ——— via hfrouter — —
DeepInfrabf16 16k $0.07$0.14— deepinfra — 68.0% ✓
DeepInfrabf16 16k $0.07$0.14— deepinfra — 100.0% ✓
Azure 125k $0.12$0.50— via modelsdev — —

sorted by blended price ((3·input + output) / 4 per 1M) · ✓ = the provider's own catalog confirms the offer · "via …" prices are what the aggregator routing the offer charges, not the provider's own list price

source aliases
aa
phi-4
llmstats
phi-4
openrouter
microsoft/phi-4