Phi 4 phi-4

microsoft · microsoft

unranked — no quality signals yet

params
14.7B
arch
dense
context
16k
license
mit open weights
released
Dec 2024
downloads/30d
680.1k

# architecture

attn shared GQA 40q/10kv feed-forward (dense) every parameter, every token out ×40 layers ctx 16,384 14.7B — no routing
layers
40
d_model
5120
heads
40q / 10kv
head dim
128
vocab
100352
family
phi3

signal path of one layer, generated from the registry's structured fields — dimension lines quote the model's real numbers; an MoE trace forks at the router, a dense trace runs straight through. Geometry fields come from the repo's config.json.

# why ranked

Overall: provisional — score 3.1 ● low — a single signal; treat with caution

provisional: too few independent signals for a numbered position — the score is shown, but this model sorts after every ranked model.

signalweightinput (0–100)
aa_intelligence 0.70 3.1
bench_composite 0.30

missing signals are dropped and the remaining weights renormalized — never imputed.

full methodology

# trend

OGM score · last 31 days
OGM score over 31 days

# benchmarks

benchmarkscoresourcedate
AA Intelligence Index 1.0 Artificial Analysis
AA Math Index 18.0 Artificial Analysis
Arena-hard 0.8 / 1 LLM Stats

# where to run

providerquantctx$/M in$/M out$/M cacheprice srctpsuptime
Featherless via hfrouter
DeepInfrabf16 16k $0.07$0.14 deepinfra 100.0%
Azure 125k $0.12$0.50 via modelsdev

sorted by blended price ((3·input + output) / 4 per 1M) · ✓ = the provider's own catalog confirms the offer · "via …" prices are what the aggregator routing the offer charges, not the provider's own list price

source aliases
aa
phi-4
llmstats
phi-4
openrouter
microsoft/phi-4