Open-weights LLM ranking — agentic
scored as 100% swe_bench_verified (renormalized when signals are missing) — methodology
| # | model | params | ctx | score | elo | $/M out |
|---|---|---|---|---|---|---|
| 1 | kimi-k2-0905 | 1000B (A32B) | 256k | ● 100.0 | — | $2.50 |
| 2 | qwen3-coder-480b-a35b | 480B (A35B) | 1024k | ● 92.3 | — | $1.00 |
| 3 | glm-4.6 | 355B (A32B) | 198k | ● 84.6 | — | $1.74 |
| 4 | kimi-k2-instruct | 1000B (A32B) | 128k | ● 76.9 | — | $2.30 |
| 5 | glm-4.5 | 355B (A32B) | 128k | ● 69.2 | — | $2.20 |
| 6 | kimi-k2-thinking | 1000B (A32B) | 256k | ● 61.5 | — | $2.50 |
| 7 | minimax-m2 | 229B (A10B) | 200k | ● 53.8 | — | $1.02 |
| 8 | qwen3-coder-30b-a3b | 30.5B (A3.3B) | 160k | ● 46.2 | — | $0.27 |
| 9 | deepseek-v3.2 | 671B (A37B) | 128k | ● 38.5 | — | $0.34 |
| 10 | devstral-small-2512 | 24B | — | ● 30.8 | — | — |
| 11 | qwen2.5-coder-32b | 32.8B | 125k | ● 23.1 | — | $1.00 |
| 12 | deepseek-v3 | 671B (A37B) | 128k | ● 15.4 | — | $0.80 |
| 13 | devstral-small-2507 | 24B | — | ● 7.7 | — | — |
| 14 | gpt-oss-120b | 117B (A5.1B) | 128k | ● — | — | $0.14 |
| — | deepseek-r1 | 671B (A37B) | 160k | ● — | — | $2.50 |
| — | deepseek-r1-0528 | 671B (A37B) | 160k | ● — | — | $2.15 |
| — | deepseek-v3.1 | 671B (A37B) | 160k | ● — | — | $0.79 |
| — | deepseek-v4-flash | 158B | 1024k | ● — | — | $0.18 |
| — | deepseek-v4-pro | 862B | 1024k | ● — | 1457 | $0.87 |
| — | gemma-3-12b-it | 12B | 128k | ● — | — | $0.15 |
| — | gemma-3-27b-it | 27B | 128k | ● — | — | $0.16 |
| — | gemma-4-12b-it | 12B | — | ● — | — | — |
| — | gemma-4-26b-a4b-it | 26.5B (A4B) | 256k | ● — | — | $0.30 |
| — | gemma-4-31b-it | 32.7B | 256k | ● — | — | $0.35 |
| — | glm-4.5-air | 106B (A12B) | 128k | ● — | — | $0.85 |
| — | glm-4.7 | 358B | 198k | ● — | — | $1.75 |
| — | glm-4.7-flash | 31.2B | 198k | ● — | — | $0.40 |
| — | glm-5 | 754B | 198k | ● — | 1457 | $1.92 |
| — | glm-5.1 | 754B | 198k | ● — | 1472 | $3.04 |
| — | glm-5.2 | 753B | 1024k | ● — | — | $2.86 |
| — | gpt-oss-20b | 21B (A3.6B) | 128k | ● — | — | $0.13 |
| — | kimi-k2.6 | 1059B (A32B) | 256k | ● — | 1461 | $3.20 |
| — | kimi-k2.7-code | 1059B (A32B) | 256k | ● — | — | $3.15 |
| — | leanstral-1.5-119b-a6b | 119B (A6B) | — | ● — | — | — |
| — | llama-3.1-405b-instruct | 405B | — | ● — | — | — |
| — | llama-3.3-70b-instruct | 70.6B | 128k | ● — | — | $0.32 |
| — | llama-4-maverick | 400B (A17B) | 1024k | ● — | — | $0.60 |
| — | llama-4-scout | 109B (A17B) | 10000k | ● — | — | $0.30 |
| — | longcat-2.0 | 1776B | — | ● — | — | — |
| — | magistral-small-2506 | 24B | — | ● — | — | — |
| — | minimax-m1 | 456B (A45.9B) | 1000k | ● — | — | $2.20 |
| — | minimax-m3 | 427B | 1024k | ● — | — | $1.20 |
| — | mistral-large-2411 | 123B | — | ● — | — | — |
| — | mistral-small-3.2-24b | 24B | 125k | ● — | — | $0.20 |
| — | olmo-2-32b-instruct | 32B | — | ● — | — | — |
| — | olmo-3-32b | 32.2B | — | ● — | — | — |
| — | ornith-1.0-35b | 35B | — | ● — | — | — |
| — | ornith-1.0-397b | 397B | — | ● — | — | — |
| — | ornith-1.0-9b | 9B | — | ● — | — | — |
| — | qwen-agentworld-35b-a3b | 34.7B (A3.3B) | — | ● — | — | — |
| — | qwen2.5-72b-instruct | 72.7B | 128k | ● — | — | $0.40 |
| — | qwen3-235b-a22b | 235B (A22B) | 128k | ● — | — | $1.82 |
| — | qwen3-30b-a3b | 30.5B (A3.3B) | 128k | ● — | — | $0.50 |
| — | qwen3-32b | 32.8B | 128k | ● — | — | $0.28 |
| — | qwen3-coder-next | 79.7B | 256k | ● — | — | $0.80 |
| — | qwen3.5-122b-a10b | 125B (A10B) | 256k | ● — | — | $2.08 |
| — | qwen3.5-397b-a17b | 403B (A17B) | 250k | ● — | — | $2.34 |
| — | qwen3.5-9b | 9.7B | 256k | ● — | — | $0.15 |
| — | qwen3.6-27b | 27.8B | 256k | ● — | — | $2.00 |
| — | qwen3.6-35b-a3b | 36B (A3.3B) | 256k | ● — | — | $0.97 |
| — | qwq-32b | 32.8B | — | ● — | — | — |