#1 GPT-6.1 Sol OpenAI 1025K ·
FTI 52–57 3 sources, 3 independent of the vendor: centre 54; the sources disagree widely, so shown as a band.
how FTI is computed
3 sources
1025K
yes
none
#2 🐰 Space Bunny (stealth) Undisclosed (stealth) 1M · · 15 events
FTI 35–40 1 source, 1 independent of the vendor: centre 38; fewer than 3 sources or none independent, so shown as a band.
37.9 AI Coding Daily LLM Coding Leaderboard : 57.19 · leaderboardai-benchy : 7 · community · not used: no reference models with an FTI collected for this benchmark yet gpqa-subset : 82 · community · not used: partial question set; not comparable with full-test scores hle-subset : 46.1 · community · not used: partial question set; not comparable with full-test scores how FTI is computed
1 source
1M
yes
15 events
#3 DeepSeek V4.1 Flash DeepSeek 1M · · 6 events
FTI 32
1M
yes
6 events
#3 MiMo V2.6 Flash Xiaomi MiMo 1050K* · 1 event
FTI 32
1050K (200K on the Zen free tier)
no
1 event
#3–9 Muse Spark 1.3 (Contributor) Meta 1M · · 5 events
FTI 29–34 3 sources, 2 independent of the vendor: centre 32; the sources disagree widely, so shown as a band.
how FTI is computed
3 sources
1M
yes
5 events
#3–9 Nex-N2.5-Pro Nex AGI 262K · · 2 events
FTI 29–34 3 sources, 0 independent of the vendor: centre 32; the sources disagree widely, so shown as a band.
31.9 SWE-bench Pro (public) : 61.2 · vendor · read against Kimi K3, GLM-5.3, DeepSeek V4 Pro 0813, Qwen3.8 Max, GPT-5.6 Sol in the same table32 Terminal-Bench 2.1 : 82.7 · vendor · read against Kimi K3, GLM-5.3, DeepSeek V4 Pro 0813, Qwen3.8 Max, Claude Opus 5, GPT-5.6 Sol in the same table21.9 toolathlon verified : 68.5 · vendorbrowsecomp : 89.7 · vendor · not used: no reference models for this benchmark deepswe v1 1 : 55.8 · vendor · not used: no reference runs on the same harness osworld verified : 82.2 · vendor · not used: no reference models for this benchmark how FTI is computed
3 sources
262K
yes
2 events
#3–9 Step 5 Preview StepFun 1M · · 4 events
FTI 29–34 2 sources, 2 independent of the vendor: centre 32; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
1M
yes
4 events
#8 MiMo V2.6 Pro Xiaomi MiMo 1M ·
FTI 31
1M
yes
none
#3–12 Ling 3.1 Flash 1019 inclusionAI 1M · img ? · 3 events
FTI 27–32 1 source, 1 independent of the vendor: centre 30; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
1 source
1M
not checked
3 events
#8–12 MiniMax M3.1 Flash MiniMax 1M · · 8 events
FTI 26–31 2 sources, 1 independent of the vendor: centre 29; the sources disagree widely, so shown as a band.
how FTI is computed
2 sources
1M
yes
8 events
#9–14 GPT-6 Luna OpenAI 1025K ·
FTI 25–30 4 sources, 4 independent of the vendor: centre 28; the sources disagree widely, so shown as a band.
how FTI is computed
4 sources
1025K
yes
none
#9–14 Kimi K3 Moonshot AI (Kimi) 1M · · 2 events
FTI 25–30 7 sources, 7 independent of the vendor: centre 28; the sources disagree widely, so shown as a band.
how FTI is computed
7 sources
1M
yes
2 events
#10–14 Gemini 3.7 Flash Google 1M · · 3 events
FTI 24–29 5 sources, 5 independent of the vendor: centre 26; the sources disagree widely, so shown as a band.
how FTI is computed
5 sources
1M
yes
3 events
#10–14 GLM 5.3 Z.ai 1M
FTI 24–29 7 sources, 6 independent of the vendor: centre 26; the sources disagree widely, so shown as a band.
how FTI is computed
7 sources
1M
no
none
#13–19 Muse Spark 1.2 (Contributor) Meta 1M · · 5 events
FTI 21–26 2 sources, 2 independent of the vendor: centre 24; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
1M
yes
5 events
#15–21 Gemini 3.8 Flash Google 1M · · 2 events
FTI 20–25 5 sources, 5 independent of the vendor: centre 23; the sources disagree widely, so shown as a band.
how FTI is computed
5 sources
1M
yes
2 events
#15–23 Gemini 3.6 Flash Google 1M · · 1 event
FTI 19–24 5 sources, 5 independent of the vendor: centre 22; the sources disagree widely, so shown as a band.
how FTI is computed
5 sources
1M
yes
1 event
#15–21 LongCat 2.5 Preview Meituan LongCat 1M · · 5 events
FTI 20–25 1 source, 1 independent of the vendor: centre 22; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
1 source
1M
unreliable
5 events
#15–23 Qwen3.8 Flash Qwen 1M · · 3 events
FTI 19–24 2 sources, 2 independent of the vendor: centre 22; the sources disagree widely, so shown as a band.
how FTI is computed
2 sources
1M
yes
3 events
#20 GLM 5.3 Flash Z.ai 1M · · 2 events
FTI 21
1M
yes
2 events
#20 Qwen3.8 27B Qwen 262K · · 3 events
FTI 21
262K
yes
3 events
#22 DeepSeek V4 Flash DeepSeek 200K* · 6 events
FTI 20
200K on the Zen free tier
no
6 events
#22 Gemini 3.5 Flash Google 1M · · 2 events
FTI 20
1M
yes
2 events
#20–27 Ling 3.1 Flash inclusionAI 262K · 19 events
FTI 16–21 3 sources, 0 independent of the vendor: centre 19; fewer than 3 sources or none independent, so shown as a band. Vendor claims only: low confidence.
how FTI is computed
3 sources
262K
no
19 events
#22–30 Beam 1.0 Reflection AI 1M · 4 events
FTI 15–20 7 sources, 1 independent of the vendor: centre 18; the sources disagree widely, so shown as a band.
how FTI is computed
7 sources
1M
no
4 events
#20–27 Dots3-Note Preview Dots Studio 512K · · 7 events
FTI 16–21 3 sources, 0 independent of the vendor: centre 18; the sources disagree widely, so shown as a band.
22.4 SWE-bench Pro (public) : 61 · vendor · read against Hy3, GLM 5.2, DeepSeek V4 Flash 0420 (table: "preview"), Kimi K3, Claude Opus 4.8, GPT-5.5 in the same table12.9 SWE-bench Verified : 78.4 · vendor · read against Hy3, GLM 5.2, DeepSeek V4 Flash 0420 (table: "preview") in the same table18.5 Terminal-Bench 2.1 : 75.1 · vendor · read against Hy3, GLM 5.2, DeepSeek V4 Flash 0731, Claude Opus 4.8, GPT-5.5 in the same tablehow FTI is computed
3 sources
512K
yes
7 events
#22–30 Hy4 preview Tencent Hunyuan CN only not checked · 2 events
FTI 15–20 3 sources, 0 independent of the vendor: centre 18; the sources disagree widely, so shown as a band. Vendor claims only: low confidence.
how FTI is computed
3 sources
not checked
no
2 events
#28 Gemini 3.5 Flash-Lite Google 1M · · 1 event
FTI 16
1M
yes
1 event
#28 Inkling Small Thinking Machines 1M · · 7 events
FTI 16
1M
yes
7 events
#24–36 Laguna S 2.1 Poolside 262K · 11 events
FTI 14–19 3 sources, 0 independent of the vendor: centre 16; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
3 sources
262K
no
11 events
#28–39 Inkling Thinking Machines 1M · · 7 events
FTI 12–17 2 sources, 2 independent of the vendor: centre 15; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
1M
yes
7 events
#31 MiMo V2.5 Xiaomi MiMo 1M · · 3 events
FTI 15
1M
yes
3 events
#31 MiniMax M2.7 MiniMax 197K · 2 events
FTI 15
197K
no
2 events
#25–37 MiniMax M3 MiniMax 1M · · 2 events
FTI 13–18 6 sources, 4 independent of the vendor: centre 15; the sources disagree widely, so shown as a band.
how FTI is computed
6 sources
1M
yes
2 events
#25–37 Nex-N2-Pro Nex AGI 262K · · 2 events
FTI 13–18 5 sources, 1 independent of the vendor: centre 15; the sources disagree widely, so shown as a band.
how FTI is computed
5 sources
262K
yes
2 events
#25–37 Ring-2.6-1T inclusionAI 262K · 2 events
FTI 13–18 3 sources, 1 independent of the vendor: centre 15; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
3 sources
262K
no
2 events
#28–44 Nemotron 3.5 Super VL NVIDIA 1M · · 2 events
FTI 11–16 7 sources, 1 independent of the vendor: centre 14; the sources disagree widely, so shown as a band.
how FTI is computed
7 sources
1M
yes
2 events
#31–48 Ling 3.0 Flash Fin inclusionAI 256K · 3 events
FTI 10–15 2 sources, 2 independent of the vendor: centre 13; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
256K
no
3 events
#28–44 Solar Pro 4 Upstage 512K
FTI 11–16 3 sources, 1 independent of the vendor: centre 13; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
3 sources
512K
no
none
#37–50 Hy3 Tencent Hunyuan CN only 262K · 4 events
FTI 9–14 2 sources, 1 independent of the vendor: centre 12; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
262K
no
4 events
#37–50 Ling 3.0 Flash VL inclusionAI 262K · · 2 events
FTI 9–14 1 source, 1 independent of the vendor: centre 12; fewer than 3 sources or none independent, so shown as a band.
Artificial Analysis · third partycharxiv rq : 81.3 · vendor · not used: only 0 reference models claweval mm : 59.9 · vendor · not used: no reference models for this benchmark mathvision : 84.87 · vendor · not used: no reference models for this benchmark mmmu pro : 79 · vendor · not used: no reference runs on the same harness mmsearch : 79 · vendor · not used: no reference models for this benchmark omnidocbench 1 5 : 91.35 · vendor · not used: no reference models for this benchmark webvoyager : 90.83 · vendor · not used: no reference models for this benchmark how FTI is computed
1 source
262K
yes
2 events
#31–48 Nemotron 3 Ultra (550B-A55B) NVIDIA 1M · 9 events
FTI 10–15 5 sources, 2 independent of the vendor: centre 12; the sources disagree widely, so shown as a band.
how FTI is computed
5 sources
1M
no
9 events
#31–48 Qwen3.5 397B A17B Qwen 262K ·
FTI 10–15 2 sources, 2 independent of the vendor: centre 12; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
262K
yes
none
#37–50 Solar Mini 4 Upstage 512K
FTI 9–14 3 sources, 1 independent of the vendor: centre 12; the sources disagree widely, so shown as a band.
how FTI is computed
3 sources
512K
no
none
#38–55 R Flint Recursive 262K · 3 events
FTI 8–13 2 sources, 0 independent of the vendor: centre 11; fewer than 3 sources or none independent, so shown as a band.
9 SWE-bench Verified : 74.2 · vendor · read against Qwen3.6 35B A3B, Gemma 4 26B A4B in the same table12.5 Terminal-Bench 2.1 : 54.9 · vendor · read against Qwen3.6 35B A3B in the same tableswe bench pro v2 : 89.7 · vendor · not used: no reference models for this benchmark how FTI is computed
2 sources
262K
no
3 events
#37–50 Gemma 4 26B A4B Google 262K · · 6 events
FTI 9–14 2 sources, 2 independent of the vendor: centre 11; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
262K
yes
6 events
#38–55 Hy3 preview Tencent Hunyuan 262K · 2 events
FTI 8–13 3 sources, 1 independent of the vendor: centre 11; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
3 sources
262K
no
2 events
#45 Qwen3.6 27B Qwen 262K ·
FTI 11
262K
yes
none
#38–55 Ling-3.0-flash inclusionAI 262K · 2 events
FTI 8–13 5 sources, 3 independent of the vendor: centre 10; the sources disagree widely, so shown as a band.
how FTI is computed
5 sources
262K
no
2 events
#49 Qwen3.5 4B Qwen 256K · · 2 events
FTI 10
256K
yes
2 events
#45–60 Gemma 4 31B Google 256K · · 6 events
FTI 6–11 2 sources, 2 independent of the vendor: centre 9; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
256K
yes
6 events
#40–57 Laguna XS 2.1 Poolside 256K · 7 events
FTI 7–12 2 sources, 0 independent of the vendor: centre 9; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
256K
no
7 events
#45–60 North Mini Code Cohere 256K · 6 events
FTI 6–11 3 sources, 1 independent of the vendor: centre 9; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
3 sources
256K
no
6 events
#40–57 Step 3.7 Flash StepFun 256K · · 3 events
FTI 7–12 2 sources, 1 independent of the vendor: centre 9; the sources disagree widely, so shown as a band.
how FTI is computed
2 sources
256K
yes
3 events
#40–57 Xing 4.0 29B XingChen AGI 256K · 3 events
FTI 7–12 3 sources, 0 independent of the vendor: centre 9; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
3 sources
256K
no
3 events
#45–60 Ling-2.6-1T inclusionAI 262K · 2 events
FTI 6–11 2 sources, 1 independent of the vendor: centre 8; fewer than 3 sources or none independent, so shown as a band.
Artificial Analysis · third party10.3 SWE-bench Verified : 72.2 · vendorbfcl v4 : 70.64 · vendor · not used: no reference models for this benchmark claw eval : 51 · vendor · not used: only 0 reference models ifbench : 57 · vendor · not used: only 0 reference models mrcr 16k 256k : 80.37 · vendor · not used: no reference models for this benchmark pinchbench : 87.4 · vendor · not used: most reference models share one score tau2 bench : 78.36 · vendor · not used: only 0 reference models how FTI is computed
2 sources
262K
no
2 events
#49–64 Nemotron 3 Super NVIDIA 262K · 8 events
FTI 5–10 3 sources, 0 independent of the vendor: centre 8; fewer than 3 sources or none independent, so shown as a band. Vendor claims only: low confidence.
how FTI is computed
3 sources
262K
no
8 events
#58 GLM-4.7-Flash Z.ai 200K · 4 events
FTI 7
200K
no
4 events
#51–65 gpt-oss-20b OpenAI 128K
FTI 4–9 2 sources, 2 independent of the vendor: centre 7; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
128K
no
none
#49–64 Qwen3.5 9B Qwen 262K ·
FTI 5–10 2 sources, 2 independent of the vendor: centre 7; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
262K
yes
none
#51–65 gpt-oss-120b OpenAI 128K
FTI 4–9 7 sources, 7 independent of the vendor: centre 6; the sources disagree widely, so shown as a band.
how FTI is computed
7 sources
128K
no
none
#56–68 Ling-2.6-flash inclusionAI 262K · 2 events
FTI 3–8 3 sources, 1 independent of the vendor: centre 6; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
3 sources
262K
no
2 events
#56–68 Nemotron 3 Nano Omni 30B A3B (reasoning) NVIDIA 256K · · 6 events
FTI 3–8 1 source, 1 independent of the vendor: centre 6; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
1 source
256K
yes
6 events
#56–68 Nemotron 3.5 Lightning NVIDIA 1M · 9 events
FTI 3–8 5 sources, 3 independent of the vendor: centre 6; the sources disagree widely, so shown as a band.
how FTI is computed
5 sources
1M
no
9 events
#58–68 LFM 2.5 2.6B Liquid AI 128K · 7 events
FTI 2–7 2 sources, 1 independent of the vendor: centre 5; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
128K
no
7 events
#66 DeepSeek R1 0528 Qwen3 8B DeepSeek 128K · 1 event
FTI 4
128K
no
1 event
#58–68 Mistral Small 3.2 24B Mistral AI 256K* · · 2 events
FTI 2–7 2 sources, 1 independent of the vendor: centre 4; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
256K (128K on OVHcloud)
yes
2 events
#61–69 Qwen3 8B Qwen 128K · 2 events
FTI 1–6 2 sources, 2 independent of the vendor: centre 4; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
128K
no
2 events
#65–70 Llama 3.3 70B Instruct Meta 128K
FTI 0–5 2 sources, 2 independent of the vendor: centre 2; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
128K
no
none
#65–70 Mistral 7B Instruct v0.3 Mistral AI 32K · 1 event
FTI 0–5 2 sources, 2 independent of the vendor: centre 1; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
2 sources
32K
no
1 event
#65–71 Mistral Nemo Instruct 2407 Mistral AI 128K* · 2 events
FTI 0–5 3 sources, 3 independent of the vendor: centre 0; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
3 sources
128K (64K on OVHcloud)
no
2 events
#65–71 Qwen2.5 7B Instruct Qwen 32K · 2 events
FTI 0–5 1 source, 1 independent of the vendor: centre 0; fewer than 3 sources or none independent, so shown as a band.
how FTI is computed
1 source
32K
no
2 events
Not scored · 47 models with no usable benchmark source yet
C Crouton Alpha (stealth) Undisclosed (stealth) 1M · · 3 events
—
1M
yes
3 events
G Glyph Cluster Undisclosed (stealth) 256K · 1 event
FTI —
256K
no
1 event
LFM3-1.7B Liquid AI 256K · 2 events
—
256K
no
2 events
H Ampersand v0.1 Humans& 1M · 1 event
—
1M
no
1 event
🥒 Big Pickle Undisclosed (stealth) 195K · 2 events
—
195K
no
2 events
Coding Kimi K3 Moonshot AI (Kimi) 1M · · 2 events
—
1M
yes
2 events
GLM-4 9B 0414 Z.ai 32K · 2 events
—
32K
no
2 events
GLM-4-Flash-250414 Z.ai 128K · img ? · 2 events
—
128K
not checked
2 events
GLM-Z1 9B 0414 Z.ai 128K · 1 event
—
128K
no
1 event
Hunyuan-MT-7B Tencent Hunyuan not checked · 1 event
—
not checked
no
1 event
I Iceman Undisclosed (stealth) 262K · 1 event
—
262K
no
1 event
Inkling 2 Small Thinking Machines 1M · · 1 event
—
1M
yes
1 event
Qwen2.5 VL 72B Instruct Qwen 128K* ·
—
128K (32K on OVHcloud)
yes
none
A Andromeda Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
Apodex 1.1 Mini Apodex 256K · 8 events
—
256K
no
8 events
A Aurora Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
B Bert-Nebulon Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
🐱 Cat Jam Undisclosed (stealth) 1M · · 6 events
—
1M
unreliable
6 events
C Cinematika 7B (alpha) Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
C Cypher Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
E Exo Undisclosed (stealth) 1M · · 2 events
—
1M
yes
2 events
🐣 Fledge Alpha Undisclosed (stealth) 1M · · 3 events
—
1M
yes
3 events
Gemini 2.0 Flash Experimental Google not checked · img ? · 2 events
—
not checked
not checked
2 events
Gemini 2.5 Pro Experimental (03-25) Google not checked · img ? · 2 events
—
not checked
not checked
2 events
Gemma 7B IT Google not checked · img ? · 2 events
—
not checked
not checked
2 events
GLM-4.5-Flash Z.ai 200K · 4 events
—
200K
no
4 events
H Healer Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
H Hunter Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
I Iceman Contributor Undisclosed (stealth) 262K · 2 events
—
262K
no
2 events
J JEV 1.13 Undisclosed (stealth) 62K · 3 events
—
62K
no
3 events
Ling 3.0 Flash Sante inclusionAI 256K · 8 events
—
256K
no
8 events
L LL Alpha Undisclosed (stealth) 262K · 2 events
—
262K
no
2 events
G MythoMist 7B Gryphe not checked · img ? · 2 events
—
not checked
not checked
2 events
N Nous Capybara 7B Nous Research not checked · img ? · 2 events
—
not checked
not checked
2 events
O OpenChat 7B OpenChat not checked · img ? · 2 events
—
not checked
not checked
2 events
O Optimus Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
🐮 Ox Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
P Polaris Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
O Pulse Alpha OpenCode 1M · img ? · 2 events
—
1M
not checked
2 events
Q Quasar Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
R RWKV-5 3B AI Town Recursal not checked · img ? · 2 events
—
not checked
not checked
2 events
S Sherlock Dash Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
S Sherlock Think Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
S Sonoma Dusk Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
U Toppy M 7B Undi95 not checked · img ? · 2 events
—
not checked
not checked
2 events
U Union Alpha Undisclosed (stealth) not checked · img ? · 2 events
—
not checked
not checked
2 events
H Zephyr 7B Beta Hugging Face H4 not checked · img ? · 2 events
—
not checked
not checked
2 events