Black Friday Discount! Until December 1st, 50% off premium membership

LLM Coding Leaderboard

Last update: November 21st, 2026 (Added MAI Code 2 and MAI Code 2 Flash)

Full methodology and scoring formulas explained in this article.

Notify me when a new model is benchmarked

New rankings go out in the weekly AI Coding Daily newsletter. Unsubscribe anytime.

No families found.

# Model Total points
(max 90)
Avg cost
per prompt
Avg time
per prompt
Video Tested with Points per project
Laravel Code Quality
(max 20)
React-TS Code Quality
(max 20)
Bug Finding Test
(max 10)
Python Code Quality
(max 20)
Edge-case Testing
(4 projects, max 20)
1 Opus 5.5 (High) 84.95 $0.83 03:42
Claude Code
18.68 19 9.1 18.17 20 0
2 Fable 5.2 (Medium) 84.7 $1.42 03:03
Claude Code
19.13 19.5 9.52 17.8 18.75 0
3 GPT-6-Astra (High) 84.25 $0.96 04:34
Codex CLI
18.6 18.17 9.03 18.47 20 −0.02
4 GPT-6-Astra (Medium) 83.89 $0.69 03:08
Codex CLI
18.2 17.83 9.38 18.5 20 −0.02
5 GPT-6.1-Sol (High) 83.86 $0.23 04:19
Codex CLI
18.5 18.83 9.03 18 19.5 0
6 GPT-6.2-Sol (High) 83.53 $0.30 05:37
Codex CLI
19.17 19.17 8.92 17.27 19 0
7 GPT-6.2-Astra (High) 83.48 $0.72 05:40
Codex CLI
18.73 19.83 7.15 17.77 20 0
8 GPT-6.2-Astra (Medium) 83.39 $0.48 02:20
Codex CLI
18.42 19.17 7.57 18.23 20 0
9 Opus 5.5 (Medium) 83.15 $0.57 02:20
Claude Code
18.95 18.5 7.98 18.5 19.5 −0.28
10 GPT-6.2-Sol (Medium) 83.1 $0.22 05:30
Codex CLI
19.12 19.17 8.61 17.5 19.2 −0.50

Wanna support updates of this leaderboard? Subscribe to Premium membership.

11 GPT-6.2-Sol (Low) 83.08 $0.13 02:12
Codex CLI
18.43 18.83 8.54 17.8 19.5 −0.02
12 GPT-6.1-Sol (Medium) 83.04 $0.15 02:24
Codex CLI
18.17 18 9.1 18.27 19.5 0
13 Sonnet 5.5 (High) 80.58 $0.34 01:53
Claude Code
18.68 18.5 7.6 16.83 19 −0.03
14 Gemini 4 Neon (Xhigh) 80.13 N/A 10:56
Antigravity
18.08 17.5 10 15.8 18.75 0
15 Gemini 4 Neon (High) 79.85 N/A 07:25
Antigravity
17.8 17.5 10 15.8 18.75 0
16 Kimi K3.1 Pro (Max) 79.85 $0.74 13:39
OpenCode
18.55 18.33 8.75 16.47 17.75 0
17 GPT-6.1-Sol (Low) 78.8 $0.10 01:21
Codex CLI
17.53 16.67 8.75 18.1 18.5 −0.75
18 Opus 5.5 (Low) 78.19 $0.37 01:21
Claude Code
17.37 18.17 6.63 18.1 18.5 −0.58
19 Gemini 4 Hydrogen (High) 78.01 N/A 03:42
Antigravity
18.23 17.33 7.92 16.27 18.75 −0.49
20 GPT-6.1-Terra (Max) 77.67 $0.27 07:55
Codex CLI
17.82 18.17 8.61 16.7 16.5 −0.13
21 MAI Code 2 (High) 77.66 $0.20 05:41
OpenCode
17.63 17.17 6.96 17.4 19.25 −0.75
22 Gemini 4 Neon (Medium) 77.34 N/A 03:57
Antigravity
16.95 18 8.02 16.87 17.5 0
23 Deepseek-V4.1-Flash-1017 (Max) 77.08 $0.07 07:09
OpenCode
17.42 18.17 8.47 16.27 17.25 −0.50
24 Haiku 5.5 (High) 76.3 $0.05 03:37
Claude Code
17.3 18 7.22 17.23 17.25 −0.70
25 Haiku 5.5 (Medium) 75.84 $0.03 02:37
Claude Code
17.32 17 7.09 17.43 17 0
26 Kimi K3.1 Pro (High) 75.47 $0.25 05:23
OpenCode
17.7 17.33 7.36 17.8 17.25 −1.97
27 Sonnet 5.5 (Medium) 75.44 $0.20 00:58
Claude Code
17.88 18.33 6.18 16.63 17.25 −0.83
28 Grok 4.7 (High) 75.44 $1.85 23:27
Cursor
17.7 18.33 8.06 15.6 16.25 −0.50
29 Qwen4-Max (High) 73.67 $0.21 06:23
OpenCode
18.15 16.83 6.95 18.37 14.15 −0.78
30 Gemini 4 Hydrogen (Medium) 73.44 N/A 01:43
Antigravity
17.35 16.17 6.18 17.27 16.75 −0.28
31 GPT-6-Luna (Max) 73.06 $0.03 11:03
Codex CLI
18.12 17.17 7.08 16.03 16.7 −2.04
32 Gemini 4 Argon (High) 72.46 N/A 09:41
Devin
17.15 18.5 7.64 15.17 14.25 −0.25
33 SWE-2 (Max) 72.45 N/A 11:59
Devin
17.5 17.83 6.67 16.73 14.45 −0.73
34 Grok 4.6 (High) 72.28 $0.77 09:19
Cursor
17.4 18 6.56 15.57 14.75 0
35 GPT-6.1-Terra (Xhigh) 71.99 $0.07 01:29
Codex CLI
16.23 17.5 8.82 15.57 14.4 −0.53
36 Deepseek-V4.1-Flash-1017 (High) 71 $0.03 03:13
OpenCode
17.98 16.83 6.88 16.7 14.25 −1.64
37 MiniMax M3.1-Flash (Max) 70.93 N/A 15:42
OpenCode
17.44 17 5.31 16.9 15.25 −0.97
38 GPT-6-Luna (Xhigh) 70.75 $0.03 10:08
Codex CLI
17.02 17.17 6.39 16 15.75 −1.58
39 Qwen 3.8 Max (0902) (High) 70.68 $0.40 11:49
OpenCode
17.75 18 5.45 17.7 12.95 −1.17
40 GLM-5.3 (High) 70.29 $0.19 04:58
OpenCode
17.55 17.67 5.38 16.27 14.7 −1.28
41 GPT-6.1-Terra (High) 69.31 $0.05 00:46
Codex CLI
16.12 16.17 7.85 14.77 14.4 0
42 Tencent Hy4 Flash (High) 68.81 N/A 02:59
OpenCode
17.62 17.67 5.14 16.73 14.2 −2.55
43 SWE-2 Flash (High) 68.62 N/A 11:29
Devin
17.4 17.33 4.24 17.4 13 −0.75
44 MiMo-V2.6 Pro (High) 68.37 $0.09 15:04
OpenCode
17.41 18 6.18 15.23 12.15 −0.60
45 GPT-6.1-Terra (Medium) 68.22 $0.04 00:31
Codex CLI
16.28 16.17 7.43 15.67 14.45 −1.78
46 GPT-6-Luna (High) 67.33 $0.01 03:51
Codex CLI
16.9 15.83 5.35 15.53 15 −1.28
47 Qwen 3.8 Flash (Xhigh) 67.31 $0.04 08:38
OpenCode
16.35 17.67 5.7 16.33 13.2 −1.94
48 Deepseek-V4-Pro-0813 (Max) 66.9 $0.05 09:06
OpenCode
17.3 16.5 4.62 17.83 11.65 −1.00
49 Deepseek-V4-Pro-0813 (High) 65.07 $0.04 07:15
OpenCode
17.25 16.33 3.47 17.3 12.05 −1.33
50 Mistral Large 4 (High) 65.01 $0.18 05:30
OpenCode
17.78 18.5 4.14 15.03 12.4 −2.84
51 Muse Ember 1.0 (Max) 64.52 $0.03 02:16
OpenCode
15.95 16.67 5.31 14.33 14.7 −2.44
52 MiMo-V2.6 Flash (High) 64.39 $0.04 17:56
OpenCode
17.83 17.5 7.46 14.1 10.15 −2.65
53 Tencent Hy4 (High) 62.69 $0.45 16:32
OpenCode
18.05 16.83 3.96 15 10.65 −1.80
54 Tencent Hy3 (High) 62.25 $0.05 06:35
OpenCode
16.8 14.33 2.64 14.03 16.45 −2.00
55 Muse Spark 1.3 (Xhigh) 61.69 N/A 06:51
OpenCode
15.9 16.67 5.7 11.9 12.65 −1.13
56 GLM-5.3-Flash (Max) 61.46 $0.02 08:54
OpenCode
17.2 17.17 4.79 17 8.45 −3.15
57 Qwen 3.8 27B (Xhigh) 60.71 $0.45 23:22
OpenCode
17.23 15.67 3.26 15.3 12.15 −2.90
58 GPT-6-Luna (Medium) 56.7 $0.01 02:13
Codex CLI
16.33 14.17 3.89 14.83 9.7 −2.22
59 MAI Code 2 Flash (High) 52.98 $0.03 09:33
OpenCode
16.42 15 4.39 6.97 13.45 −3.25
60 Beam (Max) 51.94 N/A 01:38
OpenCode
15.7 15.33 2.36 11.2 10.15 −2.80
61 Composer 2.5 45.75 $0.10 02:41
Cursor
16 15.83 3.3 10.1 5.6 −5.08
62 Nemotron 3.5 Super VL (High) 44 N/A 06:47
OpenCode
15.01 15.17 2.3 11.9 5.3 −5.68
Older LLMs hidden from table

These models are hidden to keep the leaderboard focused on current LLMs. Untick any of them to add it back to the table.

Support Leaderboard Updates

Running dozens of prompts on multiple projects with different LLMs is costly.
Help keep it updated: get Premium membership.


Recent Premium Videos


Explanations

  • Full methodology and scoring formulas explained in this article
  • Prices are calculated with API costs
  • When a model is tested via a subscription plan rather than the API, there's no per-prompt price to measure, so the avg cost column shows N/A for comparison

Updates

  • November 21st: Added MAI Code 2 and MAI Code 2 Flash
  • November 19th: Added Gemini 4 Neon
  • November 18th: Added GPT-6.2 Sol and GPT-6.2 Astra
  • November 17th: Added Qwen4-Max and Hy4 Flash
  • November 15th: More runs for accuracy, improved charts for effort levels and subscription usage
  • November 13th: Added Gemini 4 Hydrogen
  • November 11th: Added Muse Ember 1.0
  • November 10th: Added Fable 5.2
  • November 9th: Added SWE-2 Flash and Tencent Hy4
  • October 31st: Re-benchmarked updated Mistral Large 4
  • October 27th: Added GPT-6.1-Terra
  • October 24th: Added Kimi K3.1-Pro
  • October 21st: Added Mercury 3
  • October 20th: Added MiniMax-M3.1-Flash
  • October 20th: Re-benchmarked GPT-6.1-Sol and Opus 5.5
  • October 17th: Added Beam and Nemotron 3.5 Super VL
  • October 15th: Added Mistral 4 Large
  • October 14th: Added Gemini 4 Argon
  • October 8th: Added Haiku 5.5
  • October 3rd: Added new project worth 10 points for finding bugs
  • September 30th: Added GPT-6.1-Sol
  • September 29th: Added Sonnet 5.5
  • September 28th: Added LongCat-2.5-Preview
  • September 27th: Added MiMo v2.6 Pro/Flash models
  • September 25th: Added Space Bunny stealth model
  • September 24th: Added GPT-6-Sol and GPT-6-Luna
  • September 23rd: Added Opus 5.5
  • September 22nd: Added Grok 4.7
  • September 15th: Added SWE-2 model by Devin
  • September 12th: Added new project React/Typescript code quality (20 points max)
  • September 11th: Added Deepseek v4.1 Flash model
  • September 9th: Added Qwen 3.8 Max (0902)
  • September 8th: Added Fable 5.1 and re-calculate scoring on Code Quality project
  • September 6th: Added GPT-6-Astra
  • September 3rd: Added Gemini-3.8-Flash
  • August 31st: New project evaluating CODE QUALITY (max 20 points)
  • August 29th: Added Qwen3.8-Flash model
  • August 27th: Added GLM-5.3-Flash (ex Ox Alpha) model
  • August 20th: Added Qwen 3.8 27B
  • August 18th: Added Gemini-3.7-Flash tested in Antigravity
  • August 15th: Added GLM-5.3 model
  • August 14th: Added DeepSeek-v4-Pro-0813 and Grok 4.6 models
  • August 12th: Added new evaluation project no.4 with Go language
  • August 7th: Added Muse Spark 1.2 and GPT-5.6-Terra High levels
  • August 4th: Added Qwen 3.8 Max and NEW 3rd Project Flutter/Dart
  • August 2nd: Added Max levels of GPT-5.6-Luna and Deepseek-v4-Flash
  • August 1st: Re-tested GPT-5.6-Luna/Terra and Deepseek-v4-Flash with new prices
  • July 27th: added Opus 5 High and GPT-5.6-Sol Medium
  • July 27th: new v2 version of the leaderboard - with only two (but more complex) projects.
  • July 26th: cleanup - removed older models: GPT-5.5, Kimi K2.6, Gemini 3.5 Flash, Sonnet 4.6
  • July 22nd: added Gemini 3.6 Flash and Gemini 3.5 Flash Lite
  • July 18th: added Kimi K3
  • July 11th: added GPT-5.6 Luna and Terra
  • July 9th: added Grok 4.5
  • July 8th: added Tencent Hy3
  • July 1st: added Sonnet 5
  • June 24th: added GPT-5.4-Mini and Gemini-3.5-Flash
  • June 23rd: added 5th benchmark project, removed Opus 4.7 and GLM-5.1, added GPT-5.4
  • June 17th: added GLM-5.2
  • June 13th: added Kimi-K2.7-Code
  • June 5th: added Deepseek v4 Flash and removed Minimax M2.7
  • June 4th: added Qwen 3.7 Plus
  • June 2nd: added Qwen 3.7 Max and Tested with column
  • June 2nd: added Minimax M3
  • May 30th: added Avg Cost for all LLMs (based on API pricing)
  • May 29th: added Claude Opus 4.8
  • May 24th: added 4th benchmark project - for React/TypeScript
  • May 20th: added Composer 2.5
Povilas Korop

Get Weekly AI Coding News

Sent every Wednesday. No spam, ever. Unsubscribe anytime.