EN中
← All visual benchmarksArena / 2026-10-22
Arena · CODING

Coding preference

Coding response preference, not test pass rate.

Hover or tap a bar to inspect. Select up to 3 models to highlight and compare.
Model scores10 models
Coding preference. Zoomed horizontal axis, from 1513.3 to 1549.6ZOOMED X-AXIS · 1513.3 – 1549.6 · NOT FROM ZERO1513.31522.41531.51540.51549.6Claude Opus 5.5 (High)Claude Opus 5.5 (High) · 1545 Arena Rating · zoomed horizontal axis1545Gemini 4 Argon (High)Gemini 4 Argon (High) · 1539.3 Arena Rating · zoomed horizontal axis1539.3Claude Opus 4.6Claude Opus 4.6 · 1534.4 Arena Rating · zoomed horizontal axis1534.4Claude Opus 5 (High)Claude Opus 5 (High) · 1532.6 Arena Rating · zoomed horizontal axis1532.6MiMo-V2.6-ProMiMo-V2.6-Pro · 1532.5 Arena Rating · zoomed horizontal axis1532.5Claude Opus 5 (Max)Claude Opus 5 (Max) · 1531.9 Arena Rating · zoomed horizontal axis1531.9Claude Fable 5.1 (Max)Claude Fable 5.1 (Max) · 1530.9 Arena Rating · zoomed horizontal axis1530.9Claude Opus 4.6 (High)Claude Opus 4.6 (High) · 1530.5 Arena Rating · zoomed horizontal axis1530.5Claude Opus 4.7 (High)Claude Opus 4.7 (High) · 1518.4 Arena Rating · zoomed horizontal axis1518.4Claude Fable 5 (High)Claude Fable 5 (High) · 1517.9 Arena Rating · zoomed horizontal axis1517.9
Choose a bar for details.

How to read this chart

Official top-ranked excerpt. Human preference ratings are not accuracy percentages; IPS is a distinct metric.

Score unit: Arena Rating. Values can only be compared within the same task and protocol.

Source publication: 2026-10-22. Higher values indicate better results for the reported metric.

Source: Arena · CC BY 4.0. Redrawn from released data; reduced to selected models and rounded. Not affiliated with the source organization.

Explore related charts

Arena2026-10-22

Web development

#1Claude Opus 5.5 (Max)1806.9
Web development. Zoomed horizontal axis, from 1733.9 to 1816.4Claude Opus 5.5 (Max) · 1806.9 Arena Rating · zoomed horizontal axisGPT-6 Astra (Max) · 1774.7 Arena Rating · zoomed horizontal axisClaude Sonnet 5.5 (xHigh) · 1767.5 Arena Rating · zoomed horizontal axisGPT-6.1 Sol (Max) · 1749 Arena Rating · zoomed horizontal axisClaude Fable 5.1 (Max) · 1743.4 Arena Rating · zoomed horizontal axis1733.91816.4ZOOMED · NOT ZERO
Arena RatingOpen chart
EvalPlus2026-10-23

HumanEval+ code tests

#1O1 Mini (Sept 2024)89
HumanEval+ code tests. Zoomed horizontal axis, from 86.24 to 89.36O1 Mini (Sept 2024) · 89 pass@1 (%) · zoomed horizontal axisO1 Preview (Sept 2024) · 89 pass@1 (%) · zoomed horizontal axisGPT 4o (Aug 2024) · 87.2 pass@1 (%) · zoomed horizontal axisQwen2.5-Coder-32B-Instruct · 87.2 pass@1 (%) · zoomed horizontal axisDeepSeek-V3 (Nov 2024) · 86.6 pass@1 (%) · zoomed horizontal axis86.2489.36ZOOMED · NOT ZERO
pass@1 (%)Open chart
EvalPlus2026-10-23

MBPP+ code tests

#1O1 Preview (Sept 2024)80.2
MBPP+ code tests. Zoomed horizontal axis, from 73.76 to 81.04O1 Preview (Sept 2024) · 80.2 pass@1 (%) · zoomed horizontal axisO1 Mini (Sept 2024) · 78.8 pass@1 (%) · zoomed horizontal axisQwen2.5-Coder-32B-Instruct · 77 pass@1 (%) · zoomed horizontal axisDeepSeek-Coder-V2-Instruct · 75.1 pass@1 (%) · zoomed horizontal axisGemini 1.5 Pro 002 · 74.6 pass@1 (%) · zoomed horizontal axis73.7681.04ZOOMED · NOT ZERO
pass@1 (%)Open chart