← All visual benchmarksEvalPlus / 2026-10-23
EvalPlus · CODING

HumanEval+ code tests

Pass@1 on HumanEval+ rigorous test cases.

Hover or tap a bar to inspect. Select up to 3 models to highlight and compare.
Model scores10 models
HumanEval+ code tests. Zoomed horizontal axis, from 80.61 to 90.09ZOOMED X-AXIS · 80.61 – 90.09 · NOT FROM ZERO80.6182.9885.3587.7290.09O1 Mini (Sept 2024)O1 Mini (Sept 2024) · 89 pass@1 (%) · zoomed horizontal axis89O1 Preview (Sept 2024)O1 Preview (Sept 2024) · 89 pass@1 (%) · zoomed horizontal axis89GPT 4o (Aug 2024)GPT 4o (Aug 2024) · 87.2 pass@1 (%) · zoomed horizontal axis87.2Qwen2.5-Coder-32B-InstructQwen2.5-Coder-32B-Instruct · 87.2 pass@1 (%) · zoomed horizontal axis87.2DeepSeek-V3 (Nov 2024)DeepSeek-V3 (Nov 2024) · 86.6 pass@1 (%) · zoomed horizontal axis86.6GPT-4-Turbo (April 2024)GPT-4-Turbo (April 2024) · 86.6 pass@1 (%) · zoomed horizontal axis86.6DeepSeek-V2.5 (Nov 2024)DeepSeek-V2.5 (Nov 2024) · 83.5 pass@1 (%) · zoomed horizontal axis83.5GPT 4o Mini (July 2024)GPT 4o Mini (July 2024) · 83.5 pass@1 (%) · zoomed horizontal axis83.5DeepSeek-Coder-V2-InstructDeepSeek-Coder-V2-Instruct · 82.3 pass@1 (%) · zoomed horizontal axis82.3Claude Sonnet 3.5 (June 2024)Claude Sonnet 3.5 (June 2024) · 81.7 pass@1 (%) · zoomed horizontal axis81.7
Choose a bar for details.

How to read this chart

EvalPlus pass@1 scores are from official reports; prompting and model configurations may differ.

Score unit: pass@1 (%). Values can only be compared within the same task and protocol.

Data retrieved: 2026-10-23. Higher values indicate better results for the reported metric.

Source: EvalPlus · Apache-2.0. Redrawn from released data; reduced to selected models and rounded. Not affiliated with the source organization.

Explore related charts