Internal Research Debugging Evaluation
percentageInternal Research Debugging Evaluation — official/provider-reported evaluation result. Methodology conditions ar...
Find tools, models, companies, news, guides, comparisons and benchmark data from one research-driven index.
Internal Research Debugging Evaluation — official/provider-reported evaluation result. Methodology conditions ar...
Living open-source code-review benchmark based on real-world pull-request behavior; F1 balances precision and re...
Controlled code-review benchmark across 50 hard-to-find bugs; F1 balances precision and recall.
LiveCodeBench — official/provider-reported evaluation result. Methodology conditions are preserved in the result...
LiveCodeBench v6 — official/provider-reported evaluation result. Methodology conditions are preserved in the res...
Codeforces Percentile — official/provider-reported evaluation result. Methodology conditions are preserved in th...
Figure's public controlled evaluation of Helix S1 logistics manipulation after scaling demonstration data; score...
Accuracy on Exa's open WebCode Contents track measuring extraction fidelity against golden markdown.
Human-validated 500-instance SWE-bench subset used to evaluate coding agents and systems.
SWE-bench Verified (OpenAI 477 Tasks) — official/provider-reported evaluation result. Methodology conditions are...
Aider Polyglot (Diff) — official/provider-reported evaluation result. Methodology conditions are preserved in th...
SWE-Bench Pro — official/provider-reported evaluation result. Methodology conditions are preserved in the result...
Terminal-Bench 2.1 — official/provider-reported evaluation result. Methodology conditions are preserved in the r...
SWE-bench Verified (Anthropic Full 500) — official/provider-reported evaluation result. Methodology conditions a...
SWE-bench Verified (Anthropic Full 500 High Compute) — official/provider-reported evaluation result. Methodology...
Terminal-bench — official/provider-reported evaluation result. Methodology conditions are preserved in the resul...
SWE-bench Verified (Anthropic 489 Internal Subset) — official/provider-reported evaluation result. Methodology c...
SWE-bench Verified (Anthropic 489 High Compute) — official/provider-reported evaluation result. Methodology cond...
Aider Polyglot — official/provider-reported evaluation result. Methodology conditions are preserved in the resul...
SWE-bench Verified (Google Single Attempt) — official/provider-reported evaluation result. Methodology condition...
SWE-bench Verified (Google Multiple Attempts) — official/provider-reported evaluation result. Methodology condit...
SWE-bench Verified (DeepSeek Resolved) — official/provider-reported evaluation result. Methodology conditions ar...
Publicly reported coding & terminal agents benchmark result.