Leading score65.80 %
Verified AI benchmark
SWE-bench Verified — Agent Systems Leaderboard
Human-validated 500-instance SWE-bench subset used to evaluate coding agents and systems.
Semantic classUnclassified
CategorySoftware Engineering DirectionHigher is better
VersionVerified Verified entities2
How to interpret this leaderboard
What this benchmark does—and does not—measure
This leaderboard preserves the benchmark's own metric, source and test date. Results are comparable only within the same benchmark definition and semantic class; missing data is never treated as a zero.
Method & source
- Unit
- %
- Results
- 2
- Latest test
- Apr 15, 2025
- Distinct source links
- 1
Entities at top score1
Evidence freshnessApr 15, 2025
Verified results
SWE-bench Verified — Agent Systems rankings
Only the latest verified result for each listed entity is shown. Equal scores receive the same displayed rank.
| Rank | Model / Tool | Score | Tested | Evidence |
|---|---|---|---|---|
| #1 | OpenHands | 65.80% | Apr 15, 2025 | SWE-bench |
| #2 | Amazon Q Developer | 65.40% | Apr 5, 2025 | SWE-bench |
What to keep in mind
A benchmark is one evidence signal, not a universal product verdict. Test conditions, benchmark versions, source methodology and date can all affect interpretation. Compare shared benchmarks and current product evidence before making a model or tool decision.
Why dates and sources are shown
AI Orbit retains the source and tested date for each verified result so readers can judge whether evidence is current enough for their use case. Older evidence is not silently presented as a new test.