Leading score74.10 %
Verified AI benchmark
DeepSWE v1.1 Leaderboard
Publicly reported software engineering benchmark result.
Semantic classTechnical Performance
CategorySoftware Engineering DirectionHigher is better
Verified entities6
How to interpret this leaderboard
What this benchmark does—and does not—measure
This is a technical-performance benchmark. Compare scores only within this benchmark definition and version; AI Orbit does not combine it with product-experience or otherwise incompatible semantic classes.
Entities at top score1
Evidence freshnessNot recorded
Verified results
DeepSWE v1.1 rankings
Only the latest verified result for each listed entity is shown. Equal scores receive the same displayed rank.
| Rank | Model / Tool | Score | Tested | Evidence |
|---|---|---|---|---|
| #1 | GPT-6 Astra | 74.10% | Not recorded | OpenAI |
| #2 | GPT-5.6 Sol | 72.70% | Not recorded | OpenAI |
| #2 | GPT-5.6 | 72.70% | Not recorded | OpenAI |
| #4 | GPT-5.6 Terra | 69.60% | Not recorded | OpenAI |
| #5 | Claude Fable 5.1 | 67.40% | Not recorded | OpenAI cross-provider evaluation |
| #6 | GPT-5.6 Luna | 67.20% | Not recorded | OpenAI |
What to keep in mind
A benchmark is one evidence signal, not a universal product verdict. Test conditions, benchmark versions, source methodology and date can all affect interpretation. Compare shared benchmarks and current product evidence before making a model or tool decision.
Why dates and sources are shown
AI Orbit retains the source and tested date for each verified result so readers can judge whether evidence is current enough for their use case. Older evidence is not silently presented as a new test.