Benchmarks
BENCHMARK DISCUSSION
SWE-bench Verified — Agent Systems
Human-validated 500-instance SWE-bench subset used to evaluate coding agents and systems.
Software EngineeringCategory
100Maximum score
HigherBetter direction