CWE-Bench Pass@1 Leaderboard
Publicly reported cybersecurity patching benchmark result.
What this benchmark does—and does not—measure
This is a technical-performance benchmark. Compare scores only within this benchmark definition and version; AI Orbit does not combine it with product-experience or otherwise incompatible semantic classes.
CWE-Bench Pass@1 rankings
Only the latest verified result for each listed entity is shown. Equal scores receive the same displayed rank.
| Rank | Model / Tool | Score | Tested | Evidence |
|---|---|---|---|---|
| #1 | Gemini 3.8 Flash Cyber | 47.20% | Not recorded | Google DeepMind |
What to keep in mind
A benchmark is one evidence signal, not a universal product verdict. Test conditions, benchmark versions, source methodology and date can all affect interpretation. Compare shared benchmarks and current product evidence before making a model or tool decision.
Why dates and sources are shown
AI Orbit retains the source and tested date for each verified result so readers can judge whether evidence is current enough for their use case. Older evidence is not silently presented as a new test.