pass@1

pass@1 is the metric on SWE-bench Pro V2 HARD. higher is better. Ceiling 100. Methodology v1.0.

• SOTA
• co-SOTA
• near-SOTA
• was SOTA
• pending
• style control
• Elo/Bradley-Terry