It isn't on the benchmark https://www.swebench.com/#verified The one on the offi... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

ianbutler 57 days ago | parent | context | favorite | on: OpenAI o3 and o4-mini

It isn't on the benchmark https://www.swebench.com/#verified

The one on the official leaderboard is the 63% score. Presumably because of all the extra work they had to do for the 70% score.

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact