Senior SWE-Bench Refresh Adds Trials and Judge Panel
Evaluating agents as senior engineers on the work we actually give them Senior SWE-Bench gets a promotion A refreshed leaderboard with higher reliability, new models, and more insights. Today, we're releasing a few significant improvements to Senior SWE-Bench based on feedback from all of you.…
Senior SWE-Bench got a promotion: a refreshed leaderboard with higher reliability, new models, and more insights. And yes, you read the scores right👀 Read the latest from @henryehrenberg:
Just shipped a few tune-ups to the Senior SWE-Bench leaderboard, and somehow there's a 3-way tie for first: Fable 5, Opus 5, and GPT-5.6 Sol. Yes it's sus. But we've verified it! New blog dives into differences in coverage (pass@k), reliability (pass^k), perf-per-$, and more.
RT @henryehrenberg: Just shipped a few tune-ups to the Senior SWE-Bench leaderboard, and somehow there's a 3-way tie for first: Fable 5, Op…
Original title: Senior SWE-Bench
Samuel Times preserves the original link so every selection remains auditable.