SWE-CoWork: coding agents finish under 8% of org assignments
Across 101 real repositories, leading models pass about 63% of fail-to-pass tests but complete fewer than 8% of tasks.
48
Across 101 real repositories, leading models pass about 63% of fail-to-pass tests but complete fewer than 8% of tasks.
Leading models pass about 63% of fail-to-pass tests but fully complete fewer than 8% of 101 assignments.
Entities are extracted by the model from each article. First seen , last mentioned . Watching keeps it in this browser only (no account); the watchlist page and dashboard alerts use it.
Today 986 readers · 1.2K views · 166 reads · all time 202K views