Fable 5.2 completes 41.3 percent of freelance jobs in RLI test
Original title: Anthropic's Fable 5.2 completes 41 percent of real freelance jobs, up from 2.5 percent a year ago
Scale Labs says that is up from about 16 percent for Fable 5 in July and 2.5 percent for Manus a year ago.
Scale Labs reported Fable 5.2 finished 41.3 percent of jobs in the Remote Labor Index, nearly twice Opus 5.5 at 21.25 percent and GPT 6 Astra at 20.83 percent. The set covers 240 Upwork projects worth about $144,000, averaging $632.60 and just under 29 hours. Gains were largest in audio, architecture and 3D work, while industrial design and animation remain weak. Human experts still grade outputs because AI reviewers overrate polished but flawed files.
Unconfirmed: The completion rates are Scale Labs benchmark scores, not independently verified job outcomes.
- Fable 5.1 trailed at just under 18 percent.
- Gemini Argon 4 placed fifth at 17.08 percent.
- Nearly 50 completions were jobs no tested agent had solved.
- Agents used Blender, GIMP, Audacity and generative media tools.
- CAIS attempts to automate review with another AI have failed so far.
- Organizations
- Scale LabsCAIS
From the original article
2 min read at the-decoder.com
Anthropic's Fable 5. 2 completes 41. 3 percent of real freelance jobs at professional quality on the Remote Labor Index, more than double the next-best systems Opus 5.
By Maximilian Schreiner · the-decoder.com
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.