AI 编码智能体在模拟职场中完成不足一成任务
AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace
一项新实验把 AI 编码智能体放进带同事、项目看板和聊天记录的模拟软件公司中当数字员工,即使 Claude Opus 5.5 和 GPT-6 Astra 也完整完成不到十分之一的任务。相比之下,这些智能体在 SWE-bench 等标准基准上已接近饱和,Anthropic 称 Claude 编写了公司超过 80% 的生产代码。

ChatGPT-5.6 prompted by THE DECODER
AI coding agents are nearing top scores on standard benchmarks. A new experiment puts them to work for the first time as digital employees inside a simulated software company with colleagues, project boards, and chat histories. Even Claude Opus 5.5 and GPT-6 Astra fully complete fewer than one in ten tasks.
Success stories about AI coding agents keep piling up. Anthropic says Claude writes more than 80 percent of the company's production code, and standard benchmarks like SWE-bench are nearly saturated.
来源:The Decoder · the-decoder.com