AI 编码代理在独立测试中表现出色,但在模拟工作场所中完成的任务不到十分之一
原文:AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace
英文正文:点「译成中文」可整篇机器翻译(免费通道,不花钱),翻好永久缓存、下次秒开。
一项新的真实世界测试将 AI 编码代理置于模拟的开发人员工作中,其中有同事、项目看板和不完整的交接,他们必须在混乱的日常工作流程中自行继续开发软件,并可靠地关闭未结工单。即使是 Opus 5.5 和 Astra 也远远达不到要求,完全解决的任务不到十分之一。这些模型能够快速完成明确的独立任务,但它们
ChatGPT-5.6 prompted by THE DECODER AI coding agents are nearing top scores on standard benchmarks. A new experiment puts them to work for the first time as digital employees inside a simulated software company with colleagues, project boards, and chat histories. Even Claude Opus 5.5 and GPT-6 Astra fully complete fewer than one in ten tasks.
Success stories about AI coding agents keep piling up. Anthropic says Claude writes more than 80 percent of the company's production code , and standard benchmarks like SWE-bench are nearly saturated.
THE DECODER+
Continue reading with THE DECODER+
- Every Plus article and the full archive
- No ad banners
- Frontier Radar: 6 deep dives a year
First month −50% Monthly $4.99 for the first month Then $9.99 a month. Cancel any time. Subscribe monthly Best value Yearly $8.25 a month $99 once a year. Subscribe yearly
Already a subscriber? Sign in Back to the homepage
"Ask AI" with your Decoder subscription
- AI perspectives on the topic
- More context from the archive
- Get technical terms explained
- Ask your own questions
Ask AI Beta
Ask a question about the article or an AI topic. You can ask follow-up questions.
正文由本站服务器抓取保存(已自动过滤广告、推荐位与追踪图片),排版与原站可能不同;版权归原站所有。