‹ The Decoder

AI 编码代理在独立测试中表现出色,但在模拟工作场所中完成的任务不到十分之一

原文:AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace

The Decoder 本站已缓存

英文正文:点「译成中文」可整篇机器翻译(免费通道,不花钱),翻好永久缓存、下次秒开。

一项新的真实世界测试将 AI 编码代理置于模拟的开发人员工作中,其中有同事、项目看板和不完整的交接,他们必须在混乱的日常工作流程中自行继续开发软件,并可靠地关闭未结工单。即使是 Opus 5.5 和 Astra 也远远达不到要求,完全解决的任务不到十分之一。这些模型能够快速完成明确的独立任务,但它们

Skip to content AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace Image description ChatGPT-5.6 prompted by THE DECODER

AI coding agents are nearing top scores on standard benchmarks. A new experiment puts them to work for the first time as digital employees inside a simulated software company with colleagues, project boards, and chat histories. Even Claude Opus 5.5 and GPT-6 Astra fully complete fewer than one in ten tasks.

Success stories about AI coding agents keep piling up. Anthropic says Claude writes more than 80 percent of the company's production code , and standard benchmarks like SWE-bench are nearly saturated.

THE DECODER+

Continue reading with THE DECODER+

  • Every Plus article and the full archive
  • No ad banners
  • Frontier Radar: 6 deep dives a year
What is included →

First month −50% Monthly $4.99 for the first month Then $9.99 a month. Cancel any time. Subscribe monthly Best value Yearly $8.25 a month $99 once a year. Subscribe yearly

Already a subscriber? Sign in Back to the homepage

"Ask AI" with your Decoder subscription

  • AI perspectives on the topic
  • More context from the archive
  • Get technical terms explained
  • Ask your own questions
Subscribe now Already subscribed? Sign in wpDiscuz

Ask AI Beta

Ask a question about the article or an AI topic. You can ask follow-up questions.

    打开原文 ↗

    正文由本站服务器抓取保存(已自动过滤广告、推荐位与追踪图片),排版与原站可能不同;版权归原站所有。

    相关报道同一事件 / 同分类