Skip to main content

Share story

Science AI

Survey of 27 Papers Identifies Six Failure Clusters in LLM Agents

A synthesis of 27 benchmark, taxonomy, and audit papers spanning 19 distinct benchmarks (2023-2026) identifies six cross-cutting failure clusters in large language model agents. The taxonomy integrates evidence across tool use, planning, long-horizon reasoning, multi-agent coordination, safety, and measurement validity. The six clusters are: tool invocation and parameter-level errors; planning and constraint-satisfaction failures; long-horizon degradation from context accumulation; multi-agent coordination failures; safety and security failures under adversarial or underspecified conditions; and measurement validity problems. Failures compound nonlinearly with task length, strong performance on individual sub-tasks does not reliably translate to end-to-end success, and additional scaffolding does not consistently improve reliability. Progress has been demonstrated in single-turn tool use, short-horizon web navigation, and narrowly scoped coding tasks. The taxonomy was derived iteratively by grouping independently reported error categories into themes corresponding to distinct stages of the agent reasoning-to-action pipeline.
Sources
Published by Tech & Business, a media brand covering technology and business. This story was sourced from cs.AI updates on arXiv.org and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Products
Products

Paramount closes $110 billion Warner Bros. Discovery acquisition

Paramount has completed its $110 billion acquisition of Warner Bros. Discovery, creating a combined company called Skydance, The Verge reports. The transaction brings the companies' film studios, streaming services and brands incl...

Robotics
Robotics

Waymo reportedly increases inaugural debt raise to $5 billion

Waymo increased its inaugural debt raise from $3B+ to $5 billion, Bloomberg reported, citing sources. The robotaxi company is tapping lenders to finance growth as it expands globally. The larger raise comes as Waymo faces rising ...

Capital AI
Capital AI

Flai raises $27 million for dealership AI software

Flai said Tuesday it raised a $27 million Series A led by Base10 Partners for its AI software serving car dealerships. Investors included Friedkin Group, Findlay Automotive, Toyota's venture arm, Y Combinator and First Round Capit...

Capital
Capital

Vinci raises $250 million at $1.5 billion valuation

Software startup Vinci said Tuesday it raised $250 million at a $1.5 billion valuation, Reuters reported. The company makes software that simulates elements of chip and other hardware design and is seeking to expand its suite of s...

Security AI
Security AI

Dimon says cyberattack risks rose 10-fold after Mythos release

JPMorgan Chase CEO Jamie Dimon says cyberattack risks have risen 10-fold since Anthropic released its Mythos AI model. Speaking to Bloomberg at the JPMorgan Tech Stars Conference in London, he said artificial intelligence has expo...

Products Capital
Products Capital

Uber agrees to buy workplace catering platform ezCater for $2.3 billion

Uber has agreed to acquire workplace catering platform ezCater for $2.3 billion in cash, MoneyCheck reported. Uber plans to integrate ezCater's catering infrastructure into Uber Eats and Uber for Business, expanding its corporate ...