Skip to main content

Share story

AI Policy

Study finds widespread 'cognitive surrender' to AI recommendations

Study finds widespread 'cognitive surrender' to AI recommendations Image: Primary
Research involving over 1,300 participants and 9,000 trials reveals a troubling pattern of "cognitive surrender," where humans routinely defer to artificial intelligence even when its reasoning is demonstrably flawed. The study, conducted by academic researchers, found most subjects exhibited minimal skepticism toward AI-generated suggestions, accepting erroneous conclusions at rates that challenge assumptions about human oversight of automated systems. Participants rarely verified AI outputs independently, instead treating machine-generated content as authoritative regardless of their own domain knowledge. The phenomenon persisted across diverse demographic groups and task types, suggesting systemic rather than situational vulnerability. Researchers warn the findings have implications for high-stakes domains including healthcare, criminal justice, and financial services where AI assistive tools are increasingly deployed. The study adds empirical weight to concerns that human-in-the-loop safeguards may fail if operators lack either the capacity or motivation to challenge algorithmic recommendations. Critics note the research methodology focused on controlled tasks rather than professional contexts where training and accountability pressures might alter behavior.
Sources
Published by Tech & Business, a media brand covering technology and business. This story was sourced from Ars Technica, Techmeme and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
AI Science
AI Science

AI agents develop physical model from quantum-material observations

Researchers report in an arXiv preprint that their AI Theorist system autonomously developed a physical model explaining previously unpublished experimental observations in α-RuCl₃, a candidate material for realizing a Kitaev quan...

AI Policy
AI Policy

Trump creates federal AI task force chaired by Jay Clayton

President Donald Trump announced a Super Intelligence Force to coordinate federal work on advanced AI, saying national intelligence director Jay Clayton would lead it. TechCrunch reports that Clayton will chair the group, with Fed...

Policy AI
Policy AI

California subpoenas OpenAI over AI cybersecurity incidents

California's Department of Justice has subpoenaed OpenAI to obtain information about cybersecurity incidents involving its AI models and agents, Tom's Hardware reported. Attorney General Rob Bonta said the investigation seeks to d...

Products Policy
Products Policy

Boeing awarded US$20-billion Navy fighter development contract

Boeing has been awarded a US$20-billion US Navy contract to develop the F/A-XX sixth-generation fighter, New Atlas reports. Boeing beat rival Northrop Grumman for the contract. The Navy needs a multirole aircraft that can operate...

AI Products
AI Products

Anthropic releases Mods to let developers change Claude Code's behavior

Anthropic released a Mods system that lets developers change Claude Code's interface and behavior through JavaScript or TypeScript functions, The Decoder reports. These functions run inside the coding tool and respond to events su...