Skip to main content

Share story

Science AI

AI agents benchmarked on quantum circuit visual understanding with cost-accuracy tradeoffs

Researchers introduced Quantum Circuit Vision, a cost-aware evaluation framework testing whether multimodal AI agents can visually comprehend quantum circuit diagrams and generate verified executable code. The benchmark spans 132 circuits across 13 categories (1-10 qubits) with executable Amazon Braket code and unitary-fidelity verification. Evaluating three frontier Claude-family models at different capability-cost tiers over five repeated trials, the mid-tier model (Sonnet 4.6, 1.30× credits) achieved a 91% pass rate on the core subset at 18% of the per-call cost of the strongest model (Opus 4.6), whose accuracy advantage was not statistically significant (paired t-test, p=0.083). Circuit depth, not qubit count, was the primary predictor of failure (p<0.001). Chain-of-thought prompting showed no statistically significant effect (all p>0.18), suggesting visual pattern recognition outweighs explicit reasoning for structurally coupled diagrams. A cascade routing strategy (cheap → expensive models) reached 84% accuracy at 38% of single-model cost, demonstrating that model routing dominates prompt engineering as a cost lever. The QCV-Dataset (132 circuits, five modalities, 1,931 files) and all evaluation code, cost logs, and verification scripts were released on Hugging Face Hub and GitHub.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from arXiv and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
AI Products
AI Products

Tencent plans about $5 billion bond offering to help fund AI spending

Tencent told fixed-income investors Monday that a planned bond offering of about $5 billion would help finance AI-related capital expenditures, Bloomberg reported, citing people familiar with the matter. The offering would provide...

Products Security
Products Security

IonQ agrees to acquire Elisity for up to $1.3 billion in stock

Quantum computing firm IonQ has agreed to acquire Elisity for as much as $1.3 billion in an all-stock transaction, Bloomberg reported. The deal is intended to expand IonQ's cybersecurity platform to address dangers assisted by art...

Security Policy
Security Policy

UK expands AI vulnerability searches into closed government systems

The UK government will expand its use of frontier AI models to find vulnerabilities, moving the next phase into closed government systems. One pilot generated 407 findings across nine government organisations during a month of wee...

AI Infrastructure
AI Infrastructure

AWS launches Ray LLM containers for inference across GPU nodes

AWS has launched Ray LLM Deep Learning Containers for serving language models across multiple GPU nodes, extending its preassembled inference stack beyond single-node deployments. The containers bundle the inference engine, servin...

Infrastructure AI
Infrastructure AI

Microsoft details 96-chip Maia 300 racks and expanded inference network

Microsoft detailed a Maia 300 design that doubles accelerator density to 96 chips in a 167-kW rack and connects up to 12,288 accelerators through one network. The company says the full rack delivers up to 7 times Maia 200's token ...