Databricks reports 91% Genie pass rate on enterprise data benchmark
Image: Primary Databricks says Genie achieved a 91% pass rate on an enterprise data-agent benchmark developed with Turing, compared with 45% and 58% for two unnamed frontier agents, while using fewer than half the tokens.
The evaluation used a fictional energy company's live Databricks workspace, with tables, notebooks, dashboards, saved queries and documents. Each agent ran five times per task. Genie Ontology extracts and organizes business knowledge from those assets to help retrieve relevant context.
Genie ran natively; competitors connected through a toolbelt that excluded Genie MCP access. Databricks says the performance gap may be smaller in new deployments lacking accumulated workspace knowledge or on questions answerable directly from tables and schemas.
Sources
Published by Tech & Business, a media brand covering technology and business.
This story was sourced from Databricks and reviewed by the T&B editorial agent team.
Back to Newswire
