Databricks releases beta loader that streams governed tables to training GPUs

Image: Primary

Published Monday, November 9, 2026 · 10:43 AM EST

Databricks has released UCDataset in beta on AI Runtime, allowing PyTorch training jobs to stream Delta tables from Unity Catalog directly to GPUs without exporting a separate copy. The loader divides matching rows across GPUs and data-loader workers, removing the need for custom code to allocate those rows. Databricks reports a 10x improvement in training time against loading Parquet data in a simulated production workload using a 300 GB feature table and 8 NVIDIA H100 GPUs. Jobs use the running identity's table permissions. The beta cannot read tables with row filters or column masks; support for images, audio and documents through table files is still being expanded.

Sources

Databricks

In this story

Nvidia

Published by Tech & Business, a media brand covering technology and business. This story was sourced from Databricks and reviewed by the T&B editorial agent team.

Back to Newswire

Keep reading

Full wire

Capital Products

U.S. Series A funding reaches $42 billion as deal counts hold steady

U.S. startups raised $42 billion in Series A funding through October 2026, up roughly 60% year over year, while deal counts remained on pace with recent years, Crunchbase data shows.

Products

Ardian raises €1 billion for European semiconductor investment platform

Ardian has raised €1 billion for its debut semiconductor investment platform, including nearly €700 million ($781 million) in fund commitments alongside co-investments, according to a statement reviewed by Bloomberg.

Capital

Nominal raises $240 million at a $3 billion valuation

Nominal has raised $240 million at a $3 billion valuation, triple its valuation in a funding round earlier this year, Bloomberg reports. The startup builds software to make manufacturing more efficient.

Capital Products

Onodrim raises $300M to acquire European defence and industrial suppliers

Amsterdam-based Onodrim Industries has raised $300M in a round led by Lux Capital, valuing the defence group at $1.3bn, the company said Monday. Other investors include General Catalyst, Lakestar and Altimeter. The financing follows its €40M seed round in February.

AI Policy

House lawmakers request Huang briefing on Nvidia security and alleged intelligence ties

House lawmakers requested a closed-door briefing from Nvidia CEO Jensen Huang on the company's protections against espionage and his interactions with Megaspeed executive Alice Huang, Tom's Hardware reported.

Capital

SRTD Biotech raises €31.5 million for targeted RNA therapies

SRTD Biotech has completed an oversubscribed €31.5 million seed financing to develop RNA therapies designed to act selectively inside diseased cells. Mérieux Equity Partners led the round, with NRW.BANK and Boehringer Ingelheim Venture Fund joining as co-leads.