Eclipse Aerospace replaces flight-data pipeline with direct Spark decoding

Image: Primary

Published Thursday, November 12, 2026 · 2:41 PM EST

Eclipse Aerospace has replaced a multi-stage flight-data ingestion pipeline with a connector that decodes proprietary files directly inside Spark, Databricks said. The change removes an AWS Lambda processing step and intermediate Avro copies of flight records. The connector wraps Eclipse's existing Rust decoder in Python and transfers decoded records through Apache Arrow without copying the data. Databricks says it can process records within a minute of upload, including startup time, and commonly handles large, multi-gigabyte batches in under two minutes. Eclipse stores more than 3TB of flight data spanning nearly 20 years. The compiled connector requires care over software-version and processor-architecture compatibility.

Sources

Databricks

In this story

Amazon

Published by Tech & Business, a media brand covering technology and business. This story was sourced from Databricks and reviewed by the T&B editorial agent team.

Back to Newswire

Keep reading

Full wire

Infrastructure

Rowan raises about $1.5 billion to advance data center projects

Rowan Digital Infrastructure raised about $1.5 billion in fresh financing from lenders including Citigroup, Bloomberg reported. The Blackstone-backed data center developer is seeking to advance its growing pipeline of projects with the new financing from lenders.

Security

Researchers report 21 N-central servers compromised through new exploit

Attackers have compromised at least 21 production N-able N-central servers through a newly disclosed exploit chain, security company Huntback told BleepingComputer. Nineteen ran the latest Hotfix 2 release, issued November 10. The attacks installed XMRig cryptocurrency miners.

Capital AI

Orakl Oncology raises $34M to expand cancer drug prediction platform

Paris-based Orakl Oncology has raised a $34M Series A co-led by Norrsken VC and Singular, bringing total funding to $50M.

Capital Infrastructure

Mount Thor raises $45 million for Apple silicon cloud infrastructure

Mount Thor announced $45 million in Seed and Series A funding to expand cloud infrastructure built on Apple silicon. CRV and Conviction co-led the Series A; Chad Byers and Offline Ventures co-led the Seed.

Capital

Nebuly raises $21 million to measure the economic value of AI agents

Nebuly raised $21 million in Series A financing to help enterprises measure the economic value of AI agents. Planven led the round for the startup, which is based in Turin and New York.

Capital Infrastructure

Gama raises €15M to move satellite solar arrays into volume production

French satellite equipment company Gama raised a €15M seed round from Transition, Planet A, Draper Associates, and Manta Ray to move its Wing solar arrays into volume production near Paris. The funding covers a production line, expanded testing, and around 60 engineering hires.