Skip to main content

Share story

AI Infrastructure

ggml 1.0.0 adds FP8 support and breaks compatibility with older RPC peers

Overview
ggml 1.0.0 prunes the deprecated public API and the legacy DIAG_MASK ops, adds configurable YaRN truncation and FP8 support, and brings broad performance work across backends: few-row quan... Image: Primary
ggml 1.0.0 adds FP8 support on CUDA and new execution paths across hardware backends, according to its release notes. The release also removes deprecated public interfaces and legacy masking operations, updating its remote procedure call protocol to reject incompatible peers. The scheduler now avoids uploading inputs that computations do not read. A cache for mixture-of-experts models can compute a share of cache misses on the CPU and copy results back asynchronously. Other additions include an Intel FlashAttention prefill kernel on Vulkan and a device-side mixture-of-experts scheduler on SYCL. The RPC protocol moves to v9, with faster loading and graceful failure on unreachable endpoints or failed handshakes.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from GitHub and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
AI Capital
AI Capital

Luminal raises $25 million Series A led by Standard Capital

Luminal raised a $25 million Series A led by Standard Capital, CEO Joe Fioti told Axios Pro. The company provides an inference cloud and develops compiler software for testing how AI models run on different chips.

Science AI
Science AI

EvoX preprint reports higher agent task success through runtime controls

A preprint introduces EvoX, a Rust-based runtime for AI agents, and reports a 56.2% success rate across 691 common task-model pairs. That was the highest numerical result among six agent harnesses, approximately 3.0 percentage points above the average of the other five.