Skip to main content

Share story

AI Infrastructure

Helion enables GPU kernel settings that bypass autotuning

Helion enables GPU kernel settings that bypass autotuning Image: Primary
Helion now selects GPU kernel settings at compile time without benchmarking alternative configurations, PyTorch announced. The heuristics are merged and enabled by default for H100 and B200 GPUs using the Triton backend. The compiler examines operations and dataflow to choose settings such as block sizes and parallel execution groups. PyTorch reports performance of 1.27x vLLM's handwritten CUDA operators across 153 kernel-and-shape combinations covering six reduction kernels on H100, compared with 0.58x for Helion's previous default. The change offers developers an alternative to spending GPU time tuning each kernel and shape. Kernels whose dimensions are not all known at compile time still fall back to the original default.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from PyTorch and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Capital AI
Capital AI

Norwest raises $4 billion fund targeting AI startups and overlooked sectors

Wells Fargo & Co.-backed Norwest has raised $4 billion for its latest investment fund, Bloomberg reported. The fund will target early-stage AI startups alongside deals in sectors other investors have overlooked. The firm plans to announce the fund Thursday.

Infrastructure
Infrastructure

Rowan raises about $1.5 billion to advance data center projects

Rowan Digital Infrastructure raised about $1.5 billion in fresh financing from lenders including Citigroup, Bloomberg reported. The Blackstone-backed data center developer is seeking to advance its growing pipeline of projects with the new financing from lenders.