Share story
Products

Linux module targets higher AI computation rates on Nvidia RTX 3000 cards

Unlock FP/BF16 instruction issue rate on Nvidia 3000's cards to their professional equivalents - Zagitta/gpu-unlock Image: Primary
The gpu-unlock project offers a Linux kernel module that its developer says doubles the instruction issue rate for specified floating-point operations on Nvidia GA102, GA103, GA104 and GA106 cards. It changes speed selectors before the unmodified Nvidia driver takes control, avoiding manual patches with each driver release. User reports cited by the project show LLM prefill gains of 14-36%. Memory bandwidth limits mean LLM decoding stays about the same, as does INT8 work. Reported matrix benchmark gains are not directly comparable because tests and power limits differ.
Sources
github.com
In this story
Nvidia
Published by Tech & Business, a media brand covering technology and business. This story was sourced from github.com and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
AI Products
AI Products

ServiceNow and Nvidia make Arc enterprise agent available on Mac

ServiceNow and Nvidia's Arc enterprise AI agent is now generally available on Mac, ZDNET reported. Originally announced in May, Arc handles work involving tools such as email and Microsoft Teams and can run locally on an employee'...

ZDNET
Products
Products

Nvidia driver adds cloud-precompiled shaders for supported PC games

Nvidia is rolling out driver version 621.01 with support for Microsoft's Advanced Shader Delivery, which moves shader compilation to the cloud to shorten game launches. Nvidia says the system also eliminates mid-game compilation t...

The Verge
Products
Products

Musk plans SpaceX-Tesla merger that would create $3.6T company

Elon Musk is planning to combine SpaceX and Tesla into a company valued at $3.6T, the Financial Times reported. The proposed merger would bring the two businesses into one company, but faces hurdles including shareholder votes and...

Techmeme
AI Products
AI Products

OpenAI expands ChatGPT advertising to 26 additional countries

OpenAI said it is extending ChatGPT Ads to 26 additional countries, bringing availability to 89 countries. Advertisers in the new markets can buy placements through technology partners or through self-service access in Ads Manager...

Unite.AI
Products
Products

Spotify launches native app in five Audi models

Spotify launched a native in-car app for Free and Premium listeners in Audi's A6 e-tron, Q6 e-tron, A5, Q5 and A6 on October 21, the company announced. Available through the Audi Application Store, it runs on the vehicle's infotai...

Spotify