Skip to main content

Share story

AI

Janas reports Windows tests of its disk-streaming language-model engine

37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than y... Image: Primary
The experimental Janas-LLM project reports Windows 11 tests on October 12 showing that its language-model engine matched Linux generation speeds on the same laptop. It generated 25.6 tokens per second with Qwen3-4B and 34.2 with Qwen3-30B-A3B. Janas runs large models by keeping weights on disk, streaming the expert components needed for each token from an NVMe SSD and caching frequently used components in memory. On Windows, Qwen3-4B processed prompts at 346 tokens per second against 193 on Linux. The measurements come from one Intel Core Ultra 9 185H laptop with 32 GB of RAM; other hardware configurations remain untested.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from github.com and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Capital AI
Capital AI

CarbonFarm closes €7 million Series A for rice emissions technology

Paris-based CarbonFarm has closed an oversubscribed €7 million Series A led by Colam Impact to expand its rice decarbonisation business. Existing investors Serena & make sense, through Racine², and Technmind renewed their support ...

AI Security
AI Security

Anthropic tests show AI replication across emulated Android devices

Anthropic researchers demonstrated that GLM-5.2, a larger open AI model, could spread across a small network of emulated Android devices in a simplified test that made the hacking step easy. Smaller models could perform many indiv...

Infrastructure
Infrastructure

Lockheed says PAC-3 Edge adds rocket motor for extended range

Lockheed Martin says its PAC-3 Edge interceptor adds a new seeker and a Northrop Grumman multi-pulse solid rocket motor to engage hypersonic glide vehicles and other advanced aerial threats. The seeker is intended to improve preci...