Skip to main content

Share story

AI Infrastructure

Builder runs Kimi K3 on CPU with discontinued Optane memory

Open white PC case with a large CPU cooler and two black blower fans aimed at a row of memory modules Image: Primary
A home server builder ran Moonshot AI's 2.8-trillion-parameter Kimi K3 model without a GPU, using discontinued Intel Optane PMem 200 memory and a 40-core Xeon processor, Tom's Hardware reported. The builder measured 0.85 tokens per second with 1-bit quantization, which reduces the precision used to store model parameters. The system exposes Optane as persistent memory that software accesses directly. Even the smallest community quantization of Kimi K3 requires at least 610GB of RAM. The builder used dual 12W blower fans to cool the modules and warned that sustained inference could endanger neighboring DRAM. The performance measurements preceded thread-count and NUMA-affinity tuning.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from Tom's Hardware and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Robotics Capital
Robotics Capital

GenRobot AI raises $100 million for robot training data infrastructure

Beijing-based GenRobot AI has completed a $100 million Series A+ funding round, TechNode reported. The company develops equipment and software that collect human demonstrations for use in training robots, providing data infrastructure for companies developing robots.

Science
Science

Phase 3 retatrutide trials report weight loss and reduced knee pain

Two Northwestern University-led Phase 3 trials involving more than 1,000 adults found that participants receiving high doses of Eli Lilly's experimental retatrutide lost, on average, up to 25% of their body weight.

AI Products
AI Products

Apple tests development process giving engineers 50% more coding time

Apple is experimenting with a software development process that gives engineers 50% more time to code and explore while reducing time spent on integration, 9to5Mac reported, citing Bloomberg's Mark Gurman. The experiment comes as coding agents have improved.

Infrastructure
Infrastructure

Diamond Foundry says it has made a 200mm single-crystal diamond wafer

Diamond Foundry announced what it calls the world's first 200mm single-crystal diamond wafer, a manufacturing milestone aimed at using diamond to cool semiconductors, including AI chips. The material is estimated to conduct heat at least five times better than copper.