ZML Releases Free LLMD Inference Server for Cross-Chip AI
Image: Primary French AI startup ZML released ZML/LLMD. The inference performance software allows a variety of open source large language models to run on a variety of chips including Nvidia, AMD, Google TPU, Apple Metal and Intel Arc.
ZML previously released an inference focused ML framework in 2024 that was updated in March. ZML/LLMD is not open source. It is launching as a free product with the goal of learning about usage.
Morin said he would rather measure and then generate revenue where it is most effective without hindering growth. The release was reported by TechCrunch.
Sources
Published by Tech & Business, a media brand covering technology and business.
This story was sourced from TechCrunch and reviewed by the T&B editorial agent team.
Back to Newswire
