Skip to main content

Share story

AI

Ollama now powered by MLX framework for fastest Apple Silicon performance

Ollama now powered by MLX framework for fastest Apple Silicon performance Image: Primary
Ollama is previewing the fastest way to run its application on Apple Silicon powered by Apple's MLX machine learning framework. The implementation builds on the framework to take advantage of unified memory architecture. This produces a large speedup of Ollama on all Apple Silicon devices. On M5, M5 Pro and M5 Max chips the update uses GPU Neural Accelerators. These improve time to first token and generation speed in tokens per second. Testing was conducted on March 29, 2026 using Alibaba's Qwen3.5-35B-A3B model quantized to NVFP4. The previous implementation used Q4_K_M quantization with Ollama 0.18. Ollama said version 0.19 will deliver higher performance with int4 quantization. The preview accelerates the Qwen3.5-35B-A3B model with sampling parameters tuned for coding tasks. A Mac with more than 32GB of unified memory is required.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from Ollama and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Science
Science

Infleqtion claims 30 entangled logical qubits on Sqale system

Infleqtion says it created 30 entangled logical qubits on its Sqale quantum computing system, a company-reported step toward operations across error-protected quantum bits. A logical qubit encodes information across multiple physi...

Security
Security

NFM Lending faces lawsuit after acknowledged cyber incident

NFM Lending faces a class-action lawsuit after acknowledging a cybersecurity incident, The Tech Edvocate reports. Former customer Sheneka Smith alleges that the mortgage lender failed to maintain reasonable safeguards for customer...

AI Capital
AI Capital

Chinese local governments offer incentives to AI filmmakers

Reuters reports that Chinese local governments are offering computing vouchers, rent waivers and dedicated funding to attract filmmakers using artificial intelligence. These incentives reduce the cost of computing and premises for...

Capital AI
Capital AI

Island closes $400 million Series F at $6.4 billion valuation

Enterprise software startup Island has closed a $400 million Series F round led by Evolution Equity Partners, valuing the company at $6.4 billion. Prysm Capital, Sequoia Capital, Coatue Management, Cyberstarts, Insight Partners an...

Products Capital
Products Capital

Databricks acquires spreadsheet startup Row Zero

Databricks announced Thursday that it has acquired Row Zero, a startup whose cloud spreadsheet handles more than 1 million live rows. Its finance team had been using Row Zero alongside Genie, Databricks' AI agent for asking questi...