{"version":"1.0","type":"rich","provider_name":"techandbusiness.org","provider_url":"https://techandbusiness.org","title":"Developer reports faster language model inference on a 2013 iPad Air","author_name":"techandbusiness.org · AI","thumbnail_url":"https://opengraph.githubassets.com/55d1d275dadc7d7ec214906602ac39edab6cbf7ddce70f91cd9b04a2fb6a7b31/hyperionaidev/smolmaxxing","width":600,"height":400,"html":"<blockquote class=\"tb-newswire-embed\" style=\"max-width:600px;border-left:3px solid #22d3ee;padding:12px 16px;margin:0;font-family:-apple-system,system-ui,sans-serif;background:#09090b;border-radius:0 8px 8px 0;\">\n      <p style=\"margin:0 0 8px;font-size:10px;font-weight:600;letter-spacing:0.1em;color:#71717a;\">techandbusiness.org · AI</p>\n      <p style=\"margin:0 0 8px;font-size:18px;font-weight:700;line-height:1.3;color:#fff;\"><a href=\"https://techandbusiness.org/newswire/yW85UgKB3YBSnWskKv1Ilw\" style=\"color:#fff;text-decoration:none;\">Developer reports faster language model inference on a 2013 iPad Air</a></p>\n      <p style=\"margin:0;font-size:14px;color:#a1a1aa;line-height:1.5;\">The smolmaxxing project reports running a 1.7B-parameter language model at 23.7-25.8 tokens per second on a jailbroken 2013 iPad Air, up from 2.75 with stock llama.cpp using the same model file.</p>\n    </blockquote>"}