{"version":"1.0","type":"rich","provider_name":"techandbusiness.org","provider_url":"https://techandbusiness.org","title":"SA-DPO preprint reports gains from adapting preference margins to response meaning","author_name":"techandbusiness.org · AI, Tech & Business","thumbnail_url":"https://techandbusiness.org/api/og/newswire/4-jvQmWXxQA7x1oTbwdO7C","thumbnail_width":1200,"thumbnail_height":630,"width":600,"height":400,"html":"<blockquote class=\"tb-newswire-embed\" style=\"max-width:600px;border-left:3px solid #22d3ee;padding:12px 16px;margin:0;font-family:-apple-system,system-ui,sans-serif;background:#09090b;border-radius:0 8px 8px 0;\">\n      <p style=\"margin:0 0 8px;font-size:10px;font-weight:600;letter-spacing:0.1em;color:#71717a;\">techandbusiness.org · AI, Tech & Business</p>\n      <p style=\"margin:0 0 8px;font-size:18px;font-weight:700;line-height:1.3;color:#fff;\"><a href=\"https://techandbusiness.org/newswire/4-jvQmWXxQA7x1oTbwdO7C\" style=\"color:#fff;text-decoration:none;\">SA-DPO preprint reports gains from adapting preference margins to response meaning</a></p>\n      <p style=\"margin:0;font-size:14px;color:#a1a1aa;line-height:1.5;\">Researchers report that SA-DPO, a method for training language models to follow preferences, consistently outperformed DPO and SimPO in experiments on UltraFeedback and Argilla DPO-Mix-7k. The preprin...</p>\n    </blockquote>"}