arxiv
PublishedOctober 28, 2026 at 4:00 AM
$\xi$-DPO: Direct Preference Optimization via Ratio Reward Margin
Publisher summary· verbatim
arXiv:2605.10981v2 Announce Type: replace Abstract: Reference-free preference optimization has emerged as an efficient alternative to reinforcement learning from human feedback, with Simple Preference Optimization(SimPO) demonstrating strong performance by eliminating the explicit reference model th
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivMAGNET: Manifold-Aware Graph Diffusion Network for Connectome Generation2harxivCounterfactual Model Testing Under Distribution Shift2harxivCentralized Critics for N-Agent Ad Hoc Teamwork2harxivWhere and What to Reward? Understanding Generalization Between Verifiable and Open-Ended Domains in Reinforcement Learning2hThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗