Understanding the Performance Gap in Preference Learning: A Dichotomy of RLHF and DPO

作者：Ruizhe Shi, Minhak Song, Runlong Zhou, Zihan Zhang, Maryam Fazel, Simon Du · 来源：OpenReview · 发布日期：2026