A General Theoretical Paradigm to Understand Learning from Human Preferences figure
AlphaXiv 中文概览(可滚动查看)