The Trickle-down Impact of Reward (In-)consistency on RLHF figure
AlphaXiv 中文概览(可滚动查看)