Minor DPO reject penalty to increase training robustness

19 August 2024

Papers citing "Minor DPO reject penalty to increase training robustness"

4 / 4 papers shown

Title
Trust Region Preference Approximation: A simple and stable reinforcement learning algorithm for LLM reasoning Xuerui Su Shufang Xie Guoqing Liu Yingce Xia Renqian Luo Peiran Jin Zhiming Ma Yue Wang Zun Wang Yuting Liu LRM 27 1 0 06 Apr 2025
Minor SFT loss for LLM fine-tune to increase performance and reduce model deviation Shiming Xie Hong Chen Fred Yu Zeye Sun Xiuyu Wu 22 0 0 20 Aug 2024
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 306 11,909 0 04 Mar 2022
Fine-Tuning Language Models from Human Preferences Daniel M. Ziegler Nisan Stiennon Jeff Wu Tom B. Brown Alec Radford Dario Amodei Paul Christiano G. Irving ALM 275 1,587 0 18 Sep 2019