Direct Preference Optimization: Your Language Model is Secretly a Reward Model
A new approach to RLHF that directly optimizes language model preferences without a separate reward model...
Rafailov, Sharma, Mitchell, et al.
NeurIPS 2023 · 3,812 citations