论文与标准

Training Language Models to Follow Instructions with Human Feedback

以监督示范、偏好比较、奖励模型和强化学习使语言模型更贴近标注者意图。

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, Ryan Lowe · 2022 · Advances in Neural Information Processing Systems 35