A Little Bit of Reinforcement Learning from Human Feedback
A short introduction to RLHF and post-training
focused on language models.
Abstract
Reinforcement learning from human feedback (RLHF) has become an
important technical and storytelling tool to deploy the latest machine
learning systems. In this book, we hope to give a gentle introduction
to the core methods for people with some level of quantitative
background. The book starts with the origins of RLHF – both in recent
literature and in a convergence of disparate fields of science in
economics, p...
Read more at rlhfbook.com