RLHF

Reinforcement learning from human feedback: training a model to prefer answers people rated as better, used to make it more helpful and safe.