RLHF · Aligning to Human Preference
unseel.com · Reward model · PPO · KL leash
Reward 0.00
KL drift 0.00
Stage —
Prompt / policy
Preferred answer
Rejected answer
Reward model
Unseel.com · RLHF