Label Smoothing · Softening the Target
unseel.com · y' = (1−ε)y + ε/K · ε=0.1, K=5
Correct target 1.00
Max grad 0.00
State
Wrong class
Correct class
Prediction p
Overconfident
Unseel.com · Label Smoothing Unseel.com · Label Smoothing Regularization: Softening One-Hot Targets to Calibrate Neural Networks