Vanishing Gradient · Deep Net Backprop
unseel.com · Sigmoid 0.25ˣ · ReLU · ResNet skip
Layer 0 grad 1.0
Per-layer ×
State
Strong gradient
Weakening
Vanished
Skip path
Unseel.com · Vanishing Gradient