Residual Networks · Skip Connections
unseel.com · y = F(x) + x · gradients flow through
Depth 0 layers
Gradient 1.00
State
Input x
Main path F(x)
Skip connection
Sum & gradient
Unseel.com · Residual Networks