Layer Normalization ·
One Sample, d Features
un
seel
.com · Normalize across features · O(d) per token
μ
—
σ²
—
Step
—
Feature xᵢ
Mean μ line
Normalized x̂
Output y = γx̂+β
▶ Play
←
→
🔇 Unmute
Reset
Un
seel
.com · Layer Normalization
Un
seel
.com · Layer Normalization: Per-Sample Feature Normalization for Sequence Models