Mixture of Experts ·
Sparse Routing
un
seel
.com · Router · top-k experts · params ≫ FLOPs
Experts
8
Active / token
0
State
—
Token
Idle expert
Chosen (top-k)
Collapsed
▶ Play
←
→
🔇 Unmute
Reset
Un
seel
.com · Mixture of Experts