Transformer Attention ·
softmax(QKᵀ/√d) V
un
seel
.com · Self-attention · O(n²·d)
Sequence
"the cat sat on the mat"
Heads
1
Stage
tokens loaded
Token
Query (Q)
Key (K)
Value (V)
Play
Pause
Unmute
Reset
Un
seel
.com · Transformer Attention