The attention mechanism

Ready?

The attention mechanism

Attention lets the model weigh which words matter most for predicting the next token. This allows understanding long-range dependencies in text.

Full screen — no distractions