Lesson 19 of 20 · What is AI?
7th Grade · AI for Kids
Transformers and attention
Ready?
Transformers and attention
The transformer architecture uses an attention mechanism that lets the model focus on relevant parts of input. This powers GPT, BERT, and similar models.
Full screen — no distractions