Unit DL10-U05 · Neural learning and multimodal foundations
Attention and transformer architecture
Trace shapes and information flow in a simplified example.
Outline only
This is an outline, not a lesson yet
The full lesson for this unit has not been written. This page shows what it is planned to teach, how long it is planned to take, and the reading chosen to support it. No explanation, worked example, quiz or task is published for it yet. See content status.
Planned outcome
Trace shapes and information flow in a simplified example.
How it would be assessed
Assessed outcome: Trace shapes and information flow in a simplified example.
Evidence: A task artifact demonstrating the stated action, a verification or comparison record, and a short explanation of uncertainty or failure. Use a new input for the completion check. Allocate the scheduled time across reading, demonstration, lab, quiz, and feedback rather than treating it as reading alone.
Planned time and place
- Planned time
- 5 h in total, including practice and assessment (a planning figure, not tested with learners)
- Module
- DL10: Neural learning and multimodal foundations
- Chapter
- DL10-C03: Attention and measured experiments
- Prerequisite modules
- ML10
- Used in programs
- P07
Selected reading for this topic
Core reading
- Dive into Deep Learning Preliminaries, neural networks, training, generalization, vision, and attention.Try it: Trace shapes and information flow in a simplified example.About this reference (B07)
Supporting reading
- Hugging Face LLM Course Transformers, tokenization, model use, datasets, and adaptation.Try it: Trace shapes and information flow in a simplified example.About this reference (W22)
Advanced
- Attention Is All You Need Original transformer architecture; use a guided reading after attention intuition.Try it: Trace shapes and information flow in a simplified example.About this reference (P01)
Reading is chosen to support the outcome; none of it is compulsory homework. Links go to the owners' own sites and some resources cost money. Reviewed 2026-11-17.