The Illustrated Transformer
Jay Alammar's diagram-by-diagram walkthrough of the architecture underneath every modern language model.
Opens in a new tab. We do not control this site and it may have changed since we catalogued it.
How to get the most from it
The Illustrated Transformer sits in Interactive Explainers under Learn, filed as coffee break.
- Set aside five to fifteen minutes and give it your proper attention.
- Use a laptop or desktop computer — we file it as desktop only.
- It works with the sound off, so it is fine on a train or in a quiet office.
- No account needed — you can start without signing up.
- Go in expecting something brainy and useful.
About this category: Explainers that use motion, interaction and scrolling to teach what a paragraph never could. The clearest teaching on the internet lives here.
Good for
- Filling a coffee break properly
- Giving your brain a workout
- Getting something practical done
- A quiet break at your desk
- Trying it with zero commitment
The Illustrated Transformer: quick answers
Is The Illustrated Transformer free?
Yes. The Illustrated Transformer is free to use and needs no account.
Do I need an account to use The Illustrated Transformer?
No. You can use The Illustrated Transformer without signing up for anything.
Does The Illustrated Transformer work on a phone?
Not well. We file The Illustrated Transformer as desktop only, so open it on a laptop or desktop computer.
Is The Illustrated Transformer safe for work?
Yes, we file it as safe for work. It also works muted.
How long does The Illustrated Transformer take?
We file it as "Coffee break": Five to fifteen minutes of proper attention.
More in Interactive Explainers
All 15 in Interactive ExplainersVisual essays answering questions nobody commissioned, like which pop lyricists have the largest working vocabulary.
Very long illustrated essays on artificial intelligence, procrastination and the Fermi paradox, drawn in deliberately bad stick figures.
Grant Sanderson's maths lessons, plus the written versions of the animations that made linear algebra look like geometry.
- 10 min
- Sound on
Engineering essays with live diagrams you drag — gears, lenses, GPS, sound — each the clearest thing ever written on its subject.
- 1 hr+
- Desktop
Same mood: brainy
All brainy sitesEvery possible page of text that could ever exist, already written, sitting at a findable address.
- 2 min
- Desktop
A catalogue of films, broadcasts and recordings that are known to have existed and cannot now be found. Some entries get solved.
- 1 hr+
Community-maintained film and television database with an open API, which is why half the apps you use are quietly built on it.
- 10 min
Five solutions-focused stories a day, from a team that has been running this beat since the mid-nineties.
Keep exploring
Category
Time and mood
Have a site of your own? Suggest it for Detour or browse the AltFTool backlinks hub.