All labsStart this quest
AI ~4 minattention, softmax, temperature
How attention turns scores into focus
Drag a query vector and watch a transformer decide where to look.
AI · ~4 min · live model
Loading the lab…
Make a prediction, then push the model. What you discover is recorded here.
The idea behind this lab (open after you’ve tried it)
Softmax turns similarity scores into weights; lowering the temperature sharpens attention towards a single key.
Go deeper than one lab.
A full quest builds the idea step by step, with checks and a new case to apply it to.