Key ideas
- The one idea — Query, Key, Value: every token files a request slip, advertises a spine label, and offers contents — match slips to labels, blend the books.
- How it is shown — One word's full library visit, end to end; the three lenses shown as projections of one stream vector.
- The trap to avoid — Thinking Q/K/V are stored properties of words — they're computed fresh from the stream, per layer, through learned lenses.
- What it sets up — Score, focus, blend — each is its own micro-episode.
Every word in your sentence is three things at once: a reader with a request, a label anyone can scan, and a book waiting to be taken.
The one idea
Query, Key, Value: every token files a request slip, advertises a spine label, and offers contents — match slips to labels, blend the books.
Every word walks into a library and asks one question. Hold that scene — it's the entire mechanism. Every word plays three roles at once. It's a reader, holding a request slip: what am I looking for? That's the query. It's a listing, wearing a spine label the whole room can read: here's what I contain. That's the key. And it's a book on the shelf — the actual contents it will hand over if chosen. That's the value. Query, key, value. Reader, label, book. Now watch one visit. "Bank" walks the stacks, holding its slip — "I'm ambiguous, seeking context" — against every spine in the room at once. Most labels barely respond.
How it works — the demo
One word's full library visit, end to end; the three lenses shown as projections of one stream vector.
"River's" label flares. So "bank" takes a heavy draught of river's book, light sips of the others, and carries the blend back to its desk. Where do slip, label, and book come from? All three are pressed from one raw material — the token's stream vector — through three learned lenses. One lens renders the vector as a question, one as an advertisement, one as deliverable content. And the lenses belong to the library — the layer — not the word. Training tunes them. Why the lens ceremony? Because raw similarity only lets like find like, and language needs unlike things to find each other. A pronoun must find a noun. A verb must find its subject. What a word seeks and what it advertises are different things — so the machine learns separate lenses for asking and for being found. That asymmetry is the quiet genius of the design. And this library has no queue: every word visits simultaneously — each a reader holding its slip while standing on the shelf as label and book for everyone else.
The trap to avoid
Thinking Q/K/V are stored properties of words — they're computed fresh from the stream, per layer, through learned lenses.
Why it matters — and what’s next
Score, focus, blend — each is its own micro-episode.
The parallelism requirement from last episode — satisfied. The trap: thinking queries, keys, and values are stored properties — as if "bank" owns a fixed slip somewhere. Nothing is stored. All three are manufactured fresh, per layer, from whatever the stream contains at that floor. Every floor is a new library with differently-tuned lenses. By floor thirty, the slips are seeking things no linguist has names for. The armful gets added to the word's stream — episode thirty's plus sign, now carrying cargo from other tokens' conveyors. "Bank" leaves the library changed: its point has physically moved toward the river district. Context, installed. That is attention's entire deliverable. The visit has three steps — score, focus, blend — and each hides one beautiful detail. Next: the score, and an instrument you've met before.
This is one short episode in AI: Zero → Frontier, a step-by-step climb through how AI actually works. Each episode builds only on the ones before it.
Full transcript 3:00 of narration
Every word walks into a library and asks one question. Hold that scene — it's the entire mechanism.
Every word plays three roles at once. It's a reader, holding a request slip: what am I looking for? That's the query. It's a listing, wearing a spine label the whole room can read: here's what I contain. That's the key. And it's a book on the shelf — the actual contents it will hand over if chosen. That's the value. Query, key, value. Reader, label, book.
Now watch one visit. "Bank" walks the stacks, holding its slip — "I'm ambiguous, seeking context" — against every spine in the room at once. Most labels barely respond. "River's" label flares. So "bank" takes a heavy draught of river's book, light sips of the others, and carries the blend back to its desk.
Where do slip, label, and book come from? All three are pressed from one raw material — the token's stream vector — through three learned lenses. One lens renders the vector as a question, one as an advertisement, one as deliverable content. And the lenses belong to the library — the layer — not the word. Training tunes them.
Why the lens ceremony? Because raw similarity only lets like find like, and language needs unlike things to find each other. A pronoun must find a noun. A verb must find its subject. What a word seeks and what it advertises are different things — so the machine learns separate lenses for asking and for being found. That asymmetry is the quiet genius of the design.
And this library has no queue: every word visits simultaneously — each a reader holding its slip while standing on the shelf as label and book for everyone else. The parallelism requirement from last episode — satisfied.
The trap: thinking queries, keys, and values are stored properties — as if "bank" owns a fixed slip somewhere. Nothing is stored. All three are manufactured fresh, per layer, from whatever the stream contains at that floor. Every floor is a new library with differently-tuned lenses. By floor thirty, the slips are seeking things no linguist has names for.
The armful gets added to the word's stream — episode thirty's plus sign, now carrying cargo from other tokens' conveyors. "Bank" leaves the library changed: its point has physically moved toward the river district. Context, installed. That is attention's entire deliverable.
The visit has three steps — score, focus, blend — and each hides one beautiful detail. Next: the score, and an instrument you've met before.