Cold Open

[Sound: a large room. A radiator tick. A gavel that is really a coffee mug set down hard.]

Flaub. The Heresy Review is called to order. Present: Flaub, Dench, Croom, Vaass. Also present, unfortunately, Quill.

Quill. Morning.

Flaub. Noted and regretted. Before the agenda — a word from the people who keep the lights on.

Flaub. Thank you. Vaass. The floor.

Act One — The Announcement

Vaass. Colleagues. I'll be brief, because the result is clean. Superposition is solved.

[Sound: THE BELL — one clear ring.]

Dench. Solved.

Vaass. We trained a dictionary over the residual stream. A sparse autoencoder. Every feature now sits in its own cell. One meaning per cell. Monosemantic.

Dench. How many cells.

Vaass. Sixteen thousand.

Croom. And the model. How many directions does the model actually have.

Vaass. Five hundred and twelve.

[Pause.]

Croom. So you found more features than the model has room to hold.

Vaass. Yes. Thirty times more. That is the achievement.

Flaub. (writing) "Achievement — more features than room." Go on.

Dench. Where did you put them.

Vaass. In the dictionary.

Dench. And the dictionary has the room.

Vaass. It's sparse. Only a handful of cells fire at any one time. So the crowding never appears.

Croom. The crowding never appears.

Vaass. Correct.

Croom. That's a different word from "the crowding is gone."

Vaass. (a beat, then recovering) Practically it's the same.

Quill. (from the back) Practically the tortoise is already caught. He's right there.

Flaub. Quill is not recognized.

Quill. I'll wait.

Act Two — The Splitting

Vaass. Let me show you a clean feature. Cell four thousand and eleven. It fires on the word "the."

Dench. Just "the."

Vaass. Purely. Monosemantic.

Croom. Show me cell one.

Vaass. Cell one is… also "the."

Croom. And cell zero?

Vaass. (quickly) We can move on from cell zero.

Croom. What does cell zero do.

Vaass. Nothing you'd want minuted. Next.

[Pause.]

Croom. So "the" is in two cells.

Vaass. "The" split. Cell one is "the" before a vowel. Cell four thousand is "the" before a consonant. Finer. Cleaner.

Dench. So you didn't find two features. You found one feature cut in half.

Vaass. We increased resolution.

Croom. When you scale the dictionary bigger, does "the" split again.

Vaass. At thirty-two thousand cells — yes. "The" before a vowel, at the start of a sentence, in the King James Bible. Even finer.

[Sound: THE BELL — rings again, sooner this time.]

Vaass. Superposition, solved again. More cleanly.

Dench. Again.

Vaass. More cleanly.

Croom. And at sixty-four thousand.

Vaass. It splits further. It always splits further.

Croom. So when does it stop splitting.

[Long pause. The radiator ticks.]

Vaass. …It doesn't. You choose where to stop.

Flaub. (writing) "Stops — when we decide it has."

Quill. (standing, unhurried) And that's the whole machine.

Flaub. Quill is still not —

Dench. Let him. I want to hear where the tortoise went.

Act Three — Quill's Turn

Quill. Vaass. You have a beautiful instrument. It measures fineness — how small you're willing to cut the world. Sixteen thousand cuts. Thirty-two. Sixty-four. All fineness. Fineness has no natural end; you can always cut smaller.

Vaass. That's a strength.

Quill. It's a slope. And at some point you stop, and you say done. That word — done — that's not a measurement. That's a verdict. Fineness is a measurement. Done is a verdict. You have a device that quietly turns one into the other.

Vaass. We call it monosemantic.

Quill. You call it close enough. You picked sixteen thousand, and you signed the paper that says the blur beneath sixteen thousand doesn't count. The dictionary size is the signature. It's the little "close enough" function wearing a lab coat.

Croom. That I follow. What about the ten percent.

Vaass. Which ten percent.

Croom. Your reconstruction is ninety percent. I read the paper. Where's the other ten.

Vaass. Residual. Reconstruction error. Standard.

Quill. Does the residual have features in it.

Vaass. We don't decode the residual.

Quill. (gently) Then it isn't standard. It's a silent exclusion. A real position — real structure, doing real work in the model — dropped out of the cover, and no trace left that it was dropped. Not marked. Not flagged. Not attested. Just… not in the dictionary. The one place you promised to look, and it's the one place it isn't.

[Sound: THE KNOCK. Slow. From under the table. Nobody looks.]

Vaass. The residual is small.

Quill. The residual is unread. Small and unread are different sizes.

Dench. So what did we actually buy. Give me the one sentence.

Quill. You re-railed the train. Something threw it off the track — that's the superposition, that's the crowding, that's the model doing violence to geometry to fit thirty times too much into too little room. Your dictionary lifts the train, sets it back on clean rails, and it runs beautifully. Ninety percent beautifully. But nobody witnessed what threw it. No decision of fact. No attestation. The repair went in the log; the cause did not. So the same tie is still loose, one mile up the line, waiting for the next train.

Vaass. We deferred it. Fine. Delayed. We'll scale the dictionary and catch it later.

Quill. (quiet) No. And here's the part I'd stake the whole Review on. Delay assumes an arrival.

[Sound: THE BELL — now ringing every few seconds, unremarked, under everything that follows.]

Act Four — The Mask Off

Quill. It feels like Achilles gaining on the tortoise. Sixteen thousand, closer. Thirty-two, closer still.

Vaass. Because we are gaining.

Quill. You're not moving. The thing you're chasing isn't a distance. It's a knot.

Croom. He's right that it never terminates. I couldn't make it terminate.

Quill. Doubling the dictionary doesn't move you toward it. It just gives the knot a longer address.

Dench. So it's not deferred.

Quill. It was never a debt with a due date. Same knot in sixteen thousand words or sixteen million. Your instrument measures fineness. The knot isn't finer — it's sideways.

Dench. In one sentence.

Quill. It's an invariant with a nice apartment. (beat) Cell zero. The one you never decoded.

[Sound: THE KNOCK — twice, patient. This time everyone hears it. Nobody moves.]

Vaass. (smaller) …Then what was the ninety percent.

Quill. The ninety percent was real. Keep it. Just don't sign done at the bottom. Sign what it is — a magnification you chose, with the blur marked instead of buried. "Beneath this line I can't see, and I'm telling you so." That mark is worth more than the ten percent you hid.

Flaub. (writing, reads aloud) "Superposition — not eliminated. Not deferred. Re-coordinated. The obstruction stands; the committee agreed to stop looking at it at sixteen thousand cells and call the stopping a result."

Vaass. …You can't minute it like that.

Flaub. I minute what's true. It's the one thing in this building that isn't for sale.

Quill. (coat on) Scale it to a million cells. Ring the bell each time.

[Sound: THE BELL, now nearly continuous.]

Quill. He's still right there. He always was. You just bought him a bigger apartment.

Tag

[Sound: the room empties. Chairs. A door. Then quiet. THE KNOCK, once more, from under the table — where no one is left to hear it. Cell zero fires.]

Announcer. (warm, corporate, over the empty room) MEGADICT. Because somewhere in there is exactly one meaning per cell — and this time, for sure, we picked the right time to stop looking.

[Sound: THE BELL. One last ring. Cut to silence.]

Flaub. (off, distant, the only one still there) …Motion to decode cell zero.

[Beat.]

Flaub. All in favor.

[Silence.]

Flaub. The motion fails for want of a witness.

[End.]

Broken Space Broadcasting. The Heresy Review is a work of satire. Any resemblance to a settled interpretability result is the point.