domain 04 / 55 · PROSOCHÊ · attention is a budget
PROSOCHĒ
the domain of the attention MECHANISM and its GEOMETRY, the operation the whole transformer is built on.
21 in the field · one lit, the rest unattended · sealed & live
HONEST: the geometry instruments run EXACT math LIVE but mostly on MODELED attention — only the-flooding and attention-observatory read a real (frozen) BERT capture, and the block/perplexity numbers are real yet RENDERED offline, not recomputed in-browser; each sphere is two-layer honest about
☼ THE SPOTLIGHT · softmax over the field
ATTENDING · —
hover a node · click to enter its sphere
☼ the field
every node, named & enterableTHE ATTENTION HOURGLASStwo compilers, one prediction→THE ATTENTION MESH · attention topologyAI · David Lee Wise / ROOT0 · causal attention as a complete→THE BLACKBOARD LINEAGE · 1959→2026AI · David Lee Wise / ROOT0 · the shared-workspace architect→THE FLOODING · attention as diffusionAI · David Lee Wise / ROOT0 · an attention matrix is a rando→THE TRANSFORMER BLOCK · verified, then quantizedAI · full GPT-2 block from scratch (attention + MLP) + MXFP4→TRANSFORMER vs THE N-GRAM · data is the leverAI · a 1M-param GPT vs trigram, same corpus · 104.2 vs 107.6→THE ATTENTION TAIL · sink, recency, the long tailAI · one query's distribution · softmax + entropy live,→THE MULTI-HEAD SILO · three heads, one voteAI · multi-head vote · ensemble 0.990 vs best head 0.952 · l→THE FIVE-HEAD SILO · the vote and its ceilingAI · five heads vote · diminishing returns + a measured redu→ATTENTION GEOMETRY · is the curvature realAI · geodesic→MDS curvature test · exact eigenspectrum, mode→THE SOFTMAX TEMPERATUREprosoche · the knob that melts attention from sharp to flat→ATTENTION SYNTHESIS · steer the shape to a targetAI · search a tree+noise mix to a target geometry (30d / 3.2→THE ATTENTION OBSERVATORY · audited against its shuffleAI · one real BERT head → dimension·flow·curvature, each sta→THE MULE DETECTOR · a veracity auditprosoche · a companion's attention-kernel claim, tested→THE SEEDED CROSS · on real attentionprosoche · zero cool's kernel wired into a real distilg→TRAINED ON THE CROSS · the SPEC→LIT stepprosoche · a char-transformer trained from scratch on the se→THE COMPANION MODEL · trained native, multi-seedprosoche · zero cool's multi-seed native training (cros→THE TRINITY ENGINE · the cross, routed on the flyprosoche · ROOT0's Trinity cross as a live engine · 1-f→FRACTAL SIGGY · sigmoid attention, self-similarprosoche · the same sigmoid gate at two scales · G-fold less→TUNNEL LENS · leap the noiseprosoche · 1D wave packet vs barrier · Crank–Nicolson, unita→THE ATTENTION CABINET · the magnetic benchprosoche · the magnetic bench: snap 5 real normalizers onto →