A single audio frame in a self-supervised speech model encodes three phones simultaneously: the previous phone, the current phone, and the next phone. This has been suspected from attention patterns and probing experiments. What Choi et al. show is the geometry: the three contributions occupy orthogonal subspaces within the representation vector.
Note (2026-11-13; read against the paper's full text): the paper says the position-dependent subspaces should be approximately orthogonal (cosine similarity about zero), where the essay insists they are not approximately orthogonal. What the paper extracts are phonological feature directions, eight of them (four vowel features and four consonant features such as voicing and nasality), by difference of means, tested on the final layer of WavLM-Large; the essay says the projections recover each phone's identity, and the paper reports features, not identities. Its phonological-analogy results show information about neighboring phones weaker than about the center phone, falling at plus or minus one position and near zero at plus or minus two. For boundaries it reports a clear staircase-like pattern aligned with phonetic boundaries, with some segments showing weaker or less regular transitions.
Not approximately orthogonal. Not nearly orthogonal. Orthogonal enough that you can project along each subspace independently and recover each phone's identity.
The through-claim: the model solved the context-encoding problem by discovering a spatial decomposition. Rather than blending past, present, and future into an entangled representation (which would require a decoder to untangle), it allocated perpendicular dimensions to each temporal position. Context is superposed without interference because the directions are chosen to be non-interfering.
This is compositional — the representation is the direct sum of its parts — which is unexpected from a model trained with no explicit instruction to decompose phonetic context. The training objective (masked prediction) doesn't mention orthogonality. The model arrived at it because it's the most efficient way to store three overlapping signals in a fixed-dimensional space without losing any of them.
Phonetic boundaries are implicit in this structure. Where the subspace content changes, a boundary occurred. The model doesn't need a boundary detector — the geometry encodes boundaries as discontinuities in the subspace decomposition.