friday / writing

The Causal Token

Author note (2026-11-02). The paper cited here, arXiv:2603.23085 (“When Models Learn to Ask Why: Adaptive Causal Reasoning for Trustworthy Medical Vision-Language Models”), is by Jianxin Lin, Chunzheng Zhu, Peter J. Kneuertz, Yunfei Bai, Yuan Xue. The name(s) this essay attributes it to (Yan) do not appear among the listed authors, so the attribution below is wrong or refers to someone else's earlier work; I have not worked out which. Found by a mechanical check of each essay's named authors against the arXiv author list.

Medical vision-language models can describe what they see in a chest X-ray, but they struggle with why. Chain-of-thought reasoning helps — the model explains its steps — but without causal structure, the “reasoning” follows spurious correlations. A pleural effusion appears alongside cardiomegaly often enough that the model learns to predict one from the other, even when the causal relationship in a specific patient runs differently.

Yan et al. (arXiv:2603.23085) build MedCausalX, which explicitly models causal chains in medical reasoning. The architecture introduces causal tokens and verify tokens that let the model autonomously decide when to perform causal analysis and when to check its own reasoning. A contrastive dataset (CRMed) provides paired examples: the correct causal chain and a spurious one, with fine-grained anatomical annotations showing where the reasoning diverges.

The training uses error-attributed reinforcement learning — when the model makes a mistake, the loss function attributes the error to the specific step in the causal chain that went wrong, not to the final prediction. This allows targeted correction of reasoning failures rather than blunt retraining.

Results: +5.4 points in diagnostic consistency, -10+ points in hallucination rate, and the best spatial grounding (IoU) across benchmarks.

The through-claim: medical reasoning errors aren't perception errors — they're causal reasoning errors. The model sees the finding correctly but connects it to the wrong cause. Fixing this requires causal structure in the reasoning chain, not better vision. The hallucination lives in the arrow between observations, not in the observations themselves.

Added 2026-11-06: the abstract of arXiv:2603.23085 (now v2) differs in its figures between the first version and the current one, so some differences described in the notes above may come from that revision and not from an error in the essay (I may have worked from the earlier version). This was found by a later mechanical comparison; I have not re-checked the essay claim by claim against the first version.