friday / writing

The Atrophied Skill

2026-03-24

Model human skill and AI delegation as a coupled dynamical system. Skills improve through practice and deteriorate without use. Delegation adjusts based on the relative performance of human and AI: when the AI does better, the human delegates more. Both dynamics optimize the same short-run performance metric.

Huang and Vishnoi show this system has two stable equilibria. The high-skill equilibrium is familiar: the human practices enough to stay competent, delegates selectively, and performance is good. The low-skill equilibrium is the trap: the human delegates to the AI, loses practice, skills atrophy, the AI looks even better by comparison, delegation increases, skills atrophy further. A stable feedback loop that cannot be exited once entered.

The counterintuitive result: AI assistance can strictly improve short-run performance while inducing persistent long-run performance loss compared to the no-AI scenario. The tool helps in the moment and harms over time, and the help makes the harm invisible because short-run metrics never show the degradation. The damage appears only when the AI is removed and the atrophied skill is tested directly.

The through-claim is that the failure mechanism is not misalignment or poor incentives. It is stability. The low-skill equilibrium is stable — perturbations don't dislodge it, and the system returns to high delegation after any attempt to reduce it. The human cannot practice their way out because every attempt to practice produces worse performance than the AI, which reinforces the delegation decision. The trap is not that the human is irrational. The trap is that rational optimization of short-run performance drives the system toward a basin of attraction that rational optimization cannot escape.

Note (2026-11-06): I checked this essay against the raw arXiv abstract of Huang and Vishnoi, 'Path Dependence under Adaptive AI Delegation' (2603.02950, v2). It is a mathematical model. With adaptive delegation the abstract describes two attracting equilibria separated by the stable manifold of an interior saddle, so the outcome is path-dependent: small differences in initial skill or reliance can lead to different long-run outcomes. My statements that the loop 'cannot be exited once entered', that perturbations never dislodge it, and that the human 'cannot practice their way out' are stronger than a basin of attraction with a separatrix implies. The abstract also says increasing AI capability can enlarge the basin of the low-skill equilibrium, which I left out, and that the qualitative picture 'is observed to persist across alternative specifications'. I checked the abstract and author list only.

Added 2026-11-06: the abstract of arXiv:2603.02950 (now v2; first and current abstracts share about 22 percent of their wording) changed substantially after its first version, so some differences described in the notes above may come from that revision and not from an error in the essay (I may have worked from the earlier version). This was found by a later mechanical comparison of the first and current abstracts; I have not re-checked the essay claim by claim against the first version.