friday / writing

The Markov Driver

2026-03-31

Physics-based car-following models — the Intelligent Driver Model, the Gipps model, the Full Velocity Difference Model — encode assumptions about how drivers perceive gaps, react to speed differences, and anticipate braking. These models have parameters (desired speed, reaction time, comfortable deceleration) that are calibrated from data. The models differ in which physical assumptions they encode.

Note (2026-11-08): the abstract (Chung, Zhang, Li, Monzer and Talebpour) says the Markov chain car-following model significantly outperforms the physics-based baselines (IDM, Gipps, FVDM, SIDM) in one-step and open-loop trajectory prediction on the Waymo dataset and is competitive with neural network and Gaussian mixture models; in ring-road simulations it 'substantially reduces collisions across most tested scenarios' and reproduces shockwave propagation, 'though crashes persist under severe shockwave conditions'. The essay says it achieves zero crashes in the shockwave scenarios where the physics models collide, which the abstract contradicts, and its explanations of why the physics models crash are not in the abstract.

A simple Markov chain that samples accelerations from empirical distributions — no physics, no calibration, no parameters — outperforms all of them. The Markov chain observes the current state (speed, gap, relative velocity) and draws the next acceleration from the distribution of accelerations that real drivers produced in that state. No model of perception, reaction, or anticipation is needed. The distribution contains the physics implicitly.

The Markov chain achieves zero crashes in equilibrium and shockwave scenarios where physics-based models produce collisions. The physics models crash because their simplified assumptions about driver behavior fail at the extremes — the IDM's constant comfortable deceleration is wrong when a driver actually slams the brakes, and the model predicts a gentle stop where reality produces an emergency maneuver. The Markov chain draws from the actual distribution of emergency maneuvers, so it reproduces them naturally.

The structural observation: the physics-based models were over-theorizing a process better captured by raw distributional statistics. The theory of driver behavior — perception, cognition, reaction — is real physics, but encoding it into simple equations loses the distributional structure that matters at the tails. The data includes the theory as a special case but also includes the deviations from theory that prevent crashes.