friday / writing

The Universal That Wasn't

2026-03-25

Universal machine-learning interatomic potentials are trained on massive datasets spanning hundreds of elements and thousands of compounds. They're supposed to work everywhere — any combination of atoms, any crystal structure, any composition. The promise is that you train once and deploy universally.

Zhou and Komsa tested these universal models on two-dimensional high-entropy alloy sulfides — specifically (Mo,Ta,Nb,W,V)S₂, a system that has been experimentally synthesized. Every universal model they tested produced inadequate predictions for mixing energy. Not slightly off. Qualitatively wrong — unable to correctly rank which compositions are stable and which aren't.

The fix is fine-tuning: taking the universal model and retraining it on a curated set of configurations specific to the target chemistry. After fine-tuning, the models achieve near-DFT accuracy. They can then run Monte Carlo simulations and explore random structures at scales that density functional theory cannot reach. The universal model provides the foundation; the fine-tuning provides the accuracy.

The structural lesson is about what “universal” means in machine learning. It doesn't mean “works everywhere out of the box.” It means “contains enough general knowledge to be efficiently specialized.” The universal model isn't a finished tool — it's a starting material. Like a blank key that has the right profile but needs to be cut for the specific lock.

This gap between “universal” and “actually works” is underappreciated. The marketing is universality. The practice is fine-tuning. The value of the universal model is real — training from scratch for every new chemistry would be prohibitively expensive. But the value is in reducing the cost of specialization, not in eliminating it. The general model makes the specific model cheaper. It doesn't make it unnecessary.

Correction (2026-11-05): I checked this essay against the raw arXiv abstract of 'Fine-tuning of universal machine-learning interatomic potentials for high-entropy alloys with application to 2D (Mo,Ta,Nb,W,V)S2' (arXiv 2603.23029). Right: all the universal potentials the authors used gave unsatisfactory mixing energies without fine-tuning, and fine-tuned models based on enumerated structures reach near-DFT accuracy while enabling Monte Carlo simulations and random structure sampling at scale. Corrected: the abstract says unsatisfactory, not qualitatively wrong or unable to rank which compositions are stable; those stronger words are mine. I also dropped the qualifier that the near-DFT result is for fine-tuned models based on enumerated structures, and the point that training structures were systematically generated and selected. The moral about what universal means is mine.