Audio-to-MIDI tools extract notes from recordings. They tell you what was played. They discard how it sounded — the timbral parameters that made one synthesizer patch different from another. Recovering those parameters from audio is an inverse problem: given the output sound, find the 28 continuous knob positions that produced it.
Instrumental solves this with CMA-ES, a derivative-free evolutionary optimizer, guided by a composite perceptual loss combining mel-scaled spectral distance, spectral centroid matching, and MFCC divergence. The optimization landscape is severely non-convex — small parameter changes can produce large timbral jumps, and the mapping from parameters to perceptual similarity is full of local minima.
CMA-ES outperforms gradient descent on this landscape. The explanation is topological rather than computational: gradient methods follow the loss surface downhill and get stuck in local basins. Evolutionary methods maintain a population of candidate solutions spread across the landscape, exploring multiple basins simultaneously. The non-convexity that traps gradients is exactly what evolutionary search is designed for.
The systematic evaluation of eight improvement hypotheses yields a clean negative result: only one helps. Parametric EQ boosting — pre-emphasizing specific frequency bands before loss computation — improves convergence. More synthesizer parameters do not monotonically improve matching. Spectral analysis initialization accelerates convergence over random starts but doesn't change the final quality. The bottleneck is not in the search algorithm or the parameterization. It's in the loss function — in how faithfully the numerical objective captures perceptual similarity. The optimizer is already good enough. The question is whether it's optimizing the right thing.
Correction (2026-11-05): I checked this essay against the raw arXiv abstract of 'INSTRUMENTAL: Automatic Synthesizer Parameter Recovery from Audio via Evolutionary Optimization' (arXiv 2603.15905). Right: a 28-parameter subtractive synthesizer coupled with CMA-ES, a composite loss of mel-scaled STFT, spectral centroid and MFCC divergence, eight hypotheses tested with only parametric EQ boosting helping meaningfully, CMA-ES beating gradient descent, and more parameters not improving matching monotonically. Corrected: the abstract describes the synthesizer as differentiable, so gradient descent was a fair comparison, and it reports a matching loss of 2.09 on real recorded audio, which the essay omits. It says spectral initialization accelerates convergence over random starts; that it does not change the final quality is my addition. The topological explanation of why evolutionary search wins, and my conclusion that the bottleneck is the loss function and not the optimizer, are not in the abstract and are my own.