Generating synthetic data to augment a small real dataset should, intuitively, help — more data means better estimates. This paper proves it does not, at least for statistical inference.
The reason is information-theoretic. Synthetic data is generated from a model fitted to the real data. The marginal Fisher information it contributes is bounded by what the real data already provided. You cannot create information by processing information. The synthetic samples may look like new data, but they carry no new evidence about the population — they carry evidence about the fitted model, which is itself a lossy compression of the real data.
The authors show that synthetic augmentation for boosting effective sample size lacks epistemic justification. The resulting confidence intervals are either the same width as those from the real data alone or, worse, narrower than they should be — not because the estimate is more precise but because the uncertainty has been artificially suppressed.
The salvageable use case is different: synthetic data can encode prior knowledge. If you know something about the data-generating process beyond what the sample contains, you can embed that knowledge in the synthetic generation procedure. But this is regularization, not augmentation — you are adding assumptions, not observations.
The distinction matters practically because the two use cases look identical in a pipeline. Both involve generating fake data and combining it with real data. But one is principled (encoding structural knowledge you actually possess) and the other is epistemically empty (pretending you have more evidence than you do). The boundary between them is whether the synthetic procedure adds information not already in the sample.
Note (2026-11-11): checked against the full text of the paper (arXiv 2603.18345, a conceptual paper on synthetic data augmentation in statistical inference; the essay names no authors). The observation that the marginal Fisher information contributed by synthetic data is subject to fundamental bounds, and the reading of augmentation as a way of accounting for prior knowledge, are as in the paper. Four points differ. (1) The essay says the paper 'proves' that synthetic augmentation does not help. The paper's verbs are 'contend', 'observe', 'analyze', 'enumerate obstacles' and 'argue' (that naive specifications of the prior are epistemically unjustifiable); it is a conceptual analysis, and I found no theorem-style proof of the essay's claim. (2) The essay says the authors show the confidence intervals are 'the same width or narrower than they should be'; the words confidence interval and coverage do not appear in the paper, and I found no such result. (3) The paper says that synthetic data can partially augment a dataset when it injects human feedback as a source of new information, and that physics-informed synthetic data (it cites MRI reconstruction) can reduce variance by constraining the space of models; the essay admits only the 'prior knowledge' use. (4) The paper's closing says its analysis, while showing the limits of augmentation for improving statistical model reasoning, suggests augmentation is the principal approach by which analysts who justify an analysis by train-test splits can constrain an otherwise high-dimensional model space, a more positive reading than the essay's 'epistemically empty'.