Research Questions Standard Definition of Epistemic Uncertainty in Machine Learning
A new preprint posted to arXiv proves that the standard definition of epistemic uncertainty and its standard mathematical measure are formally inconsistent with each other. The paper constructs an explicit counterexample in which the mutual-information-based measure assigns all uncertainty to the epistemic class, yet no amount of additional training data reduces it. This matters because epistemic uncertainty estimates are widely used in active learning, out-of-distribution detection, and safety-critical AI systems.
The paper, submitted to arXiv on June 10, 2026, targets a cornerstone assumption in Bayesian and probabilistic machine learning: that epistemic uncertainty is the component of predictive uncertainty reducible by collecting more data, and that mutual information between model parameters and predictions is its correct quantification. The authors prove these two characterizations are extensionally inconsistent, meaning they disagree on which uncertainties are epistemic in concrete cases. They propose a finer three-part taxonomy — aleatoric, sample-reducible epistemic, and mechanism-reducible epistemic uncertainty — and derive an exact identity showing that in-distribution data never reduces mechanism-irreducible uncertainty and can actually increase it. The paper also critiques ensemble disagreement, the most commonly deployed proxy for epistemic uncertainty in practice, showing it tracks training procedure artifacts rather than true epistemic content: it collapses to zero even when genuine uncertainty exists under consistent training, and reflects initialization noise under interpolation. The theoretical claims are supported by a finite-sample falsification test and seed-swept empirical experiments. If the findings hold up to peer review, they would require significant revision of how uncertainty is measured and interpreted in deployed machine learning models.
What's missing
As a preprint, this work has not yet undergone formal peer review, and independent replication of the theoretical proofs and experiments has not been reported. The paper's practical implications for specific deployed systems — such as how large language models or medical AI tools would be affected — are not addressed.
What different sources said
- arXiv stat.MLCenter
Epistemic Uncertainty Is Not the Reducible Kind
Related
Gut Bacteria Enzyme Found to Break Down Heat-Processed Food Compounds, Producing Novel Biogenic Amines
Researchers have discovered that an enzyme in common gut bacteria can degrade N-epsilon-carboxymethyllysine (CML), a compound formed during thermal food processing, producing previously unknown biogenic amines. The enzyme, ornithine decarboxylase SpeC from enterobacteria, acts on CML and related modified lysine derivatives through a low-level 'underground' catalytic activity. This finding suggests a previously unrecognized communication axis between thermally processed dietary compounds and gut microbial physiology, with potential implications for host health.
Full-Length Gene Sequencing Reveals Two Distinct Bacterial Communities in Black-Legged Ticks Expanding Into Canada
Researchers used Oxford Nanopore full-length 16S rRNA gene sequencing to characterize the microbiome of Ixodes scapularis black-legged ticks collected in Nova Scotia, Canada, distinguishing between tick-adapted bacteria and environmentally acquired bacteria. The study comes as I. scapularis — the primary vector of Lyme disease — is rapidly expanding northward into Canada due to climate change. The findings suggest that environmentally derived bacteria in tick microbiomes are not mere contamination, which has implications for how tick microbiome data is collected and interpreted across surveillance studies.
Study Identifies Metabolic Link Between Cell Envelope Stress and Biofilm Formation in Bacteria
Researchers have discovered that the metabolite acetyl-CoA directly inhibits enzymes that degrade the bacterial signaling molecule c-di-GMP, connecting cell envelope biosynthesis stress to biofilm formation in Pseudomonas aeruginosa. The study found that sub-inhibitory concentrations of antibiotics targeting early peptidoglycan biosynthesis — but not other antibiotic classes — elevate c-di-GMP levels by reducing phosphodiesterase activity, with acetyl-CoA competing for the enzyme active site. Because the relevant enzyme domain is broadly conserved across bacterial species, this checkpoint mechanism may be widespread and could have implications for understanding antibiotic-induced biofilm responses.