Research Shows Edge of Stability Phenomenon Selectively Affects Learning Across Training Data Groups
Researchers have shown that the 'edge of stability' (EoS) phenomenon in neural network optimization is not merely a global training property but selectively amplifies learning for some data subgroups while suppressing it for others. The study identifies two conditions that determine which groups benefit: alignment of the group's gradient with the top Hessian eigenvector, and sustained non-vanishing gradient magnitude over time. These findings reframe EoS as a mechanism governing how learning is allocated across a training distribution, with implications for fairness and generalization in machine learning.
A new study accepted at the ICML 2026 HiLD workshop challenges the conventional view that the edge of stability (EoS) in gradient-based optimization is a uniform, global phenomenon. Using a 'branching intervention' experimental design that enters or exits the EoS regime from an identical training state, the authors causally demonstrate that the stability constraint redistributes learning unevenly across subsets of the training data. Two necessary conditions are identified for a data group to benefit from EoS: its aggregate gradient must align with the top eigenvector of the Hessian matrix, and it must maintain a non-vanishing gradient magnitude over training. The researchers isolate the alignment mechanism through a controlled perturbation that preserves gradient distance but randomizes direction, confirming that destroying alignment eliminates the group's advantage. Under cross-entropy loss, gradient saturation causes confidently classified examples to decouple from the learning dynamic, shifting the EoS benefit toward 'output-outliers' whose gradients remain active. These results suggest that EoS functions not only as a stability boundary but as an implicit, structured mechanism shaping which parts of the data distribution receive learning resources.
What's missing
The study does not address how these findings generalize across different neural network architectures, optimizers, or loss functions beyond cross-entropy. It is also unclear whether the identified EoS-driven learning disparities persist at scale or can be deliberately controlled to improve fairness in practice. The work is a workshop paper and has not yet undergone full peer review.
What different sources said
- arXiv cs.LGCenter
Edge of Stability Selectively Shapes Learning Across the Data Distribution
Related
Gut Bacteria Enzyme Found to Break Down Heat-Processed Food Compounds, Producing Novel Biogenic Amines
Researchers have discovered that an enzyme in common gut bacteria can degrade N-epsilon-carboxymethyllysine (CML), a compound formed during thermal food processing, producing previously unknown biogenic amines. The enzyme, ornithine decarboxylase SpeC from enterobacteria, acts on CML and related modified lysine derivatives through a low-level 'underground' catalytic activity. This finding suggests a previously unrecognized communication axis between thermally processed dietary compounds and gut microbial physiology, with potential implications for host health.
Full-Length Gene Sequencing Reveals Two Distinct Bacterial Communities in Black-Legged Ticks Expanding Into Canada
Researchers used Oxford Nanopore full-length 16S rRNA gene sequencing to characterize the microbiome of Ixodes scapularis black-legged ticks collected in Nova Scotia, Canada, distinguishing between tick-adapted bacteria and environmentally acquired bacteria. The study comes as I. scapularis — the primary vector of Lyme disease — is rapidly expanding northward into Canada due to climate change. The findings suggest that environmentally derived bacteria in tick microbiomes are not mere contamination, which has implications for how tick microbiome data is collected and interpreted across surveillance studies.
Study Identifies Metabolic Link Between Cell Envelope Stress and Biofilm Formation in Bacteria
Researchers have discovered that the metabolite acetyl-CoA directly inhibits enzymes that degrade the bacterial signaling molecule c-di-GMP, connecting cell envelope biosynthesis stress to biofilm formation in Pseudomonas aeruginosa. The study found that sub-inhibitory concentrations of antibiotics targeting early peptidoglycan biosynthesis — but not other antibiotic classes — elevate c-di-GMP levels by reducing phosphodiesterase activity, with acetyl-CoA competing for the enzyme active site. Because the relevant enzyme domain is broadly conserved across bacterial species, this checkpoint mechanism may be widespread and could have implications for understanding antibiotic-induced biofilm responses.