EvoBrowseComp: New Benchmark Tests Search Agents on Evolving, Contamination-Free Knowledge
Researchers have introduced EvoBrowseComp, an evolving benchmark of 800 complex questions (400 English, 400 Chinese) designed to evaluate large language model search agents on fresh, contamination-free knowledge. The benchmark addresses a key weakness in existing evaluations like BrowseComp, where models can score highly by recalling memorized facts rather than demonstrating genuine web retrieval and reasoning. By automating question synthesis from live web data, the system can be regularly refreshed, offering a more durable and rigorous standard for assessing AI browsing competence.
EvoBrowseComp is a newly proposed benchmark for evaluating search-augmented large language models, introduced in a preprint submitted to arXiv on June 11, 2026. The benchmark consists of 400 English and 400 Chinese questions synthesized through live web traversal, designed to prevent the test-set contamination and parametric memorization that undermine existing static benchmarks. The authors developed a three-agent collaborative framework to generate questions: a QA synthesis agent retrieves current web knowledge, an information filtering agent screens for credibility and popularity to block shortcut answers, and a high-level guidance agent structures questions into reasoning graphs to reduce logical redundancy. Because the pipeline is fully automated, the benchmark can be updated on a rolling basis to stay ahead of model training data and evolving world knowledge. Experiments reported in the paper confirm the benchmark is highly challenging, requiring broad horizontal search rather than narrow fact recall. The work is currently under peer review and represents a proposed paradigm for scalable, auto-updatable AI evaluation.
What's missing
The paper is a preprint under review and has not yet been peer-reviewed or published in a venue. Key open questions include: how frequently the benchmark will be updated in practice, whether the automated synthesis pipeline introduces its own systematic biases or errors in question quality, and how performance on EvoBrowseComp correlates with real-world search agent utility. The authors do not report inter-annotator agreement or human baseline performance, which would help calibrate the difficulty claims.
What different sources said
- arXiv cs.CLCenter
EvoBrowseComp: Benchmarking Search Agents on Evolving Knowledge
Related
Gut Bacteria Enzyme Found to Break Down Heat-Processed Food Compounds, Producing Novel Biogenic Amines
Researchers have discovered that an enzyme in common gut bacteria can degrade N-epsilon-carboxymethyllysine (CML), a compound formed during thermal food processing, producing previously unknown biogenic amines. The enzyme, ornithine decarboxylase SpeC from enterobacteria, acts on CML and related modified lysine derivatives through a low-level 'underground' catalytic activity. This finding suggests a previously unrecognized communication axis between thermally processed dietary compounds and gut microbial physiology, with potential implications for host health.
Full-Length Gene Sequencing Reveals Two Distinct Bacterial Communities in Black-Legged Ticks Expanding Into Canada
Researchers used Oxford Nanopore full-length 16S rRNA gene sequencing to characterize the microbiome of Ixodes scapularis black-legged ticks collected in Nova Scotia, Canada, distinguishing between tick-adapted bacteria and environmentally acquired bacteria. The study comes as I. scapularis — the primary vector of Lyme disease — is rapidly expanding northward into Canada due to climate change. The findings suggest that environmentally derived bacteria in tick microbiomes are not mere contamination, which has implications for how tick microbiome data is collected and interpreted across surveillance studies.
Study Identifies Metabolic Link Between Cell Envelope Stress and Biofilm Formation in Bacteria
Researchers have discovered that the metabolite acetyl-CoA directly inhibits enzymes that degrade the bacterial signaling molecule c-di-GMP, connecting cell envelope biosynthesis stress to biofilm formation in Pseudomonas aeruginosa. The study found that sub-inhibitory concentrations of antibiotics targeting early peptidoglycan biosynthesis — but not other antibiotic classes — elevate c-di-GMP levels by reducing phosphodiesterase activity, with acetyl-CoA competing for the enzyme active site. Because the relevant enzyme domain is broadly conserved across bacterial species, this checkpoint mechanism may be widespread and could have implications for understanding antibiotic-induced biofilm responses.