Paper Detail

Tracing the Scientific Discovery Capacity of LLMs to Their Training Data

Arda Uzunoglu, Mahler Revsine, Michael Schatz, Benjamin Van Durme, Mehrdad Farajtabar, Daniel Khashabi, Eric Nalisnick

arxiv Score 10.8

Published 2026-11-02 · First seen 2026-11-03

General AI

Abstract

Large language models (LLMs) show growing promise for scientific discovery, yet basic questions remain about what enables reliable discovery. How can we trace the scientific discovery capacity of LLMs to their training data? We study this question as one of missing probability mass and develop a theoretical account in which monofacts-the facts observed once during training-set the discovery capacity. In materials science and regulatory genomics, we directly manipulate monofact rates in training sets and find that more monofacts consistently yield more discoveries across two open-weight model families, sampling strategies, and reasoning budgets. Further experiments show the relationship cannot be explained by training-set diversity alone and can transfer across scientific domains when paired with in-domain data. Together, our results identify monofact rate in training data as a key factor governing discoveries in language models.

Workflow Status

Review status
pending
Role
unreviewed
Read priority
now
Vote
Not set.
Saved
no
Collections
Not filed yet.
Next action
Not filled yet.

Reading Brief

No structured notes yet. Add `summary_sections`, `why_relevant`, `claim_impact`, or `next_action` in `papers.jsonl` to enrich this view.

Why It Surfaced

No ranking explanation is available yet.

Tags

No tags.

BibTeX

@article{uzunoglu2026tracing,
  title = {Tracing the Scientific Discovery Capacity of LLMs to Their Training Data},
  author = {Arda Uzunoglu and Mahler Revsine and Michael Schatz and Benjamin Van Durme and Mehrdad Farajtabar and Daniel Khashabi and Eric Nalisnick},
  year = {2026},
  abstract = {Large language models (LLMs) show growing promise for scientific discovery, yet basic questions remain about what enables reliable discovery. How can we trace the scientific discovery capacity of LLMs to their training data? We study this question as one of missing probability mass and develop a theoretical account in which monofacts-the facts observed once during training-set the discovery capacity. In materials science and regulatory genomics, we directly manipulate monofact rates in training },
  url = {https://arxiv.org/abs/2611.03617},
  keywords = {cs.CL, cs.AI},
  eprint = {2611.03617},
  archiveprefix = {arXiv},
}

Metadata

{}