Paper Detail

Mycelium: A Meta-Study of Hallucination Detection Across Provenance, Typology, and Granularities

Julia Belikova, Elisei Rykov

huggingface Score 10.5

Published 2026-10-24 · First seen 2026-10-27

General AI

Abstract

Hallucination detection is increasingly important for evaluating and deploying large language models. However, existing methods are often compared across benchmarks that define and measure hallucination in substantially different ways, making reported scores difficult to interpret across settings. We study hallucination detection as a benchmark-conditioned measurement problem and organize existing benchmarks along three axes: provenance, which describes how model outputs and evidence conditions are obtained; typology, which captures the factuality and faithfulness failures represented by benchmark labels; and granularity, which specifies the unit at which hallucinations are annotated, predicted, and evaluated. Using this framework, we analyze how benchmark construction, annotation, and evaluation choices shape the underlying prediction task, and relate detector mechanisms and assumptions to the settings in which their performance is measured. We also examine span-level evaluation, where variation in annotation boundaries can substantially affect reported results, and propose Span Coverage F1 as a complementary containment-based metric. Our analysis clarifies what detector scores capture, highlights limitations of cross-benchmark comparisons, and motivates more explicit evaluation of generalization across benchmark conditions.

Workflow Status

Review status
pending
Role
unreviewed
Read priority
now
Vote
Not set.
Saved
no
Collections
Not filed yet.
Next action
Not filled yet.

Reading Brief

No structured notes yet. Add `summary_sections`, `why_relevant`, `claim_impact`, or `next_action` in `papers.jsonl` to enrich this view.

Why It Surfaced

No ranking explanation is available yet.

Tags

No tags.

BibTeX

@misc{belikova2026mycelium,
  title = {Mycelium: A Meta-Study of Hallucination Detection Across Provenance, Typology, and Granularities},
  author = {Julia Belikova and Elisei Rykov},
  year = {2026},
  abstract = {Hallucination detection is increasingly important for evaluating and deploying large language models. However, existing methods are often compared across benchmarks that define and measure hallucination in substantially different ways, making reported scores difficult to interpret across settings. We study hallucination detection as a benchmark-conditioned measurement problem and organize existing benchmarks along three axes: provenance, which describes how model outputs and evidence conditions },
  url = {https://huggingface.co/papers/2610.33608},
  keywords = {hallucination detection, provenance, typology, granularity, span-level evaluation, Span Coverage F1, cross-benchmark comparisons, detector mechanisms, code available, huggingface daily},
  eprint = {2610.33608},
  archiveprefix = {arXiv},
}

Metadata

{}