Paper Detail

FSE: Continual Learning for Named Entity Recognition by Fast-Slow Experts

Yunan Zhang, Yang Fan, Heng Li, Xiangping Wu, Qingcai Chen

arxiv Score 16.5

Published 2026-07-24 · First seen 2026-07-27

Research Track A

Abstract

Continual Learning for Named Entity Recognition (CLNER) enable models to incrementally learn new entity types without forgetting previously acquired ones. However, existing methods suffer from catastrophic forgetting and insufficient exploitation of shared information across tasks. This paper proposes FSE, a Fast-Slow Experts enhanced span-based NER model for CLNER. The shared fast expert learns token-level links to efficiently filter out unlikely spans, while the task-specific slow expert performs span classification only on the remaining candidates. It stabilizes learning by promoting knowledge sharing across tasks and maintains plasticity by reducing learning burden at each task. A length-decay negative sampling strategy to mitigate span imbalance is also introduced. Extensive experiments on OntoNotes and FewNERD synthestic datasets demonstrate that FSE achieves state-of-the-art performance in CLNER scenarios, with effectiveness of each component, empirical evidence of faster convergence and expected functionality of both experts.

Workflow Status

Review status
pending
Role
unreviewed
Read priority
now
Vote
Not set.
Saved
no
Collections
Not filed yet.
Next action
Not filled yet.

Reading Brief

No structured notes yet. Add `summary_sections`, `why_relevant`, `claim_impact`, or `next_action` in `papers.jsonl` to enrich this view.

Why It Surfaced

No ranking explanation is available yet.

Tags

No tags.

BibTeX

@article{zhang2026fse,
  title = {FSE: Continual Learning for Named Entity Recognition by Fast-Slow Experts},
  author = {Yunan Zhang and Yang Fan and Heng Li and Xiangping Wu and Qingcai Chen},
  year = {2026},
  abstract = {Continual Learning for Named Entity Recognition (CLNER) enable models to incrementally learn new entity types without forgetting previously acquired ones. However, existing methods suffer from catastrophic forgetting and insufficient exploitation of shared information across tasks. This paper proposes FSE, a Fast-Slow Experts enhanced span-based NER model for CLNER. The shared fast expert learns token-level links to efficiently filter out unlikely spans, while the task-specific slow expert perfo},
  url = {https://arxiv.org/abs/2607.22075},
  keywords = {cs.CL, cs.AI},
  eprint = {2607.22075},
  archiveprefix = {arXiv},
}

Metadata

{}