Paper Detail

As the Story Unfolds: Watching a Film and Identifying Characters as a Human Does

Zhongrui Gui, Junyu Xie, Tengda Han, Weidi Xie, Andrew Zisserman

arxiv Score 11.3

Published 2026-10-27 · First seen 2026-10-28

General AI

Abstract

Films introduce characters incrementally as they progress. We study the problem of identifying principal characters and assigning their names directly from the movie itself, without using external cast lists, actor photographs, or pre-built character banks. We introduce the character naming task: given a name mentioned in dialogue and the associated video context, the model must determine which visible character bears that name. This task is challenging because name resolution often depends on cinematic cues such as shot-reverse-shot structure, self-introduction, direct address, third-party reference, gaze, and temporal continuity. We provide a dataset and annotations for evaluating character naming and first character appearances, develop a video-and-dialogue model for the task, and compare it with proprietary multimodal large language models. We further introduce a progressive framework for building a character bank as the film unfolds. Together, these contributions support online, human-like movie understanding in which character identities are inferred from the film itself.

Workflow Status

Review status
pending
Role
unreviewed
Read priority
now
Vote
Not set.
Saved
no
Collections
Not filed yet.
Next action
Not filled yet.

Reading Brief

No structured notes yet. Add `summary_sections`, `why_relevant`, `claim_impact`, or `next_action` in `papers.jsonl` to enrich this view.

Why It Surfaced

No ranking explanation is available yet.

Tags

No tags.

BibTeX

@article{gui2026story,
  title = {As the Story Unfolds: Watching a Film and Identifying Characters as a Human Does},
  author = {Zhongrui Gui and Junyu Xie and Tengda Han and Weidi Xie and Andrew Zisserman},
  year = {2026},
  abstract = {Films introduce characters incrementally as they progress. We study the problem of identifying principal characters and assigning their names directly from the movie itself, without using external cast lists, actor photographs, or pre-built character banks. We introduce the character naming task: given a name mentioned in dialogue and the associated video context, the model must determine which visible character bears that name. This task is challenging because name resolution often depends on c},
  url = {https://arxiv.org/abs/2610.37579},
  keywords = {cs.CV},
  eprint = {2610.37579},
  archiveprefix = {arXiv},
}

Metadata

{}