Paper Detail

ChronoCulture: Evaluating Cultural Awareness Across Time in Large Language Models

Rusali Saha, Nitya Khurana, Ruihong Huang, Kuan-Hao Huang

arxiv Score 9.8

Published 2026-10-14 · First seen 2026-10-15

General AI

Abstract

Cultural attitudes and social norms evolve over time, yet most cultural benchmarks for large language models (LLMs) treat culture as a static attribute of a country or region. We introduce ChronoCulture, a benchmark of 10,360 temporal pairs built from longitudinal survey data across 72 countries. Each pair contains the same survey question asked in the same country in an older and a newer year, with full population response distributions as ground truth. Across six LLMs, we find that models can often predict a country's attitudes at one point in time but do not reliably capture how those attitudes change. Their predictions for different years tend to stay close together, failing to capture much of the observed change. Specifying the intended year in the prompt also offers little overall improvement in alignment with survey responses. These findings suggest that models often present a largely static picture of cultural attitudes, highlighting the need to evaluate cultural awareness across time.

Workflow Status

Review status
pending
Role
unreviewed
Read priority
now
Vote
Not set.
Saved
no
Collections
Not filed yet.
Next action
Not filled yet.

Reading Brief

No structured notes yet. Add `summary_sections`, `why_relevant`, `claim_impact`, or `next_action` in `papers.jsonl` to enrich this view.

Why It Surfaced

No ranking explanation is available yet.

Tags

No tags.

BibTeX

@article{saha2026chronoculture,
  title = {ChronoCulture: Evaluating Cultural Awareness Across Time in Large Language Models},
  author = {Rusali Saha and Nitya Khurana and Ruihong Huang and Kuan-Hao Huang},
  year = {2026},
  abstract = {Cultural attitudes and social norms evolve over time, yet most cultural benchmarks for large language models (LLMs) treat culture as a static attribute of a country or region. We introduce ChronoCulture, a benchmark of 10,360 temporal pairs built from longitudinal survey data across 72 countries. Each pair contains the same survey question asked in the same country in an older and a newer year, with full population response distributions as ground truth. Across six LLMs, we find that models can },
  url = {https://arxiv.org/abs/2610.20472},
  keywords = {cs.CL, cs.CY},
  eprint = {2610.20472},
  archiveprefix = {arXiv},
}

Metadata

{}