Reproduce “Distinct dynamics of conceptual and referential disruptions in human reading and large language model processing” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Rui He, Nihal Altay, Wolfram Hinzen
Research from Universitat Pompeu Fabra reveals that conceptual and referential meaning disruptions exhibit distinct temporal processing dynamics in both human reading and large language models. Conceptual distortions produce localized, rapidly decaying processing costs, while referential distortions result in weaker, more gradual effects sensitive to sentence boundaries.
Key insights
- Conceptual and referential meaning dimensions elicit fundamentally different temporal processing signatures, extending beyond simple differences in disruption magnitude.
- Grammatical structure, particularly sentence boundaries, plays a critical role in modulating the persistence of referential disruptions in both humans and LLMs, but not conceptual ones.
- LLMs capture these distinct processing dynamics in their predictive surprisal, mirroring human behavioral patterns, while showing a nuanced difference in internal representational changes for referential versus conceptual disruptions.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.