Contextual Semantic Relevance and Word Surprisal Predict N400 and P600 Dynamics During Naturalistic Reading

• URL: http://arxiv.org/abs/2607.04107v2
• Date: Tue, 07 Jul 2026 03:44:55 GMT
• Title: Contextual Semantic Relevance and Word Surprisal Predict N400 and P600 Dynamics During Naturalistic Reading
• Abstract summary: This study examined whether contextual semantic relevance predicts word-locked EEG activity in the N400 and P600 windows.<n>Contextual semantic relevance was computed as an attention-aware measure of how strongly a target word is semantically connected to its recent discourse context.<n>Both predictors were reliably associated with EEG responses, but they showed partly different temporal and scalp-level patterns.
• Score: 23.77480663886995
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Word surprisal is a well-established computational predictor of human neural responses during language comprehension, but it remains less clear whether local semantic fit explains neural response variation beyond lexical expectation during naturalistic reading. Using the Dublin EEG-based Reading Experiment Corpus (DERCo), this study examined whether contextual semantic relevance predicts word-locked EEG activity in the N400 and P600 windows. Contextual semantic relevance was computed as an attention-aware measure of how strongly a target word is semantically connected to its recent discourse context, and it was compared with GPT-based word surprisal. Across 22 participants and 32 EEG channels, we tested both predictors using regression-based ERP analyses and generalized additive mixed models while controlling for lexical variables and repeated observations. Both predictors were reliably associated with EEG responses, but they showed partly different temporal and scalp-level patterns. Surprisal captured expectancy-related variation, whereas contextual semantic relevance showed robust effects across N400- and P600-window mean voltages, with particularly strong explanatory support in the P600 window. Model comparisons indicated that contextual semantic relevance contributed explanatory value beyond lexical controls and surprisal. These findings suggest that naturalistic reading depends on both lexical expectation and local semantic integration, and that contextual semantic relevance offers an interpretable computational link between discourse semantic fit and ERP dynamics.

Related papers

• Contextual Semantic Relevance Tracks fMRI BOLD Responses During Naturalistic Speech Comprehension [23.77480663886995]
  This study investigates whether contextual semantic relevance, defined as how strongly an incoming word relates to its recent semantic context, predicts BOLD responses during naturalistic speech comprehension.<n>We analyzed two public fMRI datasets, the Alice dataset and the Moth dataset, treating them as complementary rather than identical replications.<n>Semantic relevance was significant across all 12 ROIs (region of interest), whereas surprisal was not significant after FDR correction.
  arXiv  Detail & Related papers  (2026-07-17T11:12:33Z)
• Heterogeneous Neural Predictivity from Language Models During Naturalistic Comprehension [0.6331422666055228]
  Language-model representations provide structured, high-dimensional annotations of naturalistic language stimuli.<n>Positive held-out prediction and gains over low-level baselines were widespread in source-level summaries.<n>These findings show that language-model-derived quantities can annotate neural activity during natural speech and text comprehension.
  arXiv  Detail & Related papers  (2026-06-25T11:08:49Z)
• Modeling semantic association in self-paced reading with language model embeddings [1.647226581907515]
  We use embeddings from LMs to estimate semantic association on a corpus of electroencephalography (EEG) and self-paced reading of natural, Dutch texts.<n>The choice of embedding model can alter the estimated effect of semantic association on both the N400 and self-paced reading times.
  arXiv  Detail & Related papers  (2026-06-05T09:06:22Z)
• Estimating the strength and timing of syntactic structure building in naturalistic reading [4.261343728593896]
  We show that phrase structure can precede category detection and dominate lexical influences.<n>These findings support a predictive "tree-scaffolding" account of comprehension.
  arXiv  Detail & Related papers  (2025-09-27T08:56:12Z)
• On the Role of Context in Reading Time Prediction [50.87306355705826]
  We present a new perspective on how readers integrate context during real-time language comprehension.<n>Our proposals build on surprisal theory, which posits that the processing effort of a linguistic unit is an affine function of its in-context information content.
  arXiv  Detail & Related papers  (2024-09-12T15:52:22Z)
• Decomposition of surprisal: Unified computational model of ERP components in language processing [7.760815504640362]
  We advance an information-theoretic model of human language processing in the brain in which incoming linguistic input is processed at first shallowly and later with more depth. We show that the information content (surprisal) of a word in context can be decomposed into two quantities: (A) shallow surprisal, which signals shallow processing difficulty for a word, and corresponds with the N400 signal; and (B) deep surprisal, which reflects the discrepancy between shallow and deep representations, and corresponds to the P600 signal.
  arXiv  Detail & Related papers  (2024-09-10T18:14:02Z)
• Explaining Text Similarity in Transformer Models [52.571158418102584]
  Recent advances in explainable AI have made it possible to mitigate limitations by leveraging improved explanations for Transformers. We use BiLRP, an extension developed for computing second-order explanations in bilinear similarity models, to investigate which feature interactions drive similarity in NLP models. Our findings contribute to a deeper understanding of different semantic similarity tasks and models, highlighting how novel explainable AI methods enable in-depth analyses and corpus-level insights.
  arXiv  Detail & Related papers  (2024-05-10T17:11:31Z)
• A unified information-theoretic model of EEG signatures of human language processing [7.190747604294439]
  We advance an information-theoretic model of human language processing in the brain, in which incoming linguistic input is processed at two levels. We propose that these two kinds of information processing have distinct electroencephalographic signatures, corresponding to the well-documented N400 and P600 components of language-related event-related potentials (ERPs) Our theory is in principle compatible with traditional cognitive theories assuming a good-enough' interpretation stage, but with precise information-theoretic formulation.
  arXiv  Detail & Related papers  (2022-12-16T00:15:45Z)
• Contextualized Semantic Distance between Highly Overlapped Texts [85.1541170468617]
  Overlapping frequently occurs in paired texts in natural language processing tasks like text editing and semantic similarity evaluation. This paper aims to address the issue with a mask-and-predict strategy. We take the words in the longest common sequence as neighboring words and use masked language modeling (MLM) to predict the distributions on their positions. Experiments on Semantic Textual Similarity show NDD to be more sensitive to various semantic differences, especially on highly overlapped paired texts.
  arXiv  Detail & Related papers  (2021-10-04T03:59:15Z)
• Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledge [59.22170796793179]
  Transformers Language Models (TLMs) were tested on a benchmark for the textitdynamic estimation of thematic fit Our results show that TLMs can reach performances that are comparable to those achieved by SDM. However, additional analysis consistently suggests that TLMs do not capture important aspects of event knowledge.
  arXiv  Detail & Related papers  (2021-07-22T20:52:26Z)
• A comprehensive comparative evaluation and analysis of Distributional Semantic Models [61.41800660636555]
  We perform a comprehensive evaluation of type distributional vectors, either produced by static DSMs or obtained by averaging the contextualized vectors generated by BERT. The results show that the alleged superiority of predict based models is more apparent than real, and surely not ubiquitous. We borrow from cognitive neuroscience the methodology of Representational Similarity Analysis (RSA) to inspect the semantic spaces generated by distributional models.
  arXiv  Detail & Related papers  (2021-05-20T15:18:06Z)
• Decomposing lexical and compositional syntax and semantics with deep language models [82.81964713263483]
  The activations of language transformers like GPT2 have been shown to linearly map onto brain activity during speech comprehension. Here, we propose a taxonomy to factorize the high-dimensional activations of language models into four classes: lexical, compositional, syntactic, and semantic representations. The results highlight two findings. First, compositional representations recruit a more widespread cortical network than lexical ones, and encompass the bilateral temporal, parietal and prefrontal cortices.
  arXiv  Detail & Related papers  (2021-03-02T10:24:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.