Language Has Two Parameters: Narrative-Induced Semantic Plasticity and Phase-Sensitive Interpretation
- URL: http://arxiv.org/abs/2608.18041v2
- Date: Thu, 20 Aug 2026 03:10:35 GMT
- Title: Language Has Two Parameters: Narrative-Induced Semantic Plasticity and Phase-Sensitive Interpretation
- Abstract summary: This paper proposes that encounters alter persistent relations among simultaneously active meanings.<n>It argues that future AI agents will need persistent semantic states indexed to particular individuals and relationships.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Reading fiction or encountering narrative generally does not merely add information. The encounter changes the reader. This paper proposes that encounters alter persistent relations among simultaneously active meanings, producing individual and shared histories that population-trained language models do not necessarily retain. A model may be told of an encounter and reproduce its consequences while the history remains in context; this is not the same as being changed by the encounter. This paper formalizes this missing relational state as phase, sets out testable predictions about encounter order, quotation, and suppressed meanings, and argues that future AI agents will need persistent semantic states indexed to particular individuals and relationships. The matching risk is semantic poisoning: an attack that re-signs relations among meanings already present.
Related papers
- Private Etymology: Designing Relational Reuse of Shared Symbols in Long-Term Human-AI Interaction [0.0]
Private Etymology is a machine-representable relational provenance.<n>It records how a dyad-specific symbolic expression is proposed, interpreted, negotiated, repaired, reused, revised, stabilized, contested, forgotten, or retired over time.<n>Private Etymology is proposed as infrastructure for conversational agents to participate in changing relational microcultures.
arXiv Detail & Related papers (2026-08-09T03:23:08Z) - Phantom transitions in language model fine-tuning [0.0]
Fine-tuning a language model on contexts with a near-synonym competitor often fails silently.<n>We study this regime across five transformer architectures spanning two families and a fivefold parameter range.<n>We observe sharp catapult-like jumps in the order parameter that resemble a phase transition.
arXiv Detail & Related papers (2026-05-25T10:44:42Z) - Inductive Reasoning for Temporal Knowledge Graphs with Emerging Entities [54.48612448535698]
Reasoning on Temporal Knowledge Graphs (TKGs) is essential for predicting future events and time-aware facts.<n>We propose TransFIR, a novel framework that leverages historical interaction sequences from semantically similar known entities to support inductive reasoning.
arXiv Detail & Related papers (2026-04-11T11:23:05Z) - Beyond Semantics: How Temporal Biases Shape Retrieval in Transformer and State-Space Models [4.69761138328817]
In-context learning is governed by both temporal and semantic relationships.<n>This work probes the ability of various pretrained Large Language Models (LLMs) to differentiate and retrieve temporally separated events.<n>Our findings deepen the understanding of temporal biases in in-context learning and offer an illustration of how these biases can enable temporal separation and episodic retrieval.
arXiv Detail & Related papers (2025-10-26T17:01:41Z) - Counterfactual reasoning: an analysis of in-context emergence [57.118735341305786]
We show that language models are capable of counterfactual reasoning.<n>We find that self-attention, model depth and pre-training data diversity drive performance.<n>Our findings extend to counterfactual reasoning under SDE dynamics.
arXiv Detail & Related papers (2025-06-05T16:02:07Z) - Semantics drives analogical change in Germanic strong verb paradigms: a phylogenetic study [45.11082946405984]
In some Germanic languages, there is a greater affinity for stem allomorphy shared by preterite forms and past participles to the exclusion of present forms.<n>We show that there is a greater long-term preference for this alternation pattern in situations where narrative past tense has been extended to the past participle.
arXiv Detail & Related papers (2025-02-24T21:36:15Z) - Gumbel Counterfactual Generation From Language Models [64.55296662926919]
We show that counterfactual reasoning is conceptually distinct from interventions.<n>We propose a framework for generating true string counterfactuals.<n>We show that the approach produces meaningful counterfactuals while at the same time showing that commonly used intervention techniques have considerable undesired side effects.
arXiv Detail & Related papers (2024-11-11T17:57:30Z) - Surprise! Uniform Information Density Isn't the Whole Story: Predicting Surprisal Contours in Long-form Discourse [54.08750245737734]
We propose that speakers modulate information rate based on location within a hierarchically-structured model of discourse.
We find that hierarchical predictors are significant predictors of a discourse's information contour and that deeply nested hierarchical predictors are more predictive than shallow ones.
arXiv Detail & Related papers (2024-10-21T14:42:37Z) - Distributional Semantics, Holism, and the Instability of Meaning [0.0]
Large Language Models are built on the so-called distributional semantic approach to linguistic meaning.<n>A standard objection to holism is the charge of instability.<n>We argue that the instability that language models display is constrained by the structure and scale of relationships between words.
arXiv Detail & Related papers (2024-05-20T14:53:25Z) - A Tale of Two Laws of Semantic Change: Predicting Synonym Changes with
Distributional Semantic Models [1.856334276134661]
There are two competing, apparently opposite hypotheses in the historical linguistic literature regarding how synonymous words evolve.
We take a first step toward detecting whether Law of Differentiation (LD) or Law of Parallel Change (LPC) operates for given word pairs.
We then propose various computational approaches to the problem using Distributional Semantic Models and grounded in recent literature on Lexical Semantic Change detection.
arXiv Detail & Related papers (2023-05-30T15:50:29Z) - The distribution of syntactic dependency distances [0.13812010983144798]
We contribute to the characterization of the actual distribution of syntactic dependency distances.<n>We propose a new model with two exponential regimes in which the probability decay is allowed to change after a break-point.<n>We find that a two-regime model is the most likely one in all 20 languages we considered, independently of sentence length and annotation style.
arXiv Detail & Related papers (2022-11-26T17:31:25Z) - Are Representations Built from the Ground Up? An Empirical Examination
of Local Composition in Language Models [91.3755431537592]
Representing compositional and non-compositional phrases is critical for language understanding.
We first formulate a problem of predicting the LM-internal representations of longer phrases given those of their constituents.
While we would expect the predictive accuracy to correlate with human judgments of semantic compositionality, we find this is largely not the case.
arXiv Detail & Related papers (2022-10-07T14:21:30Z) - Sketch and Customize: A Counterfactual Story Generator [71.34131541754674]
We propose a sketch-and-customize generation model guided by the causality implicated in the conditions and endings.
Experimental results show that the proposed model generates much better endings, as compared with the traditional sequence-to-sequence model.
arXiv Detail & Related papers (2021-04-02T08:14:22Z) - Embracing Uncertainty: Decoupling and De-bias for Robust Temporal
Grounding [23.571580627202405]
Temporal grounding aims to localize temporal boundaries within untrimmed videos by language queries.
It faces the challenge of two types of inevitable human uncertainties: query uncertainty and label uncertainty.
We propose a novel DeNet (Decoupling and De-bias) to embrace human uncertainty.
arXiv Detail & Related papers (2021-03-31T07:00:56Z) - Lexical semantic change for Ancient Greek and Latin [61.69697586178796]
Associating a word's correct meaning in its historical context is a central challenge in diachronic research.
We build on a recent computational approach to semantic change based on a dynamic Bayesian mixture model.
We provide a systematic comparison of dynamic Bayesian mixture models for semantic change with state-of-the-art embedding-based models.
arXiv Detail & Related papers (2021-01-22T12:04:08Z) - Mechanisms for Handling Nested Dependencies in Neural-Network Language
Models and Humans [75.15855405318855]
We studied whether a modern artificial neural network trained with "deep learning" methods mimics a central aspect of human sentence processing.
Although the network was solely trained to predict the next word in a large corpus, analysis showed the emergence of specialized units that successfully handled local and long-distance syntactic agreement.
We tested the model's predictions in a behavioral experiment where humans detected violations in number agreement in sentences with systematic variations in the singular/plural status of multiple nouns.
arXiv Detail & Related papers (2020-06-19T12:00:05Z) - Temporal Embeddings and Transformer Models for Narrative Text
Understanding [72.88083067388155]
We present two approaches to narrative text understanding for character relationship modelling.
The temporal evolution of these relations is described by dynamic word embeddings, that are designed to learn semantic changes over time.
A supervised learning approach based on the state-of-the-art transformer model BERT is used instead to detect static relations between characters.
arXiv Detail & Related papers (2020-03-19T14:23:12Z) - A Knowledge-Enhanced Pretraining Model for Commonsense Story Generation [98.25464306634758]
We propose to utilize commonsense knowledge from external knowledge bases to generate reasonable stories.
We employ multi-task learning which combines a discriminative objective to distinguish true and fake stories.
Our model can generate more reasonable stories than state-of-the-art baselines, particularly in terms of logic and global coherence.
arXiv Detail & Related papers (2020-01-15T05:42:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.