On Entity Identification in Language Models

• URL: http://arxiv.org/abs/2506.02701v4
• Date: Sun, 20 Jul 2025 11:22:13 GMT
• Title: On Entity Identification in Language Models
• Abstract summary: Internal representations of language models (LMs) identify and distinguish mentions of named entities.<n>We first formulate two problems of entity mentions -- ambiguity and variability.<n>We propose a framework analogous to clustering quality metrics.
• Score: 22.988199295121134
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We analyze the extent to which internal representations of language models (LMs) identify and distinguish mentions of named entities, focusing on the many-to-many correspondence between entities and their mentions. We first formulate two problems of entity mentions -- ambiguity and variability -- and propose a framework analogous to clustering quality metrics. Specifically, we quantify through cluster analysis of LM internal representations the extent to which mentions of the same entity cluster together and mentions of different entities remain separated. Our experiments examine five Transformer-based autoregressive models, showing that they effectively identify and distinguish entities with metrics analogous to precision and recall ranging from 0.66 to 0.9. Further analysis reveals that entity-related information is compactly represented in a low-dimensional linear subspace at early LM layers. Additionally, we clarify how the characteristics of entity representations influence word prediction performance. These findings are interpreted through the lens of isomorphism between LM representations and entity-centric knowledge structures in the real world, providing insights into how LMs internally organize and use entity information.

Related papers

• Weight-Informed Self-Explaining Clustering for Mixed-Type Tabular Data [63.62853416081748]
  WISE is a framework that unifies representation, feature weighting, clustering, and interpretation.<n>It produces faithful, human-interpretable explanations grounded in the same primitives that drive clustering.
  arXiv  Detail & Related papers  (2026-04-07T13:18:31Z)
• From Human Cognition to Neural Activations: Probing the Computational Primitives of Spatial Reasoning in LLMs [2.3268065525165316]
  spatial intelligence becomes an increasingly important capability for foundation models.<n>It remains unclear whether foundation models' performance on spatial reasoning benchmarks reflects structured internal spatial representations or reliance on language models.
  arXiv  Detail & Related papers  (2026-03-27T11:42:36Z)
• Interpreting Multi-Attribute Confounding through Numerical Attributes in Large Language Models [13.5805504750573]
  We show that large language models (LLMs) encode real-world numerical correlations but tend to systematically amplify them.<n> irrelevant context induces consistent shifts in magnitude representations, with downstream effects that vary by model size.<n>These findings lay the groundwork for fairer, representation-aware control under multi-attribute entanglement.
  arXiv  Detail & Related papers  (2025-11-06T04:47:08Z)
• Large Language Model Sourcing: A Survey [84.63438376832471]
  Large language models (LLMs) have revolutionized artificial intelligence, shifting from supporting objective tasks to empowering subjective decision-making.<n>Due to the black-box nature of LLMs and the human-like quality of their generated content, issues such as hallucinations, bias, unfairness, and copyright infringement become significant.<n>This survey presents a systematic investigation into provenance tracking for content generated by LLMs, organized around four interrelated dimensions.
  arXiv  Detail & Related papers  (2025-10-11T10:52:30Z)
• Factual Self-Awareness in Language Models: Representation, Robustness, and Scaling [56.26834106704781]
  Factual incorrectness in generated content is one of the primary concerns in ubiquitous deployment of large language models (LLMs)<n>We provide evidence supporting the presence of LLMs' internal compass that dictate the correctness of factual recall at the time of generation.<n>Scaling experiments across model sizes and training dynamics highlight that self-awareness emerges rapidly during training and peaks in intermediate layers.
  arXiv  Detail & Related papers  (2025-05-27T16:24:02Z)
• The Shape of Adversarial Influence: Characterizing LLM Latent Spaces with Persistent Homology [4.280045926995889]
  This study focuses on how adversarial inputs systematically affect the internal representation spaces of Large Language Models.<n>By quantifying the shape of activations and neuronal information flow, our architecture-agnostic framework reveals fundamental invariants of representational change.
  arXiv  Detail & Related papers  (2025-05-26T18:31:49Z)
• Disentangling Linguistic Features with Dimension-Wise Analysis of Vector Embeddings [0.0]
  This paper proposes a framework for uncovering the specific dimensions of vector embeddings that encode distinct linguistic properties (LPs)<n>We introduce the Linguistically Distinct Sentence Pairs dataset, which isolates ten key linguistic features such as synonymy, negation, tense, and quantity.<n>Using this dataset, we analyze BERT embeddings with various methods to identify the most influential dimensions for each LP.<n>Our findings show that certain properties, such as negation and polarity, are robustly encoded in specific dimensions, while others, like synonymy, exhibit more complex patterns.
  arXiv  Detail & Related papers  (2025-04-20T23:38:16Z)
• How do Large Language Models Understand Relevance? A Mechanistic Interpretability Perspective [64.00022624183781]
  Large language models (LLMs) can assess relevance and support information retrieval (IR) tasks.<n>We investigate how different LLM modules contribute to relevance judgment through the lens of mechanistic interpretability.
  arXiv  Detail & Related papers  (2025-04-10T16:14:55Z)
• Persistent Topological Features in Large Language Models [0.6597195879147556]
  We introduce persistence similarity, a new metric that quantifies the persistence and transformation of topological features. Unlike traditional similarity measures, our approach captures the entire evolutionary trajectory of these features. As a practical application, we leverage persistence similarity to identify and prune redundant layers.
  arXiv  Detail & Related papers  (2024-10-14T19:46:23Z)
• Knowing Your Nonlinearities: Shapley Interactions Reveal the Underlying Structure of Data [8.029715695737567]
  We use Shapley Taylor interaction indices (STII) to analyze the impact of underlying data structure on model representations. Considering linguistic structure in masked and auto-regressive language models (ML and ALMs), we find that STII increases within idiomatic expressions. Our speech model findings reflect the phonetic principal that the openness of the oral cavity determines how much a phoneme varies based on its context.
  arXiv  Detail & Related papers  (2024-03-19T19:13:22Z)
• Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment [31.70064035432789]
  We propose a Large Language Model-enhanced Entity Alignment framework (LLMEA) LLMEA identifies candidate alignments for a given entity by considering both embedding similarities between entities across Knowledge Graphs and edit distances to a virtual equivalent entity. Experiments conducted on three public datasets reveal that LLMEA surpasses leading baseline models.
  arXiv  Detail & Related papers  (2024-01-30T12:41:04Z)
• Exploiting Contextual Target Attributes for Target Sentiment Classification [53.30511968323911]
  Existing PTLM-based models for TSC can be categorized into two groups: 1) fine-tuning-based models that adopt PTLM as the context encoder; 2) prompting-based models that transfer the classification task to the text/word generation task. We present a new perspective of leveraging PTLM for TSC: simultaneously leveraging the merits of both language modeling and explicit target-context interactions via contextual target attributes.
  arXiv  Detail & Related papers  (2023-12-21T11:45:28Z)
• Understanding the Inner Workings of Language Models Through Representation Dissimilarity [5.987278280211877]
  representation dissimilarity measures are functions that measure the extent to which two model's internal representations differ. Our results suggest that dissimilarity measures are a promising set of tools for shedding light on the inner workings of language models.
  arXiv  Detail & Related papers  (2023-10-23T14:46:20Z)
• A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis [128.0532113800092]
  We present a mechanistic interpretation of Transformer-based LMs on arithmetic questions. This provides insights into how information related to arithmetic is processed by LMs.
  arXiv  Detail & Related papers  (2023-05-24T11:43:47Z)
• Boundary Knowledge Translation based Reference Semantic Segmentation [62.60078935335371]
  We introduce a Reference Reference segmentation Network (Ref-Net) to conduct visual boundary knowledge translation. Inspired by the human recognition mechanism, RSMTM is devised only to segment the same category objects based on the features of the reference objects. With tens of finely-grained annotated samples as guidance, Ref-Net achieves results on par with fully supervised methods on six datasets.
  arXiv  Detail & Related papers  (2021-08-01T07:40:09Z)
• Interpretable Multi-dataset Evaluation for Named Entity Recognition [110.64368106131062]
  We present a general methodology for interpretable evaluation for the named entity recognition (NER) task. The proposed evaluation method enables us to interpret the differences in models and datasets, as well as the interplay between them. By making our analysis tool available, we make it easy for future researchers to run similar analyses and drive progress in this area.
  arXiv  Detail & Related papers  (2020-11-13T10:53:27Z)
• Similarity Analysis of Contextual Word Representation Models [39.12749165544309]
  We use existing and novel similarity measures to gauge the level of localization of information in the deep models. The analysis reveals that models within the same family are more similar to one another, as may be expected. Surprisingly, different architectures have rather similar representations, but different individual neurons.
  arXiv  Detail & Related papers  (2020-05-03T19:48:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.