The Prediction-Measurement Gap: Toward Meaning Representations as Scientific Instruments

• URL: http://arxiv.org/abs/2603.10130v1
• Date: Tue, 10 Mar 2026 18:08:53 GMT
• Title: The Prediction-Measurement Gap: Toward Meaning Representations as Scientific Instruments
• Abstract summary: The paper argues that scientific meaning analysis motivates a distinct family of objectives - scientific usability.<n>The paper assesses static word embeddings and contextual transformer representations against these requirements.<n>As the field debates the limits of scale-first progress, measurement-ready representations offer a principled new frontier.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Text embeddings have become central to computational social science and psychology, enabling scalable measurement of meaning and mixed-method inference. Yet most representation learning is optimized and evaluated for prediction and retrieval, yielding a prediction-measurement gap: representations that perform well as features may be poorly suited as scientific instruments. The paper argues that scientific meaning analysis motivates a distinct family of objectives - scientific usability - emphasizing geometric legibility, interpretability and traceability to linguistic evidence, robustness to non-semantic confounds, and compatibility with regression-style inference over semantic directions. Grounded in cognitive and neuro-psychological views of meaning, the paper assesses static word embeddings and contextual transformer representations against these requirements: static spaces remain attractive for transparent measurement, whereas contextual spaces offer richer semantics but entangle meaning with other signals and exhibit geometric and interpretability issues that complicate inference. The paper then outlines a course-setting agenda around (i) geometry-first design for gradients and abstraction, including hierarchy-aware spaces constrained by psychologically privileged levels; (ii) invertible post-hoc transformations that recondition embedding geometry and reduce nuisance influence; and (iii) meaning atlases and measurement-oriented evaluation protocols for reliable and traceable semantic inference. As the field debates the limits of scale-first progress, measurement-ready representations offer a principled new frontier.

Related papers

• Lexical Consensus: Grounded Word Learning and Shared Meaning in Artificial Agents [0.0]
  This paper introduces Lexical Consensus, an experimental framework for studying grounded word learning over a structured perceptual substrate.<n>We test whether agents can acquire artificial labels for visual concepts, generalize them bidirectionally, and stabilize them across controlled settings.<n>The main result is a robust perceptual-coherence gradient: native categories are easiest to learn, coherent overextensions remain learnable, mid-range disjunctive concepts degrade, and far-disjunctive concepts approach chance.
  arXiv  Detail & Related papers  (2026-06-20T20:08:07Z)
• AURORA: Contextual Orthogonalization for Geometric Representation Learning in Healthcare Foundation Models [1.7823291802496628]
  We introduce AURORA, Adaptive Uncertainty Representations through Orthogonalized observational alignment.<n>AURORA decomposes semantic subspaces into contextual factors learns consistency objectives within each subspace.<n>It consistently outperforms reconstruction and substantially improves contextual disentanglement, neighborhood purity, and under institutional distribution shift.
  arXiv  Detail & Related papers  (2026-05-18T02:32:50Z)
• Characterizing Human Semantic Navigation in Concept Production as Trajectories in Embedding Space [0.0]
  We introduce a framework that represents concept production as navigation through embedding space.<n>We construct participant-specific semantic trajectories based on cumulative embeddings and extract geometric and dynamical metrics.<n>We evaluate the framework on four datasets across different languages, spanning different property generation tasks.
  arXiv  Detail & Related papers  (2026-02-05T18:23:04Z)
• Interpretation as Linear Transformation: A Cognitive-Geometric Model of Belief and Meaning [0.0]
  I show how belief distortion, motivational drift, counterfactual evaluation, and the limits of mutual understanding arise from purely algebraic constraints.<n>I argue that this cognitive-geometric perspective clarifies the boundaries of influence in both human and artificial systems.
  arXiv  Detail & Related papers  (2025-12-10T17:13:01Z)
• Artemis: Structured Visual Reasoning for Perception Policy Learning [64.57381337070616]
  Empirical observations indicate that purely linguistic intermediate reasoning often reduces performance on perception tasks.<n>We introduce Artemis, a perception-policy learning framework that performs structured proposal-based reasoning.
  arXiv  Detail & Related papers  (2025-12-01T18:45:30Z)
• Skews in the Phenomenon Space Hinder Generalization in Text-to-Image Generation [59.138470433237615]
  We introduce statistical metrics that quantify both the linguistic and visual skew of a dataset for relational learning. We show that systematically controlled metrics are strongly predictive of generalization performance. This work informs an important direction towards quality-enhancing the data diversity or balance to scaling up the absolute size.
  arXiv  Detail & Related papers  (2024-03-25T03:18:39Z)
• How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding [56.222097640468306]
  We provide mechanistic understanding of how transformers learn "semantic structure" We show, through a combination of mathematical analysis and experiments on Wikipedia data, that the embedding layer and the self-attention layer encode the topical structure.
  arXiv  Detail & Related papers  (2023-03-07T21:42:17Z)
• An Informational Space Based Semantic Analysis for Scientific Texts [62.997667081978825]
  This paper introduces computational methods for semantic analysis and the quantifying the meaning of short scientific texts. The representation of scientific-specific meaning is standardised by replacing the situation representations, rather than psychological properties. The research in this paper conducts the base for the geometric representation of the meaning of texts.
  arXiv  Detail & Related papers  (2022-05-31T11:19:32Z)
• On the Viability of Monocular Depth Pre-training for Semantic Segmentation [48.29060171161375]
  We study whether pre-training on geometric tasks is viable for downstream transfer to semantic tasks. We find that monocular depth is a viable form of pre-training for semantic segmentation, validated by improvements over common baselines.
  arXiv  Detail & Related papers  (2022-03-26T04:27:28Z)
• Ousiometrics and Telegnomics: The essence of meaning conforms to a two-dimensional powerful-weak and dangerous-safe framework with diverse corpora presenting a safety bias [0.0]
  We show that the essence of meaning conveyed by words is instead best described by a compass-like power-danger framework. We introduce and explore synousionyms' and antousionyms' -- ousiometric counterparts of synonyms and antonyms. We use our findings to construct and test a prototype ousiometer'
  arXiv  Detail & Related papers  (2021-10-13T16:35:22Z)
• Semantic Analysis for Automated Evaluation of the Potential Impact of Research Articles [62.997667081978825]
  This paper presents a novel method for vector representation of text meaning based on information theory. We show how this informational semantics is used for text classification on the basis of the Leicester Scientific Corpus. We show that an informational approach to representing the meaning of a text has offered a way to effectively predict the scientific impact of research papers.
  arXiv  Detail & Related papers  (2021-04-26T20:37:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.