Does Slightly Mean Somewhat? Measuring Vague Intensity Words in LLM Numeric Actions

• URL: http://arxiv.org/abs/2605.21827v1
• Date: Wed, 20 May 2026 23:49:44 GMT
• Title: Does Slightly Mean Somewhat? Measuring Vague Intensity Words in LLM Numeric Actions
• Abstract summary: I study a researcher-constructed scale of 10 English degree modifier, from slightly to drastically.<n>The only variable that changes between runs is the intensity word or the starting system state.<n>Across 6,620 runs at T=0.7, three patterns emerge: four lower-tier words all map to the same value, while stronger words break into higher regimes.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Do language models preserve the ordinal meaning of intensity words when those words must produce numeric actions? I study a researcher-constructed scale of 10 English degree modifiers, from slightly to drastically, informed by the Quirk et al. degree-modifier taxonomy, in a controlled resource-allocation environment where Claude Haiku receives a natural-language instruction, produces a numeric allocation, and a deterministic backend converts that allocation into a measurable outcome. The only variable that changes between runs is the intensity word or the starting system state, isolating their effects on the model's numeric output. Across 6,620 runs at T=0.0 and T=0.7, three patterns emerge. First, the model compresses 10 intensity words into 5 distinct median outputs: four lower-tier words all map to the same value, while stronger words break into higher regimes (Spearman rho = 0.845, p < 0.001). Second, when the current system state is supplied as context, separate Kruskal-Wallis tests show that grouping by starting allocation captures far more rank-based variance than grouping by word (epsilon-squared baseline = 0.782 vs. epsilon-squared word = 0.079), and lexical differentiation collapses to zero as the system approaches capacity. Third, near feasibility limits the model exhibits three behavioral modes: weak words hedge with small adjustments, strong words abstain entirely, and the word drastically pushes to the local ceiling. These patterns persist across temperature, with stochastic sampling broadening distributions but not restoring ordinal distinctions between words. In this model and domain, the model's numeric interpretation of vague intensity words is compressed, state-dependent, and discontinuous near operational boundaries.

Related papers

• Rethinking Dense Sequential Chains: Reasoning Language Models Can Extract Answers from Sparse, Order-Shuffling Chain-of-Thoughts [51.84894623128418]
  Modern reasoning language models generate dense, sequential chain-of-thought traces implicitly assuming that every token contributes and that steps must be consumed in order.<n>We challenge both assumptions through a systematic intervention pipeline--removal, masking, shuffling, and noise injection--applied to model-generated reasoning chains.<n>We find that answer extraction operates on a sparse, order-insensitive, and structurally robust informational substrate.
  arXiv  Detail & Related papers  (2026-05-08T06:15:50Z)
• Community-Specific Slang and Entity Detection via Semantic Shift in Fine-Tuned Language Models [2.938641176780401]
  We propose an unsupervised method of resolving slang, unique entities, and folklore from online communities.<n>We show that one can successfully resolve words that have unique significance to the community by pulling data in the bottom 10-percentile.<n>In contrast, we show that data in the top 10-percentile consist of words that carry relatively universal semantics.
  arXiv  Detail & Related papers  (2026-04-19T17:30:39Z)
• The Randomness Floor: Measuring Intrinsic Non-Randomness in Language Model Token Distributions [0.0]
  This paper introduces Entropic Deviation (ED), the normalised KL divergence between a model's token distribution and the uniform distribution.<n>Three transformer families converge on nearly identical ED values despite different training data and vocabularies.<n>Cross-lingual experiments with Qwen-32B show a stable gradient across five languages that does not correlate with token fertility.
  arXiv  Detail & Related papers  (2026-03-29T21:17:46Z)
• Quantifying non deterministic drift in large language models [0.0]
  Large language models (LLMs) are widely used for tasks ranging from summarisation to decision support.<n>In practice, identical prompts do not always produce identical outputs, even when temperature and other decoding parameters are fixed.<n>We quantify behavioural baseline drift, defined as output variability observed when the same prompt is issued multiple times under operator-free conditions.
  arXiv  Detail & Related papers  (2026-01-12T10:34:48Z)
• Intention Collapse: Intention-Level Metrics for Reasoning in Language Models [0.0]
  We call this process intention collapse: a many-to-one projection from a high dimensional intention space I into an external language space L.<n>We define three model agnostic intention metrics (intention entropy, effective dimensionality dimeff, and latent knowledge recoverability Recov)<n>Using a 4 bit Mistral 7B model on 200 GSM8K problems, we compare a direct answer baseline, a chain of thought (CoT) regime, and a babble control.
  arXiv  Detail & Related papers  (2026-01-03T00:19:53Z)
• The distribution of syntactic dependency distances [0.13812010983144798]
  We contribute to the characterization of the actual distribution of syntactic dependency distances.<n>We propose a new model with two exponential regimes in which the probability decay is allowed to change after a break-point.<n>We find that a two-regime model is the most likely one in all 20 languages we considered, independently of sentence length and annotation style.
  arXiv  Detail & Related papers  (2022-11-26T17:31:25Z)
• Quark: Controllable Text Generation with Reinforced Unlearning [68.07749519374089]
  Large-scale language models often learn behaviors that are misaligned with user expectations. We introduce Quantized Reward Konditioning (Quark), an algorithm for optimizing a reward function that quantifies an (un)wanted property. For unlearning toxicity, negative sentiment, and repetition, our experiments show that Quark outperforms both strong baselines and state-of-the-art reinforcement learning methods.
  arXiv  Detail & Related papers  (2022-05-26T21:11:51Z)
• Scaling Structured Inference with Randomization [64.18063627155128]
  We propose a family of dynamic programming (RDP) randomized for scaling structured models to tens of thousands of latent states. Our method is widely applicable to classical DP-based inference. It is also compatible with automatic differentiation so can be integrated with neural networks seamlessly.
  arXiv  Detail & Related papers  (2021-12-07T11:26:41Z)
• Text Information Aggregation with Centrality Attention [86.91922440508576]
  We propose a new way of obtaining aggregation weights, called eigen-centrality self-attention. We build a fully-connected graph for all the words in a sentence, then compute the eigen-centrality as the attention score of each word.
  arXiv  Detail & Related papers  (2020-11-16T13:08:48Z)
• NLP-CIC @ DIACR-Ita: POS and Neighbor Based Distributional Models for Lexical Semantic Change in Diachronic Italian Corpora [62.997667081978825]
  We present our systems and findings on unsupervised lexical semantic change for the Italian language. The task is to determine whether a target word has evolved its meaning with time, only relying on raw-text from two time-specific datasets. We propose two models representing the target words across the periods to predict the changing words using threshold and voting schemes.
  arXiv  Detail & Related papers  (2020-11-07T11:27:18Z)
• Constructing interval variables via faceted Rasch measurement and multitask deep learning: a hate speech application [63.10266319378212]
  We propose a method for measuring complex variables on a continuous, interval spectrum by combining supervised deep learning with the Constructing Measures approach to faceted Rasch item response theory (IRT) We demonstrate this new method on a dataset of 50,000 social media comments sourced from YouTube, Twitter, and Reddit and labeled by 11,000 U.S.-based Amazon Mechanical Turk workers.
  arXiv  Detail & Related papers  (2020-09-22T02:15:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.