Where Steering Signals Come From: Activation Source Selection in Activation Steering

• URL: http://arxiv.org/abs/2607.25270v1
• Date: Tue, 28 Jul 2026 04:18:24 GMT
• Title: Where Steering Signals Come From: Activation Source Selection in Activation Steering
• Abstract summary: We find that effective steering is not explained simply by whether the desired behavior appears in the source text.<n>Strong signals come from execution-boundary states, where the model is about to produce or continue the target behavior.<n>Building on this view, we introduce tail subtraction, which removes shared prompt and continuation semantics from boundary states.
• Score: 71.96112659293725
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Activation steering controls language models by adding vectors or features to hidden states at inference time, but the upstream source of these steering signals is often treated as a secondary detail. We study this source choice as activation source selection: the combination of source context and activation readout policy used to collect the hidden states from which a steering signal is built. Holding the downstream intervention fixed, we show across three instruction-tuned models and four steering task families that changing only the source activations substantially changes steering success. We further find that effective steering is not explained simply by whether the desired behavior appears in the source text. Instead, strong signals come from execution-boundary states, where the model is about to produce or continue the target behavior. This pre-/post-realization distinction explains why answer-based sources sometimes work: their useful component aligns with execution-boundary directions rather than target appearance alone. Building on this view, we introduce tail subtraction, which removes shared prompt and continuation semantics from boundary states and yields cleaner, more stable steering signals. Overall, our results suggest that steering depends on representations of what the model is about to do, not merely on what has already appeared.

Related papers

• Disentangling Steering Vectors [13.671243729016568]
  We propose a framework to explicitly isolate individual and semantically consistent features from composite directions.<n>Specifically, we pair positive and negative activations and take their differences to generate a set of instance-level steering vectors.<n>We show that our method yields a set of semantically consistent basis vectors whose steering effects are mutually distinguishable.
  arXiv  Detail & Related papers  (2026-09-07T04:45:32Z)
• DiMaS: Distribution Matching for Steering Vision-Language-Action Models [41.9662194189542]
  Flow-matching vision-language-action (VLA) models have emerged as powerful policies for robotic manipulation.<n> behavioral control is the ability to govern how a robot performs a task by intervening on its internal representations.<n>We propose DiMaS, a Distribution-Matching Steering strategy tailored to flow-matching VLAs.
  arXiv  Detail & Related papers  (2026-07-15T18:39:13Z)
• When is Your LLM Steerable? [56.656180566692946]
  Activation steering offers a lightweight approach to control language models' behavior at inference time.<n>Finding the regime and boundaries of successful steering typically requires expensive grid searches.<n>We investigate whether steerability can be predicted from the model's internal states at the beginning of the generation process.
  arXiv  Detail & Related papers  (2026-06-10T02:55:34Z)
• Steer Like the LLM: Activation Steering that Mimics Prompting [0.0]
  Large language models can be steered at inference time through prompting or activation interventions.<n> activation steering methods often underperform compared to prompt-based approaches.<n>We propose a framework that formulates prompt steering as a form of activation steering.
  arXiv  Detail & Related papers  (2026-05-05T15:59:42Z)
• What Drives Representation Steering? A Mechanistic Case Study on Steering Refusal [53.189667624047416]
  We show that different steering methodologies leverage functionally interchangeable circuits when applied at the same layer.<n>We show that steering vectors can be sparsified by up to 90-99% while retaining most performance.
  arXiv  Detail & Related papers  (2026-04-09T17:57:14Z)
• ODESteer: A Unified ODE-Based Steering Framework for LLM Alignment [49.68063561145927]
  We propose a unified ordinary differential equations (ODEs)-based theoretical framework for activation steering.<n>We introduce ODESteer, a kind of ODE-based steering guided by barrier functions.<n>Compared to state-of-the-art activation steering methods, ODESteer achieves consistent empirical improvements.
  arXiv  Detail & Related papers  (2026-02-19T17:13:44Z)
• Why Steering Works: Toward a Unified View of Language Model Parameter Dynamics [81.80010043113445]
  Local weight fine-tuning, LoRA-based adaptation, and activation-based interventions are studied in isolation.<n>We present a unified view that frames these interventions as dynamic weight updates induced by a control signal.<n>Across methods, we observe a consistent trade-off between preference and utility: stronger control increases preference while predictably reducing utility.
  arXiv  Detail & Related papers  (2026-02-02T17:04:36Z)
• SteeringSafety: A Systematic Safety Evaluation Framework of Representation Steering in LLMs [42.189660766537536]
  We introduce SteeringSafety, a systematic framework for evaluating representation steering methods across seven safety perspectives spanning 17 datasets.<n>Our framework provides modularized building blocks for state-of-the-art steering methods, enabling unified implementation of DIM, ACE, CAA, PCA, and LAT with recent enhancements like conditional steering.
  arXiv  Detail & Related papers  (2025-09-16T18:36:22Z)
• Improving Instruction-Following in Language Models through Activation Steering [58.876600545898675]
  We derive instruction-specific vector representations from language models and use them to steer models accordingly.<n>We demonstrate how this method can enhance model adherence to constraints such as output format, length, and word inclusion.<n>Our findings demonstrate that activation steering offers a practical and scalable approach for fine-grained control in language generation.
  arXiv  Detail & Related papers  (2024-10-15T08:38:20Z)
• Analyzing the Generalization and Reliability of Steering Vectors [8.253773195379166]
  We show that steering vectors have substantial limitations both in- and out-of-distribution.<n>In-distribution, steerability is highly variable across different inputs.<n>Out-of-distribution, while steering vectors often generalise well, for several concepts they are brittle to reasonable changes in the prompt.
  arXiv  Detail & Related papers  (2024-07-17T08:32:03Z)
• Improving Activation Steering in Language Models with Mean-Centring [10.101141087916133]
  We find that taking the average of activations associated with a target dataset, and subtracting the mean of all training activations, results in effective steering vectors. We also apply mean-centring to extract function vectors, more effectively triggering the execution of a range of natural language tasks by a significant margin.
  arXiv  Detail & Related papers  (2023-12-06T18:27:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.