AutoLexSteer: Automatic Contrast Construction for Lexical Activation Steering

• URL: http://arxiv.org/abs/2609.06879v1
• Date: Sun, 06 Sep 2026 23:54:05 GMT
• Title: AutoLexSteer: Automatic Contrast Construction for Lexical Activation Steering
• Abstract summary: We introduce Hangman, a novel type of steering vector that operates using word senses, as well as AutoLexSteer, the first fully automated process for building steering vectors.<n>The steering vectors are quite precise, can be used to steer at the level of words and sets of word senses (meanings) and are able to steer certain LLM behaviors like sycophancy.
• Score: 23.265383538634854
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Steering vectors have rapidly emerged as a popular and effective method for guiding the output of LLMs in very specific ways. But constructing accurate steering vectors is a difficult manual process due to the opacity of embeddings. We introduce Hangman, a novel type of steering vector that operates using word senses, as well as AutoLexSteer, the first fully automated process for building steering vectors. AutoLexSteer employs families of closely-related words extracted from WordNet to specify both the steering source to be avoided and the desired steering target. The steering vectors are quite precise, can be used to steer at the level of words and sets of word senses (meanings), and are able to steer certain LLM behaviors like sycophancy. The dataset and code can be found at https://github.com/ShuheWang1998/autolexsteer.

Related papers

• Where Steering Signals Come From: Activation Source Selection in Activation Steering [71.96112659293725]
  We find that effective steering is not explained simply by whether the desired behavior appears in the source text.<n>Strong signals come from execution-boundary states, where the model is about to produce or continue the target behavior.<n>Building on this view, we introduce tail subtraction, which removes shared prompt and continuation semantics from boundary states.
  arXiv  Detail & Related papers  (2026-07-28T04:18:24Z)
• On the Limits of Steering Vectors for Preference-Aligned Generation [12.350800078736128]
  We study the limits of steering vector generalization along three dimensions: trait expressibility, task transfer, and multi-trait composition.<n>Our results suggest that steering vectors face meaningful limits as a general-purpose tool for preference alignment.
  arXiv  Detail & Related papers  (2026-07-02T07:18:36Z)
• What Drives Representation Steering? A Mechanistic Case Study on Steering Refusal [53.189667624047416]
  We show that different steering methodologies leverage functionally interchangeable circuits when applied at the same layer.<n>We show that steering vectors can be sparsified by up to 90-99% while retaining most performance.
  arXiv  Detail & Related papers  (2026-04-09T17:57:14Z)
• SteerX: Disentangled Steering for LLM Personalization [75.89038195784701]
  Large language models (LLMs) have shown remarkable success in recent years, enabling a wide range of applications.<n>A critical factor in building such assistants is personalizing LLMs, as user preferences and needs vary widely.<n>We propose SteerX, a method that isolates preference-driven components from preference-agnostic components.
  arXiv  Detail & Related papers  (2025-10-25T11:26:20Z)
• Enhancing LLM Steering through Sparse Autoencoder-Based Vector Refinement [31.282134977964976]
  Existing steering methods rely on large-scale datasets to learn clear behavioral information.<n>We introduce Refinement of Steering Vector via Sparse Autoencoder (SAE-RSV) that leverages SAEs to semantically denoise and augment the steering vectors.<n>In our framework, we first remove task-irrelevant features according to their semantics provided by SAEs, and then enrich task-relevant features missing from the small dataset through their semantic similarity to the identified relevant features.
  arXiv  Detail & Related papers  (2025-09-28T10:49:22Z)
• Learning to Steer: Input-dependent Steering for Multimodal LLMs [54.41165851011022]
  In this paper, we investigate a fine-grained steering that uses an input-specific linear shift.<n>We train a small auxiliary module to predict the input-specific steering vector.<n>Our approach, dubbed as L2S (Learn-to-Steer), demonstrates that it reduces hallucinations and enforces safety in MLLMs, outperforming other static baselines.
  arXiv  Detail & Related papers  (2025-08-18T10:53:20Z)
• AlphaSteer: Learning Refusal Steering with Principled Null-Space Constraint [49.641959856967276]
  We present a theoretically grounded and empirically effective activation steering method called AlphaSteer.<n>For utility preservation, it learns to construct a nearly zero vector for steering benign data, with the null-space constraints.<n>Experiments across multiple jailbreak attacks and utility benchmarks demonstrate the effectiveness of AlphaSteer.
  arXiv  Detail & Related papers  (2025-06-08T07:03:28Z)
• HyperSteer: Activation Steering at Scale with Hypernetworks [25.6004576064897]
  HyperSteer is a family of hypernetwork-based architectures which are trained end-to-end to generate steering vectors conditioned on the natural language steering prompts.<n>We show that scaling HyperSteer with thousands of steering prompts exceeds the performance of state-of-the-art activation steering methods.
  arXiv  Detail & Related papers  (2025-06-03T18:32:01Z)
• Effectively Steer LLM To Follow Preference via Building Confident Directions [39.40603123075168]
  We propose a theoretical framework to understand and quantify the model steering methods.<n>Inspired by the framework, we propose a confident direction steering method (CONFST) that steers LLMs via modifying their activations.<n>Our approach offers three key advantages over popular bidirectional model steering methods.
  arXiv  Detail & Related papers  (2025-03-04T20:32:27Z)
• Improving Instruction-Following in Language Models through Activation Steering [58.876600545898675]
  We derive instruction-specific vector representations from language models and use them to steer models accordingly.<n>We demonstrate how this method can enhance model adherence to constraints such as output format, length, and word inclusion.<n>Our findings demonstrate that activation steering offers a practical and scalable approach for fine-grained control in language generation.
  arXiv  Detail & Related papers  (2024-10-15T08:38:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.