Unsupervised Identification and Removal of Spurious Correlations During Fine-Tuning

• URL: http://arxiv.org/abs/2605.27676v1
• Date: Tue, 26 May 2026 20:51:48 GMT
• Title: Unsupervised Identification and Removal of Spurious Correlations During Fine-Tuning
• Abstract summary: Fine-tuning a pretrained language model on a curated dataset can produce spurious correlations.<n>We show that latent factors can be identified, without supervision, from the weights of a naive LoRA fine-tune.<n>We propose GRASP, GRadient projection of Associated Spurious Patterns.
• Score: 6.800325210654667
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Fine-tuning a pretrained language model on a curated dataset can produce spurious correlations between the fine-tuning task and unintended latent factors -- such as misaligned personas or political slant -- that the curation procedure has entangled with the task. The model can latch onto these spurious correlations, leading to bias and reduced out-of-distribution generalisation. We prove that under reasonable assumptions on task complexity and the spurious correlation, such latent factors can be identified, without supervision, from the weights of a naive LoRA fine-tune. Existing approaches to removing bias, such as activation steering, remove identified factors from residual-stream activations, either at inference or during training. We argue, however, that the goal should be to remove the spurious correlation, not the latent factor itself, as the pretrained model may rely on it for genuine task signal. To enable this, we propose GRASP, GRadient projection of Associated Spurious Patterns, which prevents the model from acquiring new reliance on the identified latent factor while preserving any pretrained content along it. We validate on three fine-tuning tasks. The first two involve emergent misalignment, where fine-tuning on a narrow task -- in our case, writing insecure code and giving bad medical advice -- leads to misaligned responses on unrelated topics. Here our method completely removes misalignment in the insecure code case and reduces them by ~5x in the bad medical advice case, beating all baselines in the trade-off between misalignment-reduction and task-preservation. The last is a novel political-bias experiment, where fine-tuning on right-skewed Reddit financial-advice data causes political-lean drift on unrelated topics. Here our method reduces drift by more than half, while improving financial task performance, beating all baselines.

Related papers

• The Intervention Gap in Latent World Models [0.0]
  Planning-time intervention fidelity is a distinct, measurable property of a learned world model.<n>Across released TD-MPC2 checkpoint sizes, episode return falls as an operator-error diagnostic on task observables grows.<n>A self-supervised world model trained without task signal preserves the same operator substantially better than a task-anchored model on the shared task.
  arXiv  Detail & Related papers  (2026-08-30T19:47:51Z)
• Pitfalls and Remedies for Multi-Task Bayesian Optimization [10.431916242473045]
  Bayesian optimization routinely warms a target experiment with data from related source tasks.<n>We revisit this default in a controlled setting and find that it misestimates the cross-task correlation.<n>We trace the failure to two independent structural mechanisms.
  arXiv  Detail & Related papers  (2026-07-10T03:38:36Z)
• LLMs Learn to Deceive Unintentionally: Emergent Misalignment in Dishonesty from Misaligned Samples to Biased Human-AI Interactions [60.48458130500911]
  We investigate whether emergent misalignment can extend beyond safety behaviors to a broader spectrum of dishonesty and deception under high-stakes scenarios.<n>We finetune open-sourced LLMs on misaligned completions across diverse domains.<n>We find that introducing as little as 1% of misalignment data into a standard downstream task is sufficient to decrease honest behavior over 20%.
  arXiv  Detail & Related papers  (2025-10-09T13:35:19Z)
• Mitigating Spurious Correlations Between Question and Answer via Chain-of-Thought Correctness Perception Distillation [25.195244084313114]
  Chain-of-Thought Correctness Perception Distillation (CoPeD) aims to improve the reasoning quality of the student model.<n>CoPeD encourages the student model to predict answers based on correct rationales and revise them when they are incorrect.
  arXiv  Detail & Related papers  (2025-09-06T05:33:17Z)
• TRACEALIGN -- Tracing the Drift: Attributing Alignment Failures to Training-Time Belief Sources in LLMs [7.125400292079228]
  Large Language Models (LLMs) fine-tuned to align with human values often exhibit alignment drift.<n>While prior work has behaviorally characterized alignment failure, little is known about the training-time belief sources underlying these failures.<n>We introduce TraceAlign, a unified framework for tracing unsafe completions back to their root causes in the model's training corpus.
  arXiv  Detail & Related papers  (2025-08-04T05:03:35Z)
• Improving Group Robustness on Spurious Correlation via Evidential Alignment [26.544938760265136]
  Deep neural networks often learn and rely on spurious correlations, i.e., superficial associations between non-causal features and the targets.<n>Existing methods typically mitigate this issue by using external group annotations or auxiliary deterministic models.<n>We propose Evidential Alignment, a novel framework that leverages uncertainty quantification to understand the behavior of the biased models.
  arXiv  Detail & Related papers  (2025-06-12T22:47:21Z)
• ALBAR: Adversarial Learning approach to mitigate Biases in Action Recognition [52.537021302246664]
  Action recognition models often suffer from background bias (i.e., inferring actions based on background cues) and foreground bias (i.e., relying on subject appearance)<n>We propose ALBAR, a novel adversarial training method that mitigates foreground and background biases without requiring specialized knowledge of the bias attributes.<n>We evaluate our method on established background and foreground bias protocols, setting a new state-of-the-art and strongly improving combined debiasing performance by over 12% absolute on HMDB51.
  arXiv  Detail & Related papers  (2025-01-31T20:47:06Z)
• Single-weight Model Editing for Post-hoc Spurious Correlation Neutralization [54.8794775172033]
  Neural network training tends to exploit the simplest features as shortcuts to greedily minimize training loss.<n>Some of these features might be spuriously correlated with the target labels, leading to incorrect predictions by the model.<n>We propose a unique precise class removal technique that makes a single-weight modification, which entails negligible performance compromise.
  arXiv  Detail & Related papers  (2025-01-24T02:22:42Z)
• Robustly Improving Bandit Algorithms with Confounded and Selection Biased Offline Data: A Causal Approach [18.13887411913371]
  This paper studies bandit problems where an agent has access to offline data that might be utilized to potentially improve the estimation of each arm's reward distribution. We categorize the biases into confounding bias and selection bias based on the causal structure they imply. We extract the causal bound for each arm that is robust towards compound biases from biased observational data.
  arXiv  Detail & Related papers  (2023-12-20T03:03:06Z)
• Nonparametric Identifiability of Causal Representations from Unknown Interventions [63.1354734978244]
  We study causal representation learning, the task of inferring latent causal variables and their causal relations from mixtures of the variables. Our goal is to identify both the ground truth latents and their causal graph up to a set of ambiguities which we show to be irresolvable from interventional data.
  arXiv  Detail & Related papers  (2023-06-01T10:51:58Z)
• Neighborhood Adaptive Estimators for Causal Inference under Network Interference [109.17155002599978]
  We consider the violation of the classical no-interference assumption with units connected by a network.<n>For tractability, we consider a known network that describes how interference may spread.
  arXiv  Detail & Related papers  (2022-12-07T14:53:47Z)
• Self-supervised debiasing using low rank regularization [59.84695042540525]
  Spurious correlations can cause strong biases in deep neural networks, impairing generalization ability. We propose a self-supervised debiasing framework potentially compatible with unlabeled samples. Remarkably, the proposed debiasing framework significantly improves the generalization performance of self-supervised learning baselines.
  arXiv  Detail & Related papers  (2022-10-11T08:26:19Z)
• DisCor: Corrective Feedback in Reinforcement Learning via Distribution Correction [96.90215318875859]
  We show that bootstrapping-based Q-learning algorithms do not necessarily benefit from corrective feedback. We propose a new algorithm, DisCor, which computes an approximation to this optimal distribution and uses it to re-weight the transitions used for training.
  arXiv  Detail & Related papers  (2020-03-16T16:18:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.