Manifold-Aligned Guided Integrated Gradients for Reliable Feature Attribution

• URL: http://arxiv.org/abs/2605.02167v2
• Date: Wed, 06 May 2026 11:20:39 GMT
• Title: Manifold-Aligned Guided Integrated Gradients for Reliable Feature Attribution
• Abstract summary: Integrated Gradients (IG) can yield unreliable explanations when the integration path between a baseline and the input passes through regions with noisy gradients.<n>We propose emphManifold-Aligned Guided Integrated Gradients (MA-GIG), which constructs attribution paths in the latent space of a pre-trained variational autoencoder.
• Score: 26.87015322424142
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Feature attribution is central to diagnosing and trusting deep neural networks, and Integrated Gradients (IG) is widely used due to its axiomatic properties. However, IG can yield unreliable explanations when the integration path between a baseline and the input passes through regions with noisy gradients. While Guided Integrated Gradients reduces this sensitivity by adaptively updating low-gradient-magnitude features, input-space guidance still produces intermediate inputs that deviate from the data manifold. To address this limitation, we propose \emph{Manifold-Aligned Guided Integrated Gradients} (MA-GIG), which constructs attribution paths in the latent space of a pre-trained variational autoencoder. By decoding intermediate latent states, MA-GIG biases the path toward the learned generative manifold and reduces exposure to implausible input-space regions. Through qualitative and quantitative evaluations, we demonstrate that MA-GIG produces faithful explanations by aggregating gradients on path features proximal to the input. Consequently, our method reduces off-manifold noise and outperforms prior path-based attribution methods across multiple datasets and classifiers. Our code is available at https://github.com/leekwoon/ma-gig/.

Related papers

• Geometric Gradient Rectification for Safe Open-Set Semi-Supervised Learning [15.386002863432678]
  Open-set semi-supervised learning aims to leverage unlabeled data that may contain out-of-distribution outliers.<n>Existing methods mainly follow two paradigms: filtering suspicious samples or incorporating unlabeled objectives with soft weighting.<n>We argue that both face a common trade-off: aggressive filtering can discard informative but hard ID samples, whereas utilization can introduce auxiliary gradients that conflict with supervised learning when pseudo labels are wrong.<n>We propose textitGeometric Gradient Rectification (GGR), a plug-in framework that uses the supervised gradient as an anchor and projects conflicting auxiliary gradients onto an admissible
  arXiv  Detail & Related papers  (2026-06-25T12:45:42Z)
• Diffusion Integrated Gradients: Controllable Path Generation for Flexible Feature Attribution [29.066960285647962]
  Integrated Diffusion Gradients (DiffIG) is a novel method that reformulates path generation as a conditional generative modeling problem.<n>We demonstrate that DiffIG quantitatively matches or outperforms existing path-based methods, achieving perceptually aligned explanations.<n>This work introduces a new generative perspective for flexible, inference-time controllable Explainable Artificial Intelligence (XAI) methods.
  arXiv  Detail & Related papers  (2026-06-21T03:04:35Z)
• Spectral Integrated Gradients for Coarse-to-Fine Feature Attribution [26.87015322424142]
  Integrated Gradients (IG) is a widely adopted feature attribution method.<n>Standard straight-line path introduces all input features simultaneously, often accumulating noisy gradients along the way.<n>We propose Spectral Integrated Gradients, which constructs integration paths based on singular value decomposition.
  arXiv  Detail & Related papers  (2026-05-19T09:47:04Z)
• Enhancing Gradient Inversion Attacks in Federated Learning via Hierarchical Feature Optimization [56.95448807869383]
  Federated Learning (FL) has emerged as a compelling paradigm for privacy-preserving distributed machine learning.<n>Recent studies find that the gradients exchanged in the FL system are also vulnerable to privacy leakage.<n>We propose textbfGradient textbfInversion over textbfFeature textbfDomains (GIFD)
  arXiv  Detail & Related papers  (2026-04-01T14:32:15Z)
• Grad-ELLM: Gradient-based Explanations for Decoder-only LLMs [52.15785423211181]
  Grad-ELLM is a gradient-based attribution method for decoder-only transformer-based Large Language Models.<n>We introduce two faithfulneses metrics $$-Soft-NC and $$-Soft-NS, which provide fairer comparisons.<n>Experiment results show that Grad-ELLM consistently achieves superior faithfulness than other attribution methods.
  arXiv  Detail & Related papers  (2026-01-06T15:22:39Z)
• Using the Path of Least Resistance to Explain Deep Networks [5.614094161229764]
  Integrated Gradients (IG) is a widely used axiomatic path-based attribution method.<n>We show that straight paths can lead to flawed attributions.<n>We propose Geodesic Integrated Gradients (GIG) as an alternative.
  arXiv  Detail & Related papers  (2025-02-17T18:29:24Z)
• IG2: Integrated Gradient on Iterative Gradient Path for Feature Attribution [6.278326325782819]
  Iterative Gradient path Integrated Gradients (IG2) is a prominent path attribution method for deep neural networks. IG2 incorporates the counterfactual gradient iteratively into the integration path, generating a novel path (GradPath) and a novel baseline (GradCF) Experimental results on XAI benchmark, ImageNet, MNIST, TREC questions answering, wafer-map failure patterns, and CelebA face attributes validate that IG2 delivers superior feature attributions.
  arXiv  Detail & Related papers  (2024-06-16T08:48:03Z)
• GIFD: A Generative Gradient Inversion Method with Feature Domain Optimization [52.55628139825667]
  Federated Learning (FL) has emerged as a promising distributed machine learning framework to preserve clients' privacy. Recent studies find that an attacker can invert the shared gradients and recover sensitive data against an FL system by leveraging pre-trained generative adversarial networks (GAN) as prior knowledge. We propose textbfGradient textbfInversion over textbfFeature textbfDomains (GIFD), which disassembles the GAN model and searches the feature domains of the intermediate layers.
  arXiv  Detail & Related papers  (2023-08-09T04:34:21Z)
• Divide and Contrast: Source-free Domain Adaptation via Adaptive Contrastive Learning [122.62311703151215]
  Divide and Contrast (DaC) aims to connect the good ends of both worlds while bypassing their limitations. DaC divides the target data into source-like and target-specific samples, where either group of samples is treated with tailored goals. We further align the source-like domain with the target-specific samples using a memory bank-based Maximum Mean Discrepancy (MMD) loss to reduce the distribution mismatch.
  arXiv  Detail & Related papers  (2022-11-12T09:21:49Z)
• The Manifold Hypothesis for Gradient-Based Explanations [55.01671263121624]
  gradient-based explanation algorithms provide perceptually-aligned explanations. We show that the more a feature attribution is aligned with the tangent space of the data, the more perceptually-aligned it tends to be. We suggest that explanation algorithms should actively strive to align their explanations with the data manifold.
  arXiv  Detail & Related papers  (2022-06-15T08:49:24Z)
• Geometrically Guided Integrated Gradients [0.3867363075280543]
  We introduce an interpretability method called "geometrically-guided integrated gradients" Our method explores the model's dynamic behavior from multiple scaled versions of the input and captures the best possible attribution for each input. We also propose a "model perturbation" sanity check to complement the traditionally used "model randomization" test.
  arXiv  Detail & Related papers  (2022-06-13T05:05:43Z)
• Guided Integrated Gradients: An Adaptive Path Method for Removing Noise [9.792727625917083]
  Integrated Gradients (IG) is a commonly used feature attribution method for deep neural networks. We show that one of the causes of the problem is the accumulation of noise along the IG path. We propose adapting the attribution path itself -- conditioning the path not just on the image but also on the model being explained.
  arXiv  Detail & Related papers  (2021-06-17T20:00:55Z)
• Understanding Integrated Gradients with SmoothTaylor for Deep Neural Network Attribution [70.78655569298923]
  Integrated Gradients as an attribution method for deep neural network models offers simple implementability. It suffers from noisiness of explanations which affects the ease of interpretability. The SmoothGrad technique is proposed to solve the noisiness issue and smoothen the attribution maps of any gradient-based attribution method.
  arXiv  Detail & Related papers  (2020-04-22T10:43:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.