Spectral Integrated Gradients for Coarse-to-Fine Feature Attribution

• URL: http://arxiv.org/abs/2605.19607v1
• Date: Tue, 19 May 2026 09:47:04 GMT
• Title: Spectral Integrated Gradients for Coarse-to-Fine Feature Attribution
• Abstract summary: Integrated Gradients (IG) is a widely adopted feature attribution method.<n>Standard straight-line path introduces all input features simultaneously, often accumulating noisy gradients along the way.<n>We propose Spectral Integrated Gradients, which constructs integration paths based on singular value decomposition.
• Score: 26.87015322424142
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Integrated Gradients (IG) is a widely adopted feature attribution method that satisfies desirable axiomatic properties. However, the choice of integration path significantly affects the quality of attributions, and the standard straight-line path introduces all input features simultaneously, often accumulating noisy gradients along the way. To address this limitation, we propose Spectral Integrated Gradients, which constructs integration paths based on singular value decomposition (SVD) of the baseline-to-input difference. By progressively activating singular components from largest to smallest, SIG introduces global structure before fine-grained details, naturally following a coarse-to-fine progression. Through extensive evaluation across diverse image classification datasets, we demonstrate that SIG produces cleaner attribution maps with reduced noise and achieves improved quantitative performance compared to existing path-based attribution methods. Our code is available at https://github.com/leekwoon/sig/.

Related papers

• A Polynomial Architecture-Attribution Co-Design Framework for Exact Aumann-Shapley Attribution in GNNs [13.870126338533346]
  We study feature-level and node-level explanations for graph neural networks (GNNs) through the lens of Aumann-Shapley attribution.<n>Path-integral methods such as Integrated Gradients provide an axiomatic formulation of attribution, but their practical use in deep GNNs typically relies on finite-sample numerical approximations to the path integral.<n>This paper proposes APEX, a model-attribution co-design framework that makes the attribution exactly integral under a GNN architecture.
  arXiv  Detail & Related papers  (2026-07-23T09:26:15Z)
• Manifold-Aligned Guided Integrated Gradients for Reliable Feature Attribution [26.87015322424142]
  Integrated Gradients (IG) can yield unreliable explanations when the integration path between a baseline and the input passes through regions with noisy gradients.<n>We propose emphManifold-Aligned Guided Integrated Gradients (MA-GIG), which constructs attribution paths in the latent space of a pre-trained variational autoencoder.
  arXiv  Detail & Related papers  (2026-05-04T02:56:29Z)
• Grad-ELLM: Gradient-based Explanations for Decoder-only LLMs [52.15785423211181]
  Grad-ELLM is a gradient-based attribution method for decoder-only transformer-based Large Language Models.<n>We introduce two faithfulneses metrics $$-Soft-NC and $$-Soft-NS, which provide fairer comparisons.<n>Experiment results show that Grad-ELLM consistently achieves superior faithfulness than other attribution methods.
  arXiv  Detail & Related papers  (2026-01-06T15:22:39Z)
• CogniEdit: Dense Gradient Flow Optimization for Fine-Grained Image Editing [88.9067184995168]
  We propose a unified framework CogniEdit, combining multi-modal reasoning with dense reward optimization.<n>Our method achieves state-of-the-art performance in balancing fine-grained instruction following with visual quality and editability preservation.
  arXiv  Detail & Related papers  (2025-12-15T12:36:50Z)
• Unleashing Degradation-Carrying Features in Symmetric U-Net: Simpler and Stronger Baselines for All-in-One Image Restoration [52.82397287366076]
  All-in-one image restoration aims to handle diverse degradations (e.g., noise, blur, adverse weather) within a unified framework.<n>In this work, we reveal a critical insight: well-crafted feature extraction inherently encodes degradation-carrying information.<n>Our symmetric design preserves intrinsic degradation signals robustly, rendering simple additive fusion in skip connections.
  arXiv  Detail & Related papers  (2025-12-11T12:20:31Z)
• Using the Path of Least Resistance to Explain Deep Networks [5.614094161229764]
  Integrated Gradients (IG) is a widely used axiomatic path-based attribution method.<n>We show that straight paths can lead to flawed attributions.<n>We propose Geodesic Integrated Gradients (GIG) as an alternative.
  arXiv  Detail & Related papers  (2025-02-17T18:29:24Z)
• A Refreshed Similarity-based Upsampler for Direct High-Ratio Feature Upsampling [54.05517338122698]
  A popular similarity-based feature upsampling pipeline has been proposed, which utilizes a high-resolution feature as guidance.<n>We propose an explicitly controllable query-key feature alignment from both semantic-aware and detail-aware perspectives.<n>We develop a fine-grained neighbor selection strategy on HR features, which is simple yet effective for alleviating mosaic artifacts.
  arXiv  Detail & Related papers  (2024-07-02T14:12:21Z)
• IG2: Integrated Gradient on Iterative Gradient Path for Feature Attribution [6.278326325782819]
  Iterative Gradient path Integrated Gradients (IG2) is a prominent path attribution method for deep neural networks. IG2 incorporates the counterfactual gradient iteratively into the integration path, generating a novel path (GradPath) and a novel baseline (GradCF) Experimental results on XAI benchmark, ImageNet, MNIST, TREC questions answering, wafer-map failure patterns, and CelebA face attributes validate that IG2 delivers superior feature attributions.
  arXiv  Detail & Related papers  (2024-06-16T08:48:03Z)
• Calibrated Feature Decomposition for Generalizable Person Re-Identification [82.64133819313186]
  Calibrated Feature Decomposition (CFD) module focuses on improving the generalization capacity for person re-identification. A calibrated-and-standardized Batch normalization (CSBN) is designed to learn calibrated person representation.
  arXiv  Detail & Related papers  (2021-11-27T17:12:43Z)
• Investigating Saturation Effects in Integrated Gradients [5.366801257602863]
  We propose a variant of IntegratedGradients which primarily captures gradients in unsaturated regions. We find that this attribution technique shows higher model faithfulness and lower sensitivity to noise com-pared with standard Integrated Gradients.
  arXiv  Detail & Related papers  (2020-10-23T22:48:02Z)
• Understanding Integrated Gradients with SmoothTaylor for Deep Neural Network Attribution [70.78655569298923]
  Integrated Gradients as an attribution method for deep neural network models offers simple implementability. It suffers from noisiness of explanations which affects the ease of interpretability. The SmoothGrad technique is proposed to solve the noisiness issue and smoothen the attribution maps of any gradient-based attribution method.
  arXiv  Detail & Related papers  (2020-04-22T10:43:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.