ShapBPT: Image Feature Attributions Using Data-Aware Binary Partition Trees

• URL: http://arxiv.org/abs/2602.07047v1
• Date: Wed, 04 Feb 2026 10:42:21 GMT
• Title: ShapBPT: Image Feature Attributions Using Data-Aware Binary Partition Trees
• Authors: Muhammad Rashid, Elvio G. Amparore, Enrico Ferrari, Damiano Verda,
• Abstract summary: Pixel-level feature attributions are an important tool in eXplainable AI for Computer Vision (XCV)<n>This paper introduces ShapBPT, a novel data-aware XCV method based on the hierarchical Shapley formula.<n>By using this data-aware hierarchical partitioning, ShapBPT ensures that feature attributions align with intrinsic image data.
• Score: 3.7098626170498643
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Pixel-level feature attributions are an important tool in eXplainable AI for Computer Vision (XCV), providing visual insights into how image features influence model predictions. The Owen formula for hierarchical Shapley values has been widely used to interpret machine learning (ML) models and their learned representations. However, existing hierarchical Shapley approaches do not exploit the multiscale structure of image data, leading to slow convergence and weak alignment with the actual morphological features. Moreover, no prior Shapley method has leveraged data-aware hierarchies for Computer Vision tasks, leaving a gap in model interpretability of structured visual data. To address this, this paper introduces ShapBPT, a novel data-aware XCV method based on the hierarchical Shapley formula. ShapBPT assigns Shapley coefficients to a multiscale hierarchical structure tailored for images, the Binary Partition Tree (BPT). By using this data-aware hierarchical partitioning, ShapBPT ensures that feature attributions align with intrinsic image morphology, effectively prioritizing relevant regions while reducing computational overhead. This advancement connects hierarchical Shapley methods with image data, providing a more efficient and semantically meaningful approach to visual interpretability. Experimental results confirm ShapBPT's effectiveness, demonstrating superior alignment with image structures and improved efficiency over existing XCV methods, and a 20-subject user study confirming that ShapBPT explanations are preferred by humans.

Related papers

• Feature Engineering is Not Dead: Reviving Classical Machine Learning with Entropy, HOG, and LBP Feature Fusion for Image Classification [0.13194391758295113]
  We revisit classical machine learning based image classification through a novel approach centered on Permutation Entropy (PE)<n>We extend PE to two-dimensional images and propose a multiscale, multi-orientation entropy-based feature extraction approach.<n>Our results demonstrate that the fusion of PE with HOG and LBP provides a compact, interpretable, and effective alternative to computationally expensive and limited interpretable deep learning models.
  arXiv  Detail & Related papers  (2025-07-18T09:29:03Z)
• COMIX: Compositional Explanations using Prototypes [46.15031477955461]
  We propose a method to align machine representations with human understanding.<n>The proposed method, named COMIX, classifies an image by decomposing it into regions based on learned concepts.<n>We show that our method provides fidelity of explanations and shows that the efficiency is competitive with other inherently interpretable architectures.
  arXiv  Detail & Related papers  (2025-01-10T15:40:31Z)
• Table2Image: Interpretable Tabular Data Classification with Realistic Image Transformations [5.62508658491325]
  This paper introduces Table2Image, a novel framework that transforms tabular data into realistic and diverse image representations.<n>We also present an interpretability framework that integrates insights from both the original data and its transformed image representations.
  arXiv  Detail & Related papers  (2024-12-09T07:24:31Z)
• Hierarchical Information Flow for Generalized Efficient Image Restoration [108.83750852785582]
  We propose a hierarchical information flow mechanism for image restoration, dubbed Hi-IR.<n>Hi-IR constructs a hierarchical information tree representing the degraded image across three levels.<n>In seven common image restoration tasks, Hi-IR achieves its effectiveness and generalizability.
  arXiv  Detail & Related papers  (2024-11-27T18:30:08Z)
• ShapG: new feature importance method based on the Shapley value [3.411077163447709]
  We propose a new Explainable Artificial Intelligence (XAI) method called ShapG (Explanations based on Shapley value for Graphs) for measuring feature importance.<n>At the first stage, it defines an undirected graph based on the dataset, where nodes represent features and edges are added.<n>At the second stage, it calculates an approximated Shapley value by sampling the data taking into account this graph structure.
  arXiv  Detail & Related papers  (2024-06-29T18:19:55Z)
• Parameter-Inverted Image Pyramid Networks [49.35689698870247]
  We propose a novel network architecture known as the Inverted Image Pyramid Networks (PIIP) Our core idea is to use models with different parameter sizes to process different resolution levels of the image pyramid. PIIP achieves superior performance in tasks such as object detection, segmentation, and image classification.
  arXiv  Detail & Related papers  (2024-06-06T17:59:10Z)
• Efficient Visual State Space Model for Image Deblurring [99.54894198086852]
  Convolutional neural networks (CNNs) and Vision Transformers (ViTs) have achieved excellent performance in image restoration.<n>We propose a simple yet effective visual state space model (EVSSM) for image deblurring.<n>The proposed EVSSM performs favorably against state-of-the-art methods on benchmark datasets and real-world images.
  arXiv  Detail & Related papers  (2024-05-23T09:13:36Z)
• Fast Hierarchical Games for Image Explanations [78.16853337149871]
  We present a model-agnostic explanation method for image classification based on a hierarchical extension of Shapley coefficients. Unlike other Shapley-based explanation methods, h-Shap is scalable and can be computed without the need of approximation. We compare our hierarchical approach with popular Shapley-based and non-Shapley-based methods on a synthetic dataset, a medical imaging scenario, and a general computer vision problem.
  arXiv  Detail & Related papers  (2021-04-13T13:11:02Z)
• Out-of-distribution Generalization via Partial Feature Decorrelation [72.96261704851683]
  We present a novel Partial Feature Decorrelation Learning (PFDL) algorithm, which jointly optimize a feature decomposition network and the target image classification model. The experiments on real-world datasets demonstrate that our method can improve the backbone model's accuracy on OOD image classification datasets.
  arXiv  Detail & Related papers  (2020-07-30T05:48:48Z)
• Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond [62.730497582218284]
  We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation. We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
  arXiv  Detail & Related papers  (2020-04-30T03:23:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.