Metric-Guided Synthesis of Class Activation Mapping

• URL: http://arxiv.org/abs/2504.09998v1
• Date: Mon, 14 Apr 2025 09:01:49 GMT
• Title: Metric-Guided Synthesis of Class Activation Mapping
• Authors: Alejandro Luque-Cerpa, Elizabeth Polgreen, Ajitha Rajan, Hazem Torfah,
• Abstract summary: Class activation mapping (CAM) is a class of saliency methods used to explain the behavior of convolutional neural networks (CNNs)<n>In this paper, we introduce SyCAM, a metric-based approach for CAM expressions.
• Score: 46.28094812718678
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Class activation mapping (CAM) is a widely adopted class of saliency methods used to explain the behavior of convolutional neural networks (CNNs). These methods generate heatmaps that highlight the parts of the input most relevant to the CNN output. Various CAM methods have been proposed, each distinguished by the expressions used to derive heatmaps. In general, users look for heatmaps with specific properties that reflect different aspects of CNN functionality. These may include similarity to ground truth, robustness, equivariance, and more. Although existing CAM methods implicitly encode some of these properties in their expressions, they do not allow for variability in heatmap generation following the user's intent or domain knowledge. In this paper, we address this limitation by introducing SyCAM, a metric-based approach for synthesizing CAM expressions. Given a predefined evaluation metric for saliency maps, SyCAM automatically generates CAM expressions optimized for that metric. We specifically explore a syntax-guided synthesis instantiation of SyCAM, where CAM expressions are derived based on predefined syntactic constraints and the given metric. Using several established evaluation metrics, we demonstrate the efficacy and flexibility of our approach in generating targeted heatmaps. We compare SyCAM with other well-known CAM methods on three prominent models: ResNet50, VGG16, and VGG19.

Related papers

• A Top-down Graph-based Tool for Modeling Classical Semantic Maps: A Crosslinguistic Case Study of Supplementary Adverbs [50.982315553104975]
  Semantic map models (SMMs) construct a network-like conceptual space from cross-linguistic instances or forms.<n>Most SMMs are manually built by human experts using bottom-up procedures.<n>We propose a novel graph-based algorithm that automatically generates conceptual spaces and SMMs in a top-down manner.
  arXiv  Detail & Related papers  (2024-12-02T12:06:41Z)
• BroadCAM: Outcome-agnostic Class Activation Mapping for Small-scale Weakly Supervised Applications [69.22739434619531]
  We propose an outcome-agnostic CAM approach, called BroadCAM, for small-scale weakly supervised applications. By evaluating BroadCAM on VOC2012 and BCSS-WSSS for WSSS and OpenImages30k for WSOL, BroadCAM demonstrates superior performance.
  arXiv  Detail & Related papers  (2023-09-07T06:45:43Z)
• MetaCAM: Ensemble-Based Class Activation Map [0.0]
  Class Activation Maps (CAMs) are an increasingly popular category of visual explanation methods for CNNs. We propose MetaCAM, an ensemble-based method for combining multiple existing CAM methods. We show that MetaCAM outperforms existing CAMs and refines the most salient regions of images used for model predictions.
  arXiv  Detail & Related papers  (2023-07-31T17:20:48Z)
• Opti-CAM: Optimizing saliency maps for interpretability [10.122899813335694]
  We introduce Opti-CAM, combining ideas from CAM-based and masking-based approaches. Our saliency map is a linear combination of feature maps, where weights are optimized per image. On several datasets, Opti-CAM largely outperforms other CAM-based approaches according to the most relevant classification metrics.
  arXiv  Detail & Related papers  (2023-01-17T16:44:48Z)
• Recipro-CAM: Gradient-free reciprocal class activation map [0.0]
  We propose a lightweight architecture and gradient free Reciprocal CAM (Recipro-CAM) to exploit the correlation between activation maps and network outputs. With the proposed method, we achieved the gains of 1:78 - 3:72% in the ResNet family compared to Score-CAM. In addition, Recipro-CAM exhibits a saliency map generation rate similar to Grad-CAM and approximately 148 times faster than Score-CAM.
  arXiv  Detail & Related papers  (2022-09-28T13:15:03Z)
• VS-CAM: Vertex Semantic Class Activation Mapping to Interpret Vision Graph Neural Network [10.365366151667017]
  Graph convolutional neural network (GCN) has drawn increasing attention and attained good performance in various computer vision tasks. For standard convolutional neural networks (CNNs), class activation mapping (CAM) methods are commonly used to visualize the connection between CNN's decision and image region by generating a heatmap. In this paper, we proposed a novel visualization method particularly applicable to GCN, Vertex Semantic Class Activation Mapping (VS-CAM)
  arXiv  Detail & Related papers  (2022-09-15T09:45:59Z)
• Generalizing Adversarial Explanations with Grad-CAM [7.165984630575092]
  We present a novel method that extends Grad-CAM from example-based explanations to a method for explaining global model behaviour. For our experiment, we study adversarial attacks on deep models such as VGG16, ResNet50, and ResNet101, and wide models such as InceptionNetv3 and XceptionNet. The proposed method can be used to understand adversarial attacks and explain the behaviour of black box CNN models for image analysis.
  arXiv  Detail & Related papers  (2022-04-11T22:09:21Z)
• Class Re-Activation Maps for Weakly-Supervised Semantic Segmentation [88.55040177178442]
  Class activation maps (CAM) is arguably the most standard step of generating pseudo masks for semantic segmentation. Yet, the crux of the unsatisfactory pseudo masks is the binary cross-entropy loss (BCE) widely used in CAM. We introduce an embarrassingly simple yet surprisingly effective method: Reactivating the converged CAM with BCE by using softmax cross-entropy loss (SCE) The evaluation on both PASCAL VOC and MSCOCO shows that ReCAM not only generates high-quality masks, but also supports plug-and-play in any CAM variant with little overhead.
  arXiv  Detail & Related papers  (2022-03-02T09:14:58Z)
• SChME at SemEval-2020 Task 1: A Model Ensemble for Detecting Lexical Semantic Change [58.87961226278285]
  This paper describes SChME, a method used in SemEval-2020 Task 1 on unsupervised detection of lexical semantic change. SChME usesa model ensemble combining signals of distributional models (word embeddings) and wordfrequency models where each model casts a vote indicating the probability that a word sufferedsemantic change according to that feature.
  arXiv  Detail & Related papers  (2020-12-02T23:56:34Z)
• Use HiResCAM instead of Grad-CAM for faithful explanations of convolutional neural networks [89.56292219019163]
  Explanation methods facilitate the development of models that learn meaningful concepts and avoid exploiting spurious correlations. We illustrate a previously unrecognized limitation of the popular neural network explanation method Grad-CAM. We propose HiResCAM, a class-specific explanation method that is guaranteed to highlight only the locations the model used to make each prediction.
  arXiv  Detail & Related papers  (2020-11-17T19:26:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.