Image Forgery Detection with Interpretability

• URL: http://arxiv.org/abs/2202.00908v1
• Date: Wed, 2 Feb 2022 08:16:50 GMT
• Title: Image Forgery Detection with Interpretability
• Authors: Ankit Katiyar, Arnav Bhavsar
• Abstract summary: We consider the detection of both copy-move forgeries and inpainting based forgeries. In addition to classification, the focus is also on interpretability of the forgery detection.
• Score: 8.122270502556374
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this work, we present a learning based method focusing on the convolutional neural network (CNN) architecture to detect these forgeries. We consider the detection of both copy-move forgeries and inpainting based forgeries. For these, we synthesize our own large dataset. In addition to classification, the focus is also on interpretability of the forgery detection. As the CNN classification yields the image-level label, it is important to understand if forged region has indeed contributed to the classification. For this purpose, we demonstrate using the Grad-CAM heatmap, that in various correctly classified examples, that the forged region is indeed the region contributing to the classification. Interestingly, this is also applicable for small forged regions, as is depicted in our results. Such an analysis can also help in establishing the reliability of the classification.

Related papers

• Spatial Action Unit Cues for Interpretable Deep Facial Expression Recognition [55.97779732051921]
  State-of-the-art classifiers for facial expression recognition (FER) lack interpretability, an important feature for end-users. A new learning strategy is proposed to explicitly incorporate AU cues into classifier training, allowing to train deep interpretable models. Our new strategy is generic, and can be applied to any deep CNN- or transformer-based classifier without requiring any architectural change or significant additional training time.
  arXiv  Detail & Related papers  (2024-10-01T10:42:55Z)
• LEAD: Self-Supervised Landmark Estimation by Aligning Distributions of Feature Similarity [49.84167231111667]
  Existing works in self-supervised landmark detection are based on learning dense (pixel-level) feature representations from an image. We introduce an approach to enhance the learning of dense equivariant representations in a self-supervised fashion. We show that having such a prior in the feature extractor helps in landmark detection, even under drastically limited number of annotations.
  arXiv  Detail & Related papers  (2022-04-06T17:48:18Z)
• Importance Sampling CAMs for Weakly-Supervised Segmentation [16.86352815414646]
  Class activation maps (CAMs) can be used to localize and segment objects in images by means of class activation maps (CAMs) In this work, we approach both problems with two contributions for improving CAM learning. We conduct experiments on the PASCAL VOC 2012 benchmark dataset to demonstrate that these modifications significantly increase the performance in terms of contour accuracy.
  arXiv  Detail & Related papers  (2022-03-23T14:54:29Z)
• A Sneak Attack on Segmentation of Medical Images Using Deep Neural Network Classifiers [0.0]
  We use trained Convolutional Neural Network (CNN) classifiers to approach the segmentation problem. Heatmaps can be visualized and formed using Gradient-weighted Class Activation Mapping (Grad-CAM) Results from our experiments show that heatmaps can locate and segment partial tumor areas.
  arXiv  Detail & Related papers  (2022-01-08T05:57:26Z)
• Weakly-supervised fire segmentation by visualizing intermediate CNN layers [82.75113406937194]
  Fire localization in images and videos is an important step for an autonomous system to combat fire incidents. We consider weakly supervised segmentation of fire in images, in which only image labels are used to train the network. We show that in the case of fire segmentation, which is a binary segmentation problem, the mean value of features in a mid-layer of classification CNN can perform better than conventional Class Activation Mapping (CAM) method.
  arXiv  Detail & Related papers  (2021-11-16T11:56:28Z)
• Re-rank Coarse Classification with Local Region Enhanced Features for Fine-Grained Image Recognition [22.83821575990778]
  We re-rank the TopN classification results by using the local region enhanced embedding features to improve the Top1 accuracy. To learn more effective semantic global features, we design a multi-level loss over an automatically constructed hierarchical category structure. Our method achieves state-of-the-art performance on three benchmarks: CUB-200-2011, Stanford Cars, and FGVC Aircraft.
  arXiv  Detail & Related papers  (2021-02-19T11:30:25Z)
• Region Growing with Convolutional Neural Networks for Biomedical Image Segmentation [1.5469452301122177]
  We present a methodology that uses convolutional neural networks (CNNs) for segmentation by iteratively growing predicted mask regions in each coordinate direction. We use a threshold on the CNN probability scores to determine whether pixels are added to the region and the iteration continues until no new pixels are added to the region. Our method is able to achieve high segmentation accuracy and preserve biologically realistic morphological features while leveraging small amounts of training data and maintaining computational efficiency.
  arXiv  Detail & Related papers  (2020-09-23T17:53:00Z)
• Region Comparison Network for Interpretable Few-shot Image Classification [97.97902360117368]
  Few-shot image classification has been proposed to effectively use only a limited number of labeled examples to train models for new classes. We propose a metric learning based method named Region Comparison Network (RCN), which is able to reveal how few-shot learning works. We also present a new way to generalize the interpretability from the level of tasks to categories.
  arXiv  Detail & Related papers  (2020-09-08T07:29:05Z)
• Fine-Grained Visual Classification with Efficient End-to-end Localization [49.9887676289364]
  We present an efficient localization module that can be fused with a classification network in an end-to-end setup. We evaluate the new model on the three benchmark datasets CUB200-2011, Stanford Cars and FGVC-Aircraft.
  arXiv  Detail & Related papers  (2020-05-11T14:07:06Z)
• Manifold-driven Attention Maps for Weakly Supervised Segmentation [9.289524646688244]
  We propose a manifold driven attention-based network to enhance visual salient regions. Our method generates superior attention maps directly during inference without the need of extra computations.
  arXiv  Detail & Related papers  (2020-04-07T00:03:28Z)
• High-Order Information Matters: Learning Relation and Topology for Occluded Person Re-Identification [84.43394420267794]
  We propose a novel framework by learning high-order relation and topology information for discriminative features and robust alignment. Our framework significantly outperforms state-of-the-art by6.5%mAP scores on Occluded-Duke dataset.
  arXiv  Detail & Related papers  (2020-03-18T12:18:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.