Noise and Edge Based Dual Branch Image Manipulation Detection
- URL: http://arxiv.org/abs/2207.00724v1
- Date: Sat, 2 Jul 2022 03:28:51 GMT
- Title: Noise and Edge Based Dual Branch Image Manipulation Detection
- Authors: Zhongyuan Zhang, Yi Qian, Yanxiang Zhao, Lin Zhu, and Jinjin Wang
- Abstract summary: In this paper, the noise image extracted by the improved constrained convolution is used as the input of the model.
The dual-branch network, consisting of a high-resolution branch and a context branch, is used to capture the traces of artifacts as much as possible.
A specially designed manipulation edge detection module is constructed based on the dual-branch network to identify these artifacts better.
- Score: 9.400611271697302
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Unlike ordinary computer vision tasks that focus more on the semantic content
of images, the image manipulation detection task pays more attention to the
subtle information of image manipulation. In this paper, the noise image
extracted by the improved constrained convolution is used as the input of the
model instead of the original image to obtain more subtle traces of
manipulation. Meanwhile, the dual-branch network, consisting of a
high-resolution branch and a context branch, is used to capture the traces of
artifacts as much as possible. In general, most manipulation leaves
manipulation artifacts on the manipulation edge. A specially designed
manipulation edge detection module is constructed based on the dual-branch
network to identify these artifacts better. The correlation between pixels in
an image is closely related to their distance. The farther the two pixels are,
the weaker the correlation. We add a distance factor to the self-attention
module to better describe the correlation between pixels. Experimental results
on four publicly available image manipulation datasets demonstrate the
effectiveness of our model.
Related papers
- Distractors-Immune Representation Learning with Cross-modal Contrastive Regularization for Change Captioning [71.14084801851381]
Change captioning aims to succinctly describe the semantic change between a pair of similar images.
Most existing methods directly capture the difference between them, which risk obtaining error-prone difference features.
We propose a distractors-immune representation learning network that correlates the corresponding channels of two image representations.
arXiv Detail & Related papers (2024-07-16T13:00:33Z) - Pixel-Inconsistency Modeling for Image Manipulation Localization [59.968362815126326]
Digital image forensics plays a crucial role in image authentication and manipulation localization.
This paper presents a generalized and robust manipulation localization model through the analysis of pixel inconsistency artifacts.
Experiments show that our method successfully extracts inherent pixel-inconsistency forgery fingerprints.
arXiv Detail & Related papers (2023-09-30T02:54:51Z) - Transformer-Based UNet with Multi-Headed Cross-Attention Skip
Connections to Eliminate Artifacts in Scanned Documents [0.0]
A modified UNet structure using a Swin Transformer backbone is presented to remove typical artifacts in scanned documents.
An improvement in text extraction quality with a reduced error rate of up to 53.9% on the synthetic data is archived.
arXiv Detail & Related papers (2023-06-05T12:12:23Z) - Auto-Focus Contrastive Learning for Image Manipulation Detection [28.332585163675617]
We propose an Auto-Focus Contrastive Learning (AF-CL) network for image manipulation detection.
It contains two main ideas, i.e., multi-scale view generation (MSVG) and trace relation modeling (TRM)
arXiv Detail & Related papers (2022-11-20T09:40:36Z) - Learning Hierarchical Graph Representation for Image Manipulation
Detection [50.04902159383709]
The objective of image manipulation detection is to identify and locate the manipulated regions in the images.
Recent approaches mostly adopt the sophisticated Convolutional Neural Networks (CNNs) to capture the tampering artifacts left in the images.
We propose a hierarchical Graph Convolutional Network (HGCN-Net), which consists of two parallel branches.
arXiv Detail & Related papers (2022-01-15T01:54:25Z) - M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection [74.19291916812921]
forged images generated by Deepfake techniques pose a serious threat to the trustworthiness of digital information.
In this paper, we aim to capture the subtle manipulation artifacts at different scales for Deepfake detection.
We introduce a high-quality Deepfake dataset, SR-DF, which consists of 4,000 DeepFake videos generated by state-of-the-art face swapping and facial reenactment methods.
arXiv Detail & Related papers (2021-04-20T05:43:44Z) - Swapping Autoencoder for Deep Image Manipulation [94.33114146172606]
We propose the Swapping Autoencoder, a deep model designed specifically for image manipulation.
The key idea is to encode an image with two independent components and enforce that any swapped combination maps to a realistic image.
Experiments on multiple datasets show that our model produces better results and is substantially more efficient compared to recent generative models.
arXiv Detail & Related papers (2020-07-01T17:59:57Z) - Self-Supervised Linear Motion Deblurring [112.75317069916579]
Deep convolutional neural networks are state-of-the-art for image deblurring.
We present a differentiable reblur model for self-supervised motion deblurring.
Our experiments demonstrate that self-supervised single image deblurring is really feasible.
arXiv Detail & Related papers (2020-02-10T20:15:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.