Robust Image Protection Countering Cropping Manipulation

• URL: http://arxiv.org/abs/2206.02405v1
• Date: Mon, 6 Jun 2022 07:26:29 GMT
• Title: Robust Image Protection Countering Cropping Manipulation
• Authors: Qichao Ying, Hang Zhou, Zhenxing Qian, Sheng Li and Xinpeng Zhang
• Abstract summary: This paper presents a novel robust watermarking scheme for image Cropping localization and Recovery (CLR-Net) We first protect the original image by introducing imperceptible perturbations. Then, typical image post-processing attacks are simulated to erode the protected image. On the recipient's side, we predict the cropping mask and recover the original image.
• Score: 30.185576617722713
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Image cropping is an inexpensive and effective operation of maliciously altering image contents. Existing cropping detection mechanisms analyze the fundamental traces of image cropping, for example, chromatic aberration and vignetting to uncover cropping attack, yet fragile to common post-processing attacks which deceive forensics by removing such cues. Besides, they ignore the fact that recovering the cropped-out contents can unveil the purpose of the behaved cropping attack. This paper presents a novel robust watermarking scheme for image Cropping Localization and Recovery (CLR-Net). We first protect the original image by introducing imperceptible perturbations. Then, typical image post-processing attacks are simulated to erode the protected image. On the recipient's side, we predict the cropping mask and recover the original image. We propose two plug-and-play networks to improve the real-world robustness of CLR-Net, namely, the Fine-Grained generative JPEG simulator (FG-JPEG) and the Siamese image pre-processing network. To the best of our knowledge, we are the first to address the combined challenge of image cropping localization and entire image recovery from a fragment. Experiments demonstrate that CLR-Net can accurately localize the cropping as well as recover the details of the cropped-out regions with both high quality and fidelity, despite of the presence of image processing attacks of varied types.

Related papers

• Learning Subject-Aware Cropping by Outpainting Professional Photos [69.0772948657867]
  We propose a weakly-supervised approach to learn what makes a high-quality subject-aware crop from professional stock images. Our insight is to combine a library of stock images with a modern, pre-trained text-to-image diffusion model. We are able to automatically generate a large dataset of cropped-uncropped training pairs to train a cropping model.
  arXiv  Detail & Related papers  (2023-12-19T11:57:54Z)
• IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AI [52.90082445349903]
  Diffusion-based image generation models can create artistic images that mimic the style of an artist or maliciously edit the original images for fake content. Several attempts have been made to protect the original images from such unauthorized data usage by adding imperceptible perturbations. In this work, we introduce a purification perturbation platform, named IMPRESS, to evaluate the effectiveness of imperceptible perturbations as a protective measure.
  arXiv  Detail & Related papers  (2023-10-30T03:33:41Z)
• MaskSketch: Unpaired Structure-guided Masked Image Generation [56.88038469743742]
  MaskSketch is an image generation method that allows spatial conditioning of the generation result using a guiding sketch as an extra conditioning signal during sampling. We show that intermediate self-attention maps of a masked generative transformer encode important structural information of the input image. Our results show that MaskSketch achieves high image realism and fidelity to the guiding structure.
  arXiv  Detail & Related papers  (2023-02-10T20:27:02Z)
• Learning to Immunize Images for Tamper Localization and Self-Recovery [30.185576617722713]
  Image immunization (Imuge) is a technology of protecting the images by introducing trivial perturbation. This paper presents Imuge+, an enhanced scheme for image immunization.
  arXiv  Detail & Related papers  (2022-10-28T05:16:56Z)
• LTT-GAN: Looking Through Turbulence by Inverting GANs [86.25869403782957]
  We propose the first turbulence mitigation method that makes use of visual priors encapsulated by a well-trained GAN. Based on the visual priors, we propose to learn to preserve the identity of restored images on a periodic contextual distance. Our method significantly outperforms prior art in both the visual quality and face verification accuracy of restored results.
  arXiv  Detail & Related papers  (2021-12-04T16:42:13Z)
• From Image to Imuge: Immunized Image Generation [23.430377385327308]
  Imuge is an image tamper resilient generative scheme for image self-recovery. We jointly train a U-Net backboned encoder, a tamper localization network and a decoder for image recovery. We demonstrate that our method can recover the details of the tampered regions with a high quality despite the presence of various kinds of attacks.
  arXiv  Detail & Related papers  (2021-10-27T05:56:15Z)
• Hiding Images into Images with Real-world Robustness [21.328984859163956]
  We introduce a generative network based method for hiding images into images while assuring high-quality extraction. An embedding network is sequentially decoupling with an attack layer, a decoupling network and an image extraction network. We are the first to robustly hide three secret images.
  arXiv  Detail & Related papers  (2021-10-12T02:20:34Z)
• No way to crop: On robust image crop localization [18.714976804821738]
  This paper presents a novel scheme for image crop localization using robust watermarking. We further extend our scheme to detect tampering attack on the attacked image.
  arXiv  Detail & Related papers  (2021-10-12T02:19:42Z)
• Generative and Discriminative Learning for Distorted Image Restoration [22.230017059874445]
  Liquify is a technique for image editing, which can be used for image distortion. We propose a novel generative and discriminative learning method based on deep neural networks.
  arXiv  Detail & Related papers  (2020-11-11T14:01:29Z)
• Deep Photo Cropper and Enhancer [65.11910918427296]
  We propose a new type of image enhancement problem: to crop an image which is embedded within a photo. We split our proposed approach into two deep networks: deep photo cropper and deep image enhancer. In the photo cropper network, we employ a spatial transformer to extract the embedded image. In the photo enhancer, we employ super-resolution to increase the number of pixels in the embedded image.
  arXiv  Detail & Related papers  (2020-08-03T03:50:20Z)
• Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation [181.08127307338654]
  This work presents an effective way to exploit the image prior captured by a generative adversarial network (GAN) trained on large-scale natural images. The deep generative prior (DGP) provides compelling results to restore missing semantics, e.g., color, patch, resolution, of various degraded images.
  arXiv  Detail & Related papers  (2020-03-30T17:45:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.