Effects of Image Compression on Face Image Manipulation Detection: A Case Study on Facial Retouching

• URL: http://arxiv.org/abs/2103.03654v1
• Date: Fri, 5 Mar 2021 13:28:28 GMT
• Title: Effects of Image Compression on Face Image Manipulation Detection: A Case Study on Facial Retouching
• Authors: Christian Rathgeb, Kevin Bernardo, Nathania E. Haryanto, Christoph Busch
• Abstract summary: The effects of image compression on face image manipulation detection are analyzed. A case study on facial retouching detection under the influence of image compression is presented.
• Score: 14.92708078957906
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In the past years, numerous methods have been introduced to reliably detect digital face image manipulations. Lately, the generalizability of these schemes has been questioned in particular with respect to image post-processing. Image compression represents a post-processing which is frequently applied in diverse biometric application scenarios. Severe compression might erase digital traces of face image manipulation and hence hamper a reliable detection thereof. In this work, the effects of image compression on face image manipulation detection are analyzed. In particular, a case study on facial retouching detection under the influence of image compression is presented. To this end, ICAO-compliant subsets of two public face databases are used to automatically create a database containing more than 9,000 retouched reference images together with unconstrained probe images. Subsequently, reference images are compressed applying JPEG and JPEG 2000 at compression levels recommended for face image storage in electronic travel documents. Novel detection algorithms utilizing texture descriptors and deep face representations are proposed and evaluated in a single image and differential scenario. Results obtained from challenging cross-database experiments in which the analyzed retouching technique is unknown during training yield interesting findings: (1) most competitive detection performance is achieved for differential scenarios employing deep face representations; (2) image compression severely impacts the performance of face image manipulation detection schemes based on texture descriptors while methods utilizing deep face representations are found to be highly robust; (3) in some cases, the application of image compression might as well improve detection performance.

Related papers

• Recompression Based JPEG Tamper Detection and Localization Using Deep Neural Network Eliminating Compression Factor Dependency [2.8498944632323755]
  We propose a Convolution Neural Network based deep learning architecture, which is capable of detecting the presence of re compression based forgery in JPEG images. In this work, we also aim to localize the regions of image manipulation based on re compression features, using the trained neural network.
  arXiv  Detail & Related papers  (2024-07-03T09:19:35Z)
• Transferable Learned Image Compression-Resistant Adversarial Perturbations [69.79762292033553]
  Adversarial attacks can readily disrupt the image classification system, revealing the vulnerability of DNN-based recognition tasks. We introduce a new pipeline that targets image classification models that utilize learned image compressors as pre-processing modules.
  arXiv  Detail & Related papers  (2024-01-06T03:03:28Z)
• MMNet: Multi-Collaboration and Multi-Supervision Network for Sequential Deepfake Detection [81.59191603867586]
  Sequential deepfake detection aims to identify forged facial regions with the correct sequence for recovery. The recovery of forged images requires knowledge of the manipulation model to implement inverse transformations. We propose Multi-Collaboration and Multi-Supervision Network (MMNet) that handles various spatial scales and sequential permutations in forged face images.
  arXiv  Detail & Related papers  (2023-07-06T02:32:08Z)
• A Comparative Study of Fingerprint Image-Quality Estimation Methods [54.84936551037727]
  Poor-quality images result in spurious and missing features, thus degrading the performance of the overall system. In this work, we review existing approaches for fingerprint image-quality estimation. We have also tested a selection of fingerprint image-quality estimation algorithms.
  arXiv  Detail & Related papers  (2021-11-14T19:53:12Z)
• Metric Learning for Anti-Compression Facial Forgery Detection [32.33501564446107]
  We propose a novel anti-compression facial forgery detection framework. It learns a compression-insensitive embedding feature space utilizing both original and compressed forgeries.
  arXiv  Detail & Related papers  (2021-03-15T14:11:14Z)
• Image Splicing Detection, Localization and Attribution via JPEG Primary Quantization Matrix Estimation and Clustering [49.75353434786065]
  Detection of inconsistencies of double JPEG artefacts across different image regions is often used to detect local image manipulations. We propose an end-to-end system that can also distinguish regions coming from different donor images.
  arXiv  Detail & Related papers  (2021-02-02T11:21:49Z)
• Analyzing and Mitigating JPEG Compression Defects in Deep Learning [69.04777875711646]
  We present a unified study of the effects of JPEG compression on a range of common tasks and datasets. We show that there is a significant penalty on common performance metrics for high compression.
  arXiv  Detail & Related papers  (2020-11-17T20:32:57Z)
• Discernible Image Compression [124.08063151879173]
  This paper aims to produce compressed images by pursuing both appearance and perceptual consistency. Based on the encoder-decoder framework, we propose using a pre-trained CNN to extract features of the original and compressed images. Experiments on benchmarks demonstrate that images compressed by using the proposed method can also be well recognized by subsequent visual recognition and detection models.
  arXiv  Detail & Related papers  (2020-02-17T07:35:08Z)
• Saliency Driven Perceptual Image Compression [6.201592931432016]
  The paper demonstrates that the popularly used evaluations metrics such as MS-SSIM and PSNR are inadequate for judging the performance of image compression techniques. A new metric is proposed, which is learned on perceptual similarity data specific to image compression. The model not only generates images which are visually better but also gives superior performance for subsequent computer vision tasks.
  arXiv  Detail & Related papers  (2020-02-12T13:43:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.