Detecting CNN-Generated Facial Images in Real-World Scenarios
- URL: http://arxiv.org/abs/2005.05632v1
- Date: Tue, 12 May 2020 09:18:28 GMT
- Title: Detecting CNN-Generated Facial Images in Real-World Scenarios
- Authors: Nils Hulzebosch, Sarah Ibrahimi, Marcel Worring
- Abstract summary: We present a framework for evaluating detection methods under real-world conditions.
We also evaluate state-of-the-art detection methods using the proposed framework.
Our results suggest that CNN-based detection methods are not yet robust enough to be used in real-world scenarios.
- Score: 15.755089410308647
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Artificial, CNN-generated images are now of such high quality that humans
have trouble distinguishing them from real images. Several algorithmic
detection methods have been proposed, but these appear to generalize poorly to
data from unknown sources, making them infeasible for real-world scenarios. In
this work, we present a framework for evaluating detection methods under
real-world conditions, consisting of cross-model, cross-data, and
post-processing evaluation, and we evaluate state-of-the-art detection methods
using the proposed framework. Furthermore, we examine the usefulness of
commonly used image pre-processing methods. Lastly, we evaluate human
performance on detecting CNN-generated images, along with factors that
influence this performance, by conducting an online survey. Our results suggest
that CNN-based detection methods are not yet robust enough to be used in
real-world scenarios.
Related papers
- Real-world actor-based image steganalysis via classifier inconsistency detection [1.1279808969568255]
We propose a robust method for detecting guilty actors in image steganography.
The proposed approach successfully determines whether an actor is innocent or guilty, or if they should be discarded due to excessive Cover Source Mismatch (CSM)
This novel approach contributes to the field of steganalysis by offering a practical and efficient solution for handling CSM and detecting guilty actors in real-world applications.
arXiv Detail & Related papers (2025-01-08T08:58:59Z) - Understanding and Improving Training-Free AI-Generated Image Detections with Vision Foundation Models [68.90917438865078]
Deepfake techniques for facial synthesis and editing pose serious risks for generative models.
In this paper, we investigate how detection performance varies across model backbones, types, and datasets.
We introduce Contrastive Blur, which enhances performance on facial images, and MINDER, which addresses noise type bias, balancing performance across domains.
arXiv Detail & Related papers (2024-11-28T13:04:45Z) - Detecting Generated Images by Real Images Only [64.12501227493765]
Existing generated image detection methods detect visual artifacts in generated images or learn discriminative features from both real and generated images by massive training.
This paper approaches the generated image detection problem from a new perspective: Start from real images.
By finding the commonality of real images and mapping them to a dense subspace in feature space, the goal is that generated images, regardless of their generative model, are then projected outside the subspace.
arXiv Detail & Related papers (2023-11-02T03:09:37Z) - Decoupled Mixup for Generalized Visual Recognition [71.13734761715472]
We propose a novel "Decoupled-Mixup" method to train CNN models for visual recognition.
Our method decouples each image into discriminative and noise-prone regions, and then heterogeneously combines these regions to train CNN models.
Experiment results show the high generalization performance of our method on testing data that are composed of unseen contexts.
arXiv Detail & Related papers (2022-10-26T15:21:39Z) - Iris super-resolution using CNNs: is photo-realism important to iris
recognition? [67.42500312968455]
Single image super-resolution techniques are emerging, especially with the use of convolutional neural networks (CNNs)
In this work, the authors explore single image super-resolution using CNNs for iris recognition.
They validate their approach on a database of 1.872 near infrared iris images and on a mobile phone image database.
arXiv Detail & Related papers (2022-10-24T11:19:18Z) - Evaluation of Pre-Trained CNN Models for Geographic Fake Image Detection [20.41074415307636]
We are witnessing the emergence of fake satellite images, which can be misleading or even threatening to national security.
We explore the suitability of several convolutional neural network (CNN) architectures for fake satellite image detection.
This work allows the establishment of new baselines and may be useful for the development of CNN-based methods for fake satellite image detection.
arXiv Detail & Related papers (2022-10-01T20:37:24Z) - A comparison of different atmospheric turbulence simulation methods for
image restoration [64.24948495708337]
Atmospheric turbulence deteriorates the quality of images captured by long-range imaging systems.
Various deep learning-based atmospheric turbulence mitigation methods have been proposed in the literature.
We systematically evaluate the effectiveness of various turbulence simulation methods on image restoration.
arXiv Detail & Related papers (2022-04-19T16:21:36Z) - On Improving Cross-dataset Generalization of Deepfake Detectors [1.0152838128195467]
Facial manipulation by deep fake has caused major security risks and raised severe societal concerns.
We formulate deep fake detection as a hybrid combination of supervised and reinforcement learning (RL) to improve its cross-dataset generalization performance.
We demonstrate the superiority of our method over existing published research in cross-dataset generalization of deep fake detectors, thus obtaining state-of-the-art performance.
arXiv Detail & Related papers (2022-04-08T20:34:53Z) - A Study for Universal Adversarial Attacks on Texture Recognition [19.79803434998116]
We show that there exist small image-agnostic/univesal perturbations that can fool the deep learning models with more than 80% of testing fooling rates on all tested texture datasets.
The computed perturbations using various attack methods on the tested datasets are generally quasi-imperceptible, containing structured patterns with low, middle and high frequency components.
arXiv Detail & Related papers (2020-10-04T08:11:11Z) - Syn2Real Transfer Learning for Image Deraining using Gaussian Processes [92.15895515035795]
CNN-based methods for image deraining have achieved excellent performance in terms of reconstruction error as well as visual quality.
Due to challenges in obtaining real world fully-labeled image deraining datasets, existing methods are trained only on synthetically generated data.
We propose a Gaussian Process-based semi-supervised learning framework which enables the network in learning to derain using synthetic dataset.
arXiv Detail & Related papers (2020-06-10T00:33:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.