DeepfakeUCL: Deepfake Detection via Unsupervised Contrastive Learning
- URL: http://arxiv.org/abs/2104.11507v1
- Date: Fri, 23 Apr 2021 09:48:10 GMT
- Title: DeepfakeUCL: Deepfake Detection via Unsupervised Contrastive Learning
- Authors: Sheldon Fung, Xuequan Lu, Chao Zhang, Chang-Tsun Li
- Abstract summary: We design a novel deepfake detection method via unsupervised contrastive learning.
We show that our method enables comparable detection performance to state-of-the-art supervised techniques.
- Score: 20.94569893388119
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Face deepfake detection has seen impressive results recently. Nearly all
existing deep learning techniques for face deepfake detection are fully
supervised and require labels during training. In this paper, we design a novel
deepfake detection method via unsupervised contrastive learning. We first
generate two different transformed versions of an image and feed them into two
sequential sub-networks, i.e., an encoder and a projection head. The
unsupervised training is achieved by maximizing the correspondence degree of
the outputs of the projection head. To evaluate the detection performance of
our unsupervised method, we further use the unsupervised features to train an
efficient linear classification network. Extensive experiments show that our
unsupervised learning method enables comparable detection performance to
state-of-the-art supervised techniques, in both the intra- and inter-dataset
settings. We also conduct ablation studies for our method.
Related papers
- CL-Flow:Strengthening the Normalizing Flows by Contrastive Learning for
Better Anomaly Detection [1.951082473090397]
We propose a self-supervised anomaly detection approach that combines contrastive learning with 2D-Flow.
Compared to mainstream unsupervised approaches, our self-supervised method demonstrates superior detection accuracy, fewer additional model parameters, and faster inference speed.
Our approach showcases new state-of-the-art results, achieving a performance of 99.6% in image-level AUROC on the MVTecAD dataset and 96.8% in image-level AUROC on the BTAD dataset.
arXiv Detail & Related papers (2023-11-12T10:07:03Z) - Facial Forgery-based Deepfake Detection using Fine-Grained Features [7.378937711027777]
Facial forgery by deepfakes has caused major security risks and raised severe societal concerns.
We formulate deepfake detection as a fine-grained classification problem and propose a new fine-grained solution to it.
Our method is based on learning subtle and generalizable features by effectively suppressing background noise and learning discriminative features at various scales for deepfake detection.
arXiv Detail & Related papers (2023-10-10T21:30:05Z) - Improving Cross-dataset Deepfake Detection with Deep Information
Decomposition [57.284370468207214]
Deepfake technology poses a significant threat to security and social trust.
Existing detection methods suffer from sharp performance degradation when faced with cross-dataset scenarios.
We propose a deep information decomposition (DID) framework in this paper.
arXiv Detail & Related papers (2023-09-30T12:30:25Z) - Aggregating Layers for Deepfake Detection [20.191456827448736]
We consider the case where the network is trained on one Deepfake algorithm, and tested on Deepfakes generated by another algorithm.
Our algorithm aggregates features extracted across all layers of one backbone network to detect a fake.
We evaluate our approach on two domains of interest - Deepfake detection and Synthetic image detection, and find that we achieve SOTA results.
arXiv Detail & Related papers (2022-10-11T14:29:47Z) - Self-supervised Transformer for Deepfake Detection [112.81127845409002]
Deepfake techniques in real-world scenarios require stronger generalization abilities of face forgery detectors.
Inspired by transfer learning, neural networks pre-trained on other large-scale face-related tasks may provide useful features for deepfake detection.
In this paper, we propose a self-supervised transformer based audio-visual contrastive learning method.
arXiv Detail & Related papers (2022-03-02T17:44:40Z) - 3D Intracranial Aneurysm Classification and Segmentation via
Unsupervised Dual-branch Learning [14.248520176546293]
Intracranial aneurysms are common nowadays and how to detect them intelligently is of great significance in digital health.
We introduce an unsupervised method for the detection of intracranial aneurysms based on 3D point cloud data.
arXiv Detail & Related papers (2022-01-06T02:03:25Z) - Activation to Saliency: Forming High-Quality Labels for Unsupervised
Salient Object Detection [54.92703325989853]
We propose a two-stage Activation-to-Saliency (A2S) framework that effectively generates high-quality saliency cues.
No human annotations are involved in our framework during the whole training process.
Our framework reports significant performance compared with existing USOD methods.
arXiv Detail & Related papers (2021-12-07T11:54:06Z) - Distilling Image Classifiers in Object Detectors [81.63849985128527]
We study the case of object detection and, instead of following the standard detector-to-detector distillation approach, introduce a classifier-to-detector knowledge transfer framework.
In particular, we propose strategies to exploit the classification teacher to improve both the detector's recognition accuracy and localization performance.
arXiv Detail & Related papers (2021-06-09T16:50:10Z) - Anomaly Detection in Cybersecurity: Unsupervised, Graph-Based and
Supervised Learning Methods in Adversarial Environments [63.942632088208505]
Inherent to today's operating environment is the practice of adversarial machine learning.
In this work, we examine the feasibility of unsupervised learning and graph-based methods for anomaly detection.
We incorporate a realistic adversarial training mechanism when training our supervised models to enable strong classification performance in adversarial environments.
arXiv Detail & Related papers (2021-05-14T10:05:10Z) - Learning by Analogy: Reliable Supervision from Transformations for
Unsupervised Optical Flow Estimation [83.23707895728995]
Unsupervised learning of optical flow has emerged as a promising alternative to supervised methods.
We present a framework to use more reliable supervision from transformations.
Our method consistently gets a leap of performance on several benchmarks with the best accuracy among deep unsupervised methods.
arXiv Detail & Related papers (2020-03-29T14:55:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.