Few-shot Forgery Detection via Guided Adversarial Interpolation
- URL: http://arxiv.org/abs/2204.05905v2
- Date: Sun, 27 Aug 2023 16:55:27 GMT
- Title: Few-shot Forgery Detection via Guided Adversarial Interpolation
- Authors: Haonan Qiu, Siyu Chen, Bei Gan, Kun Wang, Huafeng Shi, Jing Shao,
Ziwei Liu
- Abstract summary: Existing forgery detection methods suffer from significant performance drops when applied to unseen novel forgery approaches.
We propose Guided Adversarial Interpolation (GAI) to overcome the few-shot forgery detection problem.
Our method is validated to be robust to choices of majority and minority forgery approaches.
- Score: 56.59499187594308
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: The increase in face manipulation models has led to a critical issue in
society - the synthesis of realistic visual media. With the emergence of new
forgery approaches at an unprecedented rate, existing forgery detection methods
suffer from significant performance drops when applied to unseen novel forgery
approaches. In this work, we address the few-shot forgery detection problem by
1) designing a comprehensive benchmark based on coverage analysis among various
forgery approaches, and 2) proposing Guided Adversarial Interpolation (GAI).
Our key insight is that there exist transferable distribution characteristics
between majority and minority forgery classes1. Specifically, we enhance the
discriminative ability against novel forgery approaches via adversarially
interpolating the forgery artifacts of the minority samples to the majority
samples under the guidance of a teacher network. Unlike the standard
re-balancing method which usually results in over-fitting to minority classes,
our method simultaneously takes account of the diversity of majority
information as well as the significance of minority information. Extensive
experiments demonstrate that our GAI achieves state-of-the-art performances on
the established few-shot forgery detection benchmark. Notably, our method is
also validated to be robust to choices of majority and minority forgery
approaches. The formal publication version is available in Pattern Recognition.
Related papers
- Regularized Contrastive Partial Multi-view Outlier Detection [76.77036536484114]
We propose a novel method named Regularized Contrastive Partial Multi-view Outlier Detection (RCPMOD)
In this framework, we utilize contrastive learning to learn view-consistent information and distinguish outliers by the degree of consistency.
Experimental results on four benchmark datasets demonstrate that our proposed approach could outperform state-of-the-art competitors.
arXiv Detail & Related papers (2024-08-02T14:34:27Z) - Confronting Discrimination in Classification: Smote Based on
Marginalized Minorities in the Kernel Space for Imbalanced Data [0.0]
We propose a novel classification oversampling approach based on the decision boundary and sample proximity relationships.
We test the proposed method on a classic financial fraud dataset.
arXiv Detail & Related papers (2024-02-13T04:03:09Z) - Adversarial Reweighting Guided by Wasserstein Distance for Bias
Mitigation [24.160692009892088]
Under-representation of minorities in the data makes the disparate treatment of subpopulations difficult to deal with during learning.
We propose a novel adversarial reweighting method to address such emphrepresentation bias.
arXiv Detail & Related papers (2023-11-21T15:46:11Z) - Causal Interventions-based Few-Shot Named Entity Recognition [5.961427870758681]
Few-shot named entity recognition (NER) systems aims at recognizing new classes of entities based on a few labeled samples.
The heavy overfitting in few-shot learning is mainly led by spurious correlation caused by the few samples selection bias.
We propose a causal intervention-based few-shot NER method to alleviate the problem of the spurious correlation.
arXiv Detail & Related papers (2023-05-03T06:11:39Z) - Boosting Few-Shot Text Classification via Distribution Estimation [38.99459686893034]
We propose two simple yet effective strategies to estimate the distributions of the novel classes by utilizing unlabeled query samples.
Specifically, we first assume a class or sample follows the Gaussian distribution, and use the original support set and the nearest few query samples.
Then, we augment the labeled samples by sampling from the estimated distribution, which can provide sufficient supervision for training the classification model.
arXiv Detail & Related papers (2023-03-26T05:58:39Z) - The Majority Can Help The Minority: Context-rich Minority Oversampling
for Long-tailed Classification [20.203461156516937]
We propose a novel minority over-sampling method to augment diversified minority samples.
Our key idea is to paste a foreground patch from a minority class to a background image from a majority class having affluent contexts.
Our method achieves state-of-the-art performance on various long-tailed classification benchmarks.
arXiv Detail & Related papers (2021-12-01T10:58:30Z) - Towards A Conceptually Simple Defensive Approach for Few-shot
classifiers Against Adversarial Support Samples [107.38834819682315]
We study a conceptually simple approach to defend few-shot classifiers against adversarial attacks.
We propose a simple attack-agnostic detection method, using the concept of self-similarity and filtering.
Our evaluation on the miniImagenet (MI) and CUB datasets exhibit good attack detection performance.
arXiv Detail & Related papers (2021-10-24T05:46:03Z) - Few-Shot Fine-Grained Action Recognition via Bidirectional Attention and
Contrastive Meta-Learning [51.03781020616402]
Fine-grained action recognition is attracting increasing attention due to the emerging demand of specific action understanding in real-world applications.
We propose a few-shot fine-grained action recognition problem, aiming to recognize novel fine-grained actions with only few samples given for each class.
Although progress has been made in coarse-grained actions, existing few-shot recognition methods encounter two issues handling fine-grained actions.
arXiv Detail & Related papers (2021-08-15T02:21:01Z) - Few-shot Action Recognition with Prototype-centered Attentive Learning [88.10852114988829]
Prototype-centered Attentive Learning (PAL) model composed of two novel components.
First, a prototype-centered contrastive learning loss is introduced to complement the conventional query-centered learning objective.
Second, PAL integrates a attentive hybrid learning mechanism that can minimize the negative impacts of outliers.
arXiv Detail & Related papers (2021-01-20T11:48:12Z) - M2m: Imbalanced Classification via Major-to-minor Translation [79.09018382489506]
In most real-world scenarios, labeled training datasets are highly class-imbalanced, where deep neural networks suffer from generalizing to a balanced testing criterion.
In this paper, we explore a novel yet simple way to alleviate this issue by augmenting less-frequent classes via translating samples from more-frequent classes.
Our experimental results on a variety of class-imbalanced datasets show that the proposed method improves the generalization on minority classes significantly compared to other existing re-sampling or re-weighting methods.
arXiv Detail & Related papers (2020-04-01T13:21:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.