Adversarial Attacked Teacher for Unsupervised Domain Adaptive Object Detection

• URL: http://arxiv.org/abs/2408.09431v1
• Date: Sun, 18 Aug 2024 10:22:23 GMT
• Title: Adversarial Attacked Teacher for Unsupervised Domain Adaptive Object Detection
• Authors: Kaiwen Wang, Yinzhe Shen, Martin Lauer,
• Abstract summary: Cutting-edge domain adaptive object detection methods use the teacher-student framework and domain adversarial learning to generate domain-invariant pseudo-labels for self-training. We reveal that pseudo-labels vulnerable to adversarial attacks are more likely to be low-quality. We propose a simple yet effective framework named Adversarial Attacked Teacher to improve the quality of pseudo-labels.
• Score: 4.641733276587937
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Object detectors encounter challenges in handling domain shifts. Cutting-edge domain adaptive object detection methods use the teacher-student framework and domain adversarial learning to generate domain-invariant pseudo-labels for self-training. However, the pseudo-labels generated by the teacher model tend to be biased towards the majority class and often mistakenly include overconfident false positives and underconfident false negatives. We reveal that pseudo-labels vulnerable to adversarial attacks are more likely to be low-quality. To address this, we propose a simple yet effective framework named Adversarial Attacked Teacher (AAT) to improve the quality of pseudo-labels. Specifically, we apply adversarial attacks to the teacher model, prompting it to generate adversarial pseudo-labels to correct bias, suppress overconfidence, and encourage underconfident proposals. An adaptive pseudo-label regularization is introduced to emphasize the influence of pseudo-labels with high certainty and reduce the negative impacts of uncertain predictions. Moreover, robust minority objects verified by pseudo-label regularization are oversampled to minimize dataset imbalance without introducing false positives. Extensive experiments conducted on various datasets demonstrate that AAT achieves superior performance, reaching 52.6 mAP on Clipart1k, surpassing the previous state-of-the-art by 6.7%.

Related papers

• Credible Teacher for Semi-Supervised Object Detection in Open Scene [106.25850299007674]
  In Open Scene Semi-Supervised Object Detection (O-SSOD), unlabeled data may contain unknown objects not observed in the labeled data. It is detrimental to the current methods that mainly rely on self-training, as more uncertainty leads to the lower localization and classification precision of pseudo labels. We propose Credible Teacher, an end-to-end framework to prevent uncertain pseudo labels from misleading the model.
  arXiv  Detail & Related papers  (2024-01-01T08:19:21Z)
• Domain Adaptive Object Detection via Balancing Between Self-Training and Adversarial Learning [19.81071116581342]
  Deep learning based object detectors struggle generalizing to a new target domain bearing significant variations in object and background. Current methods align domains by using image or instance-level adversarial feature alignment. We propose to leverage model's predictive uncertainty to strike the right balance between adversarial feature alignment and class-level alignment.
  arXiv  Detail & Related papers  (2023-11-08T16:40:53Z)
• Contrastive Mean Teacher for Domain Adaptive Object Detectors [20.06919799819326]
  Mean-teacher self-training is a powerful paradigm in unsupervised domain adaptation for object detection, but it struggles with low-quality pseudo-labels. We propose Contrastive Mean Teacher (CMT) -- a unified, general-purpose framework with the two paradigms naturally integrated to maximize beneficial learning signals. CMT leads to new state-of-the-art target-domain performance: 51.9% mAP on Foggy Cityscapes, outperforming the previously best by 2.1% mAP.
  arXiv  Detail & Related papers  (2023-05-04T17:55:17Z)
• Class-Distribution-Aware Pseudo Labeling for Semi-Supervised Multi-Label Learning [97.88458953075205]
  Pseudo-labeling has emerged as a popular and effective approach for utilizing unlabeled data. This paper proposes a novel solution called Class-Aware Pseudo-Labeling (CAP) that performs pseudo-labeling in a class-aware manner.
  arXiv  Detail & Related papers  (2023-05-04T12:52:18Z)
• In and Out-of-Domain Text Adversarial Robustness via Label Smoothing [64.66809713499576]
  We study the adversarial robustness provided by various label smoothing strategies in foundational models for diverse NLP tasks. Our experiments show that label smoothing significantly improves adversarial robustness in pre-trained models like BERT, against various popular attacks. We also analyze the relationship between prediction confidence and robustness, showing that label smoothing reduces over-confident errors on adversarial examples.
  arXiv  Detail & Related papers  (2022-12-20T14:06:50Z)
• Uncertainty-aware Mean Teacher for Source-free Unsupervised Domain Adaptive 3D Object Detection [6.345037597566315]
  Pseudo-label based self training approaches are a popular method for source-free unsupervised domain adaptation. We propose an uncertainty-aware mean teacher framework which implicitly filters incorrect pseudo-labels during training.
  arXiv  Detail & Related papers  (2021-09-29T18:17:09Z)
• Box Re-Ranking: Unsupervised False Positive Suppression for Domain Adaptive Pedestrian Detection [70.25977409196449]
  False positive is one of the most serious problems brought by domain shift in domain adaptive pedestrian detection. We transform a false positive suppression problem into a box re-ranking problem elegantly. Considering we aim to keep the detection of true positive unchanged, we propose box number alignment.
  arXiv  Detail & Related papers  (2021-02-01T02:31:11Z)
• Exploiting Sample Uncertainty for Domain Adaptive Person Re-Identification [137.9939571408506]
  We estimate and exploit the credibility of the assigned pseudo-label of each sample to alleviate the influence of noisy labels. Our uncertainty-guided optimization brings significant improvement and achieves the state-of-the-art performance on benchmark datasets.
  arXiv  Detail & Related papers  (2020-12-16T04:09:04Z)
• Selective Pseudo-Labeling with Reinforcement Learning for Semi-Supervised Domain Adaptation [116.48885692054724]
  We propose a reinforcement learning based selective pseudo-labeling method for semi-supervised domain adaptation. We develop a deep Q-learning model to select both accurate and representative pseudo-labeled instances. Our proposed method is evaluated on several benchmark datasets for SSDA, and demonstrates superior performance to all the comparison methods.
  arXiv  Detail & Related papers  (2020-12-07T03:37:38Z)
• Hard Class Rectification for Domain Adaptation [36.58361356407803]
  Domain adaptation (DA) aims to transfer knowledge from a label-rich domain (source domain) to a label-scare domain (target domain) We propose a novel framework, called Hard Class Rectification Pseudo-labeling (HCRPL), to alleviate the hard class problem. The proposed method is evaluated in both unsupervised domain adaptation (UDA) and semi-supervised domain adaptation (SSDA)
  arXiv  Detail & Related papers  (2020-08-08T06:21:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.