Humble Teachers Teach Better Students for Semi-Supervised Object Detection

• URL: http://arxiv.org/abs/2106.10456v1
• Date: Sat, 19 Jun 2021 09:05:10 GMT
• Title: Humble Teachers Teach Better Students for Semi-Supervised Object Detection
• Authors: Yihe Tang, Weifeng Chen, Yijun Luo, Yuting Zhang
• Abstract summary: Our model achieves COCO-style AP of 53.04% on VOC07 val set, 8.4% better than STAC, when using VOC12 as unlabeled data. It also reaches 53.8% AP on MS-COCO test-dev with 3.1% gain over the fully supervised ResNet-152 Cascaded R-CNN.
• Score: 7.764145630268344
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose a semi-supervised approach for contemporary object detectors following the teacher-student dual model framework. Our method is featured with 1) the exponential moving averaging strategy to update the teacher from the student online, 2) using plenty of region proposals and soft pseudo-labels as the student's training targets, and 3) a light-weighted detection-specific data ensemble for the teacher to generate more reliable pseudo-labels. Compared to the recent state-of-the-art -- STAC, which uses hard labels on sparsely selected hard pseudo samples, the teacher in our model exposes richer information to the student with soft-labels on many proposals. Our model achieves COCO-style AP of 53.04% on VOC07 val set, 8.4% better than STAC, when using VOC12 as unlabeled data. On MS-COCO, it outperforms prior work when only a small percentage of data is taken as labeled. It also reaches 53.8% AP on MS-COCO test-dev with 3.1% gain over the fully supervised ResNet-152 Cascaded R-CNN, by tapping into unlabeled data of a similar size to the labeled data.

Related papers

• Collaboration of Teachers for Semi-supervised Object Detection [20.991741476731967]
  We propose the Collaboration of Teachers Framework (CTF), which consists of multiple pairs of teacher and student models for training. This framework greatly improves the utilization of unlabeled data and prevents the positive feedback cycle of unreliable pseudo-labels.
  arXiv  Detail & Related papers  (2024-05-22T06:17:50Z)
• The Devil is in the Points: Weakly Semi-Supervised Instance Segmentation via Point-Guided Mask Representation [61.027468209465354]
  We introduce a novel learning scheme named weakly semi-supervised instance segmentation (WSSIS) with point labels. We propose a method for WSSIS that can effectively leverage the budget-friendly point labels as a powerful weak supervision source. We conduct extensive experiments on COCO and BDD100K datasets, and the proposed method achieves promising results comparable to those of the fully-supervised model.
  arXiv  Detail & Related papers  (2023-03-27T10:11:22Z)
• Active Teacher for Semi-Supervised Object Detection [80.10937030195228]
  We propose a novel algorithm called Active Teacher for semi-supervised object detection (SSOD) Active Teacher extends the teacher-student framework to an iterative version, where the label set is partially and gradually augmented by evaluating three key factors of unlabeled examples. With this design, Active Teacher can maximize the effect of limited label information while improving the quality of pseudo-labels.
  arXiv  Detail & Related papers  (2023-03-15T03:59:27Z)
• Neighborhood-Regularized Self-Training for Learning with Few Labels [21.7848889781112]
  One drawback of self-training is that it is vulnerable to the label noise from incorrect pseudo labels. We develop a neighborhood-based sample selection approach to tackle the issue of noisy pseudo labels. Our proposed data selection strategy reduces the noise of pseudo labels by 36.8% and saves 57.3% of the time when compared with the best baseline.
  arXiv  Detail & Related papers  (2023-01-10T00:07:33Z)
• Label Matching Semi-Supervised Object Detection [85.99282969977541]
  Semi-supervised object detection has made significant progress with the development of mean teacher driven self-training. Label mismatch problem is not yet fully explored in the previous works, leading to severe confirmation bias during self-training. We propose a simple yet effective LabelMatch framework from two different yet complementary perspectives.
  arXiv  Detail & Related papers  (2022-06-14T05:59:41Z)
• Instant-Teaching: An End-to-End Semi-Supervised Object Detection Framework [14.914115746675176]
  Semi-supervised object detection can leverage unlabeled data to improve the model performance. We propose Instant-Teaching, which uses instant pseudo labeling with extended weak-strong data augmentations for teaching during each training iteration. Our method surpasses state-of-the-art methods by 4.2 mAP on MS-COCO when using $2%$ labeled data.
  arXiv  Detail & Related papers  (2021-03-21T14:03:36Z)
• Unbiased Teacher for Semi-Supervised Object Detection [50.0087227400306]
  We revisit the Semi-Supervised Object Detection (SS-OD) and identify the pseudo-labeling bias issue in SS-OD. We introduce Unbiased Teacher, a simple yet effective approach that jointly trains a student and a gradually progressing teacher in a mutually-beneficial manner.
  arXiv  Detail & Related papers  (2021-02-18T17:02:57Z)
• 3DIoUMatch: Leveraging IoU Prediction for Semi-Supervised 3D Object Detection [76.42897462051067]
  3DIoUMatch is a novel semi-supervised method for 3D object detection applicable to both indoor and outdoor scenes. We leverage a teacher-student mutual learning framework to propagate information from the labeled to the unlabeled train set in the form of pseudo-labels. Our method consistently improves state-of-the-art methods on both ScanNet and SUN-RGBD benchmarks by significant margins under all label ratios.
  arXiv  Detail & Related papers  (2020-12-08T11:06:26Z)
• A Simple Semi-Supervised Learning Framework for Object Detection [55.95789931533665]
  Semi-supervised learning (SSL) has a potential to improve the predictive performance of machine learning models using unlabeled data. We propose STAC, a simple yet effective SSL framework for visual object detection along with a data augmentation strategy.
  arXiv  Detail & Related papers  (2020-05-10T19:15:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.