Points as Queries: Weakly Semi-supervised Object Detection by Points
- URL: http://arxiv.org/abs/2104.07434v1
- Date: Thu, 15 Apr 2021 13:08:25 GMT
- Title: Points as Queries: Weakly Semi-supervised Object Detection by Points
- Authors: Liangyu Chen, Tong Yang, Xiangyu Zhang, Wei Zhang and Jian Sun
- Abstract summary: We introduce a new detector, Point DETR, which extends DETR by adding a point encoder.
In particular, when using 20% fully labeled data from COCO, our detector achieves a promising performance, 33.3 AP.
- Score: 25.286468630229592
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose a novel point annotated setting for the weakly semi-supervised
object detection task, in which the dataset comprises small fully annotated
images and large weakly annotated images by points. It achieves a balance
between tremendous annotation burden and detection performance. Based on this
setting, we analyze existing detectors and find that these detectors have
difficulty in fully exploiting the power of the annotated points. To solve
this, we introduce a new detector, Point DETR, which extends DETR by adding a
point encoder. Extensive experiments conducted on MS-COCO dataset in various
data settings show the effectiveness of our method. In particular, when using
20% fully labeled data from COCO, our detector achieves a promising
performance, 33.3 AP, which outperforms a strong baseline (FCOS) by 2.0 AP, and
we demonstrate the point annotations bring over 10 points in various AR
metrics.
Related papers
- Better Sampling, towards Better End-to-end Small Object Detection [7.7473020808686694]
Small object detection remains unsatisfactory due to limited characteristics and high density and mutual overlap.
We propose methods enhancing sampling within an end-to-end framework.
Our model demonstrates a significant enhancement, achieving a 2.9% increase in average precision (AP) over the state-of-the-art (SOTA) on the VisDrone dataset.
arXiv Detail & Related papers (2024-05-17T04:37:44Z) - Point-Teaching: Weakly Semi-Supervised Object Detection with Point
Annotations [81.02347863372364]
We present Point-Teaching, a weakly semi-supervised object detection framework.
Specifically, we propose a Hungarian-based point matching method to generate pseudo labels for point annotated images.
We propose a simple-yet-effective data augmentation, termed point-guided copy-paste, to reduce the impact of the unmatched points.
arXiv Detail & Related papers (2022-06-01T07:04:38Z) - Object Localization under Single Coarse Point Supervision [107.46800858130658]
We propose a POL method using coarse point annotations, relaxing the supervision signals from accurate key points to freely spotted points.
CPR constructs point bags, selects semantic-correlated points, and produces semantic center points through multiple instance learning (MIL)
In this way, CPR defines a weakly supervised evolution procedure, which ensures training high-performance object localizer under coarse point supervision.
arXiv Detail & Related papers (2022-03-17T14:14:11Z) - SASA: Semantics-Augmented Set Abstraction for Point-based 3D Object
Detection [78.90102636266276]
We propose a novel set abstraction method named Semantics-Augmented Set Abstraction (SASA)
Based on the estimated point-wise foreground scores, we then propose a semantics-guided point sampling algorithm to help retain more important foreground points during down-sampling.
In practice, SASA shows to be effective in identifying valuable points related to foreground objects and improving feature learning for point-based 3D detection.
arXiv Detail & Related papers (2022-01-06T08:54:47Z) - Rethinking the Aligned and Misaligned Features in One-stage Object
Detection [9.270523894683278]
One-stage object detectors rely on the point feature to predict the detection results.
We propose a simple and plug-in operator that could generate aligned and disentangled features for each task.
Based on the object-aligned and task-disentangled operator (OAT), we propose OAT-Net, which explicitly exploits point-set features for more accurate detection results.
arXiv Detail & Related papers (2021-08-27T08:40:37Z) - WSSOD: A New Pipeline for Weakly- and Semi-Supervised Object Detection [75.80075054706079]
We propose a weakly- and semi-supervised object detection framework (WSSOD)
An agent detector is first trained on a joint dataset and then used to predict pseudo bounding boxes on weakly-annotated images.
The proposed framework demonstrates remarkable performance on PASCAL-VOC and MSCOCO benchmark, achieving a high performance comparable to those obtained in fully-supervised settings.
arXiv Detail & Related papers (2021-05-21T11:58:50Z) - Dense Label Encoding for Boundary Discontinuity Free Rotation Detection [69.75559390700887]
This paper explores a relatively less-studied methodology based on classification.
We propose new techniques to push its frontier in two aspects.
Experiments and visual analysis on large-scale public datasets for aerial images show the effectiveness of our approach.
arXiv Detail & Related papers (2020-11-19T05:42:02Z) - EHSOD: CAM-Guided End-to-end Hybrid-Supervised Object Detection with
Cascade Refinement [53.69674636044927]
We present EHSOD, an end-to-end hybrid-supervised object detection system.
It can be trained in one shot on both fully and weakly-annotated data.
It achieves comparable results on multiple object detection benchmarks with only 30% fully-annotated data.
arXiv Detail & Related papers (2020-02-18T08:04:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.