Learning Remote Sensing Object Detection with Single Point Supervision

• URL: http://arxiv.org/abs/2305.14141v2
• Date: Thu, 14 Dec 2023 09:48:27 GMT
• Title: Learning Remote Sensing Object Detection with Single Point Supervision
• Authors: Shitian He, Huanxin Zou, Yingqian Wang, Boyang Li, Xu Cao and Ning Jing
• Abstract summary: Pointly Supervised Object Detection (PSOD) has attracted considerable interests due to its lower labeling cost as compared to box-level supervised object detection. We make the first attempt to achieve RS object detection with single point supervision, and propose a PSOD method tailored for RS images. Our method can achieve significantly better performance as compared to state-of-the-art image-level and point-level supervised detection methods, and reduce the performance gap between PSOD and box-level supervised object detection.
• Score: 17.12725535531483
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Pointly Supervised Object Detection (PSOD) has attracted considerable interests due to its lower labeling cost as compared to box-level supervised object detection. However, the complex scenes, densely packed and dynamic-scale objects in Remote Sensing (RS) images hinder the development of PSOD methods in RS field. In this paper, we make the first attempt to achieve RS object detection with single point supervision, and propose a PSOD method tailored for RS images. Specifically, we design a point label upgrader (PLUG) to generate pseudo box labels from single point labels, and then use the pseudo boxes to supervise the optimization of existing detectors. Moreover, to handle the challenge of the densely packed objects in RS images, we propose a sparse feature guided semantic prediction module which can generate high-quality semantic maps by fully exploiting informative cues from sparse objects. Extensive ablation studies on the DOTA dataset have validated the effectiveness of our method. Our method can achieve significantly better performance as compared to state-of-the-art image-level and point-level supervised detection methods, and reduce the performance gap between PSOD and box-level supervised object detection. Code is available at https://github.com/heshitian/PLUG.

Related papers

• SOOD++: Leveraging Unlabeled Data to Boost Oriented Object Detection [59.868772767818975]
  We propose a simple yet effective Semi-supervised Oriented Object Detection method termed SOOD++. Specifically, we observe that objects from aerial images are usually arbitrary orientations, small scales, and aggregation. Extensive experiments conducted on various multi-oriented object datasets under various labeled settings demonstrate the effectiveness of our method.
  arXiv  Detail & Related papers  (2024-07-01T07:03:51Z)
• SpecDETR: A Transformer-based Hyperspectral Point Object Detection Network [32.7318504162588]
  Hyperspectral target detection (HTD) aims to identify materials based on spectral information in hyperspectral imagery and can detect point targets. Existing HTD methods are developed based on per-pixel binary classification, which limits the feature representation capability for point targets. We propose the first specialized network for hyperspectral multi-class point object detection, SpecDETR. We develop a simulated hyperSpectral Point Object Detection benchmark termed SPOD, and for the first time, evaluate and compare the performance of current object detection networks and HTD methods on hyperspectral multi-class point object detection.
  arXiv  Detail & Related papers  (2024-05-16T14:45:06Z)
• Few-shot Oriented Object Detection with Memorable Contrastive Learning in Remote Sensing Images [11.217630579076237]
  Few-shot object detection (FSOD) has garnered significant research attention in the field of remote sensing. We propose a novel FSOD method for remote sensing images called Few-shot Oriented object detection with Memorable Contrastive learning (FOMC) Specifically, we employ oriented bounding boxes instead of traditional horizontal bounding boxes to learn a better feature representation for arbitrary-oriented aerial objects.
  arXiv  Detail & Related papers  (2024-03-20T08:15:18Z)
• Semi-supervised Open-World Object Detection [74.95267079505145]
  We introduce a more realistic formulation, named semi-supervised open-world detection (SS-OWOD) We demonstrate that the performance of the state-of-the-art OWOD detector dramatically deteriorates in the proposed SS-OWOD setting. Our experiments on 4 datasets including MS COCO, PASCAL, Objects365 and DOTA demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2024-02-25T07:12:51Z)
• Weakly-supervised Contrastive Learning for Unsupervised Object Discovery [52.696041556640516]
  Unsupervised object discovery is promising due to its ability to discover objects in a generic manner. We design a semantic-guided self-supervised learning model to extract high-level semantic features from images. We introduce Principal Component Analysis (PCA) to localize object regions.
  arXiv  Detail & Related papers  (2023-07-07T04:03:48Z)
• SOOD: Towards Semi-Supervised Oriented Object Detection [57.05141794402972]
  This paper proposes a novel Semi-supervised Oriented Object Detection model, termed SOOD, built upon the mainstream pseudo-labeling framework. Our experiments show that when trained with the two proposed losses, SOOD surpasses the state-of-the-art SSOD methods under various settings on the DOTA-v1.5 benchmark.
  arXiv  Detail & Related papers  (2023-04-10T11:10:42Z)
• Threatening Patch Attacks on Object Detection in Optical Remote Sensing Images [55.09446477517365]
  Advanced Patch Attacks (PAs) on object detection in natural images have pointed out the great safety vulnerability in methods based on deep neural networks. We propose a more Threatening PA without the scarification of the visual quality, dubbed TPA. To the best of our knowledge, this is the first attempt to study the PAs on object detection in O-RSIs, and we hope this work can get our readers interested in studying this topic.
  arXiv  Detail & Related papers  (2023-02-13T02:35:49Z)
• Weakly-Supervised Salient Object Detection Using Point Supervison [17.88596733603456]
  Current state-of-the-art saliency detection models rely heavily on large datasets of accurate pixel-wise annotations. We propose a novel weakly-supervised salient object detection method using point supervision. Our method outperforms the previous state-of-the-art methods trained with the stronger supervision.
  arXiv  Detail & Related papers  (2022-03-22T12:16:05Z)
• Scribble-based Boundary-aware Network for Weakly Supervised Salient Object Detection in Remote Sensing Images [10.628932392896374]
  We propose a novel weakly-supervised salient object detection framework to predict the saliency of remote sensing images from sparse scribble annotations. Specifically, we design a boundary-aware module (BAM) to explore the object boundary semantics, which is explicitly supervised by the high-confidence object boundary (pseudo) labels. Then, the boundary semantics are integrated with high-level features to guide the salient object detection under the supervision of scribble labels.
  arXiv  Detail & Related papers  (2022-02-07T20:32:21Z)
• Self-Supervised Object Detection via Generative Image Synthesis [106.65384648377349]
  We present the first end-to-end analysis-by synthesis framework with controllable GANs for the task of self-supervised object detection. We use collections of real world images without bounding box annotations to learn to synthesize and detect objects. Our work advances the field of self-supervised object detection by introducing a successful new paradigm of using controllable GAN-based image synthesis for it.
  arXiv  Detail & Related papers  (2021-10-19T11:04:05Z)
• Learning Object Scale With Click Supervision for Object Detection [29.421113887739413]
  We propose a simple yet effective method which incorporatesCNN visualization with click supervision to generate the pseudoground-truths. These pseudo ground-truthscans be used to train a fully-supervised detector. Experimental results on the PASCAL VOC2007 and VOC 2012 datasets show that the proposed methodcan obtain much higher accuracy for estimating the object scale.
  arXiv  Detail & Related papers  (2020-02-20T03:59:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.