Robust Object Detection in Remote Sensing Imagery with Noisy and Sparse Geo-Annotations (Full Version)

• URL: http://arxiv.org/abs/2210.12989v1
• Date: Mon, 24 Oct 2022 07:25:31 GMT
• Title: Robust Object Detection in Remote Sensing Imagery with Noisy and Sparse Geo-Annotations (Full Version)
• Authors: Maximilian Bernhard and Matthias Schubert
• Abstract summary: In this paper, we present a novel approach for training object detectors with extremely noisy and incomplete annotations. Our method is based on a teacher-student learning framework and a correction module accounting for imprecise and missing annotations. We demonstrate that our approach improves standard detectors by 37.1% $AP_50$ on a noisy real-world remote-sensing dataset.
• Score: 4.493174773769076
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently, the availability of remote sensing imagery from aerial vehicles and satellites constantly improved. For an automated interpretation of such data, deep-learning-based object detectors achieve state-of-the-art performance. However, established object detectors require complete, precise, and correct bounding box annotations for training. In order to create the necessary training annotations for object detectors, imagery can be georeferenced and combined with data from other sources, such as points of interest localized by GPS sensors. Unfortunately, this combination often leads to poor object localization and missing annotations. Therefore, training object detectors with such data often results in insufficient detection performance. In this paper, we present a novel approach for training object detectors with extremely noisy and incomplete annotations. Our method is based on a teacher-student learning framework and a correction module accounting for imprecise and missing annotations. Thus, our method is easy to use and can be combined with arbitrary object detectors. We demonstrate that our approach improves standard detectors by 37.1\% $AP_{50}$ on a noisy real-world remote-sensing dataset. Furthermore, our method achieves great performance gains on two datasets with synthetic noise. Code is available at \url{https://github.com/mxbh/robust_object_detection}.

Related papers

• Bayesian Detector Combination for Object Detection with Crowdsourced Annotations [49.43709660948812]
  Acquiring fine-grained object detection annotations in unconstrained images is time-consuming, expensive, and prone to noise. We propose a novel Bayesian Detector Combination (BDC) framework to more effectively train object detectors with noisy crowdsourced annotations. BDC is model-agnostic, requires no prior knowledge of the annotators' skill level, and seamlessly integrates with existing object detection models.
  arXiv  Detail & Related papers  (2024-07-10T18:00:54Z)
• Robust Object Detection With Inaccurate Bounding Boxes [27.664730859319707]
  Learning accurate object detectors often requires large-scale training data with precise object bounding boxes. In this work, we aim to address the challenge of learning robust object detectors with inaccurate bounding boxes. By treating an object as a bag of instances, we introduce an Object-Aware Multiple Instance Learning approach.
  arXiv  Detail & Related papers  (2022-07-20T06:57:30Z)
• Self-supervised object detection from audio-visual correspondence [101.46794879729453]
  We tackle the problem of learning object detectors without supervision. We do not assume image-level class labels, instead we extract a supervisory signal from audio-visual data. We show that our method can learn to detect generic objects that go beyond instruments, such as airplanes and cats.
  arXiv  Detail & Related papers  (2021-04-13T17:59:03Z)
• Dense Relation Distillation with Context-aware Aggregation for Few-Shot Object Detection [18.04185751827619]
  Few-shot object detection is challenging since the fine-grained feature of novel object can be easily overlooked with only a few data available. We propose Dense Relation Distillation with Context-aware Aggregation (DCNet) to tackle the few-shot detection problem.
  arXiv  Detail & Related papers  (2021-03-30T05:34:49Z)
• Data Augmentation for Object Detection via Differentiable Neural Rendering [71.00447761415388]
  It is challenging to train a robust object detector when annotated data is scarce. Existing approaches to tackle this problem include semi-supervised learning that interpolates labeled data from unlabeled data. We introduce an offline data augmentation method for object detection, which semantically interpolates the training data with novel views.
  arXiv  Detail & Related papers  (2021-03-04T06:31:06Z)
• Self-Supervised Person Detection in 2D Range Data using a Calibrated Camera [83.31666463259849]
  We propose a method to automatically generate training labels (called pseudo-labels) for 2D LiDAR-based person detectors. We show that self-supervised detectors, trained or fine-tuned with pseudo-labels, outperform detectors trained using manual annotations. Our method is an effective way to improve person detectors during deployment without any additional labeling effort.
  arXiv  Detail & Related papers  (2020-12-16T12:10:04Z)
• Cross-Supervised Object Detection [42.783400918552765]
  We show how to build better object detectors from weakly labeled images of new categories by leveraging knowledge learned from fully labeled base categories. We propose a unified framework that combines a detection head trained from instance-level annotations and a recognition head learned from image-level annotations.
  arXiv  Detail & Related papers  (2020-06-26T15:33:48Z)
• Semi-Supervised Object Detection with Sparsely Annotated Dataset [0.27719338074999533]
  In training object detector based on convolutional neural networks, selection of effective positive examples for training is an important factor. We used two approaches to solve this problem: 1) the use of an anchorless object detector and 2) a semi-supervised learning-based object detection using a single object tracker. We were able to achieve textbfrunner-up performance in the Unseen section while achieving the first place in the Seen section of the Epic-Kitchens 2020 object detection challenge under IoU > 0.5 evaluation.
  arXiv  Detail & Related papers  (2020-06-21T02:26:48Z)
• Weakly-Supervised Salient Object Detection via Scribble Annotations [54.40518383782725]
  We propose a weakly-supervised salient object detection model to learn saliency from scribble labels. We present a new metric, termed saliency structure measure, to measure the structure alignment of the predicted saliency maps. Our method not only outperforms existing weakly-supervised/unsupervised methods, but also is on par with several fully-supervised state-of-the-art models.
  arXiv  Detail & Related papers  (2020-03-17T12:59:50Z)
• EHSOD: CAM-Guided End-to-end Hybrid-Supervised Object Detection with Cascade Refinement [53.69674636044927]
  We present EHSOD, an end-to-end hybrid-supervised object detection system. It can be trained in one shot on both fully and weakly-annotated data. It achieves comparable results on multiple object detection benchmarks with only 30% fully-annotated data.
  arXiv  Detail & Related papers  (2020-02-18T08:04:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.