Progressive Domain Adaptation with Contrastive Learning for Object Detection in the Satellite Imagery

• URL: http://arxiv.org/abs/2209.02564v3
• Date: Tue, 31 Oct 2023 04:24:58 GMT
• Title: Progressive Domain Adaptation with Contrastive Learning for Object Detection in the Satellite Imagery
• Authors: Debojyoti Biswas and Jelena Te\v{s}i\'c
• Abstract summary: State-of-the-art object detection methods largely fail to identify small and dense objects. We propose a small object detection pipeline that improves the feature extraction process. We show we can alleviate the degradation of object identification in previously unseen datasets.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: State-of-the-art object detection methods applied to satellite and drone imagery largely fail to identify small and dense objects. One reason is the high variability of content in the overhead imagery due to the terrestrial region captured and the high variability of acquisition conditions. Another reason is that the number and size of objects in aerial imagery are very different than in the consumer data. In this work, we propose a small object detection pipeline that improves the feature extraction process by spatial pyramid pooling, cross-stage partial networks, heatmap-based region proposal network, and object localization and identification through a novel image difficulty score that adapts the overall focal loss measure based on the image difficulty. Next, we propose novel contrastive learning with progressive domain adaptation to produce domain-invariant features across aerial datasets using local and global components. We show we can alleviate the degradation of object identification in previously unseen datasets. We create a first-ever domain adaptation benchmark using contrastive learning for the object detection task in highly imbalanced satellite datasets with significant domain gaps and dominant small objects. The proposed method results in a 7.4% increase in mAP performance measure over the best state-of-art.

Related papers

• FlightScope: A Deep Comprehensive Assessment of Aircraft Detection Algorithms in Satellite Imagery [1.5728609542259502]
  This paper critically evaluates and compares a suite of advanced object detection algorithms customized for the task of identifying aircraft within satellite imagery. This research encompasses an array of methodologies including YOLO versions 5 and 8, Faster RCNN, CenterNet, RetinaNet, RTMDet, and DETR, all trained from scratch. YOLOv5 emerges as a robust solution for aerial object detection, underlining its importance through superior mean average precision, Recall, and Intersection over Union scores.
  arXiv  Detail & Related papers  (2024-04-03T17:24:27Z)
• Innovative Horizons in Aerial Imagery: LSKNet Meets DiffusionDet for Advanced Object Detection [55.2480439325792]
  We present an in-depth evaluation of an object detection model that integrates the LSKNet backbone with the DiffusionDet head. The proposed model achieves a mean average precision (MAP) of approximately 45.7%, which is a significant improvement. This advancement underscores the effectiveness of the proposed modifications and sets a new benchmark in aerial image analysis.
  arXiv  Detail & Related papers  (2023-11-21T19:49:13Z)
• Sci-Net: a Scale Invariant Model for Building Detection from Aerial Images [0.0]
  We propose a Scale-invariant neural network (Sci-Net) that is able to segment buildings present in aerial images at different spatial resolutions. Specifically, we modified the U-Net architecture and fused it with dense Atrous Spatial Pyramid Pooling (ASPP) to extract fine-grained multi-scale representations.
  arXiv  Detail & Related papers  (2021-11-12T16:45:20Z)
• Decoupled Adaptation for Cross-Domain Object Detection [69.5852335091519]
  Cross-domain object detection is more challenging than object classification. D-adapt achieves a state-of-the-art results on four cross-domain object detection tasks.
  arXiv  Detail & Related papers  (2021-10-06T08:43:59Z)
• AdaZoom: Adaptive Zoom Network for Multi-Scale Object Detection in Large Scenes [57.969186815591186]
  Detection in large-scale scenes is a challenging problem due to small objects and extreme scale variation. We propose a novel Adaptive Zoom (AdaZoom) network as a selective magnifier with flexible shape and focal length to adaptively zoom the focus regions for object detection.
  arXiv  Detail & Related papers  (2021-06-19T03:30:22Z)
• Bi-Dimensional Feature Alignment for Cross-Domain Object Detection [71.85594342357815]
  We propose a novel unsupervised cross-domain detection model. It exploits the annotated data in a source domain to train an object detector for a different target domain. The proposed model mitigates the cross-domain representation divergence for object detection.
  arXiv  Detail & Related papers  (2020-11-14T03:03:11Z)
• Counting from Sky: A Large-scale Dataset for Remote Sensing Object Counting and A Benchmark Method [52.182698295053264]
  We are interested in counting dense objects from remote sensing images. Compared with object counting in a natural scene, this task is challenging in the following factors: large scale variation, complex cluttered background, and orientation arbitrariness. To address these issues, we first construct a large-scale object counting dataset with remote sensing images, which contains four important geographic objects. We then benchmark the dataset by designing a novel neural network that can generate a density map of an input image.
  arXiv  Detail & Related papers  (2020-08-28T03:47:49Z)
• LR-CNN: Local-aware Region CNN for Vehicle Detection in Aerial Imagery [43.91170581467171]
  State-of-the-art object detection approaches have difficulties detecting dense, small targets with arbitrary orientation in large aerial images. We present the Local-aware Region Convolutional Neural Network (LR-CNN), a novel two-stage approach for vehicle detection in aerial imagery.
  arXiv  Detail & Related papers  (2020-05-28T19:57:34Z)
• Concurrent Segmentation and Object Detection CNNs for Aircraft Detection and Identification in Satellite Images [0.0]
  We present a dedicated method to detect and identify aircraft, combining two very different convolutional neural networks (CNNs) The results we present show that this combination outperforms significantly each unitary model, reducing drastically the false negative rate.
  arXiv  Detail & Related papers  (2020-05-27T07:35:55Z)
• Spatial Attention Pyramid Network for Unsupervised Domain Adaptation [66.75008386980869]
  Unsupervised domain adaptation is critical in various computer vision tasks. We design a new spatial attention pyramid network for unsupervised domain adaptation. Our method performs favorably against the state-of-the-art methods by a large margin.
  arXiv  Detail & Related papers  (2020-03-29T09:03:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.