Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmark

• URL: http://arxiv.org/abs/2206.13996v1
• Date: Tue, 28 Jun 2022 13:33:06 GMT
• Title: Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmark
• Authors: Chang Xu, Jinwang Wang, Wen Yang, Huai Yu, Lei Yu, Gui-Song Xia
• Abstract summary: We propose a new evaluation metric dubbed Normalized Wasserstein Distance (NWD) and a new RanKing-based Assigning (RKA) strategy for tiny object detection. The proposed NWD-RKA strategy can be easily embedded into all kinds of anchor-based detectors to replace the standard IoU threshold-based one. Tested on four datasets, NWD-RKA can consistently improve tiny object detection performance by a large margin.
• Score: 45.10513110142015
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Tiny object detection (TOD) in aerial images is challenging since a tiny object only contains a few pixels. State-of-the-art object detectors do not provide satisfactory results on tiny objects due to the lack of supervision from discriminative features. Our key observation is that the Intersection over Union (IoU) metric and its extensions are very sensitive to the location deviation of the tiny objects, which drastically deteriorates the quality of label assignment when used in anchor-based detectors. To tackle this problem, we propose a new evaluation metric dubbed Normalized Wasserstein Distance (NWD) and a new RanKing-based Assigning (RKA) strategy for tiny object detection. The proposed NWD-RKA strategy can be easily embedded into all kinds of anchor-based detectors to replace the standard IoU threshold-based one, significantly improving label assignment and providing sufficient supervision information for network training. Tested on four datasets, NWD-RKA can consistently improve tiny object detection performance by a large margin. Besides, observing prominent noisy labels in the Tiny Object Detection in Aerial Images (AI-TOD) dataset, we are motivated to meticulously relabel it and release AI-TOD-v2 and its corresponding benchmark. In AI-TOD-v2, the missing annotation and location error problems are considerably mitigated, facilitating more reliable training and validation processes. Embedding NWD-RKA into DetectoRS, the detection performance achieves 4.3 AP points improvement over state-of-the-art competitors on AI-TOD-v2. Datasets, codes, and more visualizations are available at: https://chasel-tsui.github.io/AI-TOD-v2/

Related papers

• Similarity Distance-Based Label Assignment for Tiny Object Detection [17.059514012235354]
  We introduce a simple but effective strategy named the Similarity Distance (SimD) to evaluate the similarity between bounding boxes. Our approach can be applied in common anchor-based detectors in place of the IoU for label assignment and Non Maximum Suppression (NMS) Experiments on four mainstream tiny object detection datasets demonstrate superior performance of our method.
  arXiv  Detail & Related papers  (2024-07-02T16:12:37Z)
• Robust Tiny Object Detection in Aerial Images amidst Label Noise [50.257696872021164]
  This study addresses the issue of tiny object detection under noisy label supervision. We propose a DeNoising Tiny Object Detector (DN-TOD), which incorporates a Class-aware Label Correction scheme. Our method can be seamlessly integrated into both one-stage and two-stage object detection pipelines.
  arXiv  Detail & Related papers  (2024-01-16T02:14:33Z)
• Improving the Detection of Small Oriented Objects in Aerial Images [0.0]
  We propose a method to accurately detect small oriented objects in aerial images by enhancing the classification and regression tasks of the oriented object detection model. We designed the Attention-Points Network consisting of two losses: Guided-Attention Loss (GALoss) and Box-Points Loss (BPLoss) Experimental results show the effectiveness of our Attention-Points Network on a standard oriented aerial dataset with small object instances.
  arXiv  Detail & Related papers  (2024-01-12T11:00:07Z)
• Small Object Detection via Coarse-to-fine Proposal Generation and Imitation Learning [52.06176253457522]
  We propose a two-stage framework tailored for small object detection based on the Coarse-to-fine pipeline and Feature Imitation learning. CFINet achieves state-of-the-art performance on the large-scale small object detection benchmarks, SODA-D and SODA-A.
  arXiv  Detail & Related papers  (2023-08-18T13:13:09Z)
• RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detection [45.10513110142015]
  Current anchor-based or anchor-free label assignment paradigms incur many outlier tiny-sized ground truth samples. We propose a Gaussian Receptive Field based Label Assignment (RFLA) strategy for tiny object detection. Our approach outperforms the state-of-the-art competitors with 4.0 AP points on the AI-TOD dataset.
  arXiv  Detail & Related papers  (2022-08-18T09:35:56Z)
• Towards Large-Scale Small Object Detection: Survey and Benchmarks [48.961205652306695]
  We construct two large-scale Small Object Detection dAtasets (SODA), SODA-D and SODA-A, which focus on the Driving and Aerial scenarios respectively. For SODA-A, we harvest 2513 high resolution aerial images and annotate 872069 instances over nine classes. The proposed datasets are the first-ever attempt to large-scale benchmarks with a vast collection of exhaustively annotated instances.
  arXiv  Detail & Related papers  (2022-07-28T14:02:18Z)
• A Normalized Gaussian Wasserstein Distance for Tiny Object Detection [21.50800336432307]
  State-of-the-art detectors do not produce satisfactory results on tiny objects due to lack of appearance information. We propose a new evaluation metric using Wasserstein distance for tiny object detection.
  arXiv  Detail & Related papers  (2021-10-26T03:43:17Z)
• Dense Label Encoding for Boundary Discontinuity Free Rotation Detection [69.75559390700887]
  This paper explores a relatively less-studied methodology based on classification. We propose new techniques to push its frontier in two aspects. Experiments and visual analysis on large-scale public datasets for aerial images show the effectiveness of our approach.
  arXiv  Detail & Related papers  (2020-11-19T05:42:02Z)
• SCRDet++: Detecting Small, Cluttered and Rotated Objects via Instance-Level Feature Denoising and Rotation Loss Smoothing [131.04304632759033]
  Small and cluttered objects are common in real-world which are challenging for detection. In this paper, we first innovatively introduce the idea of denoising to object detection. Instance-level denoising on the feature map is performed to enhance the detection to small and cluttered objects.
  arXiv  Detail & Related papers  (2020-04-28T06:03:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.