RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object
Detection
- URL: http://arxiv.org/abs/2208.08738v1
- Date: Thu, 18 Aug 2022 09:35:56 GMT
- Title: RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object
Detection
- Authors: Chang Xu, Jinwang Wang, Wen Yang, Huai Yu, Lei Yu, Gui-Song Xia
- Abstract summary: Current anchor-based or anchor-free label assignment paradigms incur many outlier tiny-sized ground truth samples.
We propose a Gaussian Receptive Field based Label Assignment (RFLA) strategy for tiny object detection.
Our approach outperforms the state-of-the-art competitors with 4.0 AP points on the AI-TOD dataset.
- Score: 45.10513110142015
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Detecting tiny objects is one of the main obstacles hindering the development
of object detection. The performance of generic object detectors tends to
drastically deteriorate on tiny object detection tasks. In this paper, we point
out that either box prior in the anchor-based detector or point prior in the
anchor-free detector is sub-optimal for tiny objects. Our key observation is
that the current anchor-based or anchor-free label assignment paradigms will
incur many outlier tiny-sized ground truth samples, leading to detectors
imposing less focus on the tiny objects. To this end, we propose a Gaussian
Receptive Field based Label Assignment (RFLA) strategy for tiny object
detection. Specifically, RFLA first utilizes the prior information that the
feature receptive field follows Gaussian distribution. Then, instead of
assigning samples with IoU or center sampling strategy, a new Receptive Field
Distance (RFD) is proposed to directly measure the similarity between the
Gaussian receptive field and ground truth. Considering that the IoU-threshold
based and center sampling strategy are skewed to large objects, we further
design a Hierarchical Label Assignment (HLA) module based on RFD to achieve
balanced learning for tiny objects. Extensive experiments on four datasets
demonstrate the effectiveness of the proposed methods. Especially, our approach
outperforms the state-of-the-art competitors with 4.0 AP points on the AI-TOD
dataset. Codes are available at https://github.com/Chasel-Tsui/mmdet-rfla
Related papers
- Similarity Distance-Based Label Assignment for Tiny Object Detection [17.059514012235354]
We introduce a simple but effective strategy named the Similarity Distance (SimD) to evaluate the similarity between bounding boxes.
Our approach can be applied in common anchor-based detectors in place of the IoU for label assignment and Non Maximum Suppression (NMS)
Experiments on four mainstream tiny object detection datasets demonstrate superior performance of our method.
arXiv Detail & Related papers (2024-07-02T16:12:37Z) - Visible and Clear: Finding Tiny Objects in Difference Map [50.54061010335082]
We introduce a self-reconstruction mechanism in the detection model, and discover the strong correlation between it and the tiny objects.
Specifically, we impose a reconstruction head in-between the neck of a detector, constructing a difference map of the reconstructed image and the input, which shows high sensitivity to tiny objects.
We further develop a Difference Map Guided Feature Enhancement (DGFE) module to make the tiny feature representation more clear.
arXiv Detail & Related papers (2024-05-18T12:22:26Z) - Better Sampling, towards Better End-to-end Small Object Detection [7.7473020808686694]
Small object detection remains unsatisfactory due to limited characteristics and high density and mutual overlap.
We propose methods enhancing sampling within an end-to-end framework.
Our model demonstrates a significant enhancement, achieving a 2.9% increase in average precision (AP) over the state-of-the-art (SOTA) on the VisDrone dataset.
arXiv Detail & Related papers (2024-05-17T04:37:44Z) - Find n' Propagate: Open-Vocabulary 3D Object Detection in Urban Environments [67.83787474506073]
We tackle the limitations of current LiDAR-based 3D object detection systems.
We introduce a universal textscFind n' Propagate approach for 3D OV tasks.
We achieve up to a 3.97-fold increase in Average Precision (AP) for novel object classes.
arXiv Detail & Related papers (2024-03-20T12:51:30Z) - Improving the Detection of Small Oriented Objects in Aerial Images [0.0]
We propose a method to accurately detect small oriented objects in aerial images by enhancing the classification and regression tasks of the oriented object detection model.
We designed the Attention-Points Network consisting of two losses: Guided-Attention Loss (GALoss) and Box-Points Loss (BPLoss)
Experimental results show the effectiveness of our Attention-Points Network on a standard oriented aerial dataset with small object instances.
arXiv Detail & Related papers (2024-01-12T11:00:07Z) - Small Object Detection via Coarse-to-fine Proposal Generation and
Imitation Learning [52.06176253457522]
We propose a two-stage framework tailored for small object detection based on the Coarse-to-fine pipeline and Feature Imitation learning.
CFINet achieves state-of-the-art performance on the large-scale small object detection benchmarks, SODA-D and SODA-A.
arXiv Detail & Related papers (2023-08-18T13:13:09Z) - Detecting tiny objects in aerial images: A normalized Wasserstein
distance and a new benchmark [45.10513110142015]
We propose a new evaluation metric dubbed Normalized Wasserstein Distance (NWD) and a new RanKing-based Assigning (RKA) strategy for tiny object detection.
The proposed NWD-RKA strategy can be easily embedded into all kinds of anchor-based detectors to replace the standard IoU threshold-based one.
Tested on four datasets, NWD-RKA can consistently improve tiny object detection performance by a large margin.
arXiv Detail & Related papers (2022-06-28T13:33:06Z) - Anchor-free Oriented Proposal Generator for Object Detection [59.54125119453818]
Oriented object detection is a practical and challenging task in remote sensing image interpretation.
Nowadays, oriented detectors mostly use horizontal boxes as intermedium to derive oriented boxes from them.
We propose a novel Anchor-free Oriented Proposal Generator (AOPG) that abandons the horizontal boxes-related operations from the network architecture.
arXiv Detail & Related papers (2021-10-05T10:45:51Z) - Pseudo-IoU: Improving Label Assignment in Anchor-Free Object Detection [60.522877583407904]
Current anchor-free object detectors are quite simple and effective yet lack accurate label assignment methods.
We present Pseudo-Intersection-over-Union(Pseudo-IoU): a simple metric that brings more standardized and accurate assignment rule into anchor-free object detection frameworks.
Our method achieves comparable performance to other recent state-of-the-art anchor-free methods without bells and whistles.
arXiv Detail & Related papers (2021-04-29T02:48:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.