Metric-aligned Sample Selection and Critical Feature Sampling for Oriented Object Detection

• URL: http://arxiv.org/abs/2306.16718v2
• Date: Mon, 10 Jul 2023 07:16:17 GMT
• Title: Metric-aligned Sample Selection and Critical Feature Sampling for Oriented Object Detection
• Authors: Peng Sun, Yongbin Zheng, Wenqi Wu, Wanying Xu and Shengjian Bai
• Abstract summary: We introduce affine transformation to evaluate the quality of samples and propose a distance-based label assignment strategy. The proposed metric-aligned selection (MAS) strategy can dynamically select samples according to the shape and rotation characteristic of objects. The results show the state-of-the-art accuracy of the proposed detector.
• Score: 4.677438149607058
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Arbitrary-oriented object detection is a relatively emerging but challenging task. Although remarkable progress has been made, there still remain many unsolved issues due to the large diversity of patterns in orientation, scale, aspect ratio, and visual appearance of objects in aerial images. Most of the existing methods adopt a coarse-grained fixed label assignment strategy and suffer from the inconsistency between the classification score and localization accuracy. First, to align the metric inconsistency between sample selection and regression loss calculation caused by fixed IoU strategy, we introduce affine transformation to evaluate the quality of samples and propose a distance-based label assignment strategy. The proposed metric-aligned selection (MAS) strategy can dynamically select samples according to the shape and rotation characteristic of objects. Second, to further address the inconsistency between classification and localization, we propose a critical feature sampling (CFS) module, which performs localization refinement on the sampling location for classification task to extract critical features accurately. Third, we present a scale-controlled smooth $L_1$ loss (SC-Loss) to adaptively select high quality samples by changing the form of regression loss function based on the statistics of proposals during training. Extensive experiments are conducted on four challenging rotated object detection datasets DOTA, FAIR1M-1.0, HRSC2016, and UCAS-AOD. The results show the state-of-the-art accuracy of the proposed detector.

Related papers

• Hybrid Classification-Regression Adaptive Loss for Dense Object Detection [19.180514552400883]
  We propose a Hybrid Classification-Regression Adaptive Loss, termed as HCRAL. We introduce the Residual of Classification and IoU (RCI) module for cross-task supervision, addressing task inconsistencies, and the Conditioning Factor (CF) to focus on difficult-to-train samples within each task. We also introduce a new strategy named Expanded Adaptive Training Sample Selection (EATSS) to provide additional samples that exhibit classification and regression inconsistencies.
  arXiv  Detail & Related papers  (2024-08-30T10:31:39Z)
• Downstream-Pretext Domain Knowledge Traceback for Active Learning [138.02530777915362]
  We propose a downstream-pretext domain knowledge traceback (DOKT) method that traces the data interactions of downstream knowledge and pre-training guidance. DOKT consists of a traceback diversity indicator and a domain-based uncertainty estimator. Experiments conducted on ten datasets show that our model outperforms other state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-07-20T01:34:13Z)
• Category-Aware Dynamic Label Assignment with High-Quality Oriented Proposal [17.674175038655058]
  In this paper, an OBB representation based on the complex plane is introduced in the oriented detection framework. A conformer RPN head is constructed to predict angle information. The proposed loss function and conformer RPN head jointly generate high-quality oriented proposals.
  arXiv  Detail & Related papers  (2024-07-03T15:36:47Z)
• Small Object Detection via Coarse-to-fine Proposal Generation and Imitation Learning [52.06176253457522]
  We propose a two-stage framework tailored for small object detection based on the Coarse-to-fine pipeline and Feature Imitation learning. CFINet achieves state-of-the-art performance on the large-scale small object detection benchmarks, SODA-D and SODA-A.
  arXiv  Detail & Related papers  (2023-08-18T13:13:09Z)
• Active Learning for Object Detection with Non-Redundant Informative Sampling [1.7602289331729377]
  Our strategy integrates uncertainty and diversity-based selection principles into a joint selection objective. Our proposed NORIS algorithm quantifies the impact of training with a sample on the informativeness of other similar samples. Our strategy achieves a 20% and 30% reduction in labeling costs compared to random selection for PASCAL-VOC and KITTI.
  arXiv  Detail & Related papers  (2023-07-17T11:55:20Z)
• ARS-DETR: Aspect Ratio-Sensitive Detection Transformer for Aerial Oriented Object Detection [55.291579862817656]
  Existing oriented object detection methods commonly use metric AP$_50$ to measure the performance of the model. We argue that AP$_50$ is inherently unsuitable for oriented object detection due to its large tolerance in angle deviation. We propose an Aspect Ratio Sensitive Oriented Object Detector with Transformer, termed ARS-DETR, which exhibits a competitive performance.
  arXiv  Detail & Related papers  (2023-03-09T02:20:56Z)
• EARL: An Elliptical Distribution aided Adaptive Rotation Label Assignment for Oriented Object Detection in Remote Sensing Images [22.963695067213084]
  Adaptive Rotation Label Assignment (EARL) is proposed to select high-quality positive samples adaptively in anchor-free detectors. In this paper, an adaptive scale sampling (ADS) strategy is presented to select samples adaptively among multi-level feature maps according to the scales of targets. In addition, a dynamic elliptical distribution aided sampling (DED) strategy is proposed to make the sample distribution more flexible to fit the shapes and orientations of targets.
  arXiv  Detail & Related papers  (2023-01-14T08:32:16Z)
• Improving Sample and Feature Selection with Principal Covariates Regression [0.0]
  We focus on two popular sub-selection schemes which have been applied to this end. We show that incorporating target information provides selections that perform better in supervised tasks. We also show that incorporating aspects of simple supervised learning models can improve the accuracy of more complex models.
  arXiv  Detail & Related papers  (2020-12-22T18:52:06Z)
• Learning a Unified Sample Weighting Network for Object Detection [113.98404690619982]
  Region sampling or weighting is significantly important to the success of modern region-based object detectors. We argue that sample weighting should be data-dependent and task-dependent. We propose a unified sample weighting network to predict a sample's task weights.
  arXiv  Detail & Related papers  (2020-06-11T16:19:16Z)
• Scope Head for Accurate Localization in Object Detection [135.9979405835606]
  We propose a novel detector coined as ScopeNet, which models anchors of each location as a mutually dependent relationship. With our concise and effective design, the proposed ScopeNet achieves state-of-the-art results on COCO.
  arXiv  Detail & Related papers  (2020-05-11T04:00:09Z)
• One-Shot Object Detection without Fine-Tuning [62.39210447209698]
  We introduce a two-stage model consisting of a first stage Matching-FCOS network and a second stage Structure-Aware Relation Module. We also propose novel training strategies that effectively improve detection performance. Our method exceeds the state-of-the-art one-shot performance consistently on multiple datasets.
  arXiv  Detail & Related papers  (2020-05-08T01:59:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.