ColMix -- A Simple Data Augmentation Framework to Improve Object Detector Performance and Robustness in Aerial Images

• URL: http://arxiv.org/abs/2305.13509v1
• Date: Mon, 22 May 2023 21:56:35 GMT
• Title: ColMix -- A Simple Data Augmentation Framework to Improve Object Detector Performance and Robustness in Aerial Images
• Authors: Cuong Ly, Grayson Jorgenson, Dan Rosa de Jesus, Henry Kvinge, Adam Attarian, Yijing Watkins
• Abstract summary: We present a novel augmentation method, called collage pasting, for increasing the object density without a need for segmentation masks. We find that collage pasting is vulnerable to certain out-of-distribution shifts, such as image corruptions. We introduce two simple approaches for combining collage pasting with PixMix augmentation method, and refer to our combined techniques as ColMix.
• Score: 1.9573380763700712
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In the last decade, Convolutional Neural Network (CNN) and transformer based object detectors have achieved high performance on a large variety of datasets. Though the majority of detection literature has developed this capability on datasets such as MS COCO, these detectors have still proven effective for remote sensing applications. Challenges in this particular domain, such as small numbers of annotated objects and low object density, hinder overall performance. In this work, we present a novel augmentation method, called collage pasting, for increasing the object density without a need for segmentation masks, thereby improving the detector performance. We demonstrate that collage pasting improves precision and recall beyond related methods, such as mosaic augmentation, and enables greater control of object density. However, we find that collage pasting is vulnerable to certain out-of-distribution shifts, such as image corruptions. To address this, we introduce two simple approaches for combining collage pasting with PixMix augmentation method, and refer to our combined techniques as ColMix. Through extensive experiments, we show that employing ColMix results in detectors with superior performance on aerial imagery datasets and robust to various corruptions.

Related papers

• A Simple Background Augmentation Method for Object Detection with Diffusion Model [53.32935683257045]
  In computer vision, it is well-known that a lack of data diversity will impair model performance. We propose a simple yet effective data augmentation approach by leveraging advancements in generative models. Background augmentation, in particular, significantly improves the models' robustness and generalization capabilities.
  arXiv  Detail & Related papers  (2024-08-01T07:40:00Z)
• Select-Mosaic: Data Augmentation Method for Dense Small Object Scenes [4.418515380386838]
  Mosaic data augmentation technique stitches multiple images together to increase the diversity and complexity of training data. This paper proposes the Select-Mosaic data augmentation method, which is improved with a fine-grained region selection strategy. The improved Select-Mosaic method demonstrates superior performance in handling dense small object detection tasks.
  arXiv  Detail & Related papers  (2024-06-08T09:22:08Z)
• Supervision Interpolation via LossMix: Generalizing Mixup for Object Detection and Beyond [10.25372189905226]
  LossMix is a simple yet versatile and effective regularization that enhances the performance and robustness of object detectors. Empirical results on the PASCAL VOC and MS COCO datasets demonstrate that LossMix can consistently outperform state-of-the-art methods for detection.
  arXiv  Detail & Related papers  (2023-03-18T06:13:30Z)
• Cascaded Zoom-in Detector for High Resolution Aerial Images [12.944309759825902]
  We propose an efficient Cascaded Zoom-in (CZ) detector that re-purposes the detector itself for density-guided training and inference. During training, density crops are located, labeled as a new class, and employed to augment the training dataset. This approach is easily integrated into any detector, and creates no significant change in the standard detection process.
  arXiv  Detail & Related papers  (2023-03-15T16:39:21Z)
• Boosting Robustness of Image Matting with Context Assembling and Strong Data Augmentation [83.31087402305306]
  robustness to trimaps and generalization to images from different domains is still under-explored. We propose an image matting method which achieves higher robustness (RMat) via multilevel context assembling and strong data augmentation targeting matting.
  arXiv  Detail & Related papers  (2022-01-18T11:45:17Z)
• Context-Aware Transfer Attacks for Object Detection [51.65308857232767]
  We present a new approach to generate context-aware attacks for object detectors. We show that by using co-occurrence of objects and their relative locations and sizes as context information, we can successfully generate targeted mis-categorization attacks.
  arXiv  Detail & Related papers  (2021-12-06T18:26:39Z)
• ChessMix: Spatial Context Data Augmentation for Remote Sensing Semantic Segmentation [1.0152838128195467]
  ChessMix creates new synthetic images by mixing transformed mini-patches across the dataset in a chessboard-like grid. Results in three diverse well-known remote sensing datasets show that ChessMix is capable of improving the segmentation of objects with few labeled pixels.
  arXiv  Detail & Related papers  (2021-08-26T01:01:43Z)
• Robust and Accurate Object Detection via Adversarial Learning [111.36192453882195]
  This work augments the fine-tuning stage for object detectors by exploring adversarial examples. Our approach boosts the performance of state-of-the-art EfficientDets by +1.1 mAP on the object detection benchmark.
  arXiv  Detail & Related papers  (2021-03-23T19:45:26Z)
• ResizeMix: Mixing Data with Preserved Object Information and True Labels [57.00554495298033]
  We study the importance of the saliency information for mixing data, and find that the saliency information is not so necessary for promoting the augmentation performance. We propose a more effective but very easily implemented method, namely ResizeMix.
  arXiv  Detail & Related papers  (2020-12-21T03:43:13Z)
• DecAug: Augmenting HOI Detection via Decomposition [54.65572599920679]
  Current algorithms suffer from insufficient training samples and category imbalance within datasets. We propose an efficient and effective data augmentation method called DecAug for HOI detection. Experiments show that our method brings up to 3.3 mAP and 1.6 mAP improvements on V-COCO and HICODET dataset.
  arXiv  Detail & Related papers  (2020-10-02T13:59:05Z)
• FenceMask: A Data Augmentation Approach for Pre-extracted Image Features [18.299882139724684]
  We propose a novel data augmentation method named 'FenceMask' It exhibits outstanding performance in various computer vision tasks. Our method achieved significant performance improvement on Fine-Grained Visual Categorization task and VisDrone dataset.
  arXiv  Detail & Related papers  (2020-06-14T12:16:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.