RangeAugment: Efficient Online Augmentation with Range Learning

• URL: http://arxiv.org/abs/2212.10553v1
• Date: Tue, 20 Dec 2022 18:55:54 GMT
• Title: RangeAugment: Efficient Online Augmentation with Range Learning
• Authors: Sachin Mehta and Saeid Naderiparizi and Fartash Faghri and Maxwell Horton and Lailin Chen and Ali Farhadi and Oncel Tuzel and Mohammad Rastegari
• Abstract summary: RangeAugment efficiently learns the range of magnitudes for individual as well as composite augmentation operations. We show that RangeAugment achieves competitive performance to state-of-the-art automatic augmentation methods with 4-5 times fewer augmentation operations.
• Score: 54.61514286212455
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: State-of-the-art automatic augmentation methods (e.g., AutoAugment and RandAugment) for visual recognition tasks diversify training data using a large set of augmentation operations. The range of magnitudes of many augmentation operations (e.g., brightness and contrast) is continuous. Therefore, to make search computationally tractable, these methods use fixed and manually-defined magnitude ranges for each operation, which may lead to sub-optimal policies. To answer the open question on the importance of magnitude ranges for each augmentation operation, we introduce RangeAugment that allows us to efficiently learn the range of magnitudes for individual as well as composite augmentation operations. RangeAugment uses an auxiliary loss based on image similarity as a measure to control the range of magnitudes of augmentation operations. As a result, RangeAugment has a single scalar parameter for search, image similarity, which we simply optimize via linear search. RangeAugment integrates seamlessly with any model and learns model- and task-specific augmentation policies. With extensive experiments on the ImageNet dataset across different networks, we show that RangeAugment achieves competitive performance to state-of-the-art automatic augmentation methods with 4-5 times fewer augmentation operations. Experimental results on semantic segmentation, object detection, foundation models, and knowledge distillation further shows RangeAugment's effectiveness.

Related papers

• Additional Look into GAN-based Augmentation for Deep Learning COVID-19 Image Classification [57.1795052451257]
  We study the dependence of the GAN-based augmentation performance on dataset size with a focus on small samples. We train StyleGAN2-ADA with both sets and then, after validating the quality of generated images, we use trained GANs as one of the augmentations approaches in multi-class classification problems. The GAN-based augmentation approach is found to be comparable with classical augmentation in the case of medium and large datasets but underperforms in the case of smaller datasets.
  arXiv  Detail & Related papers  (2024-01-26T08:28:13Z)
• AugDiff: Diffusion based Feature Augmentation for Multiple Instance Learning in Whole Slide Image [15.180437840817788]
  Multiple Instance Learning (MIL), a powerful strategy for weakly supervised learning, is able to perform various prediction tasks on gigapixel Whole Slide Images (WSIs) We introduce the Diffusion Model (DM) into MIL for the first time and propose a feature augmentation framework called AugDiff. We conduct extensive experiments over three distinct cancer datasets, two different feature extractors, and three prevalent MIL algorithms to evaluate the performance of AugDiff.
  arXiv  Detail & Related papers  (2023-03-11T10:36:27Z)
• Local Magnification for Data and Feature Augmentation [53.04028225837681]
  We propose an easy-to-implement and model-free data augmentation method called Local Magnification (LOMA) LOMA generates additional training data by randomly magnifying a local area of the image. Experiments show that our proposed LOMA, though straightforward, can be combined with standard data augmentation to significantly improve the performance on image classification and object detection.
  arXiv  Detail & Related papers  (2022-11-15T02:51:59Z)
• TeachAugment: Data Augmentation Optimization Using Teacher Knowledge [11.696069523681178]
  We propose a data augmentation optimization method based on the adversarial strategy called TeachAugment. We show that TeachAugment outperforms existing methods in experiments of image classification, semantic segmentation, and unsupervised representation learning tasks.
  arXiv  Detail & Related papers  (2022-02-25T06:22:51Z)
• Scale-aware Automatic Augmentation for Object Detection [63.087930708444695]
  We propose Scale-aware AutoAug to learn data augmentation policies for object detection. In experiments, Scale-aware AutoAug yields significant and consistent improvement on various object detectors.
  arXiv  Detail & Related papers  (2021-03-31T17:11:14Z)
• Enabling Data Diversity: Efficient Automatic Augmentation via Regularized Adversarial Training [9.39080195887973]
  We propose a regularized adversarial training framework via two min-max objectives and three differentiable augmentation models. Our approach achieves superior performance over state-of-the-art auto-augmentation methods on both tasks of 2D skin cancer classification and 3D organs-at-risk segmentation.
  arXiv  Detail & Related papers  (2021-03-30T16:49:20Z)
• DivAug: Plug-in Automated Data Augmentation with Explicit Diversity Maximization [41.82120128496555]
  Two factors regarding the diversity of augmented data are still missing: 1) the explicit definition (and thus measurement) of diversity and 2) the quantifiable relationship between diversity and its regularization effects. We propose a diversity measure called Variance Diversity and theoretically show that the regularization effect of data augmentation is promised by Variance Diversity. An unsupervised sampling-based framework, DivAug, is designed to directly maximize Variance Diversity and hence strengthen the regularization effect.
  arXiv  Detail & Related papers  (2021-03-26T16:00:01Z)
• Automatic Data Augmentation for 3D Medical Image Segmentation [37.262350163905445]
  It is the first time that differentiable automatic data augmentation is employed in medical image segmentation tasks. Our numerical experiments demonstrate that the proposed approach significantly outperforms existing build-in data augmentation of state-of-the-art models.
  arXiv  Detail & Related papers  (2020-10-07T12:51:17Z)
• Unsupervised Learning of Visual Features by Contrasting Cluster Assignments [57.33699905852397]
  We propose an online algorithm, SwAV, that takes advantage of contrastive methods without requiring to compute pairwise comparisons. Our method simultaneously clusters the data while enforcing consistency between cluster assignments. Our method can be trained with large and small batches and can scale to unlimited amounts of data.
  arXiv  Detail & Related papers  (2020-06-17T14:00:42Z)
• PointAugment: an Auto-Augmentation Framework for Point Cloud Classification [105.27565020399]
  PointAugment is a new auto-augmentation framework that automatically optimize and augments point cloud samples to enrich the data diversity when we train a classification network. We formulate a learnable point augmentation function with a shape-wise transformation and a point-wise displacement, and carefully design loss functions to adopt the augmented samples.
  arXiv  Detail & Related papers  (2020-02-25T14:25:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.