Limitations of Synthetic Data Generation in Specialized Data-Scarce Domains

• URL: http://arxiv.org/abs/2608.13729v1
• Date: Thu, 13 Aug 2026 19:43:31 GMT
• Title: Limitations of Synthetic Data Generation in Specialized Data-Scarce Domains
• Abstract summary: This work focuses on domains where images differ substantially from common image datasets and additional data are expensive to obtain.<n>We evaluate the downstream performance improvements yielded by two schools of generative sparse data extension.<n>Across five trauma classification tasks using subject-wise train--validation splits, no generative approach consistently outperforms a strong non-generative baseline.
• Score: 11.861117372710714
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Advances in diffusion-based generative models have motivated the use of synthetic image generation to alleviate data scarcity in vision tasks. While this strategy has shown promise in natural image benchmarks such as ImageNet, its effectiveness in sparse, high-variance real-world domains remains unclear. In this work, we focus on domains where images differ substantially from common image datasets and additional data are expensive to obtain. Against non-generative data augmentation baselines, we evaluate the downstream classifier performance improvements yielded by two schools of generative sparse data extension: distribution modeling and sample perturbation. Across five trauma classification tasks using subject-wise train--validation splits, no generative approach consistently outperforms a strong non-generative baseline. Feature-space analysis reveals recurring failure modes: memorization or collapse, distributional drift, and generation of visually plausible but simplified canonical instances that are easier to classify than real data.

Related papers

• Diffuse and Disperse: Image Generation with Representation Regularization [23.413550999126173]
  We propose textitDispersive Loss, a plug-and-play regularizer that effectively improves diffusion-based generative models.<n>Our loss function encourages internal representations to disperse in the hidden space, analogous to contrastive self-supervised learning.<n>Compared to the recent method of representation alignment (REPA), our approach is self-contained and minimalist, requiring no pre-training, no additional parameters, and no external data.
  arXiv  Detail & Related papers  (2025-06-10T17:53:29Z)
• Unpaired Deblurring via Decoupled Diffusion Model [55.21345354747609]
  We propose UID-Diff, a generative-diffusion-based model designed to enhance deblurring performance on unknown domains.<n>We employ two Q-Formers as structural features and blur patterns extractors separately. The features extracted will be used for the supervised deblurring task on synthetic data and the unsupervised blur-transfer task.<n>Experiments on real-world datasets demonstrate that UID-Diff outperforms existing state-of-the-art methods in blur removal and structural preservation.
  arXiv  Detail & Related papers  (2025-02-03T17:00:40Z)
• GenMix: Effective Data Augmentation with Generative Diffusion Model Image Editing [60.101097709212716]
  This paper introduces GenMix, a generalizable prompt-guided generative data augmentation approach.<n>Our technique leverages image editing to generate augmented images based on custom conditional prompts.<n>Our approach mitigates unrealistic images and label ambiguity, improving the performance and adversarial robustness of the resulting models.
  arXiv  Detail & Related papers  (2024-12-03T10:45:34Z)
• Feature-to-Image Data Augmentation: Improving Model Feature Extraction with Cluster-Guided Synthetic Samples [4.041834517339835]
  This study introduces FICAug, a novel feature-to-image data augmentation framework.<n>It is designed to improve model generalization under limited data conditions by generating structured synthetic samples.<n> Experimental results demonstrate that FICAug significantly improves classification accuracy.
  arXiv  Detail & Related papers  (2024-09-26T09:51:08Z)
• Is Synthetic Image Useful for Transfer Learning? An Investigation into Data Generation, Volume, and Utilization [62.157627519792946]
  We introduce a novel framework called bridged transfer, which initially employs synthetic images for fine-tuning a pre-trained model to improve its transferability. We propose dataset style inversion strategy to improve the stylistic alignment between synthetic and real images. Our proposed methods are evaluated across 10 different datasets and 5 distinct models, demonstrating consistent improvements.
  arXiv  Detail & Related papers  (2024-03-28T22:25:05Z)
• Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems [80.62854148838359]
  Eye image segmentation is a critical step in eye tracking that has great influence over the final gaze estimate. We use dimensionality-reduction techniques to measure the overlap between the target eye images and synthetic training data. Our methods result in robust, improved performance when tackling the discrepancy between simulation and real-world data samples.
  arXiv  Detail & Related papers  (2024-03-23T22:32:06Z)
• DetDiffusion: Synergizing Generative and Perceptive Models for Enhanced Data Generation and Perception [78.26734070960886]
  Current perceptive models heavily depend on resource-intensive datasets. We introduce perception-aware loss (P.A. loss) through segmentation, improving both quality and controllability. Our method customizes data augmentation by extracting and utilizing perception-aware attribute (P.A. Attr) during generation.
  arXiv  Detail & Related papers  (2024-03-20T04:58:03Z)
• Leaving Reality to Imagination: Robust Classification via Generated Datasets [24.411444438920988]
  Recent research on robustness has revealed significant performance gaps between neural image classifiers trained on datasets similar to the test set. We study the question: How do generated datasets influence the natural robustness of image classifiers? We find that Imagenet classifiers trained on real data augmented with generated data achieve higher accuracy and effective robustness than standard training.
  arXiv  Detail & Related papers  (2023-02-05T22:49:33Z)
• Negative Data Augmentation [127.28042046152954]
  We show that negative data augmentation samples provide information on the support of the data distribution. We introduce a new GAN training objective where we use NDA as an additional source of synthetic data for the discriminator. Empirically, models trained with our method achieve improved conditional/unconditional image generation along with improved anomaly detection capabilities.
  arXiv  Detail & Related papers  (2021-02-09T20:28:35Z)
• Towards Domain Invariant Single Image Dehazing [34.075765763305235]
  Presence of haze in images obscures underlying information, which is undesirable in applications requiring accurate environment information. In this paper, we utilize an encoder-decoder based network architecture to perform the task of dehazing.
  arXiv  Detail & Related papers  (2021-01-09T14:14:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.