Implicit Data Synthesis for Contrastive Unsupervised Data Augmentation

• URL: http://arxiv.org/abs/2606.07498v1
• Date: Fri, 05 Jun 2026 17:52:09 GMT
• Title: Implicit Data Synthesis for Contrastive Unsupervised Data Augmentation
• Abstract summary: We show how to generate contrastive samples by perturbing the network weights rather than the underlying data.<n>We demonstrate this technique using a SimCLR-based pipeline applied over radar observations of meteors.
• Score: 4.011518112865689
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Scientific observations generate large quantities of unlabeled data which is laborious to hand-label, making unsupervised learning techniques valuable for processing datasets. Among these approaches, contrastive learning provides a convenient mechanism for extracting structural representations from unannotated datasets. For natural imagery, the general approach is to use a variety of data-space augmentation methods in order to generate synthetic samples; however, for scientific observations data-space perturbations can fundamentally alter the underlying data. Our proposed method is to generate contrastive samples by perturbing the network weights rather than the underlying data, thus more closely preserving the structure of the data. We demonstrate this technique using a SimCLR-based pipeline applied over radar observations of meteors, and show performance gains under matched protocols.

Related papers

• Geometric Characterisation and Structured Trajectory Surrogates for Clinical Dataset Condensation [1.6261700844888172]
  Trajectory matching (TM) is a widely used condensation approach that supervises synthetic data using changes in model parameters observed during training on real data.<n>We show that a fixed synthetic dataset can only reproduce a limited span of such training-induced parameter changes.<n>Motivated by this mismatch, we propose Bezier Trajectory Matching (BTM), which replaces SGD trajectories with quadratic Bezier trajectory surrogates.
  arXiv  Detail & Related papers  (2026-04-23T12:53:46Z)
• Contrastive Learning Boosts Deterministic and Generative Models for Weather Data [0.02256186250710104]
  We explore contrastive learning in weather data, particularly with the ERA5 dataset.<n>We introduce a temporally aware batch sampling strategy and a cycle-consistency loss to improve the structure of the latent space.<n>Our results demonstrate that contrastive learning is a feasible and advantageous compression method for sparse geoscience data.
  arXiv  Detail & Related papers  (2026-03-25T19:09:14Z)
• Robust Molecular Property Prediction via Densifying Scarce Labeled Data [53.24886143129006]
  In drug discovery, compounds most critical for advancing research often lie beyond the training set.<n>We propose a novel bilevel optimization approach that leverages unlabeled data to interpolate between in-distribution (ID) and out-of-distribution (OOD) data.
  arXiv  Detail & Related papers  (2025-06-13T15:27:40Z)
• Research on Dynamic Data Flow Anomaly Detection based on Machine Learning [11.526496773281938]
  In this study, the unsupervised learning method is employed to identify anomalies in dynamic data flows. By clustering similar data, the model is able to detect data behaviour that deviates significantly from normal traffic without the need for labelled data. Notably, it demonstrates robust and adaptable performance, particularly in the context of unbalanced data.
  arXiv  Detail & Related papers  (2024-09-23T08:19:15Z)
• Generative Expansion of Small Datasets: An Expansive Graph Approach [13.053285552524052]
  We introduce an Expansive Synthesis model generating large-scale, information-rich datasets from minimal samples. An autoencoder with self-attention layers and optimal transport refines distributional consistency. Results show comparable performance, demonstrating the model's potential to augment training data effectively.
  arXiv  Detail & Related papers  (2024-06-25T02:59:02Z)
• Domain-Transferred Synthetic Data Generation for Improving Monocular Depth Estimation [9.812476193015488]
  We propose a method of data generation in simulation using 3D synthetic environments and CycleGAN domain transfer. We compare this method of data generation to the popular NYUDepth V2 dataset by training a depth estimation model based on the DenseDepth structure using different training sets of real and simulated data. We evaluate the performance of the models on newly collected images and LiDAR depth data from a Husky robot to verify the generalizability of the approach and show that GAN-transformed data can serve as an effective alternative to real-world data, particularly in depth estimation.
  arXiv  Detail & Related papers  (2024-05-02T09:21:10Z)
• Fractal interpolation in the context of prediction accuracy optimization [44.99833362998488]
  This paper focuses on the hypothesis of optimizing time series predictions using fractal techniques. Prediction results obtained with the LSTM model showed a significant accuracy improvement compared to the raw datasets.
  arXiv  Detail & Related papers  (2024-03-01T09:49:53Z)
• Boosting Data Analytics With Synthetic Volume Expansion [3.568650932986342]
  This article explores the effectiveness of statistical methods on synthetic data and the privacy risks of synthetic data. A key finding within this framework is the generational effect, which reveals that the error rate of statistical methods on synthetic data decreases with the addition of more synthetic data but may eventually rise or stabilize.
  arXiv  Detail & Related papers  (2023-10-27T01:57:27Z)
• Hodge-Aware Contrastive Learning [101.56637264703058]
  Simplicial complexes prove effective in modeling data with multiway dependencies. We develop a contrastive self-supervised learning approach for processing simplicial data.
  arXiv  Detail & Related papers  (2023-09-14T00:40:07Z)
• Linking data separation, visual separation, and classifier performance using pseudo-labeling by contrastive learning [125.99533416395765]
  We argue that the performance of the final classifier depends on the data separation present in the latent space and visual separation present in the projection. We demonstrate our results by the classification of five real-world challenging image datasets of human intestinal parasites with only 1% supervised samples.
  arXiv  Detail & Related papers  (2023-02-06T10:01:38Z)
• Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation [151.70234052015948]
  We propose a novel approach that encourages the optimization algorithm to seek a flat trajectory. We show that the weights trained on synthetic data are robust against the accumulated errors perturbations with the regularization towards the flat trajectory. Our method, called Flat Trajectory Distillation (FTD), is shown to boost the performance of gradient-matching methods by up to 4.7%.
  arXiv  Detail & Related papers  (2022-11-20T15:49:11Z)
• Unsupervised Machine Learning for Exploratory Data Analysis of Exoplanet Transmission Spectra [68.8204255655161]
  We focus on unsupervised techniques for analyzing spectral data from transiting exoplanets. We show that there is a high degree of correlation in the spectral data, which calls for appropriate low-dimensional representations. We uncover interesting structures in the principal component basis, namely, well-defined branches corresponding to different chemical regimes.
  arXiv  Detail & Related papers  (2022-01-07T22:26:33Z)
• Negative Data Augmentation [127.28042046152954]
  We show that negative data augmentation samples provide information on the support of the data distribution. We introduce a new GAN training objective where we use NDA as an additional source of synthetic data for the discriminator. Empirically, models trained with our method achieve improved conditional/unconditional image generation along with improved anomaly detection capabilities.
  arXiv  Detail & Related papers  (2021-02-09T20:28:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.