Double InfoGAN for Contrastive Analysis
- URL: http://arxiv.org/abs/2401.17776v1
- Date: Wed, 31 Jan 2024 12:16:39 GMT
- Title: Double InfoGAN for Contrastive Analysis
- Abstract summary: Contrastive Analysis (CA) deals with the discovery of what is common and what is distinctive of a target domain compared to a background one.
Current state-of-the-art (SOTA) methods are latent variable models based on VAE (CA-VAEs)
Here, we propose Double InfoGAN, the first GAN based method for CA that leverages the high-quality synthesis of GAN and the separation power of InfoGAN.
- Score: 2.342780148664847
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Contrastive Analysis (CA) deals with the discovery of what is common and what
is distinctive of a target domain compared to a background one. This is of
great interest in many applications, such as medical imaging. Current
state-of-the-art (SOTA) methods are latent variable models based on VAE
(CA-VAEs). However, they all either ignore important constraints or they don't
enforce fundamental assumptions. This may lead to sub-optimal solutions where
distinctive factors are mistaken for common ones (or viceversa). Furthermore,
the generated images have a rather poor quality, typical of VAEs, decreasing
their interpretability and usefulness. Here, we propose Double InfoGAN, the
first GAN based method for CA that leverages the high-quality synthesis of GAN
and the separation power of InfoGAN. Experimental results on four visual
datasets, from simple synthetic examples to complex medical images, show that
the proposed method outperforms SOTA CA-VAEs in terms of latent separation and
image quality. Datasets and code are available online.
Related papers
- Counterfactual Contrastive Analysis [6.190850256222902]
We propose a classifier-free approach for visual counterfactual generation based on Contrastive Analysis (CA)<n>We disentangle the generative factors that are common across the two datasets from those that are salient to each dataset, and generate counterfactual images by swapping only the salient factors.<n>We evaluate our method on three medical imaging datasets and demonstrate superior counterfactual generation quality compared to existing approaches.
arXiv Detail & Related papers (2026-08-19T15:25:21Z) - Cross-Domain Adversarial Augmentation: Stabilizing GANs for Medical and Handwriting Data Scarcity [0.0]
Generative Adversarial Networks (GANs) offer a pragmatic route to mitigate data scarcity in vision tasks.<n>We study generative augmentation across two low-resource domains: Bangla handwritten characters and chest X-ray imaging using DCGAN-style models trained at 64x64 resolution.
arXiv Detail & Related papers (2026-05-03T10:48:26Z) - Learning Common and Salient Generative Factors Between Two Image Datasets [5.687672336203402]
We propose a novel framework for Contrastive Analysis (CA)<n>By defining new and well-adapted learning strategies and losses, we ensure a relevant separation between common and salient factors.<n>Our framework demonstrates superior separation ability and image synthesis quality compared to prior methods.
arXiv Detail & Related papers (2025-12-14T18:47:41Z) - Guided Neural Schrödinger bridge for Brain MR image synthesis with Limited Data [3.150689113642665]
Multi-modal brain MRI provides essential complementary information for clinical diagnosis.<n>To address this, various methods have been proposed to generate missing modalities from available ones.<n>We propose Fully Guided Schr"odinger Bridge (FGSB), a novel framework designed to overcome these limitations.
arXiv Detail & Related papers (2025-01-24T01:40:16Z) - Additional Look into GAN-based Augmentation for Deep Learning COVID-19
Image Classification [57.1795052451257]
We study the dependence of the GAN-based augmentation performance on dataset size with a focus on small samples.
We train StyleGAN2-ADA with both sets and then, after validating the quality of generated images, we use trained GANs as one of the augmentations approaches in multi-class classification problems.
The GAN-based augmentation approach is found to be comparable with classical augmentation in the case of medium and large datasets but underperforms in the case of smaller datasets.
arXiv Detail & Related papers (2024-01-26T08:28:13Z) - Adaptive Input-image Normalization for Solving the Mode Collapse Problem in GAN-based X-ray Images [0.08192907805418582]
This work contributes an empirical demonstration of the benefits of integrating the adaptive input-image normalization with the Deep Conversaal GAN and Auxiliary GAN to alleviate the mode collapse problems.
Results demonstrate that the DCGAN and the ACGAN with adaptive input-image normalization outperform the DCGAN and ACGAN with un-normalized X-ray images.
arXiv Detail & Related papers (2023-09-21T16:43:29Z) - DCID: Deep Canonical Information Decomposition [84.59396326810085]
We consider the problem of identifying the signal shared between two one-dimensional target variables.
We propose ICM, an evaluation metric which can be used in the presence of ground-truth labels.
We also propose Deep Canonical Information Decomposition (DCID) - a simple, yet effective approach for learning the shared variables.
arXiv Detail & Related papers (2023-06-27T16:59:06Z) - An Attentive-based Generative Model for Medical Image Synthesis [18.94900480135376]
We propose an attention-based dual contrast generative model, called ADC-cycleGAN, which can synthesize medical images from unpaired data with multiple slices.
The model integrates a dual contrast loss term with the CycleGAN loss to ensure that the synthesized images are distinguishable from the source domain.
Experimental results demonstrate that the proposed ADC-cycleGAN model produces comparable samples to other state-of-the-art generative models.
arXiv Detail & Related papers (2023-06-02T14:17:37Z) - Revisiting the Evaluation of Image Synthesis with GANs [55.72247435112475]
This study presents an empirical investigation into the evaluation of synthesis performance, with generative adversarial networks (GANs) as a representative of generative models.
In particular, we make in-depth analyses of various factors, including how to represent a data point in the representation space, how to calculate a fair distance using selected samples, and how many instances to use from each set.
arXiv Detail & Related papers (2023-04-04T17:54:32Z) - Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images.
We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem.
Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2022-03-29T08:41:17Z) - A Contrastive Learning Approach for Training Variational Autoencoder
Priors [137.62674958536712]
Variational autoencoders (VAEs) are one of the powerful likelihood-based generative models with applications in many domains.
One explanation for VAEs' poor generative quality is the prior hole problem: the prior distribution fails to match the aggregate approximate posterior.
We propose an energy-based prior defined by the product of a base prior distribution and a reweighting factor, designed to bring the base closer to the aggregate posterior.
arXiv Detail & Related papers (2020-10-06T17:59:02Z) - InfoMax-GAN: Improved Adversarial Image Generation via Information
Maximization and Contrastive Learning [39.316605441868944]
Generative Adversarial Networks (GANs) are fundamental to many generative modelling applications.
We propose a principled framework to simultaneously mitigate two fundamental issues in GANs: catastrophic forgetting of the discriminator and mode collapse of the generator.
Our approach significantly stabilizes GAN training and improves GAN performance for image synthesis across five datasets.
arXiv Detail & Related papers (2020-07-09T06:56:11Z) - Modeling Shared Responses in Neuroimaging Studies through MultiView ICA [94.31804763196116]
Group studies involving large cohorts of subjects are important to draw general conclusions about brain functional organization.
We propose a novel MultiView Independent Component Analysis model for group studies, where data from each subject are modeled as a linear combination of shared independent sources plus noise.
We demonstrate the usefulness of our approach first on fMRI data, where our model demonstrates improved sensitivity in identifying common sources among subjects.
arXiv Detail & Related papers (2020-06-11T17:29:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.