Progressively-Growing AmbientGANs For Learning Stochastic Object Models From Imaging Measurements

• URL: http://arxiv.org/abs/2001.09523v1
• Date: Sun, 26 Jan 2020 21:33:14 GMT
• Title: Progressively-Growing AmbientGANs For Learning Stochastic Object Models From Imaging Measurements
• Authors: Weimin Zhou, Sayantan Bhadra, Frank J. Brooks, Hua Li, Mark A. Anastasio
• Abstract summary: objective optimization of medical imaging systems requires full characterization of all sources of randomness in the measured data. We propose establishing an object model (SOM) that describes the variability in the class of objects to-be-imaged. Because medical imaging systems record imaging measurements that are noisy and indirect representations of object properties, GANs cannot be directly applied to establish models of objects to-be-imaged.
• Score: 14.501812971529137
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The objective optimization of medical imaging systems requires full characterization of all sources of randomness in the measured data, which includes the variability within the ensemble of objects to-be-imaged. This can be accomplished by establishing a stochastic object model (SOM) that describes the variability in the class of objects to-be-imaged. Generative adversarial networks (GANs) can be potentially useful to establish SOMs because they hold great promise to learn generative models that describe the variability within an ensemble of training data. However, because medical imaging systems record imaging measurements that are noisy and indirect representations of object properties, GANs cannot be directly applied to establish stochastic models of objects to-be-imaged. To address this issue, an augmented GAN architecture named AmbientGAN was developed to establish SOMs from noisy and indirect measurement data. However, because the adversarial training can be unstable, the applicability of the AmbientGAN can be potentially limited. In this work, we propose a novel training strategy---Progressive Growing of AmbientGANs (ProAGAN)---to stabilize the training of AmbientGANs for establishing SOMs from noisy and indirect imaging measurements. An idealized magnetic resonance (MR) imaging system and clinical MR brain images are considered. The proposed methodology is evaluated by comparing signal detection performance computed by use of ProAGAN-generated synthetic images and images that depict the true object properties.

Related papers

• Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Prediction [88.65168366064061]
  We introduce Discrete Denoising Posterior Prediction (DDPP), a novel framework that casts the task of steering pre-trained MDMs as a problem of probabilistic inference. Our framework leads to a family of three novel objectives that are all simulation-free, and thus scalable. We substantiate our designs via wet-lab validation, where we observe transient expression of reward-optimized protein sequences.
  arXiv  Detail & Related papers  (2024-10-10T17:18:30Z)
• A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
  Deep neural networks have shown great potential for reconstructing high-fidelity images from undersampled measurements. Our model is based on neural operators, a discretization-agnostic architecture. Our inference speed is also 1,400x faster than diffusion methods.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• Synthetic location trajectory generation using categorical diffusion models [50.809683239937584]
  Diffusion models (DPMs) have rapidly evolved to be one of the predominant generative models for the simulation of synthetic data. We propose using DPMs for the generation of synthetic individual location trajectories (ILTs) which are sequences of variables representing physical locations visited by individuals.
  arXiv  Detail & Related papers  (2024-02-19T15:57:39Z)
• AmbientCycleGAN for Establishing Interpretable Stochastic Object Models Based on Mathematical Phantoms and Medical Imaging Measurements [4.573310303307945]
  This work introduces a novel approach called AmbientCycleGAN that translates mathematical SOMs to realistic SOMs by use of noisy measurement data. It is demonstrated that our proposed method can stably establish SOMs based on mathematical models and noisy measurement data.
  arXiv  Detail & Related papers  (2024-02-02T06:30:33Z)
• Assessing the capacity of a denoising diffusion probabilistic model to reproduce spatial context [7.289988602420457]
  Diffusion probabilistic models (DDPMs) demonstrate superior image synthesis performance as compared to generative adversarial networks (GANs) These claims have been evaluated using either ensemble-based methods designed for natural images, or conventional measures of image quality such as structural similarity. The studies reveal new and important insights regarding the capacity of DDPMs to learn spatial context.
  arXiv  Detail & Related papers  (2023-09-19T17:58:35Z)
• On Sensitivity and Robustness of Normalization Schemes to Input Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
  Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input. DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases. We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
  arXiv  Detail & Related papers  (2023-06-23T03:09:03Z)
• Mixed Effects Neural ODE: A Variational Approximation for Analyzing the Dynamics of Panel Data [50.23363975709122]
  We propose a probabilistic model called ME-NODE to incorporate (fixed + random) mixed effects for analyzing panel data. We show that our model can be derived using smooth approximations of SDEs provided by the Wong-Zakai theorem. We then derive Evidence Based Lower Bounds for ME-NODE, and develop (efficient) training algorithms.
  arXiv  Detail & Related papers  (2022-02-18T22:41:51Z)
• Learning stochastic object models from medical imaging measurements by use of advanced AmbientGANs [7.987904193401004]
  generative adversarial networks (GANs) hold potential for such tasks. Deep generative neural networks, such as generative adversarial networks (GANs) hold potential for such tasks. In this work, a modified AmbientGAN training strategy is proposed that is suitable for modern progressive or multi-resolution training approaches.
  arXiv  Detail & Related papers  (2021-06-27T21:46:23Z)
• Data-driven generation of plausible tissue geometries for realistic photoacoustic image synthesis [53.65837038435433]
  Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties. We propose a novel approach to PAT data simulation, which we refer to as "learning to simulate" We leverage the concept of Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data to generate plausible tissue geometries.
  arXiv  Detail & Related papers  (2021-03-29T11:30:18Z)
• Advancing the AmbientGAN for learning stochastic object models [7.445527629361621]
  Variation in the objects to-be-imaged is an important source of variability that can significantly limit observer performance. In this study, we propose two advanced AmbientGAN architectures: 3D ProAmGANs and Style-AmbientGANs (StyAmGANs) The ability of 3D ProAmGANs to learn 3D SOMs from imaging measurements and the ability of StyAmGANs to control fine-scale textures of synthesized objects are demonstrated.
  arXiv  Detail & Related papers  (2021-01-30T18:08:23Z)
• Learning stochastic object models from medical imaging measurements using Progressively-Growing AmbientGANs [14.501812971529137]
  An important source of variability that can significantly limit observer performance is variation in the objects to-be-imaged. It is desirable to establish SOMs from experimental imaging measurements acquired by use of a well-characterized imaging system. Deep generative neural networks, such as generative adversarial networks (GANs) hold great potential for this task.
  arXiv  Detail & Related papers  (2020-05-29T18:45:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.