Evaluating Procedures for Establishing Generative Adversarial Network-based Stochastic Image Models in Medical Imaging

• URL: http://arxiv.org/abs/2204.03547v1
• Date: Thu, 7 Apr 2022 16:19:01 GMT
• Title: Evaluating Procedures for Establishing Generative Adversarial Network-based Stochastic Image Models in Medical Imaging
• Authors: Varun A. Kelkar, Dimitrios S. Gotsis, Frank J. Brooks, Kyle J. Myers, Prabhat KC, Rongping Zeng, Mark A. Anastasio
• Abstract summary: generative adversarial networks (GANs) hold tremendous promise for several areas of medical imaging. In this work, canonical image models (SIMs) that simulate realistic vessels in angiography images are employed to evaluate procedures for establishing SIMs using GANs. It is shown that evaluating GANs using classical metrics and medically relevant metrics may lead to different conclusions about the fidelity of the trained GANs.
• Score: 10.479865560555199
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Modern generative models, such as generative adversarial networks (GANs), hold tremendous promise for several areas of medical imaging, such as unconditional medical image synthesis, image restoration, reconstruction and translation, and optimization of imaging systems. However, procedures for establishing stochastic image models (SIMs) using GANs remain generic and do not address specific issues relevant to medical imaging. In this work, canonical SIMs that simulate realistic vessels in angiography images are employed to evaluate procedures for establishing SIMs using GANs. The GAN-based SIM is compared to the canonical SIM based on its ability to reproduce those statistics that are meaningful to the particular medically realistic SIM considered. It is shown that evaluating GANs using classical metrics and medically relevant metrics may lead to different conclusions about the fidelity of the trained GANs. This work highlights the need for the development of objective metrics for evaluating GANs.

Related papers

• Unifying Subsampling Pattern Variations for Compressed Sensing MRI with Neural Operators [72.79532467687427]
  Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled and compressed measurements. Deep neural networks have shown great potential for reconstructing high-quality images from highly undersampled measurements. We propose a unified model that is robust to different subsampling patterns and image resolutions in CS-MRI.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• AmbientCycleGAN for Establishing Interpretable Stochastic Object Models Based on Mathematical Phantoms and Medical Imaging Measurements [4.573310303307945]
  This work introduces a novel approach called AmbientCycleGAN that translates mathematical SOMs to realistic SOMs by use of noisy measurement data. It is demonstrated that our proposed method can stably establish SOMs based on mathematical models and noisy measurement data.
  arXiv  Detail & Related papers  (2024-02-02T06:30:33Z)
• Automated SSIM Regression for Detection and Quantification of Motion Artefacts in Brain MR Images [54.739076152240024]
  Motion artefacts in magnetic resonance brain images are a crucial issue. The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis. An automated image quality assessment based on the structural similarity index (SSIM) regression has been proposed here.
  arXiv  Detail & Related papers  (2022-06-14T10:16:54Z)
• Assessing the ability of generative adversarial networks to learn canonical medical image statistics [10.479865560555199]
  generative adversarial networks (GANs) have gained tremendous popularity for potential applications in medical imaging. It is not clear if modern GANs reliably learn the statistics that are meaningful to a downstream medical imaging application. In this work, the ability of a state-of-the-art GAN to learn the statistics of canonical image models (SIMs) that are relevant to objective assessment of image quality is investigated.
  arXiv  Detail & Related papers  (2022-04-26T00:30:01Z)
• Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
  We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images. We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem. Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-03-29T08:41:17Z)
• MIST GAN: Modality Imputation Using Style Transfer for MRI [0.49172272348627766]
  We formulate generating the missing MR modality from existing MR modalities as an imputation problem using style transfer. With a multiple-to-one mapping, we model a network that accommodates domain specific styles in generating the target image. Our model is tested on the BraTS'18 dataset and the results are observed to be on par with the state-of-the-art in terms of visual metrics.
  arXiv  Detail & Related papers  (2022-02-21T17:50:40Z)
• DSSIM: a structural similarity index for floating-point data [68.8204255655161]
  We propose an alternative to the popular SSIM that can be applied directly to the floating point data, which we refer to as the Data SSIM (DSSIM) While we demonstrate the usefulness of the DSSIM in the context of evaluating differences due to lossy compression on large volumes of simulation data, the DSSIM may prove useful for many other applications involving simulation or image data.
  arXiv  Detail & Related papers  (2022-02-05T19:18:33Z)
• Learning stochastic object models from medical imaging measurements by use of advanced AmbientGANs [7.987904193401004]
  generative adversarial networks (GANs) hold potential for such tasks. Deep generative neural networks, such as generative adversarial networks (GANs) hold potential for such tasks. In this work, a modified AmbientGAN training strategy is proposed that is suitable for modern progressive or multi-resolution training approaches.
  arXiv  Detail & Related papers  (2021-06-27T21:46:23Z)
• Multimodal Semantic Scene Graphs for Holistic Modeling of Surgical Procedures [70.69948035469467]
  We take advantage of the latest computer vision methodologies for generating 3D graphs from camera views. We then introduce the Multimodal Semantic Graph Scene (MSSG) which aims at providing unified symbolic and semantic representation of surgical procedures.
  arXiv  Detail & Related papers  (2021-06-09T14:35:44Z)
• Data-driven generation of plausible tissue geometries for realistic photoacoustic image synthesis [53.65837038435433]
  Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties. We propose a novel approach to PAT data simulation, which we refer to as "learning to simulate" We leverage the concept of Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data to generate plausible tissue geometries.
  arXiv  Detail & Related papers  (2021-03-29T11:30:18Z)
• Learning stochastic object models from medical imaging measurements using Progressively-Growing AmbientGANs [14.501812971529137]
  An important source of variability that can significantly limit observer performance is variation in the objects to-be-imaged. It is desirable to establish SOMs from experimental imaging measurements acquired by use of a well-characterized imaging system. Deep generative neural networks, such as generative adversarial networks (GANs) hold great potential for this task.
  arXiv  Detail & Related papers  (2020-05-29T18:45:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.