Constrained CycleGAN for Effective Generation of Ultrasound Sector
Images of Improved Spatial Resolution
- URL: http://arxiv.org/abs/2309.00995v1
- Date: Sat, 2 Sep 2023 17:32:00 GMT
- Title: Constrained CycleGAN for Effective Generation of Ultrasound Sector
Images of Improved Spatial Resolution
- Authors: Xiaofei Sun, He Li and Wei-Ning Lee
- Abstract summary: A phased or a curvilinear array produces ultrasound (US) images with a sector field of view (FOV)
This study aims to translate US images with spatially-varying resolution to ones with less spatially-varying resolution.
- Score: 22.899291098129403
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Objective. A phased or a curvilinear array produces ultrasound (US) images
with a sector field of view (FOV), which inherently exhibits spatially-varying
image resolution with inferior quality in the far zone and towards the two
sides azimuthally. Sector US images with improved spatial resolutions are
favorable for accurate quantitative analysis of large and dynamic organs, such
as the heart. Therefore, this study aims to translate US images with
spatially-varying resolution to ones with less spatially-varying resolution.
CycleGAN has been a prominent choice for unpaired medical image translation;
however, it neither guarantees structural consistency nor preserves
backscattering patterns between input and generated images for unpaired US
images. Approach. To circumvent this limitation, we propose a constrained
CycleGAN (CCycleGAN), which directly performs US image generation with unpaired
images acquired by different ultrasound array probes. In addition to
conventional adversarial and cycle-consistency losses of CycleGAN, CCycleGAN
introduces an identical loss and a correlation coefficient loss based on
intrinsic US backscattered signal properties to constrain structural
consistency and backscattering patterns, respectively. Instead of
post-processed B-mode images, CCycleGAN uses envelope data directly obtained
from beamformed radio-frequency signals without any other non-linear
postprocessing. Main Results. In vitro phantom results demonstrate that
CCycleGAN successfully generates images with improved spatial resolution as
well as higher peak signal-to-noise ratio (PSNR) and structural similarity
(SSIM) compared with benchmarks. Significance. CCycleGAN-generated US images of
the in vivo human beating heart further facilitate higher quality heart wall
motion estimation than benchmarks-generated ones, particularly in deep regions.
Related papers
- Unpaired Optical Coherence Tomography Angiography Image Super-Resolution
via Frequency-Aware Inverse-Consistency GAN [6.717440708401628]
We propose a Generative Adversarial Network (GAN)-based unpaired super-resolution method for OCTA images.
To facilitate a precise spectrum of the reconstructed image, we also propose a frequency-aware adversarial loss for the discriminator.
Experiments show that our method outperforms other state-of-the-art unpaired methods both quantitatively and visually.
arXiv Detail & Related papers (2023-09-29T14:19:51Z) - DopUS-Net: Quality-Aware Robotic Ultrasound Imaging based on Doppler
Signal [48.97719097435527]
DopUS-Net combines the Doppler images with B-mode images to increase the segmentation accuracy and robustness of small blood vessels.
An artery re-identification module qualitatively evaluate the real-time segmentation results and automatically optimize the probe pose for enhanced Doppler images.
arXiv Detail & Related papers (2023-05-15T18:19:29Z) - fRegGAN with K-space Loss Regularization for Medical Image Translation [42.253647362909476]
Generative adversarial networks (GANs) have shown remarkable success in generating realistic images.
GANs tend to suffer from a frequency bias towards low frequencies, which can lead to the removal of important structures in the generated images.
We propose a novel frequency-aware image-to-image translation framework based on the supervised RegGAN approach, which we call fRegGAN.
arXiv Detail & Related papers (2023-03-28T12:49:10Z) - Anatomically constrained CT image translation for heterogeneous blood
vessel segmentation [3.88838725116957]
Anatomical structures in contrast-enhanced CT (ceCT) images can be challenging to segment due to variability in contrast medium diffusion.
To limit the radiation dose, generative models could be used to synthesize one modality, instead of acquiring it.
CycleGAN has attracted particular attention because it alleviates the need for paired data.
We present an extension of CycleGAN to generate high fidelity images, with good structural consistency.
arXiv Detail & Related papers (2022-10-04T16:14:49Z) - OADAT: Experimental and Synthetic Clinical Optoacoustic Data for
Standardized Image Processing [62.993663757843464]
Optoacoustic (OA) imaging is based on excitation of biological tissues with nanosecond-duration laser pulses followed by detection of ultrasound waves generated via light-absorption-mediated thermoelastic expansion.
OA imaging features a powerful combination between rich optical contrast and high resolution in deep tissues.
No standardized datasets generated with different types of experimental set-up and associated processing methods are available to facilitate advances in broader applications of OA in clinical settings.
arXiv Detail & Related papers (2022-06-17T08:11:26Z) - Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images.
We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem.
Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2022-03-29T08:41:17Z) - Multi-Modal MRI Reconstruction with Spatial Alignment Network [51.74078260367654]
In clinical practice, magnetic resonance imaging (MRI) with multiple contrasts is usually acquired in a single study.
Recent researches demonstrate that, considering the redundancy between different contrasts or modalities, a target MRI modality under-sampled in the k-space can be better reconstructed with the helps from a fully-sampled sequence.
In this paper, we integrate the spatial alignment network with reconstruction, to improve the quality of the reconstructed target modality.
arXiv Detail & Related papers (2021-08-12T08:46:35Z) - Low-Dose CT Denoising Using a Structure-Preserving Kernel Prediction
Network [10.09577595969254]
CNN-based approaches treat all regions of the CT image equally and can be inefficient when fine-grained structures coexist with non-uniformly distributed noises.
We propose a Structure-preserving Kernel Prediction Network (StructKPN) that combines the kernel prediction network with a structure-aware loss function.
Our approach achieved superior performance on both synthetic and non-synthetic datasets, and better preserves structures that are highly desired in clinical screening and low-dose protocol optimization.
arXiv Detail & Related papers (2021-05-31T07:42:21Z) - Segmentation-Renormalized Deep Feature Modulation for Unpaired Image
Harmonization [0.43012765978447565]
Cycle-consistent Generative Adversarial Networks have been used to harmonize image sets between a source and target domain.
These methods are prone to instability, contrast inversion, intractable manipulation of pathology, and steganographic mappings which limit their reliable adoption in real-world medical imaging.
We propose a segmentation-renormalized image translation framework to reduce inter-scanner harmonization while preserving anatomical layout.
arXiv Detail & Related papers (2021-02-11T23:53:51Z) - Perception Consistency Ultrasound Image Super-resolution via
Self-supervised CycleGAN [63.49373689654419]
We propose a new perception consistency ultrasound image super-resolution (SR) method based on self-supervision and cycle generative adversarial network (CycleGAN)
We first generate the HR fathers and the LR sons of the test ultrasound LR image through image enhancement.
We then make full use of the cycle loss of LR-SR-LR and HR-LR-SR and the adversarial characteristics of the discriminator to promote the generator to produce better perceptually consistent SR results.
arXiv Detail & Related papers (2020-12-28T08:24:04Z) - Pathological Retinal Region Segmentation From OCT Images Using Geometric
Relation Based Augmentation [84.7571086566595]
We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape.
The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
arXiv Detail & Related papers (2020-03-31T11:50:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.