Echo from noise: synthetic ultrasound image generation using diffusion models for real image segmentation

• URL: http://arxiv.org/abs/2305.05424v2
• Date: Tue, 15 Aug 2023 09:37:05 GMT
• Title: Echo from noise: synthetic ultrasound image generation using diffusion models for real image segmentation
• Authors: David Stojanovski, Uxio Hermida, Pablo Lamata, Arian Beqiri, Alberto Gomez
• Abstract summary: We show that synthetic images can serve as a viable substitute for real data in the training of deep-learning models for ultrasound image analysis tasks. We generated synthetic 2D echocardiograms and trained a neural network for segmenting the left ventricle and left atrium.
• Score: 0.3999851878220878
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We propose a novel pipeline for the generation of synthetic ultrasound images via Denoising Diffusion Probabilistic Models (DDPMs) guided by cardiac semantic label maps. We show that these synthetic images can serve as a viable substitute for real data in the training of deep-learning models for ultrasound image analysis tasks such as cardiac segmentation. To demonstrate the effectiveness of this approach, we generated synthetic 2D echocardiograms and trained a neural network for segmenting the left ventricle and left atrium. The performance of the network trained on exclusively synthetic images was evaluated on an unseen dataset of real images and yielded mean Dice scores of 88.6 $\pm 4.91$ , 91.9 $\pm 4.22$, 85.2 $\pm 4.83$ \% for left ventricular endocardium, epicardium and left atrial segmentation respectively. This represents a relative increase of $9.2$, $3.3$ and $13.9$ \% in Dice scores compared to the previous state-of-the-art. The proposed pipeline has potential for application to a wide range of other tasks across various medical imaging modalities.

Related papers

• Echo-DND: A dual noise diffusion model for robust and precise left ventricle segmentation in echocardiography [0.6749750044497732]
  This paper introduces Echo-DND, a novel dual-noise diffusion model for echocardiogram segmentation.<n>The model's performance was rigorously validated on the CAMUS and EchoNet-Dynamic datasets.<n>It achieves high Dice scores of 0.962 and 0.939 on these datasets, respectively.
  arXiv  Detail & Related papers  (2025-06-18T06:27:08Z)
• EchoFlow: A Foundation Model for Cardiac Ultrasound Image and Video Generation [6.849095682774907]
  We present EchoFlow, a novel framework designed to generate high-quality, privacy-preserving synthetic echocardiogram images and videos. We rigorously evaluate our synthetic datasets on the clinically relevant task of ejection fraction regression and demonstrate, for the first time, that downstream models trained exclusively on EchoFlow-generated synthetic datasets achieve performance parity with models trained on real datasets.
  arXiv  Detail & Related papers  (2025-03-28T11:51:59Z)
• Transesophageal Echocardiography Generation using Anatomical Models [0.5679566039341877]
  We develop a pipeline to generate synthetic TEE images and corresponding semantic labels. For the pipeline's unpaired image-to-image (I2I) translation section, we explore two generative methods. We achieve a dice score improvement of up to 10% when we augment datasets with our synthetic images.
  arXiv  Detail & Related papers  (2024-10-09T11:20:28Z)
• Training-Free Condition Video Diffusion Models for single frame Spatial-Semantic Echocardiogram Synthesis [0.16874375111244325]
  Conditional video diffusion models (CDM) have shown promising results for video synthesis. We present a new method called Free-Echo for generating realistic echocardiograms from a single end-diastolic segmentation map. Our model can generate plausible echocardiograms that are spatially aligned with the input segmentation map, achieving performance comparable to training-based CDMs.
  arXiv  Detail & Related papers  (2024-08-06T08:31:34Z)
• CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
  We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images. The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism. We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
  arXiv  Detail & Related papers  (2024-03-21T15:13:36Z)
• AiAReSeg: Catheter Detection and Segmentation in Interventional Ultrasound using Transformers [75.20925220246689]
  endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature. This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
  arXiv  Detail & Related papers  (2023-09-25T19:34:12Z)
• LOTUS: Learning to Optimize Task-based US representations [39.81131738128329]
  Anatomical segmentation of organs in ultrasound images is essential to many clinical applications. Existing deep neural networks require a large amount of labeled data for training in order to achieve clinically acceptable performance. In this paper, we propose a novel approach for learning to optimize task-based ultra-sound image representations.
  arXiv  Detail & Related papers  (2023-07-29T16:29:39Z)
• DopUS-Net: Quality-Aware Robotic Ultrasound Imaging based on Doppler Signal [48.97719097435527]
  DopUS-Net combines the Doppler images with B-mode images to increase the segmentation accuracy and robustness of small blood vessels. An artery re-identification module qualitatively evaluate the real-time segmentation results and automatically optimize the probe pose for enhanced Doppler images.
  arXiv  Detail & Related papers  (2023-05-15T18:19:29Z)
• Feature-Conditioned Cascaded Video Diffusion Models for Precise Echocardiogram Synthesis [5.102090025931326]
  We extend elucidated diffusion models for video modelling to generate plausible video sequences from single images. Our image to sequence approach achieves an $R2$ score of 93%, 38 points higher than recently proposed sequence to sequence generation methods.
  arXiv  Detail & Related papers  (2023-03-22T15:26:22Z)
• Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
  We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images. We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem. Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-03-29T08:41:17Z)
• Voice-assisted Image Labelling for Endoscopic Ultrasound Classification using Neural Networks [48.732863591145964]
  We propose a multi-modal convolutional neural network architecture that labels endoscopic ultrasound (EUS) images from raw verbal comments provided by a clinician during the procedure. Our results show a prediction accuracy of 76% at image level on a dataset with 5 different labels.
  arXiv  Detail & Related papers  (2021-10-12T21:22:24Z)
• Image Translation for Medical Image Generation -- Ischemic Stroke Lesions [0.0]
  Synthetic databases with annotated pathologies could provide the required amounts of training data. We train different image-to-image translation models to synthesize magnetic resonance images of brain volumes with and without stroke lesions. We show that for a small database of only 10 or 50 clinical cases, synthetic data augmentation yields significant improvement.
  arXiv  Detail & Related papers  (2020-10-05T09:12:28Z)
• Segmentation of the Myocardium on Late-Gadolinium Enhanced MRI based on 2.5 D Residual Squeeze and Excitation Deep Learning Model [55.09533240649176]
  The aim of this work is to develop an accurate automatic segmentation method based on deep learning models for the myocardial borders on LGE-MRI. A total number of 320 exams (with a mean number of 6 slices per exam) were used for training and 28 exams used for testing. The performance analysis of the proposed ensemble model in the basal and middle slices was similar as compared to intra-observer study and slightly lower at apical slices.
  arXiv  Detail & Related papers  (2020-05-27T20:44:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.