Echocardiography Segmentation Using Neural ODE-based Diffeomorphic
Registration Field
- URL: http://arxiv.org/abs/2306.09687v1
- Date: Fri, 16 Jun 2023 08:37:27 GMT
- Title: Echocardiography Segmentation Using Neural ODE-based Diffeomorphic
Registration Field
- Authors: Phi Nguyen Van, Hieu Pham Huy, Long Tran Quoc
- Abstract summary: We present a novel method for diffevolution image registration using neural ordinary differential equations (Neural ODE)
The proposed method, Echo-ODE, introduces several key improvements compared to the previous state-of-the-art.
The results show that our method surpasses the previous state-of-the-art in multiple aspects.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Convolutional neural networks (CNNs) have recently proven their excellent
ability to segment 2D cardiac ultrasound images. However, the majority of
attempts to perform full-sequence segmentation of cardiac ultrasound videos
either rely on models trained only on keyframe images or fail to maintain the
topology over time. To address these issues, in this work, we consider
segmentation of ultrasound video as a registration estimation problem and
present a novel method for diffeomorphic image registration using neural
ordinary differential equations (Neural ODE). In particular, we consider the
registration field vector field between frames as a continuous trajectory ODE.
The estimated registration field is then applied to the segmentation mask of
the first frame to obtain a segment for the whole cardiac cycle. The proposed
method, Echo-ODE, introduces several key improvements compared to the previous
state-of-the-art. Firstly, by solving a continuous ODE, the proposed method
achieves smoother segmentation, preserving the topology of segmentation maps
over the whole sequence (Hausdorff distance: 3.7-4.4). Secondly, it maintains
temporal consistency between frames without explicitly optimizing for temporal
consistency attributes, achieving temporal consistency in 91% of the videos in
the dataset. Lastly, the proposed method is able to maintain the clinical
accuracy of the segmentation maps (MAE of the LVEF: 2.7-3.1). The results show
that our method surpasses the previous state-of-the-art in multiple aspects,
demonstrating the importance of spatial-temporal data processing for the
implementation of Neural ODEs in medical imaging applications. These findings
open up new research directions for solving echocardiography segmentation
tasks.
Related papers
- Bidirectional Recurrence for Cardiac Motion Tracking with Gaussian Process Latent Coding [9.263168872795843]
GPTrack is a novel unsupervised framework crafted to explore the temporal and spatial dynamics of cardiac motion.
It enhances motion tracking by employing the sequential Gaussian Process in the latent space and encoding statistics by spatial information at each time stamp.
Our GPTrack significantly improves the precision of motion tracking in both 3D and 4D medical images while maintaining computational efficiency.
arXiv Detail & Related papers (2024-10-28T05:33:48Z) - Intraoperative Registration by Cross-Modal Inverse Neural Rendering [61.687068931599846]
We present a novel approach for 3D/2D intraoperative registration during neurosurgery via cross-modal inverse neural rendering.
Our approach separates implicit neural representation into two components, handling anatomical structure preoperatively and appearance intraoperatively.
We tested our method on retrospective patients' data from clinical cases, showing that our method outperforms state-of-the-art while meeting current clinical standards for registration.
arXiv Detail & Related papers (2024-09-18T13:40:59Z) - Train-Free Segmentation in MRI with Cubical Persistent Homology [0.0]
We describe a new general method for segmentation in MRI scans using Topological Data Analysis (TDA)
It works in three steps, first identifying the whole object to segment via automatic thresholding, then detecting a distinctive subset whose topology is known in advance, and finally deducing the various components of the segmentation.
We study the examples of glioblastoma segmentation in brain MRI, where a sphere is to be detected, as well as myocardium in cardiac MRI, involving a cylinder, and cortical plate detection in fetal brain MRI, whose 2D slices are circles.
arXiv Detail & Related papers (2024-01-02T11:43:49Z) - Abdominal Multi-Organ Segmentation Based on Feature Pyramid Network and
Spatial Recurrent Neural Network [2.8391355909797644]
We propose a new image segmentation model combining Feature Pyramid Network (FPN) and Spatial Recurrent Neural Network (SRNN)
We discuss why we use FPN to extract anatomical structures of different scales and how SRNN is implemented to extract the spatial context features in abdominal ultrasound images.
arXiv Detail & Related papers (2023-08-29T09:13:24Z) - DopUS-Net: Quality-Aware Robotic Ultrasound Imaging based on Doppler
Signal [48.97719097435527]
DopUS-Net combines the Doppler images with B-mode images to increase the segmentation accuracy and robustness of small blood vessels.
An artery re-identification module qualitatively evaluate the real-time segmentation results and automatically optimize the probe pose for enhanced Doppler images.
arXiv Detail & Related papers (2023-05-15T18:19:29Z) - Self-Supervised Correction Learning for Semi-Supervised Biomedical Image
Segmentation [84.58210297703714]
We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation.
We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting.
Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
arXiv Detail & Related papers (2023-01-12T08:19:46Z) - Modality Completion via Gaussian Process Prior Variational Autoencoders
for Multi-Modal Glioma Segmentation [75.58395328700821]
We propose a novel model, Multi-modal Gaussian Process Prior Variational Autoencoder (MGP-VAE), to impute one or more missing sub-modalities for a patient scan.
MGP-VAE can leverage the Gaussian Process (GP) prior on the Variational Autoencoder (VAE) to utilize the subjects/patients and sub-modalities correlations.
We show the applicability of MGP-VAE on brain tumor segmentation where either, two, or three of four sub-modalities may be missing.
arXiv Detail & Related papers (2021-07-07T19:06:34Z) - Weakly-supervised Learning For Catheter Segmentation in 3D Frustum
Ultrasound [74.22397862400177]
We propose a novel Frustum ultrasound based catheter segmentation method.
The proposed method achieved the state-of-the-art performance with an efficiency of 0.25 second per volume.
arXiv Detail & Related papers (2020-10-19T13:56:22Z) - Weakly-Supervised Segmentation for Disease Localization in Chest X-Ray
Images [0.0]
We propose a novel approach to the semantic segmentation of medical chest X-ray images with only image-level class labels as supervision.
We show that this approach is applicable to chest X-rays for detecting an anomalous volume of air between the lung and the chest wall.
arXiv Detail & Related papers (2020-07-01T20:48:35Z) - A Global Benchmark of Algorithms for Segmenting Late Gadolinium-Enhanced
Cardiac Magnetic Resonance Imaging [90.29017019187282]
" 2018 Left Atrium Challenge" using 154 3D LGE-MRIs, currently the world's largest cardiac LGE-MRI dataset.
Analyse of the submitted algorithms using technical and biological metrics was performed.
Results show the top method achieved a dice score of 93.2% and a mean surface to a surface distance of 0.7 mm.
arXiv Detail & Related papers (2020-04-26T08:49:17Z) - Registration by tracking for sequential 2D MRI [0.0]
We present an image registration method that exploits the sequential nature of 2D MR images to estimate the displacement field.
The method is evaluated on a segmented cardiac dataset and when compared to two conventional methods we observe an improved performance.
arXiv Detail & Related papers (2020-03-24T13:12:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.