Continuous Spatio-Temporal Memory Networks for 4D Cardiac Cine MRI Segmentation

• URL: http://arxiv.org/abs/2410.23191v2
• Date: Thu, 31 Oct 2024 18:19:02 GMT
• Title: Continuous Spatio-Temporal Memory Networks for 4D Cardiac Cine MRI Segmentation
• Authors: Meng Ye, Bingyu Xin, Leon Axel, Dimitris Metaxas,
• Abstract summary: We propose a continuous STM (CSTM) network for semi-supervised whole heart and whole sequence cMR segmentation. Our network takes full advantage of the spatial, scale temporal and through-plane continuity prior to the underlying heart structures, to achieve accurate and fast 4D segmentation.
• Score: 5.542949496418442
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Current cardiac cine magnetic resonance image (cMR) studies focus on the end diastole (ED) and end systole (ES) phases, while ignoring the abundant temporal information in the whole image sequence. This is because whole sequence segmentation is currently a tedious process and inaccurate. Conventional whole sequence segmentation approaches first estimate the motion field between frames, which is then used to propagate the mask along the temporal axis. However, the mask propagation results could be prone to error, especially for the basal and apex slices, where through-plane motion leads to significant morphology and structural change during the cardiac cycle. Inspired by recent advances in video object segmentation (VOS), based on spatio-temporal memory (STM) networks, we propose a continuous STM (CSTM) network for semi-supervised whole heart and whole sequence cMR segmentation. Our CSTM network takes full advantage of the spatial, scale, temporal and through-plane continuity prior of the underlying heart anatomy structures, to achieve accurate and fast 4D segmentation. Results of extensive experiments across multiple cMR datasets show that our method can improve the 4D cMR segmentation performance, especially for the hard-to-segment regions.

Related papers

• Enabling Ultra-Fast Cardiovascular Imaging Across Heterogeneous Clinical Environments with a Generalist Foundation Model and Multimodal Database [64.65360708629485]
  MMCMR-427K is the largest and most comprehensive multimodal cardiovascular magnetic resonance k-space database.<n> CardioMM is a reconstruction foundation model capable of adapting to heterogeneous fast CMR imaging scenarios.<n> CardioMM unifies semantic contextual understanding with physics-informed data consistency to deliver robust reconstructions.
  arXiv  Detail & Related papers  (2025-12-25T12:47:50Z)
• Hierarchical Spatio-temporal Segmentation Network for Ejection Fraction Estimation in Echocardiography Videos [20.353975738483417]
  Our model aims to improve Ejection Fraction estimation accuracy by synerizing local detail modeling.<n>The hierarchical design avoids issues such as local accumulation when relying solely on single frames or details when using multi-frame data.
  arXiv  Detail & Related papers  (2025-08-26T05:04:49Z)
• M-Net: MRI Brain Tumor Sequential Segmentation Network via Mesh-Cast [2.90376151605663]
  M-Net is a flexible framework specifically designed for sequential image segmentation.<n>M-Net introduces the novel Mesh-Cast mechanism, which seamlessly integrates arbitrary sequential models into the processing of both channel and temporal information.
  arXiv  Detail & Related papers  (2025-07-28T07:33:29Z)
• X$^{2}$-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstruction [45.31051025401413]
  X$2$-Gaussian is a novel framework for continuous-time 4DCT reconstruction. It integrates dynamic radiative splatting with self-supervised respiratory motion learning. It achieves a 9.93 dB PSNR gain over traditional methods and 2.25 dB improvement against prior splatting techniques.
  arXiv  Detail & Related papers  (2025-03-27T17:59:57Z)
• Automatic Left Ventricular Cavity Segmentation via Deep Spatial Sequential Network in 4D Computed Tomography Studies [20.358413194053103]
  We propose a new method to automatically segment temporal cardiac images. We introduce a spatial sequential (SS) network to learn the deformation and motion characteristics of the LVC in an unsupervised manner. Our results on a cardiac computed tomography (CT) dataset demonstrated that our network with bi-directional learning (SS-BL) method outperformed existing methods for LVC segmentation.
  arXiv  Detail & Related papers  (2024-12-17T12:29:32Z)
• Image Segmentation in Foundation Model Era: A Survey [95.60054312319939]
  Current research in image segmentation lacks a detailed analysis of distinct characteristics, challenges, and solutions. This survey seeks to fill this gap by providing a thorough review of cutting-edge research centered around FM-driven image segmentation. An exhaustive overview of over 300 segmentation approaches is provided to encapsulate the breadth of current research efforts.
  arXiv  Detail & Related papers  (2024-08-23T10:07:59Z)
• Temporal-spatial Adaptation of Promptable SAM Enhance Accuracy and Generalizability of cine CMR Segmentation [10.911758824265736]
  We propose cineCMR-SAM, which incorporates both temporal and spatial information through a modified model architecture. Our model achieved superior data-specific model segmentation accuracy on the STACOM2011 dataset. We introduce a text prompt feature in cineCMR-SAM to specify the view type of input slices.
  arXiv  Detail & Related papers  (2024-03-15T04:27:55Z)
• CMRxRecon: An open cardiac MRI dataset for the competition of accelerated image reconstruction [62.61209705638161]
  There has been growing interest in deep learning-based CMR imaging algorithms. Deep learning methods require large training datasets. This dataset includes multi-contrast, multi-view, multi-slice and multi-coil CMR imaging data from 300 subjects.
  arXiv  Detail & Related papers  (2023-09-19T15:14:42Z)
• Echocardiography Segmentation Using Neural ODE-based Diffeomorphic Registration Field [0.0]
  We present a novel method for diffevolution image registration using neural ordinary differential equations (Neural ODE) The proposed method, Echo-ODE, introduces several key improvements compared to the previous state-of-the-art. The results show that our method surpasses the previous state-of-the-art in multiple aspects.
  arXiv  Detail & Related papers  (2023-06-16T08:37:27Z)
• Interactive Segmentation for COVID-19 Infection Quantification on Longitudinal CT scans [40.721386089781895]
  Consistent segmentation of COVID-19 patient's CT scans across multiple time points is essential to assess disease progression and response to therapy accurately. Existing automatic and interactive segmentation models for medical images only use data from a single time point (static) We propose a new single network model for interactive segmentation that fully utilizes all available past information to refine the segmentation of follow-up scans.
  arXiv  Detail & Related papers  (2021-10-03T08:06:38Z)
• Segmentation of Cardiac Structures via Successive Subspace Learning with Saab Transform from Cine MRI [29.894633364282555]
  We propose a machine learning model, successive subspace learning with the subspace approximation with adjusted bias (Saab) transform, for accurate and efficient segmentation from cine MRI. Our framework performed better than state-of-the-art U-Net models with 200$times$ fewer parameters in the left ventricle, right ventricle, and myocardium.
  arXiv  Detail & Related papers  (2021-07-22T14:50:48Z)
• Myocardial Segmentation of Cardiac MRI Sequences with Temporal Consistency for Coronary Artery Disease Diagnosis [12.53412028532286]
  We propose a myocardial segmentation framework for sequence of cardiac MRI (CMR) scanning images of left ventricular cavity, right ventricular cavity, and myocardium. Our framework can improve the segmentation accuracy by up to 2% in Dice coefficient.
  arXiv  Detail & Related papers  (2020-12-29T01:54:09Z)
• Automated Multi-Channel Segmentation for the 4D Myocardial Velocity Mapping Cardiac MR [1.8653386811342048]
  Four-dimensional (4D) left ventricular myocardial velocity mapping (MVM) is a cardiac magnetic resonance (CMR) technique. We propose a novel framework that improves the standard U-Net based methods on these CMR multi-channel data. Our proposed network trained with multi-channel data shows enhanced performance compared to standard U-Net based networks trained with single-channel data.
  arXiv  Detail & Related papers  (2020-12-16T16:15:55Z)
• Cardiac Segmentation on Late Gadolinium Enhancement MRI: A Benchmark Study from Multi-Sequence Cardiac MR Segmentation Challenge [43.01944884184009]
  This paper presents the selective results from the Multi-Sequence MR (MS-CMR) challenge, in conjunction with MII 2019. It was aimed to develop new algorithms, as well as benchmark existing ones for LGE CMR segmentation and compare them objectively. The success of these methods was mainly attributed to the inclusion of auxiliary sequences from the MS-CMR images.
  arXiv  Detail & Related papers  (2020-06-22T17:04:38Z)
• A Global Benchmark of Algorithms for Segmenting Late Gadolinium-Enhanced Cardiac Magnetic Resonance Imaging [90.29017019187282]
  " 2018 Left Atrium Challenge" using 154 3D LGE-MRIs, currently the world's largest cardiac LGE-MRI dataset. Analyse of the submitted algorithms using technical and biological metrics was performed. Results show the top method achieved a dice score of 93.2% and a mean surface to a surface distance of 0.7 mm.
  arXiv  Detail & Related papers  (2020-04-26T08:49:17Z)
• 4D Deep Learning for Multiple Sclerosis Lesion Activity Segmentation [49.32653090178743]
  We investigate whether extending this problem to full 4D deep learning using a history of MRI volumes can improve performance. We find that our proposed architecture outperforms previous approaches with a lesion-wise true positive rate of 0.84 at a lesion-wise false positive rate of 0.19.
  arXiv  Detail & Related papers  (2020-04-20T11:41:01Z)
• Multifold Acceleration of Diffusion MRI via Slice-Interleaved Diffusion Encoding (SIDE) [50.65891535040752]
  We propose a diffusion encoding scheme, called Slice-Interleaved Diffusion. SIDE, that interleaves each diffusion-weighted (DW) image volume with slices encoded with different diffusion gradients. We also present a method based on deep learning for effective reconstruction of DW images from the highly slice-undersampled data.
  arXiv  Detail & Related papers  (2020-02-25T14:48:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.