Direct Cardiac Segmentation from Undersampled K-space Using Transformers

• URL: http://arxiv.org/abs/2406.00192v1
• Date: Fri, 31 May 2024 20:54:12 GMT
• Title: Direct Cardiac Segmentation from Undersampled K-space Using Transformers
• Authors: Yundi Zhang, Nil Stolt-Ansó, Jiazhen Pan, Wenqi Huang, Kerstin Hammernik, Daniel Rueckert,
• Abstract summary: We introduce a novel approach to deriving segmentations from sparse k-space samples using a transformer (DiSK) Our model consistently outperforms the baselines in Dice and Hausdorff distances across foreground classes for all presented sampling rates.
• Score: 10.079819435628579
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The prevailing deep learning-based methods of predicting cardiac segmentation involve reconstructed magnetic resonance (MR) images. The heavy dependency of segmentation approaches on image quality significantly limits the acceleration rate in fast MR reconstruction. Moreover, the practice of treating reconstruction and segmentation as separate sequential processes leads to artifact generation and information loss in the intermediate stage. These issues pose a great risk to achieving high-quality outcomes. To leverage the redundant k-space information overlooked in this dual-step pipeline, we introduce a novel approach to directly deriving segmentations from sparse k-space samples using a transformer (DiSK). DiSK operates by globally extracting latent features from 2D+time k-space data with attention blocks and subsequently predicting the segmentation label of query points. We evaluate our model under various acceleration factors (ranging from 4 to 64) and compare against two image-based segmentation baselines. Our model consistently outperforms the baselines in Dice and Hausdorff distances across foreground classes for all presented sampling rates.

Related papers

• GCCRR: A Short Sequence Gait Cycle Segmentation Method Based on Ear-Worn IMU [3.2428847882267404]
  This paper addresses the critical task of gait cycle segmentation using short sequences from ear-worn IMUs. We introduce the Gait Characteristic Curve Regression and Restoration (GCCRR) method, a novel two-stage approach for fine-grained gait phase segmentation. Our method employs Bi-LSTM-based deep learning algorithms for regression to ensure reliable segmentation for short gait sequences.
  arXiv  Detail & Related papers  (2024-09-02T07:00:34Z)
• CAMP-Net: Consistency-Aware Multi-Prior Network for Accelerated MRI Reconstruction [4.967600587813224]
  Undersampling k-space data in MRI reduces scan time but pose challenges in image reconstruction. We propose CAMP-Net, an unrolling-based Consistency-Aware Multi-Prior Network for accelerated MRI reconstruction.
  arXiv  Detail & Related papers  (2023-06-20T02:21:45Z)
• Neural Implicit k-Space for Binning-free Non-Cartesian Cardiac MR Imaging [10.106969728359156]
  We propose a novel image reconstruction framework that learns a neural implicit representation in k-space for ECG-triggered non-Cartesian Cardiac Magnetic Imaging (CMR) We assign a unique coordinate that consists of time, coil index, and frequency domain location to each sampled k-space point. We then learn the subject-specific mapping from these unique coordinates to k-space intensities using a multi-layer perceptron with frequency domain regularization.
  arXiv  Detail & Related papers  (2022-12-16T13:46:17Z)
• FCN-Transformer Feature Fusion for Polyp Segmentation [12.62213319797323]
  Colonoscopy is widely recognised as the gold standard procedure for the early detection of colorectal cancer. The manual segmentation of polyps in colonoscopy images is time-consuming. The use of deep learning for automation of polyp segmentation has become important.
  arXiv  Detail & Related papers  (2022-08-17T15:31:06Z)
• Information Entropy Initialized Concrete Autoencoder for Optimal Sensor Placement and Reconstruction of Geophysical Fields [58.720142291102135]
  We propose a new approach to the optimal placement of sensors for reconstructing geophysical fields from sparse measurements. We demonstrate our method on the two examples: (a) temperature and (b) salinity fields around the Barents Sea and the Svalbard group of islands. We find out that the obtained optimal sensor locations have clear physical interpretation and correspond to the boundaries between sea currents.
  arXiv  Detail & Related papers  (2022-06-28T12:43:38Z)
• Residual Moment Loss for Medical Image Segmentation [56.72261489147506]
  Location information is proven to benefit the deep learning models on capturing the manifold structure of target objects. Most existing methods encode the location information in an implicit way, for the network to learn. We propose a novel loss function, namely residual moment (RM) loss, to explicitly embed the location information of segmentation targets.
  arXiv  Detail & Related papers  (2021-06-27T09:31:49Z)
• InverseForm: A Loss Function for Structured Boundary-Aware Segmentation [80.39674800972182]
  We present a novel boundary-aware loss term for semantic segmentation using an inverse-transformation network. This plug-in loss term complements the cross-entropy loss in capturing boundary transformations. We analyze the quantitative and qualitative effects of our loss function on three indoor and outdoor segmentation benchmarks.
  arXiv  Detail & Related papers  (2021-04-06T18:52:45Z)
• A persistent homology-based topological loss function for multi-class CNN segmentation of cardiac MRI [7.993897173085253]
  We build a richer description of segmentation topology by considering all possible labels and label pairs. These topological priors allow us to resolve all topological errors in a subset of 150 examples from the ACDC short axis CMR training data set.
  arXiv  Detail & Related papers  (2020-08-21T17:09:13Z)
• MetricUNet: Synergistic Image- and Voxel-Level Learning for Precise CT Prostate Segmentation via Online Sampling [66.01558025094333]
  We propose a two-stage framework, with the first stage to quickly localize the prostate region and the second stage to precisely segment the prostate. We introduce a novel online metric learning module through voxel-wise sampling in the multi-task network. Our method can effectively learn more representative voxel-level features compared with the conventional learning methods with cross-entropy or Dice loss.
  arXiv  Detail & Related papers  (2020-05-15T10:37:02Z)
• Kullback-Leibler Divergence-Based Fuzzy $C$-Means Clustering Incorporating Morphological Reconstruction and Wavelet Frames for Image Segmentation [152.609322951917]
  We come up with a Kullback-Leibler (KL) divergence-based Fuzzy C-Means (FCM) algorithm by incorporating a tight wavelet frame transform and a morphological reconstruction operation. The proposed algorithm works well and comes with better segmentation performance than other comparative algorithms.
  arXiv  Detail & Related papers  (2020-02-21T05:19:10Z)
• Residual-Sparse Fuzzy $C$-Means Clustering Incorporating Morphological Reconstruction and Wavelet frames [146.63177174491082]
  Fuzzy $C$-Means (FCM) algorithm incorporates a morphological reconstruction operation and a tight wavelet frame transform. We present an improved FCM algorithm by imposing an $ell_0$ regularization term on the residual between the feature set and its ideal value. Experimental results reported for synthetic, medical, and color images show that the proposed algorithm is effective and efficient, and outperforms other algorithms.
  arXiv  Detail & Related papers  (2020-02-14T10:00:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.