Deep Separable Spatiotemporal Learning for Fast Dynamic Cardiac MRI
- URL: http://arxiv.org/abs/2402.15939v1
- Date: Sat, 24 Feb 2024 23:56:15 GMT
- Title: Deep Separable Spatiotemporal Learning for Fast Dynamic Cardiac MRI
- Authors: Zi Wang, Min Xiao, Yirong Zhou, Chengyan Wang, Naiming Wu, Yi Li,
Yiwen Gong, Shufu Chang, Yinyin Chen, Liuhong Zhu, Jianjun Zhou, Congbo Cai,
He Wang, Di Guo, Guang Yang, Xiaobo Qu
- Abstract summary: Dynamic magnetic resonance imaging (MRI) plays an indispensable role in cardiac diagnosis.
To enable fast imaging, the k-space data can be undersampled but the image reconstruction poses a great challenge of high-dimensional processing.
This work proposes a novel and efficient approach, leveraging a reduced dimension-reduced separable learning scheme that excels even with highly limited training data.
- Score: 23.142320453773696
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Dynamic magnetic resonance imaging (MRI) plays an indispensable role in
cardiac diagnosis. To enable fast imaging, the k-space data can be undersampled
but the image reconstruction poses a great challenge of high-dimensional
processing. This challenge leads to necessitate extensive training data in many
deep learning reconstruction methods. This work proposes a novel and efficient
approach, leveraging a dimension-reduced separable learning scheme that excels
even with highly limited training data. We further integrate it with
spatiotemporal priors to develop a Deep Separable Spatiotemporal Learning
network (DeepSSL), which unrolls an iteration process of a reconstruction model
with both temporal low-rankness and spatial sparsity. Intermediate outputs are
visualized to provide insights into the network's behavior and enhance its
interpretability. Extensive results on cardiac cine datasets show that the
proposed DeepSSL is superior to the state-of-the-art methods visually and
quantitatively, while reducing the demand for training cases by up to 75%. And
its preliminary adaptability to cardiac patients has been verified through
experienced radiologists' and cardiologists' blind reader study. Additionally,
DeepSSL also benefits for achieving the downstream task of cardiac segmentation
with higher accuracy and shows robustness in prospective real-time cardiac MRI.
Related papers
- Self-STORM: Deep Unrolled Self-Supervised Learning for Super-Resolution Microscopy [55.2480439325792]
We introduce deep unrolled self-supervised learning, which alleviates the need for such data by training a sequence-specific, model-based autoencoder.
Our proposed method exceeds the performance of its supervised counterparts.
arXiv Detail & Related papers (2024-03-25T17:40:32Z) - CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images.
The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism.
We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
arXiv Detail & Related papers (2024-03-21T15:13:36Z) - Learning to sample in Cartesian MRI [1.2432046687586285]
Shortening scanning times is crucial in clinical settings, as it increases patient comfort, decreases examination costs and improves throughput.
Recent advances in compressed sensing (CS) and deep learning allow accelerated MRI acquisition by reconstructing high-quality images from undersampled data.
This thesis explores two approaches to address this gap in the context of Cartesian MRI.
arXiv Detail & Related papers (2023-12-07T14:38:07Z) - CMRxRecon: An open cardiac MRI dataset for the competition of
accelerated image reconstruction [62.61209705638161]
There has been growing interest in deep learning-based CMR imaging algorithms.
Deep learning methods require large training datasets.
This dataset includes multi-contrast, multi-view, multi-slice and multi-coil CMR imaging data from 300 subjects.
arXiv Detail & Related papers (2023-09-19T15:14:42Z) - The Challenge of Fetal Cardiac MRI Reconstruction Using Deep Learning [11.809564612082935]
Deep learning methods could help to optimise the kt-SENSE acquisition strategy and improve non-gated kt-SENSE reconstruction quality.
In this work, we explore supervised deep learning networks for reconstruction of kt-SENSE style acquired data using an extensive in vivo dataset.
We show that the best-performers recover a detailed depiction of the maternal anatomy on a large scale, but the dynamic properties of the fetal heart are under-represented.
arXiv Detail & Related papers (2023-08-15T17:22:42Z) - Implicit Neural Networks with Fourier-Feature Inputs for Free-breathing
Cardiac MRI Reconstruction [21.261567937245808]
We propose a reconstruction approach based on representing the beating heart with an implicit neural network and fitting the network so that the representation of the heart is consistent with the measurements.
Our method achieves reconstruction quality on par with or slightly better than state-of-the-art untrained convolutional neural networks and superior image quality.
arXiv Detail & Related papers (2023-05-11T14:14:30Z) - Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and
Methodologies from CNN, GAN to Attention and Transformers [72.047680167969]
This article aims to introduce the deep learning based data driven techniques for fast MRI including convolutional neural network and generative adversarial network based methods.
We will detail the research in coupling physics and data driven models for MRI acceleration.
Finally, we will demonstrate through a few clinical applications, explain the importance of data harmonisation and explainable models for such fast MRI techniques in multicentre and multi-scanner studies.
arXiv Detail & Related papers (2022-04-01T22:48:08Z) - Deep Learning for Ultrasound Beamforming [120.12255978513912]
Beamforming, the process of mapping received ultrasound echoes to the spatial image domain, lies at the heart of the ultrasound image formation chain.
Modern ultrasound imaging leans heavily on innovations in powerful digital receive channel processing.
Deep learning methods can play a compelling role in the digital beamforming pipeline.
arXiv Detail & Related papers (2021-09-23T15:15:21Z) - ShuffleUNet: Super resolution of diffusion-weighted MRIs using deep
learning [47.68307909984442]
Single Image Super-Resolution (SISR) is a technique aimed to obtain high-resolution (HR) details from one single low-resolution input image.
Deep learning extracts prior knowledge from big datasets and produces superior MRI images from the low-resolution counterparts.
arXiv Detail & Related papers (2021-02-25T14:52:23Z) - Efficient and Phase-aware Video Super-resolution for Cardiac MRI [23.5319835123499]
We propose a novel end-to-end trainable network to solve CMR video super-resolution problem.
We incorporate the cardiac knowledge into our model to assist in utilizing the temporal information.
arXiv Detail & Related papers (2020-05-21T13:29:03Z) - High-Fidelity Accelerated MRI Reconstruction by Scan-Specific
Fine-Tuning of Physics-Based Neural Networks [3.1498833540989413]
Long scan duration remains a challenge for high-resolution MRI.
Deep learning has emerged as a powerful means for accelerated MRI reconstruction by providing data-driven regularizers that are directly learned from data.
In this study, we propose to use a transfer learning approach to fine-tune these regularizers for new subjects using a self-supervision approach.
arXiv Detail & Related papers (2020-05-12T05:10:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.