The Challenge of Fetal Cardiac MRI Reconstruction Using Deep Learning
- URL: http://arxiv.org/abs/2308.07885v1
- Date: Tue, 15 Aug 2023 17:22:42 GMT
- Title: The Challenge of Fetal Cardiac MRI Reconstruction Using Deep Learning
- Authors: Denis Prokopenko, Kerstin Hammernik, Thomas Roberts, David F A Lloyd,
Daniel Rueckert, Joseph V Hajnal
- Abstract summary: Deep learning methods could help to optimise the kt-SENSE acquisition strategy and improve non-gated kt-SENSE reconstruction quality.
In this work, we explore supervised deep learning networks for reconstruction of kt-SENSE style acquired data using an extensive in vivo dataset.
We show that the best-performers recover a detailed depiction of the maternal anatomy on a large scale, but the dynamic properties of the fetal heart are under-represented.
- Score: 11.809564612082935
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Dynamic free-breathing fetal cardiac MRI is one of the most challenging
modalities, which requires high temporal and spatial resolution to depict rapid
changes in a small fetal heart. The ability of deep learning methods to recover
undersampled data could help to optimise the kt-SENSE acquisition strategy and
improve non-gated kt-SENSE reconstruction quality. In this work, we explore
supervised deep learning networks for reconstruction of kt-SENSE style acquired
data using an extensive in vivo dataset. Having access to fully-sampled
low-resolution multi-coil fetal cardiac MRI, we study the performance of the
networks to recover fully-sampled data from undersampled data. We consider
model architectures together with training strategies taking into account their
application in the real clinical setup used to collect the dataset to enable
networks to recover prospectively undersampled data. We explore a set of
modifications to form a baseline performance evaluation for dynamic fetal
cardiac MRI on real data. We systematically evaluate the models on
coil-combined data to reveal the effect of the suggested changes to the
architecture in the context of fetal heart properties. We show that the
best-performers recover a detailed depiction of the maternal anatomy on a large
scale, but the dynamic properties of the fetal heart are under-represented.
Training directly on multi-coil data improves the performance of the models,
allows their prospective application to undersampled data and makes them
outperform CTFNet introduced for adult cardiac cine MRI. However, these models
deliver similar qualitative performances recovering the maternal body very well
but underestimating the dynamic properties of fetal heart. This dynamic feature
of fast change of fetal heart that is highly localised suggests both more
targeted training and evaluation methods might be needed for fetal heart
application.
Related papers
- Fine-tuning -- a Transfer Learning approach [0.22344294014777952]
Missingness in Electronic Health Records (EHRs) is often hampered by the abundance of missing data in this valuable resource.
Existing deep imputation methods rely on end-to-end pipelines that incorporate both imputation and downstream analyses.
This paper explores the development of a modular, deep learning-based imputation and classification pipeline.
arXiv Detail & Related papers (2024-11-06T14:18:23Z) - KaLDeX: Kalman Filter based Linear Deformable Cross Attention for Retina Vessel Segmentation [46.57880203321858]
We propose a novel network (KaLDeX) for vascular segmentation leveraging a Kalman filter based linear deformable cross attention (LDCA) module.
Our approach is based on two key components: Kalman filter (KF) based linear deformable convolution (LD) and cross-attention (CA) modules.
The proposed method is evaluated on retinal fundus image datasets (DRIVE, CHASE_BD1, and STARE) as well as the 3mm and 6mm of the OCTA-500 dataset.
arXiv Detail & Related papers (2024-10-28T16:00:42Z) - Deep Separable Spatiotemporal Learning for Fast Dynamic Cardiac MRI [22.7085949508143]
MRI plays an indispensable role in cardiac diagnosis. To enable fast imaging, the k-space data can be undersampled.
This challenge necessitates extensive training data in deep learning reconstruction methods.
We propose a novel and efficient approach, leveraging a dimension separable learning scheme that can perform exceptionally well even with highly limited training data.
arXiv Detail & Related papers (2024-02-24T23:56:15Z) - D-STGCNT: A Dense Spatio-Temporal Graph Conv-GRU Network based on
transformer for assessment of patient physical rehabilitation [0.3626013617212666]
This paper introduces a new graph-based model for assessing rehabilitation exercises.
Dense connections and GRU mechanisms are used to rapidly process large 3D skeleton inputs.
The evaluation of our proposed approach on the KIMORE and UI-PRMD datasets highlighted its potential.
arXiv Detail & Related papers (2023-12-21T00:38:31Z) - JSSL: Joint Supervised and Self-supervised Learning for MRI Reconstruction [7.018974360061121]
Joint Supervised and Self-supervised Learning (JSSL) is a novel training approach for deep learning-based MRI reconstruction algorithms.
JSSL operates by simultaneously training a model in a self-supervised learning setting, using subsampled data from the target dataset.
We demonstrate JSSL's efficacy using subsampled prostate or cardiac MRI data as the target datasets.
arXiv Detail & Related papers (2023-11-27T14:23:36Z) - CMRxRecon: An open cardiac MRI dataset for the competition of
accelerated image reconstruction [62.61209705638161]
There has been growing interest in deep learning-based CMR imaging algorithms.
Deep learning methods require large training datasets.
This dataset includes multi-contrast, multi-view, multi-slice and multi-coil CMR imaging data from 300 subjects.
arXiv Detail & Related papers (2023-09-19T15:14:42Z) - Iterative Data Refinement for Self-Supervised MR Image Reconstruction [18.02961646651716]
We propose a data refinement framework for self-supervised MR image reconstruction.
We first analyze the reason of the performance gap between self-supervised and supervised methods.
Then, we design an effective self-supervised training data refinement method to reduce this data bias.
arXiv Detail & Related papers (2022-11-24T06:57:16Z) - Learning Optimal K-space Acquisition and Reconstruction using
Physics-Informed Neural Networks [46.751292014516025]
Deep neural networks have been applied to reconstruct undersampled k-space data and have shown improved reconstruction performance.
This work proposes a novel framework to learn k-space sampling trajectories by considering it as an Ordinary Differential Equation (ODE) problem.
Experiments were conducted on different in-viv datasets (textite.g., brain and knee images) acquired with different sequences.
arXiv Detail & Related papers (2022-04-05T20:28:42Z) - Medulloblastoma Tumor Classification using Deep Transfer Learning with
Multi-Scale EfficientNets [63.62764375279861]
We propose an end-to-end MB tumor classification and explore transfer learning with various input sizes and matching network dimensions.
Using a data set with 161 cases, we demonstrate that pre-trained EfficientNets with larger input resolutions lead to significant performance improvements.
arXiv Detail & Related papers (2021-09-10T13:07:11Z) - Data augmentation for deep learning based accelerated MRI reconstruction
with limited data [46.44703053411933]
Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks.
To achieve state-of-the-art performance, training on large and diverse sets of images is considered critical.
We propose a pipeline for data augmentation for accelerated MRI reconstruction and study its effectiveness at reducing the required training data.
arXiv Detail & Related papers (2021-06-28T19:08:46Z) - Motion Pyramid Networks for Accurate and Efficient Cardiac Motion
Estimation [51.72616167073565]
We propose Motion Pyramid Networks, a novel deep learning-based approach for accurate and efficient cardiac motion estimation.
We predict and fuse a pyramid of motion fields from multiple scales of feature representations to generate a more refined motion field.
We then use a novel cyclic teacher-student training strategy to make the inference end-to-end and further improve the tracking performance.
arXiv Detail & Related papers (2020-06-28T21:03:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.