End-to-End AI-based MRI Reconstruction and Lesion Detection Pipeline for
Evaluation of Deep Learning Image Reconstruction
- URL: http://arxiv.org/abs/2109.11524v1
- Date: Thu, 23 Sep 2021 17:46:08 GMT
- Title: End-to-End AI-based MRI Reconstruction and Lesion Detection Pipeline for
Evaluation of Deep Learning Image Reconstruction
- Authors: Ruiyang Zhao, Yuxin Zhang, Burhaneddin Yaman, Matthew P. Lungren,
Michael S. Hansen
- Abstract summary: We propose an end-to-end deep learning framework for image reconstruction and pathology detection.
The solution is demonstrated for a use case in detecting meniscal tears on knee MRI studies.
- Score: 1.2649531564873526
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep learning techniques have emerged as a promising approach to highly
accelerated MRI. However, recent reconstruction challenges have shown several
drawbacks in current deep learning approaches, including the loss of fine image
details even using models that perform well in terms of global quality metrics.
In this study, we propose an end-to-end deep learning framework for image
reconstruction and pathology detection, which enables a clinically aware
evaluation of deep learning reconstruction quality. The solution is
demonstrated for a use case in detecting meniscal tears on knee MRI studies,
ultimately finding a loss of fine image details with common reconstruction
methods expressed as a reduced ability to detect important pathology like
meniscal tears. Despite the common practice of quantitative reconstruction
methodology evaluation with metrics such as SSIM, impaired pathology detection
as an automated pathology-based reconstruction evaluation approach suggests
existing quantitative methods do not capture clinically important
reconstruction outcomes.
Related papers
- Accelerating Cardiac MRI Reconstruction with CMRatt: An Attention-Driven Approach [8.904269561863103]
This study aims to explore the untapped potential of attention mechanisms incorporated with a deep learning model within the context of cardiac image reconstruction.
Our primary goal is to identify the strengths and potential limitations of attention algorithms when integrated with a convolutional backbone model such as a U-Net.
We propose a new, simple yet effective, attention pipeline specifically optimised for the task of cardiac image reconstruction.
arXiv Detail & Related papers (2024-04-10T11:47:51Z) - Enhancing Low-dose CT Image Reconstruction by Integrating Supervised and
Unsupervised Learning [13.17680480211064]
We propose a hybrid supervised-unsupervised learning framework for X-ray computed tomography (CT) image reconstruction.
Each proposed trained block consists of a deterministic MBIR solver and a neural network.
We demonstrate the efficacy of this learned hybrid model for low-dose CT image reconstruction with limited training data.
arXiv Detail & Related papers (2023-11-19T20:23:59Z) - CL-MRI: Self-Supervised Contrastive Learning to Improve the Accuracy of Undersampled MRI Reconstruction [25.078280843551322]
We introduce a self-supervised pretraining procedure using contrastive learning to improve the accuracy of undersampled MRI reconstruction.
Our experiments demonstrate improved reconstruction accuracy across a range of acceleration factors and datasets.
arXiv Detail & Related papers (2023-06-01T10:29:58Z) - Model-Guided Multi-Contrast Deep Unfolding Network for MRI
Super-resolution Reconstruction [68.80715727288514]
We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix.
In this paper, we propose a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction.
arXiv Detail & Related papers (2022-09-15T03:58:30Z) - Uncertainty Quantification for Deep Unrolling-Based Computational
Imaging [0.0]
We propose a learning-based image reconstruction framework that incorporates the observation model into the reconstruction task.
We show that the proposed framework can provide uncertainty information while achieving comparable reconstruction performance to state-of-the-art deep unrolling methods.
arXiv Detail & Related papers (2022-07-02T00:22:49Z) - A Long Short-term Memory Based Recurrent Neural Network for
Interventional MRI Reconstruction [50.1787181309337]
We propose a convolutional long short-term memory (Conv-LSTM) based recurrent neural network (RNN), or ConvLR, to reconstruct interventional images with golden-angle radial sampling.
The proposed algorithm has the potential to achieve real-time i-MRI for DBS and can be used for general purpose MR-guided intervention.
arXiv Detail & Related papers (2022-03-28T14:03:45Z) - Multi-modal Aggregation Network for Fast MR Imaging [85.25000133194762]
We propose a novel Multi-modal Aggregation Network, named MANet, which is capable of discovering complementary representations from a fully sampled auxiliary modality.
In our MANet, the representations from the fully sampled auxiliary and undersampled target modalities are learned independently through a specific network.
Our MANet follows a hybrid domain learning framework, which allows it to simultaneously recover the frequency signal in the $k$-space domain.
arXiv Detail & Related papers (2021-10-15T13:16:59Z) - Adaptive Gradient Balancing for UndersampledMRI Reconstruction and
Image-to-Image Translation [60.663499381212425]
We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique.
In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
arXiv Detail & Related papers (2021-04-05T13:05:22Z) - Multi-institutional Collaborations for Improving Deep Learning-based
Magnetic Resonance Image Reconstruction Using Federated Learning [62.17532253489087]
Deep learning methods have been shown to produce superior performance on MR image reconstruction.
These methods require large amounts of data which is difficult to collect and share due to the high cost of acquisition and medical data privacy regulations.
We propose a federated learning (FL) based solution in which we take advantage of the MR data available at different institutions while preserving patients' privacy.
arXiv Detail & Related papers (2021-03-03T03:04:40Z) - Adversarial Robust Training of Deep Learning MRI Reconstruction Models [0.0]
We employ adversarial attacks to generate small synthetic perturbations, which are difficult to reconstruct for a trained Deep Learning reconstruction network.
We then use robust training to increase the network's sensitivity to these small features and encourage their reconstruction.
Experimental results show that by introducing robust training to a reconstruction network, the rate of false negative features can be reduced.
arXiv Detail & Related papers (2020-10-30T19:26:14Z) - Explaining Clinical Decision Support Systems in Medical Imaging using
Cycle-Consistent Activation Maximization [112.2628296775395]
Clinical decision support using deep neural networks has become a topic of steadily growing interest.
clinicians are often hesitant to adopt the technology because its underlying decision-making process is considered to be intransparent and difficult to comprehend.
We propose a novel decision explanation scheme based on CycleGAN activation which generates high-quality visualizations of classifier decisions even in smaller data sets.
arXiv Detail & Related papers (2020-10-09T14:39:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.