Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network

• URL: http://arxiv.org/abs/2312.00661v1
• Date: Fri, 1 Dec 2023 15:40:26 GMT
• Title: Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network
• Authors: Junwei Yang, Pietro Li\`o
• Abstract summary: Our proposed framework, based on deep learning, facilitates the optimisation for under-sampled target contrast. The method consists of three key steps: 1) Learning to synthesise data resembling the target contrast from the reference contrast; 2) Registering the multi-contrast data to reduce inter-scan motion; and 3) Utilising the registered data for reconstructing the target contrast. Experiments demonstrate the superiority of our proposed framework, for up to an 8-fold acceleration rate, compared to state-of-the-art algorithms.
• Score: 8.721677700107639
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Purpose: To develop an efficient dual-domain reconstruction framework for multi-contrast MRI, with the focus on minimising cross-contrast misalignment in both the image and the frequency domains to enhance optimisation. Theory and Methods: Our proposed framework, based on deep learning, facilitates the optimisation for under-sampled target contrast using fully-sampled reference contrast that is quicker to acquire. The method consists of three key steps: 1) Learning to synthesise data resembling the target contrast from the reference contrast; 2) Registering the multi-contrast data to reduce inter-scan motion; and 3) Utilising the registered data for reconstructing the target contrast. These steps involve learning in both domains with regularisation applied to ensure their consistency. We also compare the reconstruction performance with existing deep learning-based methods using a dataset of brain MRI scans. Results: Extensive experiments demonstrate the superiority of our proposed framework, for up to an 8-fold acceleration rate, compared to state-of-the-art algorithms. Comprehensive analysis and ablation studies further present the effectiveness of the proposed components. Conclusion:Our dual-domain framework offers a promising approach to multi-contrast MRI reconstruction. It can also be integrated with existing methods to further enhance the reconstruction.

Related papers

• A Plug-and-Play Method for Guided Multi-contrast MRI Reconstruction based on Content/Style Modeling [1.1622133377827824]
  We propose a modular two-stage approach for guided reconstruction. In a radiological task, MUNIT allowed 33.3% more acceleration over clinical reconstruction at diagnostic quality.
  arXiv  Detail & Related papers  (2024-09-20T13:08:51Z)
• Deep Unfolding Network with Spatial Alignment for multi-modal MRI reconstruction [17.41293135114323]
  Multi-modal Magnetic Resonance Imaging (MRI) offers complementary diagnostic information, but some modalities are limited by the long scanning time. To accelerate the whole acquisition process, MRI reconstruction of one modality from highly undersampled k-space data with another fully-sampled reference modality is an efficient solution. Existing deep learning-based methods that account for inter-modality misalignment perform better, but still share two main common limitations.
  arXiv  Detail & Related papers  (2023-12-28T13:02:16Z)
• Spatial and Modal Optimal Transport for Fast Cross-Modal MRI Reconstruction [54.19448988321891]
  We propose an end-to-end deep learning framework that utilizes T1-weighted images (T1WIs) as auxiliary modalities to expedite T2WIs' acquisitions. We employ Optimal Transport (OT) to synthesize T2WIs by aligning T1WIs and performing cross-modal synthesis. We prove that the reconstructed T2WIs and the synthetic T2WIs become closer on the T2 image manifold with iterations increasing.
  arXiv  Detail & Related papers  (2023-05-04T12:20:51Z)
• JoJoNet: Joint-contrast and Joint-sampling-and-reconstruction Network for Multi-contrast MRI [49.29851365978476]
  The proposed framework consists of a sampling mask generator for each image contrast and a reconstructor exploiting the inter-contrast correlations with a recurrent structure. The acceleration ratio of each image contrast is also learnable and can be driven by a downstream task performance.
  arXiv  Detail & Related papers  (2022-10-22T20:46:56Z)
• Model-Guided Multi-Contrast Deep Unfolding Network for MRI Super-resolution Reconstruction [68.80715727288514]
  We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix. In this paper, we propose a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction.
  arXiv  Detail & Related papers  (2022-09-15T03:58:30Z)
• Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution [55.52779466954026]
  Multi-contrast super-resolution (SR) reconstruction is promising to yield SR images with higher quality. Existing methods lack effective mechanisms to match and fuse these features for better reconstruction. We propose a novel network to address these problems by developing a set of innovative Transformer-empowered multi-scale contextual matching and aggregation techniques.
  arXiv  Detail & Related papers  (2022-03-26T01:42:59Z)
• Exploring Separable Attention for Multi-Contrast MR Image Super-Resolution [88.16655157395785]
  We propose a separable attention network (comprising a priority attention and background separation attention) named SANet. It can explore the foreground and background areas in the forward and reverse directions with the help of the auxiliary contrast. It is the first model to explore a separable attention mechanism that uses the auxiliary contrast to predict the foreground and background regions.
  arXiv  Detail & Related papers  (2021-09-03T05:53:07Z)
• Multi-Modal MRI Reconstruction with Spatial Alignment Network [51.74078260367654]
  In clinical practice, magnetic resonance imaging (MRI) with multiple contrasts is usually acquired in a single study. Recent researches demonstrate that, considering the redundancy between different contrasts or modalities, a target MRI modality under-sampled in the k-space can be better reconstructed with the helps from a fully-sampled sequence. In this paper, we integrate the spatial alignment network with reconstruction, to improve the quality of the reconstructed target modality.
  arXiv  Detail & Related papers  (2021-08-12T08:46:35Z)
• Deep Simultaneous Optimisation of Sampling and Reconstruction for Multi-contrast MRI [6.981200113164422]
  We propose an algorithm that generates the optimised sampling pattern and reconstruction scheme of one contrast. The proposed algorithm achieves increased PSNR and SSIM with the resulting optimal sampling pattern.
  arXiv  Detail & Related papers  (2021-03-31T00:45:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.