Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI
- URL: http://arxiv.org/abs/2307.02334v3
- Date: Mon, 10 Jul 2023 13:25:25 GMT
- Title: Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI
- Authors: Jiamiao Zhang, Yichen Chi, Jun Lyu, Wenming Yang, Yapeng Tian
- Abstract summary: Multi-contrast Super-Resolution (SR) reconstruction is promising to yield SR images with higher quality.
radiologists are accustomed to zooming the MR images at arbitrary scales rather than using a fixed scale.
We propose an implicit neural representations based dual-arbitrary multi-contrast MRI super-resolution method, called Dual-ArbNet.
- Score: 23.50915512118989
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Limited by imaging systems, the reconstruction of Magnetic Resonance Imaging
(MRI) images from partial measurement is essential to medical imaging research.
Benefiting from the diverse and complementary information of multi-contrast MR
images in different imaging modalities, multi-contrast Super-Resolution (SR)
reconstruction is promising to yield SR images with higher quality. In the
medical scenario, to fully visualize the lesion, radiologists are accustomed to
zooming the MR images at arbitrary scales rather than using a fixed scale, as
used by most MRI SR methods. In addition, existing multi-contrast MRI SR
methods often require a fixed resolution for the reference image, which makes
acquiring reference images difficult and imposes limitations on arbitrary scale
SR tasks. To address these issues, we proposed an implicit neural
representations based dual-arbitrary multi-contrast MRI super-resolution
method, called Dual-ArbNet. First, we decouple the resolution of the target and
reference images by a feature encoder, enabling the network to input target and
reference images at arbitrary scales. Then, an implicit fusion decoder fuses
the multi-contrast features and uses an Implicit Decoding Function~(IDF) to
obtain the final MRI SR results. Furthermore, we introduce a curriculum
learning strategy to train our network, which improves the generalization and
performance of our Dual-ArbNet. Extensive experiments in two public MRI
datasets demonstrate that our method outperforms state-of-the-art approaches
under different scale factors and has great potential in clinical practice.
Related papers
- Towards General Text-guided Image Synthesis for Customized Multimodal Brain MRI Generation [51.28453192441364]
Multimodal brain magnetic resonance (MR) imaging is indispensable in neuroscience and neurology.
Current MR image synthesis approaches are typically trained on independent datasets for specific tasks.
We present TUMSyn, a Text-guided Universal MR image Synthesis model, which can flexibly generate brain MR images.
arXiv Detail & Related papers (2024-09-25T11:14:47Z) - Compound Attention and Neighbor Matching Network for Multi-contrast MRI
Super-resolution [7.197850827700436]
Multi-contrast super-resolution of MRI can achieve better results than single-image super-resolution.
We propose a novel network architecture with compound-attention and neighbor matching (CANM-Net) for multi-contrast MRI SR.
CANM-Net outperforms state-of-the-art approaches in both retrospective and prospective experiments.
arXiv Detail & Related papers (2023-07-05T09:44:02Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - Flexible Alignment Super-Resolution Network for Multi-Contrast MRI [7.727046305845654]
Super-Resolution plays a crucial role in preprocessing the low-resolution images for more precise medical analysis.
We propose the Flexible Alignment Super-Resolution Network (FASR-Net) for multi-contrast magnetic resonance images Super-Resolution.
arXiv Detail & Related papers (2022-10-07T11:07:20Z) - Model-Guided Multi-Contrast Deep Unfolding Network for MRI
Super-resolution Reconstruction [68.80715727288514]
We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix.
In this paper, we propose a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction.
arXiv Detail & Related papers (2022-09-15T03:58:30Z) - Transformer-empowered Multi-scale Contextual Matching and Aggregation
for Multi-contrast MRI Super-resolution [55.52779466954026]
Multi-contrast super-resolution (SR) reconstruction is promising to yield SR images with higher quality.
Existing methods lack effective mechanisms to match and fuse these features for better reconstruction.
We propose a novel network to address these problems by developing a set of innovative Transformer-empowered multi-scale contextual matching and aggregation techniques.
arXiv Detail & Related papers (2022-03-26T01:42:59Z) - Multi-modal Aggregation Network for Fast MR Imaging [85.25000133194762]
We propose a novel Multi-modal Aggregation Network, named MANet, which is capable of discovering complementary representations from a fully sampled auxiliary modality.
In our MANet, the representations from the fully sampled auxiliary and undersampled target modalities are learned independently through a specific network.
Our MANet follows a hybrid domain learning framework, which allows it to simultaneously recover the frequency signal in the $k$-space domain.
arXiv Detail & Related papers (2021-10-15T13:16:59Z) - High-Resolution Pelvic MRI Reconstruction Using a Generative Adversarial
Network with Attention and Cyclic Loss [3.4358954898228604]
Super-resolution methods have shown excellent performance in accelerating MRI.
In some circumstances, it is difficult to obtain high-resolution images even with prolonged scan time.
We proposed a novel super-resolution method that uses a generative adversarial network (GAN) with cyclic loss and attention mechanism.
arXiv Detail & Related papers (2021-07-21T10:07:22Z) - MIASSR: An Approach for Medical Image Arbitrary Scale Super-Resolution [3.0554209431226624]
Single image super-resolution aims to obtain a high-resolution output from one low-resolution image.
Deep learning-based SISR approaches have been widely discussed in medical image processing.
We propose an approach for medical image arbitrary-scale super-resolution (MIASSR)
arXiv Detail & Related papers (2021-05-22T14:24:25Z) - Adaptive Gradient Balancing for UndersampledMRI Reconstruction and
Image-to-Image Translation [60.663499381212425]
We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique.
In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
arXiv Detail & Related papers (2021-04-05T13:05:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.