Flexible Alignment Super-Resolution Network for Multi-Contrast MRI
- URL: http://arxiv.org/abs/2210.03460v1
- Date: Fri, 7 Oct 2022 11:07:20 GMT
- Title: Flexible Alignment Super-Resolution Network for Multi-Contrast MRI
- Authors: Yiming Liu, Mengxi Zhang, Weiqin Zhang, Bo Hou, Dan Liu, Heqing Lian,
Bo Jiang
- Abstract summary: Super-Resolution plays a crucial role in preprocessing the low-resolution images for more precise medical analysis.
We propose the Flexible Alignment Super-Resolution Network (FASR-Net) for multi-contrast magnetic resonance images Super-Resolution.
- Score: 7.727046305845654
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Magnetic resonance images play an essential role in clinical diagnosis by
acquiring the structural information of biological tissue. However, during
acquiring magnetic resonance images, patients have to endure physical and
psychological discomfort, including irritating noise and acute anxiety. To make
the patient feel cozier, technically, it will reduce the retention time that
patients stay in the strong magnetic field at the expense of image quality.
Therefore, Super-Resolution plays a crucial role in preprocessing the
low-resolution images for more precise medical analysis. In this paper, we
propose the Flexible Alignment Super-Resolution Network (FASR-Net) for
multi-contrast magnetic resonance images Super-Resolution. The core of
multi-contrast SR is to match the patches of low-resolution and reference
images. However, the inappropriate foreground scale and patch size of
multi-contrast MRI sometimes lead to the mismatch of patches. To tackle this
problem, the Flexible Alignment module is proposed to endow receptive fields
with flexibility. Flexible Alignment module contains two parts: (1) The
Single-Multi Pyramid Alignmet module serves for low-resolution and reference
image with different scale. (2) The Multi-Multi Pyramid Alignment module serves
for low-resolution and reference image with the same scale. Extensive
experiments on the IXI and FastMRI datasets demonstrate that the FASR-Net
outperforms the existing state-of-the-art approaches. In addition, by comparing
the reconstructed images with the counterparts obtained by the existing
algorithms, our method could retain more textural details by leveraging
multi-contrast images.
Related papers
- Unifying Subsampling Pattern Variations for Compressed Sensing MRI with Neural Operators [72.79532467687427]
Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled and compressed measurements.
Deep neural networks have shown great potential for reconstructing high-quality images from highly undersampled measurements.
We propose a unified model that is robust to different subsampling patterns and image resolutions in CS-MRI.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI [23.50915512118989]
Multi-contrast Super-Resolution (SR) reconstruction is promising to yield SR images with higher quality.
radiologists are accustomed to zooming the MR images at arbitrary scales rather than using a fixed scale.
We propose an implicit neural representations based dual-arbitrary multi-contrast MRI super-resolution method, called Dual-ArbNet.
arXiv Detail & Related papers (2023-07-05T14:43:26Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - DisC-Diff: Disentangled Conditional Diffusion Model for Multi-Contrast
MRI Super-Resolution [8.721585866050757]
We propose a conditional diffusion model, DisC-Diff, for multi-contrast brain MRI super-resolution.
DisC-Diff estimates uncertainty in restorations effectively and ensures a stable optimization process.
We validated the effectiveness of DisC-Diff on two datasets: the IXI dataset, which contains 578 normal brains, and a clinical dataset with 316 pathological brains.
arXiv Detail & Related papers (2023-03-24T11:42:45Z) - Model-Guided Multi-Contrast Deep Unfolding Network for MRI
Super-resolution Reconstruction [68.80715727288514]
We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix.
In this paper, we propose a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction.
arXiv Detail & Related papers (2022-09-15T03:58:30Z) - Transformer-empowered Multi-scale Contextual Matching and Aggregation
for Multi-contrast MRI Super-resolution [55.52779466954026]
Multi-contrast super-resolution (SR) reconstruction is promising to yield SR images with higher quality.
Existing methods lack effective mechanisms to match and fuse these features for better reconstruction.
We propose a novel network to address these problems by developing a set of innovative Transformer-empowered multi-scale contextual matching and aggregation techniques.
arXiv Detail & Related papers (2022-03-26T01:42:59Z) - Multi-modal Aggregation Network for Fast MR Imaging [85.25000133194762]
We propose a novel Multi-modal Aggregation Network, named MANet, which is capable of discovering complementary representations from a fully sampled auxiliary modality.
In our MANet, the representations from the fully sampled auxiliary and undersampled target modalities are learned independently through a specific network.
Our MANet follows a hybrid domain learning framework, which allows it to simultaneously recover the frequency signal in the $k$-space domain.
arXiv Detail & Related papers (2021-10-15T13:16:59Z) - ShuffleUNet: Super resolution of diffusion-weighted MRIs using deep
learning [47.68307909984442]
Single Image Super-Resolution (SISR) is a technique aimed to obtain high-resolution (HR) details from one single low-resolution input image.
Deep learning extracts prior knowledge from big datasets and produces superior MRI images from the low-resolution counterparts.
arXiv Detail & Related papers (2021-02-25T14:52:23Z) - Reference-based Texture transfer for Single Image Super-resolution of
Magnetic Resonance images [1.978587235008588]
We propose a reference-based, unpaired multi-contrast texture-transfer strategy for deep learning based in-plane and across-plane MRI super-resolution.
We apply our scheme in different super-resolution architectures, observing improvement in PSNR and SSIM for 4x super-resolution in most of the cases.
arXiv Detail & Related papers (2021-02-10T14:12:48Z) - Fine Perceptive GANs for Brain MR Image Super-Resolution in Wavelet
Domain [23.23392380531189]
Fine perceptive generative adversarial networks (FP-GANs) are proposed to produce high-resolution (HR) magnetic resonance (MR) images.
Experiments on MultiRes_7T dataset demonstrate that FP-GANs outperforms the competing methods quantitatively and qualitatively.
arXiv Detail & Related papers (2020-11-09T02:09:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.