Reference-based Texture transfer for Single Image Super-resolution of
Magnetic Resonance images
- URL: http://arxiv.org/abs/2102.05450v1
- Date: Wed, 10 Feb 2021 14:12:48 GMT
- Title: Reference-based Texture transfer for Single Image Super-resolution of
Magnetic Resonance images
- Authors: Madhu Mithra K K, Sriprabha Ramanarayanan, Keerthi Ram, Mohanasankar
Sivaprakasam
- Abstract summary: We propose a reference-based, unpaired multi-contrast texture-transfer strategy for deep learning based in-plane and across-plane MRI super-resolution.
We apply our scheme in different super-resolution architectures, observing improvement in PSNR and SSIM for 4x super-resolution in most of the cases.
- Score: 1.978587235008588
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Magnetic Resonance Imaging (MRI) is a valuable clinical diagnostic modality
for spine pathologies with excellent characterization for infection, tumor,
degenerations, fractures and herniations. However in surgery, image-guided
spinal procedures continue to rely on CT and fluoroscopy, as MRI slice
resolutions are typically insufficient. Building upon state-of-the-art single
image super-resolution, we propose a reference-based, unpaired multi-contrast
texture-transfer strategy for deep learning based in-plane and across-plane MRI
super-resolution. We use the scattering transform to relate the texture
features of image patches to unpaired reference image patches, and additionally
a loss term for multi-contrast texture. We apply our scheme in different
super-resolution architectures, observing improvement in PSNR and SSIM for 4x
super-resolution in most of the cases.
Related papers
- Unifying Subsampling Pattern Variations for Compressed Sensing MRI with Neural Operators [72.79532467687427]
Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled and compressed measurements.
Deep neural networks have shown great potential for reconstructing high-quality images from highly undersampled measurements.
We propose a unified model that is robust to different subsampling patterns and image resolutions in CS-MRI.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI [23.50915512118989]
Multi-contrast Super-Resolution (SR) reconstruction is promising to yield SR images with higher quality.
radiologists are accustomed to zooming the MR images at arbitrary scales rather than using a fixed scale.
We propose an implicit neural representations based dual-arbitrary multi-contrast MRI super-resolution method, called Dual-ArbNet.
arXiv Detail & Related papers (2023-07-05T14:43:26Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - Transformer and GAN Based Super-Resolution Reconstruction Network for
Medical Images [0.0]
Super-resolution reconstruction in medical imaging has become more popular (MRI)
In this paper, we offer a deep learning-based strategy for reconstructing medical images from low resolutions utilizing Transformer and Generative Adversarial Networks (T-GAN)
The integrated system can extract more precise texture information and focus more on important locations through global image matching.
arXiv Detail & Related papers (2022-12-26T09:52:12Z) - Flexible Alignment Super-Resolution Network for Multi-Contrast MRI [7.727046305845654]
Super-Resolution plays a crucial role in preprocessing the low-resolution images for more precise medical analysis.
We propose the Flexible Alignment Super-Resolution Network (FASR-Net) for multi-contrast magnetic resonance images Super-Resolution.
arXiv Detail & Related papers (2022-10-07T11:07:20Z) - Model-Guided Multi-Contrast Deep Unfolding Network for MRI
Super-resolution Reconstruction [68.80715727288514]
We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix.
In this paper, we propose a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction.
arXiv Detail & Related papers (2022-09-15T03:58:30Z) - Transformer-empowered Multi-scale Contextual Matching and Aggregation
for Multi-contrast MRI Super-resolution [55.52779466954026]
Multi-contrast super-resolution (SR) reconstruction is promising to yield SR images with higher quality.
Existing methods lack effective mechanisms to match and fuse these features for better reconstruction.
We propose a novel network to address these problems by developing a set of innovative Transformer-empowered multi-scale contextual matching and aggregation techniques.
arXiv Detail & Related papers (2022-03-26T01:42:59Z) - Multi-modal Aggregation Network for Fast MR Imaging [85.25000133194762]
We propose a novel Multi-modal Aggregation Network, named MANet, which is capable of discovering complementary representations from a fully sampled auxiliary modality.
In our MANet, the representations from the fully sampled auxiliary and undersampled target modalities are learned independently through a specific network.
Our MANet follows a hybrid domain learning framework, which allows it to simultaneously recover the frequency signal in the $k$-space domain.
arXiv Detail & Related papers (2021-10-15T13:16:59Z) - High-Resolution Pelvic MRI Reconstruction Using a Generative Adversarial
Network with Attention and Cyclic Loss [3.4358954898228604]
Super-resolution methods have shown excellent performance in accelerating MRI.
In some circumstances, it is difficult to obtain high-resolution images even with prolonged scan time.
We proposed a novel super-resolution method that uses a generative adversarial network (GAN) with cyclic loss and attention mechanism.
arXiv Detail & Related papers (2021-07-21T10:07:22Z) - ShuffleUNet: Super resolution of diffusion-weighted MRIs using deep
learning [47.68307909984442]
Single Image Super-Resolution (SISR) is a technique aimed to obtain high-resolution (HR) details from one single low-resolution input image.
Deep learning extracts prior knowledge from big datasets and produces superior MRI images from the low-resolution counterparts.
arXiv Detail & Related papers (2021-02-25T14:52:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.