A 3D Conditional Diffusion Model for Image Quality Transfer -- An Application to Low-Field MRI

• URL: http://arxiv.org/abs/2311.06631v1
• Date: Sat, 11 Nov 2023 18:30:56 GMT
• Title: A 3D Conditional Diffusion Model for Image Quality Transfer -- An Application to Low-Field MRI
• Authors: Seunghoi Kim, Henry F. J. Tregidgo, Ahmed K. Eldaly, Matteo Figini, Daniel C. Alexander
• Abstract summary: Low-field (LF) MRI scanners are still prevalent in settings with limited resources or unreliable power supply. They often yield images with lower spatial resolution and contrast than high-field (HF) scanners. Image Quality Transfer (IQT) has been developed to enhance the quality of images by learning a mapping function between low and high-quality images.
• Score: 3.1342829196938937
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Low-field (LF) MRI scanners (<1T) are still prevalent in settings with limited resources or unreliable power supply. However, they often yield images with lower spatial resolution and contrast than high-field (HF) scanners. This quality disparity can result in inaccurate clinician interpretations. Image Quality Transfer (IQT) has been developed to enhance the quality of images by learning a mapping function between low and high-quality images. Existing IQT models often fail to restore high-frequency features, leading to blurry output. In this paper, we propose a 3D conditional diffusion model to improve 3D volumetric data, specifically LF MR images. Additionally, we incorporate a cross-batch mechanism into the self-attention and padding of our network, ensuring broader contextual awareness even under small 3D patches. Experiments on the publicly available Human Connectome Project (HCP) dataset for IQT and brain parcellation demonstrate that our model outperforms existing methods both quantitatively and qualitatively. The code is publicly available at \url{https://github.com/edshkim98/DiffusionIQT}.

Related papers

• DP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the Wild [54.139923409101044]
  We propose a novel IQA method called diffusion priors-based IQA (DP-IQA) We use pre-trained stable diffusion as the backbone, extract multi-level features from the denoising U-Net, and decode them to estimate the image quality score. We distill the knowledge in the above model into a CNN-based student model, significantly reducing the parameter to enhance applicability.
  arXiv  Detail & Related papers  (2024-05-30T12:32:35Z)
• Autoregressive Image Diffusion: Generation of Image Sequence and Application in MRI [2.0318411357438086]
  Generative models learn image distributions and can be used to reconstruct high-quality images from undersampled k-space data. We present the autoregressive image diffusion (AID) model for image sequences and use it to sample the posterior for accelerated MRI reconstruction.
  arXiv  Detail & Related papers  (2024-05-23T08:57:10Z)
• QSMDiff: Unsupervised 3D Diffusion Models for Quantitative Susceptibility Mapping [12.629091097618792]
  Quantitative Susceptibility Mapping (QSM) is an inverse problem for magnetic susceptibility distributions from MRI tissue phases. Recent developments in diffusion models have demonstrated potential for solving 2D medical imaging inverse problems. We developed a 3D image patch-based diffusion model, namely QSMDiff, for robust QSM reconstruction across different scan parameters.
  arXiv  Detail & Related papers  (2024-03-21T01:37:50Z)
• Disruptive Autoencoders: Leveraging Low-level features for 3D Medical Image Pre-training [51.16994853817024]
  This work focuses on designing an effective pre-training framework for 3D radiology images. We introduce Disruptive Autoencoders, a pre-training framework that attempts to reconstruct the original image from disruptions created by a combination of local masking and low-level perturbations. The proposed pre-training framework is tested across multiple downstream tasks and achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-07-31T17:59:42Z)
• Low-field magnetic resonance image enhancement via stochastic image quality transfer [5.0300525464861385]
  Low-field (1T) magnetic resonance imaging (MRI) scanners remain in widespread use in low- and middle-income countries (LMICs) Low-field MR images commonly have lower resolution and poorer contrast than images from high field (1.5T, 3T, and above) Here, we present Image Quality Transfer (IQT) to enhance low-field structural MRI by estimating from a low-field image the image we would have obtained from the same subject at high field.
  arXiv  Detail & Related papers  (2023-04-26T08:52:29Z)
• NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion [107.67277084886929]
  Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the input. We propose NerfDiff, which addresses this issue by distilling the knowledge of a 3D-aware conditional diffusion model (CDM) into NeRF through synthesizing and refining a set of virtual views at test time. We further propose a novel NeRF-guided distillation algorithm that simultaneously generates 3D consistent virtual views from the CDM samples, and finetunes the NeRF based on the improved virtual views.
  arXiv  Detail & Related papers  (2023-02-20T17:12:00Z)
• SOUP-GAN: Super-Resolution MRI Using Generative Adversarial Networks [9.201328999176402]
  We propose a framework called SOUP-GAN: Super-resolution Optimized Using Perceptual-tuned Generative Adversarial Network (GAN) Our model shows promise as a novel 3D SR technique, providing potential applications in both clinical and research settings.
  arXiv  Detail & Related papers  (2021-06-04T16:59:23Z)
• 3D Convolutional Neural Networks for Stalled Brain Capillary Detection [72.21315180830733]
  Brain vasculature dysfunctions such as stalled blood flow in cerebral capillaries are associated with cognitive decline and pathogenesis in Alzheimer's disease. Here, we describe a deep learning-based approach for automatic detection of stalled capillaries in brain images based on 3D convolutional neural networks. In this setting, our approach outperformed other methods and demonstrated state-of-the-art results, achieving 0.85 Matthews correlation coefficient, 85% sensitivity, and 99.3% specificity.
  arXiv  Detail & Related papers  (2021-04-04T20:30:14Z)
• Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans [72.04652116817238]
  We propose a differentiable neural architecture search (DNAS) framework to automatically search for the 3D DL models for 3D chest CT scans classification. We also exploit the Class Activation Mapping (CAM) technique on our models to provide the interpretability of the results.
  arXiv  Detail & Related papers  (2021-01-14T03:45:01Z)
• Hierarchical Amortized Training for Memory-efficient High Resolution 3D GAN [52.851990439671475]
  We propose a novel end-to-end GAN architecture that can generate high-resolution 3D images. We achieve this goal by using different configurations between training and inference. Experiments on 3D thorax CT and brain MRI demonstrate that our approach outperforms state of the art in image generation.
  arXiv  Detail & Related papers  (2020-08-05T02:33:04Z)
• Image Quality Transfer Enhances Contrast and Resolution of Low-Field Brain MRI in African Paediatric Epilepsy Patients [1.8884732354822316]
  1.5T or 3T scanners are the current standard for clinical MRI, but low-field (1T) scanners are still common in many lower- and middle-income countries. Low-field scanners provide images with lower signal-to-noise ratio at equivalent resolution. Recent paradigm of Image Quality Transfer has been applied to enhance 0.36T structural images.
  arXiv  Detail & Related papers  (2020-03-16T13:46:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.