Two-stage Deep Denoising with Self-guided Noise Attention for Multimodal Medical Images

• URL: http://arxiv.org/abs/2503.06827v1
• Date: Mon, 10 Mar 2025 01:26:47 GMT
• Title: Two-stage Deep Denoising with Self-guided Noise Attention for Multimodal Medical Images
• Authors: S M A Sharif, Rizwan Ali Naqvi, Woong-Kee Loh,
• Abstract summary: This study addresses the limitation of the contemporary denoising methods with an artificial intelligence (AI)-driven two-stage learning strategy.<n>The proposed method learns to estimate the residual noise from the noisy images.<n>It incorporates a novel noise attention mechanism to correlate estimated residual noise with noisy inputs to perform denoising in a course-to-refine manner.
• Score: 8.643724626327852
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Medical image denoising is considered among the most challenging vision tasks. Despite the real-world implications, existing denoising methods have notable drawbacks as they often generate visual artifacts when applied to heterogeneous medical images. This study addresses the limitation of the contemporary denoising methods with an artificial intelligence (AI)-driven two-stage learning strategy. The proposed method learns to estimate the residual noise from the noisy images. Later, it incorporates a novel noise attention mechanism to correlate estimated residual noise with noisy inputs to perform denoising in a course-to-refine manner. This study also proposes to leverage a multi-modal learning strategy to generalize the denoising among medical image modalities and multiple noise patterns for widespread applications. The practicability of the proposed method has been evaluated with dense experiments. The experimental results demonstrated that the proposed method achieved state-of-the-art performance by significantly outperforming the existing medical image denoising methods in quantitative and qualitative comparisons. Overall, it illustrates a performance gain of 7.64 in Peak Signal-to-Noise Ratio (PSNR), 0.1021 in Structural Similarity Index (SSIM), 0.80 in DeltaE ($\Delta E$), 0.1855 in Visual Information Fidelity Pixel-wise (VIFP), and 18.54 in Mean Squared Error (MSE) metrics.

Related papers

• Neighboring Slice Noise2Noise: Self-Supervised Medical Image Denoising from Single Noisy Image Volume [12.077993066353294]
  We propose a novel self-supervised medical image denoising method, Neighboring Slice Noise2Noise (NS-N2N)<n>NS-N2N only requires a single noisy image volume obtained from one medical imaging procedure to achieve high-quality denoising of the image volume itself.
  arXiv  Detail & Related papers  (2024-11-16T16:24:28Z)
• Advancing Unsupervised Low-light Image Enhancement: Noise Estimation, Illumination Interpolation, and Self-Regulation [55.07472635587852]
  Low-Light Image Enhancement (LLIE) techniques have made notable advancements in preserving image details and enhancing contrast. These approaches encounter persistent challenges in efficiently mitigating dynamic noise and accommodating diverse low-light scenarios. We first propose a method for estimating the noise level in low light images in a quick and accurate way. We then devise a Learnable Illumination Interpolator (LII) to satisfy general constraints between illumination and input.
  arXiv  Detail & Related papers  (2023-05-17T13:56:48Z)
• The role of noise in denoising models for anomaly detection in medical images [62.0532151156057]
  Pathological brain lesions exhibit diverse appearance in brain images. Unsupervised anomaly detection approaches have been proposed using only normal data for training. We show that optimization of the spatial resolution and magnitude of the noise improves the performance of different model training regimes.
  arXiv  Detail & Related papers  (2023-01-19T21:39:38Z)
• Noise2Contrast: Multi-Contrast Fusion Enables Self-Supervised Tomographic Image Denoising [6.314790045423454]
  Noise2Contrast combines information from multiple measured image contrasts to train a denoising model. We stack denoising with domain-transfer operators to utilize the independent noise realizations of different image contrasts to derive a self-supervised loss. Our experiments on different real measured data sets indicate that Noise2Contrast generalizes to other multi-contrast imaging modalities.
  arXiv  Detail & Related papers  (2022-12-09T13:03:24Z)
• Zero-shot Blind Image Denoising via Implicit Neural Representations [77.79032012459243]
  We propose an alternative denoising strategy that leverages the architectural inductive bias of implicit neural representations (INRs) We show that our method outperforms existing zero-shot denoising methods under an extensive set of low-noise or real-noise scenarios.
  arXiv  Detail & Related papers  (2022-04-05T12:46:36Z)
• MR Image Denoising and Super-Resolution Using Regularized Reverse Diffusion [38.62448918459113]
  We propose a new denoising method based on score-based reverse diffusion sampling. Our network, trained only with coronal knee scans, excels even on out-of-distribution in vivo liver MRI data.
  arXiv  Detail & Related papers  (2022-03-23T10:35:06Z)
• IDR: Self-Supervised Image Denoising via Iterative Data Refinement [66.5510583957863]
  We present a practical unsupervised image denoising method to achieve state-of-the-art denoising performance. Our method only requires single noisy images and a noise model, which is easily accessible in practical raw image denoising. To evaluate raw image denoising performance in real-world applications, we build a high-quality raw image dataset SenseNoise-500 that contains 500 real-life scenes.
  arXiv  Detail & Related papers  (2021-11-29T07:22:53Z)
• ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising [3.796436257221662]
  We propose a novel image denoising scheme, Interdependent Self-Cooperative Learning (ISCL) ISCL combines cyclic adversarial learning with self-supervised residual learning. We demonstrate that ISCL is superior to conventional and current state-of-the-art deep learning-based image denoising methods.
  arXiv  Detail & Related papers  (2021-02-19T10:54:25Z)
• Suppression of Correlated Noise with Similarity-based Unsupervised Deep Learning [7.61850613267116]
  Noise2Sim is an unsupervised deep denoising approach that works in a nonlocal nonlinear fashion to suppress correlated noises. Nosie2Sim recovers features from noisy low-dose and photon-counting CT images as effectively as or even better than supervised learning methods.
  arXiv  Detail & Related papers  (2020-11-06T14:31:08Z)
• Unpaired Learning of Deep Image Denoising [80.34135728841382]
  This paper presents a two-stage scheme by incorporating self-supervised learning and knowledge distillation. For self-supervised learning, we suggest a dilated blind-spot network (D-BSN) to learn denoising solely from real noisy images. Experiments show that our unpaired learning method performs favorably on both synthetic noisy images and real-world noisy photographs.
  arXiv  Detail & Related papers  (2020-08-31T16:22:40Z)
• Improving Blind Spot Denoising for Microscopy [73.94017852757413]
  We present a novel way to improve the quality of self-supervised denoising. We assume the clean image to be the result of a convolution with a point spread function (PSF) and explicitly include this operation at the end of our neural network.
  arXiv  Detail & Related papers  (2020-08-19T13:06:24Z)
• Variational Denoising Network: Toward Blind Noise Modeling and Removal [59.36166491196973]
  Blind image denoising is an important yet very challenging problem in computer vision. We propose a new variational inference method, which integrates both noise estimation and image denoising.
  arXiv  Detail & Related papers  (2019-08-29T15:54:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.