Untrained Perceptual Loss for image denoising of line-like structures in MR images

• URL: http://arxiv.org/abs/2411.05884v1
• Date: Fri, 08 Nov 2024 10:05:14 GMT
• Title: Untrained Perceptual Loss for image denoising of line-like structures in MR images
• Authors: Elisabeth Pfaehler, Daniel Pflugfelder, Hanno Scharr,
• Abstract summary: In this paper, we translate the Perceptual Loss to 3D data by comparing feature maps of untrained networks in the loss function as done previously for 2D data. We tested the performance of untrained Perceptual Loss (uPL) on 3D image denoising of MR images displaying brain vessels (MR angiograms - MRA) and images of plant roots in soil.
• Score: 2.867517731896504
• License:
• Abstract: In the acquisition of Magnetic Resonance (MR) images shorter scan times lead to higher image noise. Therefore, automatic image denoising using deep learning methods is of high interest. MR images containing line-like structures such as roots or vessels yield special characteristics as they display connected structures and yield sparse information. For this kind of data, it is important to consider voxel neighborhoods when training a denoising network. In this paper, we translate the Perceptual Loss to 3D data by comparing feature maps of untrained networks in the loss function as done previously for 2D data. We tested the performance of untrained Perceptual Loss (uPL) on 3D image denoising of MR images displaying brain vessels (MR angiograms - MRA) and images of plant roots in soil. We investigate the impact of various uPL characteristics such as weight initialization, network depth, kernel size, and pooling operations on the results. We tested the performance of the uPL loss on four Rician noise levels using evaluation metrics such as the Structural Similarity Index Metric (SSIM). We observe, that our uPL outperforms conventional loss functions such as the L1 loss or a loss based on the Structural Similarity Index Metric (SSIM). The uPL network's initialization is not important, while network depth and pooling operations impact denoising performance. E.g. for both datasets a network with five convolutional layers led to the best performance while a network with more layers led to a performance drop. We also find that small uPL networks led to better or comparable results than using large networks such as VGG. We observe superior performance of our loss for both datasets, all noise levels, and three network architectures. In conclusion, for images containing line-like structures, uPL is an alternative to other loss functions for 3D image denoising.

Related papers

• Multi-Scale Texture Loss for CT denoising with GANs [0.9349653765341301]
  Generative Adversarial Networks (GANs) have proved as a powerful framework for denoising applications in medical imaging. This work presents a loss function that leverages the intrinsic multi-scale nature of the Gray-Level-Co-occurrence Matrix (GLCM) Our approach also introduces a self-attention layer that dynamically aggregates the multi-scale texture information extracted from the images.
  arXiv  Detail & Related papers  (2024-03-25T11:28:52Z)
• A cross Transformer for image denoising [83.68175077524111]
  We propose a cross Transformer denoising CNN (CTNet) with a serial block (SB), a parallel block (PB), and a residual block (RB) CTNet is superior to some popular denoising methods in terms of real and synthetic image denoising.
  arXiv  Detail & Related papers  (2023-10-16T13:53:19Z)
• Class Anchor Margin Loss for Content-Based Image Retrieval [97.81742911657497]
  We propose a novel repeller-attractor loss that falls in the metric learning paradigm, yet directly optimize for the L2 metric without the need of generating pairs. We evaluate the proposed objective in the context of few-shot and full-set training on the CBIR task, by using both convolutional and transformer architectures.
  arXiv  Detail & Related papers  (2023-06-01T12:53:10Z)
• Deep Semantic Statistics Matching (D2SM) Denoising Network [70.01091467628068]
  We introduce the Deep Semantic Statistics Matching (D2SM) Denoising Network. It exploits semantic features of pretrained classification networks, then it implicitly matches the probabilistic distribution of clear images at the semantic feature space. By learning to preserve the semantic distribution of denoised images, we empirically find our method significantly improves the denoising capabilities of networks.
  arXiv  Detail & Related papers  (2022-07-19T14:35:42Z)
• Reducing Redundancy in the Bottleneck Representation of the Autoencoders [98.78384185493624]
  Autoencoders are a type of unsupervised neural networks, which can be used to solve various tasks. We propose a scheme to explicitly penalize feature redundancies in the bottleneck representation. We tested our approach across different tasks: dimensionality reduction using three different dataset, image compression using the MNIST dataset, and image denoising using fashion MNIST.
  arXiv  Detail & Related papers  (2022-02-09T18:48:02Z)
• NeighCNN: A CNN based SAR Speckle Reduction using Feature preserving Loss Function [1.7188280334580193]
  NeighCNN is a deep learning-based speckle reduction algorithm that handles multiplicative noise. Various synthetic, as well as real SAR images, are used for testing the NeighCNN architecture.
  arXiv  Detail & Related papers  (2021-08-26T04:20:07Z)
• Dense Dilated UNet: Deep Learning for 3D Photoacoustic Tomography Image Reconstruction [1.5749416770494706]
  We propose a modified convolutional neural network (CNN) architecture termed Dense Dilation UNet (DD-UNet) for correcting artifacts in 3D photoacoustic tomography (PAT) We compare the proposed CNN in terms of image quality as measured by the multiscale structural similarity index metric to the Fully Dense UNet (FD-UNet) Results demonstrate that the DD-Net consistently outperforms the FD-UNet and is able to more reliably reconstruct smaller image features.
  arXiv  Detail & Related papers  (2021-04-07T14:01:48Z)
• A Retinex based GAN Pipeline to Utilize Paired and Unpaired Datasets for Enhancing Low Light Images [0.0]
  This paper presents a novel deep learning pipeline that can learn from both paired and unpaired datasets. CNNs that are optimized to minimize standard loss, and Generative Adversarial Networks (GANs) that are optimized to minimize the adversarial loss are used.
  arXiv  Detail & Related papers  (2020-06-27T07:12:21Z)
• Identity Enhanced Residual Image Denoising [61.75610647978973]
  We learn a fully-convolutional network model that consists of a Chain of Identity Mapping Modules and residual on the residual architecture for image denoising. The proposed network produces remarkably higher numerical accuracy and better visual image quality than the classical state-of-the-art and CNN algorithms.
  arXiv  Detail & Related papers  (2020-04-26T04:52:22Z)
• Attention Based Real Image Restoration [48.933507352496726]
  Deep convolutional neural networks perform better on images containing synthetic degradations. This paper proposes a novel single-stage blind real image restoration network (R$2$Net)
  arXiv  Detail & Related papers  (2020-04-26T04:21:49Z)
• Y-net: Multi-scale feature aggregation network with wavelet structure similarity loss function for single image dehazing [18.479856828292935]
  We propose a Y-net that is named for its structure. This network reconstructs clear images by aggregating multi-scale features maps. We also propose a Wavelet Structure SIMilarity (W-SSIM) loss function in the training step.
  arXiv  Detail & Related papers  (2020-03-31T02:07:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.