Generalizable Denoising of Microscopy Images using Generative Adversarial Networks and Contrastive Learning

• URL: http://arxiv.org/abs/2303.15214v2
• Date: Wed, 29 Mar 2023 16:51:15 GMT
• Title: Generalizable Denoising of Microscopy Images using Generative Adversarial Networks and Contrastive Learning
• Authors: Felix Fuentes-Hurtado, Jean-Baptiste Sibarita, Virgile Viasnoff
• Abstract summary: We propose a novel framework for few-shot microscopy image denoising. Our approach combines a generative adversarial network (GAN) trained via contrastive learning (CL) with two structure preserving loss terms. We demonstrate the effectiveness of our method on three well-known microscopy imaging datasets.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Microscopy images often suffer from high levels of noise, which can hinder further analysis and interpretation. Content-aware image restoration (CARE) methods have been proposed to address this issue, but they often require large amounts of training data and suffer from over-fitting. To overcome these challenges, we propose a novel framework for few-shot microscopy image denoising. Our approach combines a generative adversarial network (GAN) trained via contrastive learning (CL) with two structure preserving loss terms (Structural Similarity Index and Total Variation loss) to further improve the quality of the denoised images using little data. We demonstrate the effectiveness of our method on three well-known microscopy imaging datasets, and show that we can drastically reduce the amount of training data while retaining the quality of the denoising, thus alleviating the burden of acquiring paired data and enabling few-shot learning. The proposed framework can be easily extended to other image restoration tasks and has the potential to significantly advance the field of microscopy image analysis.

Related papers

• Semantic Ensemble Loss and Latent Refinement for High-Fidelity Neural Image Compression [58.618625678054826]
  This study presents an enhanced neural compression method designed for optimal visual fidelity. We have trained our model with a sophisticated semantic ensemble loss, integrating Charbonnier loss, perceptual loss, style loss, and a non-binary adversarial loss. Our empirical findings demonstrate that this approach significantly improves the statistical fidelity of neural image compression.
  arXiv  Detail & Related papers  (2024-01-25T08:11:27Z)
• M2DF: Multi-grained Multi-curriculum Denoising Framework for Multimodal Aspect-based Sentiment Analysis [32.9772577419091]
  Multimodal Aspect-based Sentiment Analysis (MABSA) is a fine-grained Sentiment Analysis task. We propose a Multi-grained Multi-curriculum Denoising Framework (M2DF) which can achieve denoising by adjusting the order of training data. Our framework consistently outperforms state-of-the-art work on three sub-tasks of MABSA.
  arXiv  Detail & Related papers  (2023-10-23T06:22:39Z)
• Disruptive Autoencoders: Leveraging Low-level features for 3D Medical Image Pre-training [51.16994853817024]
  This work focuses on designing an effective pre-training framework for 3D radiology images. We introduce Disruptive Autoencoders, a pre-training framework that attempts to reconstruct the original image from disruptions created by a combination of local masking and low-level perturbations. The proposed pre-training framework is tested across multiple downstream tasks and achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-07-31T17:59:42Z)
• Domain-Aware Few-Shot Learning for Optical Coherence Tomography Noise Reduction [0.0]
  We propose a few-shot supervised learning framework for optical coherence tomography ( OCT) noise reduction. This framework offers a dramatic increase in training speed and requires only a single image, or part of an image, and a corresponding speckle suppressed ground truth. Our results demonstrate significant potential for improving sample complexity, generalization, and time efficiency.
  arXiv  Detail & Related papers  (2023-06-13T19:46:40Z)
• Deep Semantic Statistics Matching (D2SM) Denoising Network [70.01091467628068]
  We introduce the Deep Semantic Statistics Matching (D2SM) Denoising Network. It exploits semantic features of pretrained classification networks, then it implicitly matches the probabilistic distribution of clear images at the semantic feature space. By learning to preserve the semantic distribution of denoised images, we empirically find our method significantly improves the denoising capabilities of networks.
  arXiv  Detail & Related papers  (2022-07-19T14:35:42Z)
• Real-World Image Super-Resolution by Exclusionary Dual-Learning [98.36096041099906]
  Real-world image super-resolution is a practical image restoration problem that aims to obtain high-quality images from in-the-wild input. Deep learning-based methods have achieved promising restoration quality on real-world image super-resolution datasets. We propose Real-World image Super-Resolution by Exclusionary Dual-Learning (RWSR-EDL) to address the feature diversity in perceptual- and L1-based cooperative learning.
  arXiv  Detail & Related papers  (2022-06-06T13:28:15Z)
• Data augmentation for deep learning based accelerated MRI reconstruction with limited data [46.44703053411933]
  Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. To achieve state-of-the-art performance, training on large and diverse sets of images is considered critical. We propose a pipeline for data augmentation for accelerated MRI reconstruction and study its effectiveness at reducing the required training data.
  arXiv  Detail & Related papers  (2021-06-28T19:08:46Z)
• ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising [3.796436257221662]
  We propose a novel image denoising scheme, Interdependent Self-Cooperative Learning (ISCL) ISCL combines cyclic adversarial learning with self-supervised residual learning. We demonstrate that ISCL is superior to conventional and current state-of-the-art deep learning-based image denoising methods.
  arXiv  Detail & Related papers  (2021-02-19T10:54:25Z)
• Improving Blind Spot Denoising for Microscopy [73.94017852757413]
  We present a novel way to improve the quality of self-supervised denoising. We assume the clean image to be the result of a convolution with a point spread function (PSF) and explicitly include this operation at the end of our neural network.
  arXiv  Detail & Related papers  (2020-08-19T13:06:24Z)
• Deep Residual Dense U-Net for Resolution Enhancement in Accelerated MRI Acquisition [19.422926534305837]
  We propose a deep-learning approach, aiming at reconstructing high-quality images from accelerated MRI acquisition. Specifically, we use Convolutional Neural Network (CNN) to learn the differences between the aliased images and the original images. Considering the peculiarity of the down-sampled k-space data, we introduce a new term to the loss function in learning, which effectively employs the given k-space data.
  arXiv  Detail & Related papers  (2020-01-13T19:01:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.