Fluctuation-based deconvolution in fluorescence microscopy using plug-and-play denoisers

• URL: http://arxiv.org/abs/2303.11212v1
• Date: Mon, 20 Mar 2023 15:43:52 GMT
• Title: Fluctuation-based deconvolution in fluorescence microscopy using plug-and-play denoisers
• Authors: Vasiliki Stergiopoulou, Subhadip Mukherjee, Luca Calatroni, Laure Blanc-F\'eraud
• Abstract summary: spatial resolution of images of living samples obtained by fluorescence microscopes is physically limited due to the diffraction of visible light. Several deconvolution and super-resolution techniques have been proposed to overcome this limitation.
• Score: 2.236663830879273
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The spatial resolution of images of living samples obtained by fluorescence microscopes is physically limited due to the diffraction of visible light, which makes the study of entities of size less than the diffraction barrier (around 200 nm in the x-y plane) very challenging. To overcome this limitation, several deconvolution and super-resolution techniques have been proposed. Within the framework of inverse problems, modern approaches in fluorescence microscopy reconstruct a super-resolved image from a temporal stack of frames by carefully designing suitable hand-crafted sparsity-promoting regularisers. Numerically, such approaches are solved by proximal gradient-based iterative schemes. Aiming at obtaining a reconstruction more adapted to sample geometries (e.g. thin filaments), we adopt a plug-and-play denoising approach with convergence guarantees and replace the proximity operator associated with the explicit image regulariser with an image denoiser (i.e. a pre-trained network) which, upon appropriate training, mimics the action of an implicit prior. To account for the independence of the fluctuations between molecules, the model relies on second-order statistics. The denoiser is then trained on covariance images coming from data representing sequences of fluctuating fluorescent molecules with filament structure. The method is evaluated on both simulated and real fluorescence microscopy images, showing its ability to correctly reconstruct filament structures with high values of peak signal-to-noise ratio (PSNR).

Related papers

• Oscillation Inversion: Understand the structure of Large Flow Model through the Lens of Inversion Method [60.88467353578118]
  We show that a fixed-point-inspired iterative approach to invert real-world images does not achieve convergence, instead oscillating between distinct clusters. We introduce a simple and fast distribution transfer technique that facilitates image enhancement, stroke-based recoloring, as well as visual prompt-guided image editing.
  arXiv  Detail & Related papers  (2024-11-17T17:45:37Z)
• Diff-FMT: Diffusion Models for Fluorescence Molecular Tomography [16.950699640321936]
  We propose a FMT reconstruction method based on a denoising diffusion probabilistic model (DDPM) Through the step-by-step probability sampling mechanism, we achieve fine-grained reconstruction of the image, avoiding issues such as loss of image detail. We show that Diff-FMT can achieve high-resolution reconstruction images without relying on large-scale datasets.
  arXiv  Detail & Related papers  (2024-10-09T10:41:31Z)
• Fearless Luminance Adaptation: A Macro-Micro-Hierarchical Transformer for Exposure Correction [65.5397271106534]
  A single neural network is difficult to handle all exposure problems. In particular, convolutions hinder the ability to restore faithful color or details on extremely over-/under- exposed regions. We propose a Macro-Micro-Hierarchical transformer, which consists of a macro attention to capture long-range dependencies, a micro attention to extract local features, and a hierarchical structure for coarse-to-fine correction.
  arXiv  Detail & Related papers  (2023-09-02T09:07:36Z)
• Image Denoising and the Generative Accumulation of Photons [63.14988413396991]
  We show that a network trained to predict where the next photon could arrive is in fact solving the minimum mean square error (MMSE) denoising task. We present a new strategy for self-supervised denoising. We present a new method for sampling from the posterior of possible solutions by iteratively sampling and adding small numbers of photons to the image.
  arXiv  Detail & Related papers  (2023-07-13T08:03:32Z)
• DeStripe: A Self2Self Spatio-Spectral Graph Neural Network with Unfolded Hessian for Stripe Artifact Removal in Light-sheet Microscopy [40.223974943121874]
  We propose a blind artifact removal algorithm in light-sheet fluorescence microscopy (LSFM) called DeStripe. DeStripe localizes the potentially corrupted coefficients by exploiting the structural difference between unidirectional artifacts and foreground images. Affected coefficients can then be fed into a graph neural network for recovery with a Hessian regularization unrolled to further ensure structures in the standard image space are well preserved.
  arXiv  Detail & Related papers  (2022-06-27T16:13:57Z)
• Learning Discriminative Shrinkage Deep Networks for Image Deconvolution [122.79108159874426]
  We propose an effective non-blind deconvolution approach by learning discriminative shrinkage functions to implicitly model these terms. Experimental results show that the proposed method performs favorably against the state-of-the-art ones in terms of efficiency and accuracy.
  arXiv  Detail & Related papers  (2021-11-27T12:12:57Z)
• Regularization by Denoising Sub-sampled Newton Method for Spectral CT Multi-Material Decomposition [78.37855832568569]
  We propose to solve a model-based maximum-a-posterior problem to reconstruct multi-materials images with application to spectral CT. In particular, we propose to solve a regularized optimization problem based on a plug-in image-denoising function. We show numerical and experimental results for spectral CT materials decomposition.
  arXiv  Detail & Related papers  (2021-03-25T15:20:10Z)
• Spatially-Variant CNN-based Point Spread Function Estimation for Blind Deconvolution and Depth Estimation in Optical Microscopy [6.09170287691728]
  We present a method that improves the resolution of light microscopy images of thin, yet non-flat objects. We estimate the parameters of a spatially-variant Point-Spread function (PSF) model using a Convolutional Neural Network (CNN) Our method recovers PSF parameters from the image itself with up to a squared Pearson correlation coefficient of 0.99 in ideal conditions.
  arXiv  Detail & Related papers  (2020-10-08T14:20:16Z)
• Distributed optimization for nonrigid nano-tomography [0.40631409309544836]
  We propose a joint solver for imaging samples at the nanoscale with projection alignment, unwarping and regularization. Projection data consistency is regulated by dense optical flow estimated by Farneback's algorithm, leading to sharp sample reconstructions with less artifacts.
  arXiv  Detail & Related papers  (2020-07-11T19:22:43Z)
• Hyperspectral-Multispectral Image Fusion with Weighted LASSO [68.04032419397677]
  We propose an approach for fusing hyperspectral and multispectral images to provide high-quality hyperspectral output. We demonstrate that the proposed sparse fusion and reconstruction provides quantitatively superior results when compared to existing methods on publicly available images.
  arXiv  Detail & Related papers  (2020-03-15T23:07:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.