LUCYD: A Feature-Driven Richardson-Lucy Deconvolution Network
- URL: http://arxiv.org/abs/2307.07998v1
- Date: Sun, 16 Jul 2023 10:34:23 GMT
- Title: LUCYD: A Feature-Driven Richardson-Lucy Deconvolution Network
- Authors: Tom\'a\v{s} Chobola, Gesine M\"uller, Veit Dausmann, Anton Theileis,
Jan Taucher, Jan Huisken, Tingying Peng
- Abstract summary: This paper proposes LUCYD, a novel method for the restoration of volumetric microscopy images.
Lucyd combines the Richardson-Lucy deconvolution formula and the fusion of deep features obtained by a fully convolutional network.
Our experiments indicate that LUCYD can significantly improve resolution, contrast, and overall quality of microscopy images.
- Score: 0.31402652384742363
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The process of acquiring microscopic images in life sciences often results in
image degradation and corruption, characterised by the presence of noise and
blur, which poses significant challenges in accurately analysing and
interpreting the obtained data. This paper proposes LUCYD, a novel method for
the restoration of volumetric microscopy images that combines the
Richardson-Lucy deconvolution formula and the fusion of deep features obtained
by a fully convolutional network. By integrating the image formation process
into a feature-driven restoration model, the proposed approach aims to enhance
the quality of the restored images whilst reducing computational costs and
maintaining a high degree of interpretability. Our results demonstrate that
LUCYD outperforms the state-of-the-art methods in both synthetic and real
microscopy images, achieving superior performance in terms of image quality and
generalisability. We show that the model can handle various microscopy
modalities and different imaging conditions by evaluating it on two different
microscopy datasets, including volumetric widefield and light-sheet microscopy.
Our experiments indicate that LUCYD can significantly improve resolution,
contrast, and overall quality of microscopy images. Therefore, it can be a
valuable tool for microscopy image restoration and can facilitate further
research in various microscopy applications. We made the source code for the
model accessible under https://github.com/ctom2/lucyd-deconvolution.
Related papers
- Style transfer between Microscopy and Magnetic Resonance Imaging via
Generative Adversarial Network in small sample size settings [49.84018914962972]
Cross-modal augmentation of Magnetic Resonance Imaging (MRI) and microscopic imaging based on the same tissue samples is promising.
We tested a method for generating microscopic histological images from MRI scans of the corpus callosum using conditional generative adversarial network (cGAN) architecture.
arXiv Detail & Related papers (2023-10-16T13:58:53Z) - DeepContrast: Deep Tissue Contrast Enhancement using Synthetic Data
Degradations and OOD Model Predictions [6.550912532749276]
We propose a new method to counteract blurring and contrast loss in microscopy images.
We first synthetically degraded the quality of microscopy images even further by using an approximate forward model for deep tissue image degradations.
We trained a neural network that learned the inverse of this degradation function from our generated pairs of raw and degraded images.
arXiv Detail & Related papers (2023-08-16T13:40:01Z) - Phenotype-preserving metric design for high-content image reconstruction
by generative inpainting [0.0]
We evaluate the state-of-the-art inpainting methods for image restoration in a high-content fluorescence microscopy dataset of cultured cells.
We show that architectures like DeepFill V2 and Edge Connect can faithfully restore microscopy images upon fine-tuning with relatively little data.
arXiv Detail & Related papers (2023-07-26T18:13:16Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - Optimizations of Autoencoders for Analysis and Classification of
Microscopic In Situ Hybridization Images [68.8204255655161]
We propose a deep-learning framework to detect and classify areas of microscopic images with similar levels of gene expression.
The data we analyze requires an unsupervised learning model for which we employ a type of Artificial Neural Network - Deep Learning Autoencoders.
arXiv Detail & Related papers (2023-04-19T13:45:28Z) - Learning multi-scale functional representations of proteins from
single-cell microscopy data [77.34726150561087]
We show that simple convolutional networks trained on localization classification can learn protein representations that encapsulate diverse functional information.
We also propose a robust evaluation strategy to assess quality of protein representations across different scales of biological function.
arXiv Detail & Related papers (2022-05-24T00:00:07Z) - A parameter refinement method for Ptychography based on Deep Learning
concepts [55.41644538483948]
coarse parametrisation in propagation distance, position errors and partial coherence frequently menaces the experiment viability.
A modern Deep Learning framework is used to correct autonomously the setup incoherences, thus improving the quality of a ptychography reconstruction.
We tested our system on both synthetic datasets and also on real data acquired at the TwinMic beamline of the Elettra synchrotron facility.
arXiv Detail & Related papers (2021-05-18T10:15:17Z) - Deep learning-based super-resolution fluorescence microscopy on small
datasets [20.349746411933495]
Deep learning has shown the potentials to reduce the technical barrier and obtain super-resolution from diffraction-limited images.
We demonstrate a new convolutional neural network-based approach that is successfully trained with small datasets and super-resolution images.
This model can be applied to other biomedical imaging modalities such as MRI and X-ray imaging, where obtaining large training datasets is challenging.
arXiv Detail & Related papers (2021-03-07T03:17:47Z) - Reconstructing undersampled photoacoustic microscopy images using deep
learning [11.74890470096844]
We propose a novel application of deep learning principles to reconstruct undersampled PAM images.
Our results have collectively demonstrated the robust performance of our model to reconstruct PAM images with as few as 2% of the original pixels.
arXiv Detail & Related papers (2020-05-30T12:39:52Z) - Modeling and Enhancing Low-quality Retinal Fundus Images [167.02325845822276]
Low-quality fundus images increase uncertainty in clinical observation and lead to the risk of misdiagnosis.
We propose a clinically oriented fundus enhancement network (cofe-Net) to suppress global degradation factors.
Experiments on both synthetic and real images demonstrate that our algorithm effectively corrects low-quality fundus images without losing retinal details.
arXiv Detail & Related papers (2020-05-12T08:01:16Z) - Physics-enhanced machine learning for virtual fluorescence microscopy [3.7817498232858857]
This paper introduces a new method of data-driven microscope design for virtual fluorescence microscopy.
By including a model of illumination within the first layers of a deep convolutional neural network, it is possible to learn task-specific LED patterns.
arXiv Detail & Related papers (2020-04-09T00:17:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.