Advancing biological super-resolution microscopy through deep learning: a brief review

• URL: http://arxiv.org/abs/2106.13064v1
• Date: Thu, 24 Jun 2021 14:44:23 GMT
• Title: Advancing biological super-resolution microscopy through deep learning: a brief review
• Authors: Tianjie Yang, Yaoru Luo, Wei Ji and Ge Yang
• Abstract summary: Super-resolution microscopy overcomes the diffraction limit of conventional light microscopy in spatial resolution. Deep learning has achieved breakthrough performance in image processing and computer vision. We focus on how deep learning advances reconstruction of super-resolution images.
• Score: 5.677138915301383
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Super-resolution microscopy overcomes the diffraction limit of conventional light microscopy in spatial resolution. By providing novel spatial or spatio-temporal information on biological processes at nanometer resolution with molecular specificity, it plays an increasingly important role in life sciences. However, its technical limitations require trade-offs to balance its spatial resolution, temporal resolution, and light exposure of samples. Recently, deep learning has achieved breakthrough performance in many image processing and computer vision tasks. It has also shown great promise in pushing the performance envelope of super-resolution microscopy. In this brief Review, we survey recent advances in using deep learning to enhance performance of super-resolution microscopy. We focus primarily on how deep learning ad-vances reconstruction of super-resolution images. Related key technical challenges are discussed. Despite the challenges, deep learning is set to play an indispensable and transformative role in the development of super-resolution microscopy. We conclude with an outlook on how deep learning could shape the future of this new generation of light microscopy technology.

Related papers

• SaccadeDet: A Novel Dual-Stage Architecture for Rapid and Accurate Detection in Gigapixel Images [50.742420049839474]
  'SaccadeDet' is an innovative architecture for gigapixel-level object detection, inspired by the human eye saccadic movement. Our approach, evaluated on the PANDA dataset, achieves an 8x speed increase over the state-of-the-art methods. It also demonstrates significant potential in gigapixel-level pathology analysis through its application to Whole Slide Imaging.
  arXiv  Detail & Related papers  (2024-07-25T11:22:54Z)
• Quantum light microscopy [0.0]
  Much of our progress in understanding microscale biology has been powered by advances in microscopy. Super-resolution microscopes allow the observation of biological structures at near-atomic-scale resolution. Multi-photon microscopes allow imaging deep into tissue. Quantum effects can provide new ways to enhance the performance of microscopes.
  arXiv  Detail & Related papers  (2023-11-10T00:44:58Z)
• Fluorescent Neuronal Cells v2: Multi-Task, Multi-Format Annotations for Deep Learning in Microscopy [44.62475518267084]
  This dataset encompasses three image collections in which rodent neuronal cells' nuclei and cytoplasm are stained with diverse markers. Alongside the images, we provide ground-truth annotations for several learning tasks, including semantic segmentation, object detection, and counting.
  arXiv  Detail & Related papers  (2023-07-26T15:14:10Z)
• LUCYD: A Feature-Driven Richardson-Lucy Deconvolution Network [0.31402652384742363]
  This paper proposes LUCYD, a novel method for the restoration of volumetric microscopy images. Lucyd combines the Richardson-Lucy deconvolution formula and the fusion of deep features obtained by a fully convolutional network. Our experiments indicate that LUCYD can significantly improve resolution, contrast, and overall quality of microscopy images.
  arXiv  Detail & Related papers  (2023-07-16T10:34:23Z)
• Passive superresolution imaging of incoherent objects [63.942632088208505]
  Method consists of measuring the field's spatial mode components in the image plane in the overcomplete basis of Hermite-Gaussian modes and their superpositions. Deep neural network is used to reconstruct the object from these measurements.
  arXiv  Detail & Related papers  (2023-04-19T15:53:09Z)
• Widefield quantum microscopy with nitrogen-vacancy centers in diamond: strengths, limitations, and prospects [0.0]
  A dense layer of nitrogen-vacancy centers near the surface of a diamond can be interrogated in a widefield optical microscope. Technology has seen rapid development and demonstration of applications in various areas across condensed matter physics, geoscience and biology.
  arXiv  Detail & Related papers  (2021-08-13T04:52:06Z)
• A parameter refinement method for Ptychography based on Deep Learning concepts [55.41644538483948]
  coarse parametrisation in propagation distance, position errors and partial coherence frequently menaces the experiment viability. A modern Deep Learning framework is used to correct autonomously the setup incoherences, thus improving the quality of a ptychography reconstruction. We tested our system on both synthetic datasets and also on real data acquired at the TwinMic beamline of the Elettra synchrotron facility.
  arXiv  Detail & Related papers  (2021-05-18T10:15:17Z)
• Deep learning-based super-resolution fluorescence microscopy on small datasets [20.349746411933495]
  Deep learning has shown the potentials to reduce the technical barrier and obtain super-resolution from diffraction-limited images. We demonstrate a new convolutional neural network-based approach that is successfully trained with small datasets and super-resolution images. This model can be applied to other biomedical imaging modalities such as MRI and X-ray imaging, where obtaining large training datasets is challenging.
  arXiv  Detail & Related papers  (2021-03-07T03:17:47Z)
• Deep Learning-based Face Super-resolution: A Survey [78.11274281686246]
  Face super-resolution, also known as face hallucination, is a domain-specific image super-resolution problem. To date, few summaries of the studies on the deep learning-based face super-resolution are available. In this survey, we present a comprehensive review of deep learning techniques in face super-resolution in a systematic manner.
  arXiv  Detail & Related papers  (2021-01-11T08:17:11Z)
• Global Voxel Transformer Networks for Augmented Microscopy [54.730707387866076]
  We introduce global voxel transformer networks (GVTNets), an advanced deep learning tool for augmented microscopy. GVTNets are built on global voxel transformer operators (GVTOs), which are able to aggregate global information. We apply the proposed methods on existing datasets for three different augmented microscopy tasks under various settings.
  arXiv  Detail & Related papers  (2020-08-05T20:11:15Z)
• Physics-enhanced machine learning for virtual fluorescence microscopy [3.7817498232858857]
  This paper introduces a new method of data-driven microscope design for virtual fluorescence microscopy. By including a model of illumination within the first layers of a deep convolutional neural network, it is possible to learn task-specific LED patterns.
  arXiv  Detail & Related papers  (2020-04-09T00:17:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.