Fast and Light-Weight Network for Single Frame Structured Illumination Microscopy Super-Resolution

• URL: http://arxiv.org/abs/2111.09103v1
• Date: Wed, 17 Nov 2021 13:39:41 GMT
• Title: Fast and Light-Weight Network for Single Frame Structured Illumination Microscopy Super-Resolution
• Authors: Xi Cheng, Jun Li, Qiang Dai, Zhenyong Fu, Jian Yang
• Abstract summary: We propose a single-frame structured illumination microscopy (SF-SIM) based on deep learning. Our method is almost 14 times faster than traditional SIM methods when achieving similar results.
• Score: 22.953512091536663
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Structured illumination microscopy (SIM) is an important super-resolution based microscopy technique that breaks the diffraction limit and enhances optical microscopy systems. With the development of biology and medical engineering, there is a high demand for real-time and robust SIM imaging under extreme low light and short exposure environments. Existing SIM techniques typically require multiple structured illumination frames to produce a high-resolution image. In this paper, we propose a single-frame structured illumination microscopy (SF-SIM) based on deep learning. Our SF-SIM only needs one shot of a structured illumination frame and generates similar results compared with the traditional SIM systems that typically require 15 shots. In our SF-SIM, we propose a noise estimator which can effectively suppress the noise in the image and enable our method to work under the low light and short exposure environment, without the need for stacking multiple frames for non-local denoising. We also design a bandpass attention module that makes our deep network more sensitive to the change of frequency and enhances the imaging quality. Our proposed SF-SIM is almost 14 times faster than traditional SIM methods when achieving similar results. Therefore, our method is significantly valuable for the development of microbiology and medicine.

Related papers

• A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
  Deep neural networks have shown great potential for reconstructing high-fidelity images from undersampled measurements. Our model is based on neural operators, a discretization-agnostic architecture. Our inference speed is also 1,400x faster than diffusion methods.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• MicroSSIM: Improved Structural Similarity for Comparing Microscopy Data [6.550912532749276]
  Structural Similarity (SSIM) is one of the most popular measures used in the field. We show that SSIM components behave unexpectedly when the prediction generated from low-SNR input is compared with the corresponding high-SNR data. We introduce MicroSSIM, a variant of SSIM, which overcomes the above-discussed issues.
  arXiv  Detail & Related papers  (2024-08-16T13:49:18Z)
• Hybrid-Supervised Dual-Search: Leveraging Automatic Learning for Loss-free Multi-Exposure Image Fusion [60.221404321514086]
  Multi-exposure image fusion (MEF) has emerged as a prominent solution to address the limitations of digital imaging in representing varied exposure levels. This paper presents a Hybrid-Supervised Dual-Search approach for MEF, dubbed HSDS-MEF, which introduces a bi-level optimization search scheme for automatic design of both network structures and loss functions.
  arXiv  Detail & Related papers  (2023-09-03T08:07:26Z)
• Fearless Luminance Adaptation: A Macro-Micro-Hierarchical Transformer for Exposure Correction [65.5397271106534]
  A single neural network is difficult to handle all exposure problems. In particular, convolutions hinder the ability to restore faithful color or details on extremely over-/under- exposed regions. We propose a Macro-Micro-Hierarchical transformer, which consists of a macro attention to capture long-range dependencies, a micro attention to extract local features, and a hierarchical structure for coarse-to-fine correction.
  arXiv  Detail & Related papers  (2023-09-02T09:07:36Z)
• Spatio-temporal Vision Transformer for Super-resolution Microscopy [2.8348950186890467]
  Structured illumination microscopy (SIM) is an optical super-resolution technique that enables live-cell imaging beyond the diffraction limit. We propose a new transformer-based reconstruction method, VSR-SIM, that uses shifted 3-dimensional window multi-head attention. We demonstrate a use case enabled by VSR-SIM referred to as rolling SIM imaging, which increases temporal resolution in SIM by a factor of 9.
  arXiv  Detail & Related papers  (2022-02-28T19:01:10Z)
• Subspace modeling for fast and high-sensitivity X-ray chemical imaging [4.062272647963248]
  The TXM-XANES imaging technique has been an emerging tool which operates by acquiring a series of microscopy images with multi-energy X-rays and fitting to obtain the chemical map. We introduce a simple and robust denoising approach to improve the image quality, which enables fast and high-sensitivity chemical imaging.
  arXiv  Detail & Related papers  (2022-01-01T23:26:06Z)
• Burst Imaging for Light-Constrained Structure-From-Motion [4.125187280299246]
  We develop an image processing technique for aiding 3D reconstruction from images acquired in low light conditions. Our technique, based on burst photography, uses direct methods for image registration within bursts of short exposure time images. Our method is a significant step towards allowing robots to operate in low light conditions, with potential applications to robots operating in environments such as underground mines and night time operation.
  arXiv  Detail & Related papers  (2021-08-23T02:12:40Z)
• Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution [51.274657266928315]
  We propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors. Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters.
  arXiv  Detail & Related papers  (2021-04-07T12:00:38Z)
• Recurrent Exposure Generation for Low-Light Face Detection [113.25331155337759]
  We propose a novel Recurrent Exposure Generation (REG) module and a Multi-Exposure Detection (MED) module. REG produces progressively and efficiently intermediate images corresponding to various exposure settings. Such pseudo-exposures are then fused by MED to detect faces across different lighting conditions.
  arXiv  Detail & Related papers  (2020-07-21T17:30:51Z)
• Single Image Brightening via Multi-Scale Exposure Fusion with Hybrid Learning [48.890709236564945]
  A small ISO and a small exposure time are usually used to capture an image in the back or low light conditions. In this paper, a single image brightening algorithm is introduced to brighten such an image. The proposed algorithm includes a unique hybrid learning framework to generate two virtual images with large exposure times.
  arXiv  Detail & Related papers  (2020-07-04T08:23:07Z)
• ML-SIM: A deep neural network for reconstruction of structured illumination microscopy images [0.0]
  Structured illumination microscopy (SIM) has become an important technique for optical super-resolution imaging. Here we propose a versatile reconstruction method, ML-SIM, which makes use of machine learning. ML-SIM is thus robust to noise and irregularities in the illumination patterns of the raw SIM input frames.
  arXiv  Detail & Related papers  (2020-03-24T18:42:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.