eFIN: Enhanced Fourier Imager Network for generalizable autofocusing and pixel super-resolution in holographic imaging

• URL: http://arxiv.org/abs/2301.03162v1
• Date: Mon, 9 Jan 2023 04:12:10 GMT
• Title: eFIN: Enhanced Fourier Imager Network for generalizable autofocusing and pixel super-resolution in holographic imaging
• Authors: Hanlong Chen, Luzhe Huang, Tairan Liu, Aydogan Ozcan
• Abstract summary: We introduce a deep neural network termed enhanced Fourier Imager Network (eFIN) as a framework for hologram reconstruction with pixel super-resolution and image autofocusing. eFIN has a superior image reconstruction quality and exhibits external generalization to new types of samples never seen during the training phase. eFIN enables 3x pixel super-resolution imaging and increases the space-bandwidth product of the reconstructed images by 9-fold with almost no performance loss.
• Score: 0.30586855806896046
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The application of deep learning techniques has greatly enhanced holographic imaging capabilities, leading to improved phase recovery and image reconstruction. Here, we introduce a deep neural network termed enhanced Fourier Imager Network (eFIN) as a highly generalizable framework for hologram reconstruction with pixel super-resolution and image autofocusing. Through holographic microscopy experiments involving lung, prostate and salivary gland tissue sections and Papanicolau (Pap) smears, we demonstrate that eFIN has a superior image reconstruction quality and exhibits external generalization to new types of samples never seen during the training phase. This network achieves a wide autofocusing axial range of 0.35 mm, with the capability to accurately predict the hologram axial distances by physics-informed learning. eFIN enables 3x pixel super-resolution imaging and increases the space-bandwidth product of the reconstructed images by 9-fold with almost no performance loss, which allows for significant time savings in holographic imaging and data processing steps. Our results showcase the advancements of eFIN in pushing the boundaries of holographic imaging for various applications in e.g., quantitative phase imaging and label-free microscopy.

Related papers

• OAH-Net: A Deep Neural Network for Hologram Reconstruction of Off-axis Digital Holographic Microscope [5.835347176172883]
  We propose a novel reconstruction approach that integrates deep learning with the physical principles of off-axis holography. Our off-axis hologram network (OAH-Net) retrieves phase and amplitude images with errors that fall within the measurement error range attributable to hardware. This capability further expands off-axis holography's applications in both biological and medical studies.
  arXiv  Detail & Related papers  (2024-10-17T14:25:18Z)
• Calibration-free quantitative phase imaging in multi-core fiber endoscopes using end-to-end deep learning [49.013721992323994]
  We demonstrate a learning-based MCF phase imaging method, that significantly reduced the phase reconstruction time to 5.5 ms. We also introduce an innovative optical system that automatically generated the first open-source dataset tailored for MCF phase imaging. Our trained deep neural network (DNN) demonstrates robust phase reconstruction performance in experiments with a mean fidelity of up to 99.8%.
  arXiv  Detail & Related papers  (2023-12-12T09:30:12Z)
• Deep learning network to correct axial and coronal eye motion in 3D OCT retinal imaging [65.47834983591957]
  We propose deep learning based neural networks to correct axial and coronal motion artifacts in OCT based on a single scan. The experimental result shows that the proposed method can effectively correct motion artifacts and achieve smaller error than other methods.
  arXiv  Detail & Related papers  (2023-05-27T03:55:19Z)
• OADAT: Experimental and Synthetic Clinical Optoacoustic Data for Standardized Image Processing [62.993663757843464]
  Optoacoustic (OA) imaging is based on excitation of biological tissues with nanosecond-duration laser pulses followed by detection of ultrasound waves generated via light-absorption-mediated thermoelastic expansion. OA imaging features a powerful combination between rich optical contrast and high resolution in deep tissues. No standardized datasets generated with different types of experimental set-up and associated processing methods are available to facilitate advances in broader applications of OA in clinical settings.
  arXiv  Detail & Related papers  (2022-06-17T08:11:26Z)
• Fourier Imager Network (FIN): A deep neural network for hologram reconstruction with superior external generalization [0.30586855806896046]
  We introduce a deep learning framework, termed Fourier Imager Network (FIN), that can perform end-to-end phase recovery and image reconstruction from raw holograms of new types of samples. FIN exhibits superior generalization to new types of samples, while also being much faster in its image inference speed. We experimentally validated the performance of FIN by training it using human lung tissue samples and blindly testing it on human prostate, salivary gland tissue and Pap smear samples.
  arXiv  Detail & Related papers  (2022-04-22T06:56:24Z)
• Deep Learning for Ultrasound Beamforming [120.12255978513912]
  Beamforming, the process of mapping received ultrasound echoes to the spatial image domain, lies at the heart of the ultrasound image formation chain. Modern ultrasound imaging leans heavily on innovations in powerful digital receive channel processing. Deep learning methods can play a compelling role in the digital beamforming pipeline.
  arXiv  Detail & Related papers  (2021-09-23T15:15:21Z)
• A Geometry-Informed Deep Learning Framework for Ultra-Sparse 3D Tomographic Image Reconstruction [13.44786774177579]
  We establish a geometry-informed deep learning framework for ultra-sparse 3D tomographic image reconstruction. We demonstrate that the seamless inclusion of known priors is essential to enhance the performance of 3D volumetric computed tomography imaging.
  arXiv  Detail & Related papers  (2021-05-25T06:20:03Z)
• A parameter refinement method for Ptychography based on Deep Learning concepts [55.41644538483948]
  coarse parametrisation in propagation distance, position errors and partial coherence frequently menaces the experiment viability. A modern Deep Learning framework is used to correct autonomously the setup incoherences, thus improving the quality of a ptychography reconstruction. We tested our system on both synthetic datasets and also on real data acquired at the TwinMic beamline of the Elettra synchrotron facility.
  arXiv  Detail & Related papers  (2021-05-18T10:15:17Z)
• Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution [51.274657266928315]
  We propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors. Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters.
  arXiv  Detail & Related papers  (2021-04-07T12:00:38Z)
• Holographic image reconstruction with phase recovery and autofocusing using recurrent neural networks [8.040329271747753]
  Digital holography is one of the most widely used microscopy techniques in biomedical imaging. Recovery of the missing phase information of a hologram is an important step in holographic image reconstruction. Here we demonstrate a convolutional recurrent neural network based phase recovery approach.
  arXiv  Detail & Related papers  (2021-02-12T01:51:43Z)
• Learning Wavefront Coding for Extended Depth of Field Imaging [4.199844472131922]
  Extended depth of field (EDoF) imaging is a challenging ill-posed problem. We propose a computational imaging approach for EDoF, where we employ wavefront coding via a diffractive optical element. We demonstrate results with minimal artifacts in various scenarios, including deep 3D scenes and broadband imaging.
  arXiv  Detail & Related papers  (2019-12-31T17:00:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.