Calibration-free quantitative phase imaging in multi-core fiber endoscopes using end-to-end deep learning

• URL: http://arxiv.org/abs/2312.07102v1
• Date: Tue, 12 Dec 2023 09:30:12 GMT
• Title: Calibration-free quantitative phase imaging in multi-core fiber endoscopes using end-to-end deep learning
• Authors: Jiawei Sun, Bin Zhao, Dong Wang, Zhigang Wang, Jie Zhang, Nektarios Koukourakis, Juergen W. Czarske, Xuelong Li
• Abstract summary: We demonstrate a learning-based MCF phase imaging method, that significantly reduced the phase reconstruction time to 5.5 ms. We also introduce an innovative optical system that automatically generated the first open-source dataset tailored for MCF phase imaging. Our trained deep neural network (DNN) demonstrates robust phase reconstruction performance in experiments with a mean fidelity of up to 99.8%.
• Score: 49.013721992323994
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Quantitative phase imaging (QPI) through multi-core fibers (MCFs) has been an emerging in vivo label-free endoscopic imaging modality with minimal invasiveness. However, the computational demands of conventional iterative phase retrieval algorithms have limited their real-time imaging potential. We demonstrate a learning-based MCF phase imaging method, that significantly reduced the phase reconstruction time to 5.5 ms, enabling video-rate imaging at 181 fps. Moreover, we introduce an innovative optical system that automatically generated the first open-source dataset tailored for MCF phase imaging, comprising 50,176 paired speckle and phase images. Our trained deep neural network (DNN) demonstrates robust phase reconstruction performance in experiments with a mean fidelity of up to 99.8\%. Such an efficient fiber phase imaging approach can broaden the applications of QPI in hard-to-reach areas.

Related papers

• Diffusion-driven lensless fiber endomicroscopic quantitative phase imaging towards digital pathology [45.4057289850892]
  We propose a speckle-conditioned diffusion model (SpecDiffusion) to reconstruct phase images directly from speckles captured at the detection side of a multi-core fiber (MCF) Unlike conventional neural networks, SpecDiffusion employs iterative phase denoising steps for speckle-driven phase reconstruction. SpecDiffusion provides high-fidelity phase reconstruction results and shows powerful generalization capacity for unseen objects.
  arXiv  Detail & Related papers  (2024-07-26T01:42:31Z)
• Theoretical framework for real time sub-micron depth monitoring using quantum inline coherent imaging [55.2480439325792]
  Inline Coherent Imaging (ICI) is a reliable method for real-time monitoring of various laser processes, including keyhole welding, additive manufacturing, and micromachining. The axial resolution is limited to greater than 2 mum making ICI unsuitable for monitoring submicron processes. Advancements in Quantum Optical Coherence Tomography (Q OCT) has the potential to address this issue by achieving better than 1 mum depth resolution.
  arXiv  Detail & Related papers  (2023-09-17T17:05:21Z)
• eFIN: Enhanced Fourier Imager Network for generalizable autofocusing and pixel super-resolution in holographic imaging [0.30586855806896046]
  We introduce a deep neural network termed enhanced Fourier Imager Network (eFIN) as a framework for hologram reconstruction with pixel super-resolution and image autofocusing. eFIN has a superior image reconstruction quality and exhibits external generalization to new types of samples never seen during the training phase. eFIN enables 3x pixel super-resolution imaging and increases the space-bandwidth product of the reconstructed images by 9-fold with almost no performance loss.
  arXiv  Detail & Related papers  (2023-01-09T04:12:10Z)
• LWGNet: Learned Wirtinger Gradients for Fourier Ptychographic Phase Retrieval [14.588976801396576]
  We propose a hybrid model-driven residual network that combines the knowledge of the forward imaging system with a deep data-driven network. Unlike other conventional unrolling techniques, LWGNet uses fewer stages while performing at par or even better than existing traditional and deep learning techniques. This improvement in performance for low-bit depth and low-cost sensors has the potential to bring down the cost of FPM imaging setup significantly.
  arXiv  Detail & Related papers  (2022-08-08T17:22:54Z)
• OADAT: Experimental and Synthetic Clinical Optoacoustic Data for Standardized Image Processing [62.993663757843464]
  Optoacoustic (OA) imaging is based on excitation of biological tissues with nanosecond-duration laser pulses followed by detection of ultrasound waves generated via light-absorption-mediated thermoelastic expansion. OA imaging features a powerful combination between rich optical contrast and high resolution in deep tissues. No standardized datasets generated with different types of experimental set-up and associated processing methods are available to facilitate advances in broader applications of OA in clinical settings.
  arXiv  Detail & Related papers  (2022-06-17T08:11:26Z)
• Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution [51.274657266928315]
  We propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors. Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters.
  arXiv  Detail & Related papers  (2021-04-07T12:00:38Z)
• Holographic image reconstruction with phase recovery and autofocusing using recurrent neural networks [8.040329271747753]
  Digital holography is one of the most widely used microscopy techniques in biomedical imaging. Recovery of the missing phase information of a hologram is an important step in holographic image reconstruction. Here we demonstrate a convolutional recurrent neural network based phase recovery approach.
  arXiv  Detail & Related papers  (2021-02-12T01:51:43Z)
• CNN-Based Image Reconstruction Method for Ultrafast Ultrasound Imaging [9.659642285903418]
  Ultrafast ultrasound (US) revolutionized biomedical imaging with its capability of acquiring full-view frames at over 1 kHz. It suffers from strong diffraction artifacts, mainly caused by grating lobes, side lobes, or edge waves. We propose a two-step convolutional neural network (CNN)-based image reconstruction method, compatible with real-time imaging.
  arXiv  Detail & Related papers  (2020-08-28T17:15:37Z)
• Multifold Acceleration of Diffusion MRI via Slice-Interleaved Diffusion Encoding (SIDE) [50.65891535040752]
  We propose a diffusion encoding scheme, called Slice-Interleaved Diffusion. SIDE, that interleaves each diffusion-weighted (DW) image volume with slices encoded with different diffusion gradients. We also present a method based on deep learning for effective reconstruction of DW images from the highly slice-undersampled data.
  arXiv  Detail & Related papers  (2020-02-25T14:48:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.