Learning to Model and Calibrate Optics via a Differentiable Wave Optics Simulator

• URL: http://arxiv.org/abs/2005.08562v1
• Date: Mon, 18 May 2020 10:23:04 GMT
• Title: Learning to Model and Calibrate Optics via a Differentiable Wave Optics Simulator
• Authors: Josue Page, Paolo Favaro
• Abstract summary: We present a novel learning-based method to build a differentiable computational model of a real fluorescence microscope. Our model can be used to calibrate a real optical setup directly from data samples and to engineer point spread functions by specifying the desired input-output data.
• Score: 27.913052825303097
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a novel learning-based method to build a differentiable computational model of a real fluorescence microscope. Our model can be used to calibrate a real optical setup directly from data samples and to engineer point spread functions by specifying the desired input-output data. This approach is poised to drastically improve the design of microscopes, because the parameters of current models of optical setups cannot be easily fit to real data. Inspired by the recent progress in deep learning, our solution is to build a differentiable wave optics simulator as a composition of trainable modules, each computing light wave-front (WF) propagation due to a specific optical element. We call our differentiable modules WaveBlocks and show reconstruction results in the case of lenses, wave propagation in air, camera sensors and diffractive elements (e.g., phase-masks).

Related papers

• Enhancing Fluorescence Lifetime Parameter Estimation Accuracy with Differential Transformer Based Deep Learning Model Incorporating Pixelwise Instrument Response Function [0.3441582801949978]
  We introduce a new DL architecture using state-of-the-art Differential Transformer encoder-decoder architecture, MFliNet. We demonstrate the model's performance through carefully designed, complex tissue-mimicking phantoms and preclinical in-vivo cancer xenograft experiments.
  arXiv  Detail & Related papers  (2024-11-25T20:03:41Z)
• Oscillation Inversion: Understand the structure of Large Flow Model through the Lens of Inversion Method [60.88467353578118]
  We show that a fixed-point-inspired iterative approach to invert real-world images does not achieve convergence, instead oscillating between distinct clusters. We introduce a simple and fast distribution transfer technique that facilitates image enhancement, stroke-based recoloring, as well as visual prompt-guided image editing.
  arXiv  Detail & Related papers  (2024-11-17T17:45:37Z)
• Rapid stochastic spatial light modulator calibration and pixel crosstalk optimisation [0.0]
  Accurate calibration of the wavefront and intensity profile of the laser beam at the SLM display is key to the high fidelity of holographic potentials. Here, we present a new calibration technique that is faster than previous methods while maintaining the same level of accuracy. This approach allows us to measure the wavefront at the SLM to within $lambda /170$ in 5 minutes using only 10 SLM phase patterns.
  arXiv  Detail & Related papers  (2024-08-14T17:11:50Z)
• End-to-End Hybrid Refractive-Diffractive Lens Design with Differentiable Ray-Wave Model [18.183342315517244]
  We propose a new hybrid ray-tracing and wave-propagation (ray-wave) model for accurate simulation of both optical aberrations and diffractive phase modulation. The proposed ray-wave model is fully differentiable, enabling gradient back-propagation for end-to-end co-design of refractive-diffractive lens optimization and the image reconstruction network.
  arXiv  Detail & Related papers  (2024-06-02T18:48:22Z)
• A Phase Transition in Diffusion Models Reveals the Hierarchical Nature of Data [55.748186000425996]
  Recent advancements show that diffusion models can generate high-quality images. We study this phenomenon in a hierarchical generative model of data. Our analysis characterises the relationship between time and scale in diffusion models.
  arXiv  Detail & Related papers  (2024-02-26T19:52:33Z)
• Rethinking data-driven point spread function modeling with a differentiable optical model [0.19947949439280027]
  In astronomy, upcoming space telescopes with wide-field optical instruments have a spatially varying point spread function (PSF) Current data-driven PSF models can tackle spatial variations and super-resolution, but are not capable of capturing chromatic variations. By adding a differentiable optical forward model into the modeling framework, we change the data-driven modeling space from the pixels to the wavefront.
  arXiv  Detail & Related papers  (2022-03-09T17:39:18Z)
• Disentangling multiple scattering with deep learning: application to strain mapping from electron diffraction patterns [48.53244254413104]
  We implement a deep neural network called FCU-Net to invert highly nonlinear electron diffraction patterns into quantitative structure factor images. We trained the FCU-Net using over 200,000 unique dynamical diffraction patterns which include many different combinations of crystal structures. Our simulated diffraction pattern library, implementation of FCU-Net, and trained model weights are freely available in open source repositories.
  arXiv  Detail & Related papers  (2022-02-01T03:53:39Z)
• Learning optical flow from still images [53.295332513139925]
  We introduce a framework to generate accurate ground-truth optical flow annotations quickly and in large amounts from any readily available single real picture. We virtually move the camera in the reconstructed environment with known motion vectors and rotation angles. When trained with our data, state-of-the-art optical flow networks achieve superior generalization to unseen real data.
  arXiv  Detail & Related papers  (2021-04-08T17:59:58Z)
• Optical Flow Estimation from a Single Motion-blurred Image [66.2061278123057]
  Motion blur in an image may have practical interests in fundamental computer vision problems. We propose a novel framework to estimate optical flow from a single motion-blurred image in an end-to-end manner.
  arXiv  Detail & Related papers  (2021-03-04T12:45:18Z)
• Rapid characterisation of linear-optical networks via PhaseLift [51.03305009278831]
  Integrated photonics offers great phase-stability and can rely on the large scale manufacturability provided by the semiconductor industry. New devices, based on such optical circuits, hold the promise of faster and energy-efficient computations in machine learning applications. We present a novel technique to reconstruct the transfer matrix of linear optical networks.
  arXiv  Detail & Related papers  (2020-10-01T16:04:22Z)
• Optimization of collection optics for maximum fidelity in entangled photon sources [0.0]
  decoherence sources for entangled photons created by spontaneous parametric down conversion phenomenon is studied. The phase and spatial distinguishability of photon pairs from crystals reduce the maximum achievable entanglement fidelity. A realistic scenario is numerically modelled, where the photon pairs with nonzero emission angle gather a phase difference.
  arXiv  Detail & Related papers  (2020-07-14T00:48:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.