Estimating Nonplanar Flow from 2D Motion-blurred Widefield Microscopy Images via Deep Learning

• URL: http://arxiv.org/abs/2102.07228v1
• Date: Sun, 14 Feb 2021 19:44:28 GMT
• Title: Estimating Nonplanar Flow from 2D Motion-blurred Widefield Microscopy Images via Deep Learning
• Authors: Adrian Shajkofci, Michael Liebling
• Abstract summary: We present a method to predict, from a single textured wide-field microscopy image, the movement of out-of-plane particles using the local characteristics of the motion blur. This method could enable microscopists to gain insights about the dynamic properties of samples without the need for high-speed cameras or high-intensity light exposure.
• Score: 7.6146285961466
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Optical flow is a method aimed at predicting the movement velocity of any pixel in the image and is used in medicine and biology to estimate flow of particles in organs or organelles. However, a precise optical flow measurement requires images taken at high speed and low exposure time, which induces phototoxicity due to the increase in illumination power. We are looking here to estimate the three-dimensional movement vector field of moving out-of-plane particles using normal light conditions and a standard microscope camera. We present a method to predict, from a single textured wide-field microscopy image, the movement of out-of-plane particles using the local characteristics of the motion blur. We estimated the velocity vector field from the local estimation of the blur model parameters using an deep neural network and achieved a prediction with a regression coefficient of 0.92 between the ground truth simulated vector field and the output of the network. This method could enable microscopists to gain insights about the dynamic properties of samples without the need for high-speed cameras or high-intensity light exposure.

Related papers

• Deformation Monitoring of Tunnel using Phase-based Motion Magnification and Optical Flow [0.36832029288386137]
  This study combines PMM and OF to quantify the underground tunnel scene's magnified deformation mode pixel displacements. With GPU acceleration, a dense OF algorithm computing each pixel's displacement is adopted to derive the whole scene motion.
  arXiv  Detail & Related papers  (2023-06-15T19:39:47Z)
• Fast light-field 3D microscopy with out-of-distribution detection and adaptation through Conditional Normalizing Flows [16.928404625892625]
  Real-time 3D fluorescence microscopy is crucial for the analysis of live organisms. We propose a novel architecture to perform fast 3D reconstructions of live immobilized zebrafish neural activity.
  arXiv  Detail & Related papers  (2023-06-10T10:42:49Z)
• Adaptive Multi-source Predictor for Zero-shot Video Object Segmentation [68.56443382421878]
  We propose a novel adaptive multi-source predictor for zero-shot video object segmentation (ZVOS) In the static object predictor, the RGB source is converted to depth and static saliency sources, simultaneously. Experiments show that the proposed model outperforms the state-of-the-art methods on three challenging ZVOS benchmarks.
  arXiv  Detail & Related papers  (2023-03-18T10:19:29Z)
• Deep Learning-Assisted Localisation of Nanoparticles in synthetically generated two-photon microscopy images [6.251942628138834]
  Existing intensity-based localisation methods are not developed for imaging with a scanning microscope. Low signal-to-noise ratios, movement of molecules out-of-focus, and high motion blur on images recorded with scanning two-photon microscopy (2PM) in vivo pose a challenge to the accurate localisation of molecules. We developed a 2PM image simulator to supplement scarce training data.
  arXiv  Detail & Related papers  (2023-03-17T14:48:50Z)
• Retrieving space-dependent polarization transformations via near-optimal quantum process tomography [55.41644538483948]
  We investigate the application of genetic and machine learning approaches to tomographic problems. We find that the neural network-based scheme provides a significant speed-up, that may be critical in applications requiring a characterization in real-time. We expect these results to lay the groundwork for the optimization of tomographic approaches in more general quantum processes.
  arXiv  Detail & Related papers  (2022-10-27T11:37:14Z)
• Dimensions of Motion: Learning to Predict a Subspace of Optical Flow from a Single Image [50.9686256513627]
  We introduce the problem of predicting, from a single video frame, a low-dimensional subspace of optical flow which includes the actual instantaneous optical flow. We show how several natural scene assumptions allow us to identify an appropriate flow subspace via a set of basis flow fields parameterized by disparity. This provides a new approach to learning these tasks in an unsupervised fashion using monocular input video without requiring camera intrinsics or poses.
  arXiv  Detail & Related papers  (2021-12-02T18:52:54Z)
• SCFlow: Optical Flow Estimation for Spiking Camera [50.770803466875364]
  Spiking camera has enormous potential in real applications, especially for motion estimation in high-speed scenes. Optical flow estimation has achieved remarkable success in image-based and event-based vision, but % existing methods cannot be directly applied in spike stream from spiking camera. This paper presents, SCFlow, a novel deep learning pipeline for optical flow estimation for spiking camera.
  arXiv  Detail & Related papers  (2021-10-08T06:16:45Z)
• MBA-VO: Motion Blur Aware Visual Odometry [99.56896875807635]
  Motion blur is one of the major challenges remaining for visual odometry methods. In low-light conditions where longer exposure times are necessary, motion blur can appear even for relatively slow camera motions. We present a novel hybrid visual odometry pipeline with direct approach that explicitly models and estimates the camera's local trajectory within the exposure time.
  arXiv  Detail & Related papers  (2021-03-25T09:02:56Z)
• Optical Flow Estimation from a Single Motion-blurred Image [66.2061278123057]
  Motion blur in an image may have practical interests in fundamental computer vision problems. We propose a novel framework to estimate optical flow from a single motion-blurred image in an end-to-end manner.
  arXiv  Detail & Related papers  (2021-03-04T12:45:18Z)
• Spatially-Variant CNN-based Point Spread Function Estimation for Blind Deconvolution and Depth Estimation in Optical Microscopy [6.09170287691728]
  We present a method that improves the resolution of light microscopy images of thin, yet non-flat objects. We estimate the parameters of a spatially-variant Point-Spread function (PSF) model using a Convolutional Neural Network (CNN) Our method recovers PSF parameters from the image itself with up to a squared Pearson correlation coefficient of 0.99 in ideal conditions.
  arXiv  Detail & Related papers  (2020-10-08T14:20:16Z)
• ML-LBM: Machine Learning Aided Flow Simulation in Porous Media [0.0]
  Direct simulation of fluid flow in porous media requires significant computational resources to solve within reasonable timeframes. An integrated method combining predictions of fluid flow with direct flow simulation is outlined. Deep Learning techniques based on Convolutional Neural Networks (CNNs) are shown to give an accurate estimate of the steady state velocity fields.
  arXiv  Detail & Related papers  (2020-04-22T01:55:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.