Predicting ptychography probe positions using single-shot phase retrieval neural network
- URL: http://arxiv.org/abs/2405.20910v1
- Date: Fri, 31 May 2024 15:21:06 GMT
- Title: Predicting ptychography probe positions using single-shot phase retrieval neural network
- Authors: Ming Du, Tao Zhou, Junjing Deng, Daniel J. Ching, Steven Henke, Mathew J. Cherukara,
- Abstract summary: We propose a fundamentally new approach for ptychography probe position prediction for data with large position errors.
A neural network is used to make single-shot phase retrieval on individual diffraction patterns, yielding the object image at each scan point.
We show that our method can achieve good position prediction accuracy for data with large and accumulating errors on the order of $102$ pixels.
- Score: 5.889405057118457
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Ptychography is a powerful imaging technique that is used in a variety of fields, including materials science, biology, and nanotechnology. However, the accuracy of the reconstructed ptychography image is highly dependent on the accuracy of the recorded probe positions which often contain errors. These errors are typically corrected jointly with phase retrieval through numerical optimization approaches. When the error accumulates along the scan path or when the error magnitude is large, these approaches may not converge with satisfactory result. We propose a fundamentally new approach for ptychography probe position prediction for data with large position errors, where a neural network is used to make single-shot phase retrieval on individual diffraction patterns, yielding the object image at each scan point. The pairwise offsets among these images are then found using a robust image registration method, and the results are combined to yield the complete scan path by constructing and solving a linear equation. We show that our method can achieve good position prediction accuracy for data with large and accumulating errors on the order of $10^2$ pixels, a magnitude that often makes optimization-based algorithms fail to converge. For ptychography instruments without sophisticated position control equipment such as interferometers, our method is of significant practical potential.
Related papers
- Toward Efficient Visual Gyroscopes: Spherical Moments, Harmonics Filtering, and Masking Techniques for Spherical Camera Applications [83.8743080143778]
The integration of omnidirectional cameras, offering a larger field of view compared to traditional RGB cameras, has proven to yield more accurate and robust results.
However, challenges arise in situations that lack features, have substantial noise causing significant errors, and where certain features in the images lack sufficient strength.
Here, we address these challenges by introducing a novel visual gyroscope, which combines an analytical method with a neural network approach.
arXiv Detail & Related papers (2024-04-02T13:19:06Z) - Single-image camera calibration with model-free distortion correction [0.0]
This paper proposes a method for estimating the complete set of calibration parameters from a single image of a planar speckle pattern covering the entire sensor.
The correspondence between image points and physical points on the calibration target is obtained using Digital Image Correlation.
At the end of the procedure, a dense and uniform model-free distortion map is obtained over the entire image.
arXiv Detail & Related papers (2024-03-02T16:51:35Z) - Coordinate-based Neural Network for Fourier Phase Retrieval [8.827173113748703]
Single impliCit neurAl Network (SCAN) is a tool built upon coordinate neural networks meticulously designed for enhanced phase retrieval performance.
SCAN adeptly connects object coordinates to their amplitude and phase within a unified network in an unsupervised manner.
arXiv Detail & Related papers (2023-11-25T04:23:23Z) - PtychoDV: Vision Transformer-Based Deep Unrolling Network for
Ptychographic Image Reconstruction [12.780951605821238]
PtychoDV is a novel deep model-based network designed for efficient, high-quality ptychographic image reconstruction.
Results on simulated data demonstrate that PtychoDV is capable of outperforming existing deep learning methods for this problem.
arXiv Detail & Related papers (2023-10-11T14:01:36Z) - Compressive Ptychography using Deep Image and Generative Priors [9.658250977094562]
Ptychography is a well-established coherent diffraction imaging technique that enables non-invasive imaging of samples at a nanometer scale.
One major limitation of ptychography is the long data acquisition time due to mechanical scanning of the sample.
We propose a generative model combining deep image priors with deep generative priors.
arXiv Detail & Related papers (2022-05-05T02:18:26Z) - Mining the manifolds of deep generative models for multiple
data-consistent solutions of ill-posed tomographic imaging problems [10.115302976900445]
Tomographic imaging is in general an ill-posed inverse problem.
We propose a new empirical sampling method that computes multiple solutions of a tomographic inverse problem.
arXiv Detail & Related papers (2022-02-10T20:27:31Z) - LocalTrans: A Multiscale Local Transformer Network for Cross-Resolution
Homography Estimation [52.63874513999119]
Cross-resolution image alignment is a key problem in multiscale giga photography.
Existing deep homography methods neglecting the explicit formulation of correspondences between them, which leads to degraded accuracy in cross-resolution challenges.
We propose a local transformer network embedded within a multiscale structure to explicitly learn correspondences between the multimodal inputs.
arXiv Detail & Related papers (2021-06-08T02:51:45Z) - Learning Topology from Synthetic Data for Unsupervised Depth Completion [66.26787962258346]
We present a method for inferring dense depth maps from images and sparse depth measurements.
We learn the association of sparse point clouds with dense natural shapes, and using the image as evidence to validate the predicted depth map.
arXiv Detail & Related papers (2021-06-06T00:21:12Z) - A parameter refinement method for Ptychography based on Deep Learning
concepts [55.41644538483948]
coarse parametrisation in propagation distance, position errors and partial coherence frequently menaces the experiment viability.
A modern Deep Learning framework is used to correct autonomously the setup incoherences, thus improving the quality of a ptychography reconstruction.
We tested our system on both synthetic datasets and also on real data acquired at the TwinMic beamline of the Elettra synchrotron facility.
arXiv Detail & Related papers (2021-05-18T10:15:17Z) - Learned Block Iterative Shrinkage Thresholding Algorithm for
Photothermal Super Resolution Imaging [52.42007686600479]
We propose a learned block-sparse optimization approach using an iterative algorithm unfolded into a deep neural network.
We show the benefits of using a learned block iterative shrinkage thresholding algorithm that is able to learn the choice of regularization parameters.
arXiv Detail & Related papers (2020-12-07T09:27:16Z) - Data Consistent CT Reconstruction from Insufficient Data with Learned
Prior Images [70.13735569016752]
We investigate the robustness of deep learning in CT image reconstruction by showing false negative and false positive lesion cases.
We propose a data consistent reconstruction (DCR) method to improve their image quality, which combines the advantages of compressed sensing and deep learning.
The efficacy of the proposed method is demonstrated in cone-beam CT with truncated data, limited-angle data and sparse-view data, respectively.
arXiv Detail & Related papers (2020-05-20T13:30:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.