Real-time sparse-sampled Ptychographic imaging through deep neural
networks
- URL: http://arxiv.org/abs/2004.08247v1
- Date: Wed, 15 Apr 2020 23:43:17 GMT
- Title: Real-time sparse-sampled Ptychographic imaging through deep neural
networks
- Authors: Mathew J. Cherukara, Tao Zhou, Youssef Nashed, Pablo Enfedaque, Alex
Hexemer, Ross J. Harder and Martin V. Holt
- Abstract summary: A ptychography reconstruction is achieved by means of solving a complex inverse problem that imposes constraints both on the acquisition and on the analysis of the data.
We propose PtychoNN, a novel approach to solve the ptychography reconstruction problem based on deep convolutional neural networks.
- Score: 3.3351024234383946
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Ptychography has rapidly grown in the fields of X-ray and electron imaging
for its unprecedented ability to achieve nano or atomic scale resolution while
simultaneously retrieving chemical or magnetic information from a sample. A
ptychographic reconstruction is achieved by means of solving a complex inverse
problem that imposes constraints both on the acquisition and on the analysis of
the data, which typically precludes real-time imaging due to computational cost
involved in solving this inverse problem. In this work we propose PtychoNN, a
novel approach to solve the ptychography reconstruction problem based on deep
convolutional neural networks. We demonstrate how the proposed method can be
used to predict real-space structure and phase at each scan point solely from
the corresponding far-field diffraction data. The presented results demonstrate
how PtychoNN can effectively be used on experimental data, being able to
generate high quality reconstructions of a sample up to hundreds of times
faster than state-of-the-art ptychography reconstruction solutions once
trained. By surpassing the typical constraints of iterative model-based
methods, we can significantly relax the data acquisition sampling conditions
and produce equally satisfactory reconstructions. Besides drastically
accelerating acquisition and analysis, this capability can enable new imaging
scenarios that were not possible before, in cases of dose sensitive, dynamic
and extremely voluminous samples.
Related papers
- Re-Visible Dual-Domain Self-Supervised Deep Unfolding Network for MRI Reconstruction [48.30341580103962]
We propose a novel re-visible dual-domain self-supervised deep unfolding network to address these issues.
We design a deep unfolding network based on Chambolle and Pock Proximal Point Algorithm (DUN-CP-PPA) to achieve end-to-end reconstruction.
Experiments conducted on the fastMRI and IXI datasets demonstrate that our method significantly outperforms state-of-the-art approaches in terms of reconstruction performance.
arXiv Detail & Related papers (2025-01-07T12:29:32Z) - Integrating Generative and Physics-Based Models for Ptychographic Imaging with Uncertainty Quantification [0.0]
Ptychography is a scanning coherent diffractive imaging technique that enables imaging nanometer-scale features in extended samples.
This paper proposes a Bayesian inversion method for ptychography that performs effectively even with less overlap between neighboring scan locations.
arXiv Detail & Related papers (2024-12-14T16:16:37Z) - A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
Deep neural networks have shown great potential for reconstructing high-fidelity images from undersampled measurements.
Our model is based on neural operators, a discretization-agnostic architecture.
Our inference speed is also 1,400x faster than diffusion methods.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - PtychoDV: Vision Transformer-Based Deep Unrolling Network for
Ptychographic Image Reconstruction [12.780951605821238]
PtychoDV is a novel deep model-based network designed for efficient, high-quality ptychographic image reconstruction.
Results on simulated data demonstrate that PtychoDV is capable of outperforming existing deep learning methods for this problem.
arXiv Detail & Related papers (2023-10-11T14:01:36Z) - A Deep Generative Approach to Oversampling in Ptychography [9.658250977094562]
A major drawback of ptychography is the long data acquisition time.
We propose complementing sparsely acquired or undersampled data with data sampled from a deep generative network.
Because the deep generative network is pre-trained and its output can be computed as we collect data, the experimental data and the time to acquire the data can be reduced.
arXiv Detail & Related papers (2022-07-28T22:02:01Z) - Towards performant and reliable undersampled MR reconstruction via
diffusion model sampling [67.73698021297022]
DiffuseRecon is a novel diffusion model-based MR reconstruction method.
It guides the generation process based on the observed signals.
It does not require additional training on specific acceleration factors.
arXiv Detail & Related papers (2022-03-08T02:25:38Z) - Mining the manifolds of deep generative models for multiple
data-consistent solutions of ill-posed tomographic imaging problems [10.115302976900445]
Tomographic imaging is in general an ill-posed inverse problem.
We propose a new empirical sampling method that computes multiple solutions of a tomographic inverse problem.
arXiv Detail & Related papers (2022-02-10T20:27:31Z) - A parameter refinement method for Ptychography based on Deep Learning
concepts [55.41644538483948]
coarse parametrisation in propagation distance, position errors and partial coherence frequently menaces the experiment viability.
A modern Deep Learning framework is used to correct autonomously the setup incoherences, thus improving the quality of a ptychography reconstruction.
We tested our system on both synthetic datasets and also on real data acquired at the TwinMic beamline of the Elettra synchrotron facility.
arXiv Detail & Related papers (2021-05-18T10:15:17Z) - Data-driven generation of plausible tissue geometries for realistic
photoacoustic image synthesis [53.65837038435433]
Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties.
We propose a novel approach to PAT data simulation, which we refer to as "learning to simulate"
We leverage the concept of Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data to generate plausible tissue geometries.
arXiv Detail & Related papers (2021-03-29T11:30:18Z) - Probabilistic 3D surface reconstruction from sparse MRI information [58.14653650521129]
We present a novel probabilistic deep learning approach for concurrent 3D surface reconstruction from sparse 2D MR image data and aleatoric uncertainty prediction.
Our method is capable of reconstructing large surface meshes from three quasi-orthogonal MR imaging slices from limited training sets.
arXiv Detail & Related papers (2020-10-05T14:18:52Z) - Distributed optimization for nonrigid nano-tomography [0.40631409309544836]
We propose a joint solver for imaging samples at the nanoscale with projection alignment, unwarping and regularization.
Projection data consistency is regulated by dense optical flow estimated by Farneback's algorithm, leading to sharp sample reconstructions with less artifacts.
arXiv Detail & Related papers (2020-07-11T19:22:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.