A Deep Generative Approach to Oversampling in Ptychography

• URL: http://arxiv.org/abs/2207.14392v1
• Date: Thu, 28 Jul 2022 22:02:01 GMT
• Title: A Deep Generative Approach to Oversampling in Ptychography
• Authors: Semih Barutcu, Aggelos K. Katsaggelos, Do\u{g}a G\"ursoy
• Abstract summary: A major drawback of ptychography is the long data acquisition time. We propose complementing sparsely acquired or undersampled data with data sampled from a deep generative network. Because the deep generative network is pre-trained and its output can be computed as we collect data, the experimental data and the time to acquire the data can be reduced.
• Score: 9.658250977094562
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Ptychography is a well-studied phase imaging method that makes non-invasive imaging possible at a nanometer scale. It has developed into a mainstream technique with various applications across a range of areas such as material science or the defense industry. One major drawback of ptychography is the long data acquisition time due to the high overlap requirement between adjacent illumination areas to achieve a reasonable reconstruction. Traditional approaches with reduced overlap between scanning areas result in reconstructions with artifacts. In this paper, we propose complementing sparsely acquired or undersampled data with data sampled from a deep generative network to satisfy the oversampling requirement in ptychography. Because the deep generative network is pre-trained and its output can be computed as we collect data, the experimental data and the time to acquire the data can be reduced. We validate the method by presenting the reconstruction quality compared to the previously proposed and traditional approaches and comment on the strengths and drawbacks of the proposed approach.

Related papers

• Tomographic Reconstruction and Regularisation with Search Space Expansion and Total Variation [0.0]
  Dealing with incomplete data is important when a patient is vulnerable to potentially damaging radiation or is unable to cope with the long scanning time. This paper uses a swarm-based reconstruction from highly undersampled data where particles move in image space in an attempt to minimise the reconstruction error. The proposed method is shown to produce lower reproduction errors compared to standard tomographic reconstruction toolbox algorithms.
  arXiv  Detail & Related papers  (2024-06-03T15:57:43Z)
• PtychoDV: Vision Transformer-Based Deep Unrolling Network for Ptychographic Image Reconstruction [12.780951605821238]
  PtychoDV is a novel deep model-based network designed for efficient, high-quality ptychographic image reconstruction. Results on simulated data demonstrate that PtychoDV is capable of outperforming existing deep learning methods for this problem.
  arXiv  Detail & Related papers  (2023-10-11T14:01:36Z)
• Unsupervised Domain Transfer with Conditional Invertible Neural Networks [83.90291882730925]
  We propose a domain transfer approach based on conditional invertible neural networks (cINNs) Our method inherently guarantees cycle consistency through its invertible architecture, and network training can efficiently be conducted with maximum likelihood. Our method enables the generation of realistic spectral data and outperforms the state of the art on two downstream classification tasks.
  arXiv  Detail & Related papers  (2023-03-17T18:00:27Z)
• OADAT: Experimental and Synthetic Clinical Optoacoustic Data for Standardized Image Processing [62.993663757843464]
  Optoacoustic (OA) imaging is based on excitation of biological tissues with nanosecond-duration laser pulses followed by detection of ultrasound waves generated via light-absorption-mediated thermoelastic expansion. OA imaging features a powerful combination between rich optical contrast and high resolution in deep tissues. No standardized datasets generated with different types of experimental set-up and associated processing methods are available to facilitate advances in broader applications of OA in clinical settings.
  arXiv  Detail & Related papers  (2022-06-17T08:11:26Z)
• Compressive Ptychography using Deep Image and Generative Priors [9.658250977094562]
  Ptychography is a well-established coherent diffraction imaging technique that enables non-invasive imaging of samples at a nanometer scale. One major limitation of ptychography is the long data acquisition time due to mechanical scanning of the sample. We propose a generative model combining deep image priors with deep generative priors.
  arXiv  Detail & Related papers  (2022-05-05T02:18:26Z)
• Incorporating Texture Information into Dimensionality Reduction for High-Dimensional Images [65.74185962364211]
  We present a method for incorporating neighborhood information into distance-based dimensionality reduction methods. Based on a classification of different methods for comparing image patches, we explore a number of different approaches.
  arXiv  Detail & Related papers  (2022-02-18T13:17:43Z)
• Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
  Deep image prior was introduced as an effective prior for image reconstruction. Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques. We develop a two-stage learning paradigm to address the computational challenge.
  arXiv  Detail & Related papers  (2021-11-23T15:08:26Z)
• Conditional Variational Autoencoder for Learned Image Reconstruction [5.487951901731039]
  We develop a novel framework that approximates the posterior distribution of the unknown image at each query observation. It handles implicit noise models and priors, it incorporates the data formation process (i.e., the forward operator), and the learned reconstructive properties are transferable between different datasets.
  arXiv  Detail & Related papers  (2021-10-22T10:02:48Z)
• Deep Unfolded Recovery of Sub-Nyquist Sampled Ultrasound Image [94.42139459221784]
  We propose a reconstruction method from sub-Nyquist samples in the time and spatial domain, that is based on unfolding the ISTA algorithm. Our method allows reducing the number of array elements, sampling rate, and computational time while ensuring high quality imaging performance.
  arXiv  Detail & Related papers  (2021-03-01T19:19:38Z)
• Data Consistent CT Reconstruction from Insufficient Data with Learned Prior Images [70.13735569016752]
  We investigate the robustness of deep learning in CT image reconstruction by showing false negative and false positive lesion cases. We propose a data consistent reconstruction (DCR) method to improve their image quality, which combines the advantages of compressed sensing and deep learning. The efficacy of the proposed method is demonstrated in cone-beam CT with truncated data, limited-angle data and sparse-view data, respectively.
  arXiv  Detail & Related papers  (2020-05-20T13:30:49Z)
• Real-time sparse-sampled Ptychographic imaging through deep neural networks [3.3351024234383946]
  A ptychography reconstruction is achieved by means of solving a complex inverse problem that imposes constraints both on the acquisition and on the analysis of the data. We propose PtychoNN, a novel approach to solve the ptychography reconstruction problem based on deep convolutional neural networks.
  arXiv  Detail & Related papers  (2020-04-15T23:43:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.