3D Scattering Tomography by Deep Learning with Architecture Tailored to Cloud Fields

• URL: http://arxiv.org/abs/2012.05960v1
• Date: Thu, 10 Dec 2020 20:31:44 GMT
• Title: 3D Scattering Tomography by Deep Learning with Architecture Tailored to Cloud Fields
• Authors: Yael Sde-Chen, Yoav Y. Schechner, Vadim Holodovsky, Eshkol Eytan
• Abstract summary: We present 3DeepCT, a deep neural network for computed tomography, which performs 3D reconstruction of scattering volumes from multi-view images. We show that 3DeepCT outperforms physics-based inverse scattering methods in term of accuracy as well as offering a significant orders of magnitude improvement in computational time.
• Score: 12.139158398361866
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present 3DeepCT, a deep neural network for computed tomography, which performs 3D reconstruction of scattering volumes from multi-view images. Our architecture is dictated by the stationary nature of atmospheric cloud fields. The task of volumetric scattering tomography aims at recovering a volume from its 2D projections. This problem has been studied extensively, leading, to diverse inverse methods based on signal processing and physics models. However, such techniques are typically iterative, exhibiting high computational load and long convergence time. We show that 3DeepCT outperforms physics-based inverse scattering methods in term of accuracy as well as offering a significant orders of magnitude improvement in computational time. To further improve the recovery accuracy, we introduce a hybrid model that combines 3DeepCT and physics-based method. The resultant hybrid technique enjoys fast inference time and improved recovery performance.

Related papers

• R$^2$-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstruction [53.19869886963333]
  3D Gaussian splatting (3DGS) has shown promising results in rendering image and surface reconstruction. This paper introduces R2$-Gaussian, the first 3DGS-based framework for sparse-view tomographic reconstruction.
  arXiv  Detail & Related papers  (2024-05-31T08:39:02Z)
• StableDreamer: Taming Noisy Score Distillation Sampling for Text-to-3D [88.66678730537777]
  We present StableDreamer, a methodology incorporating three advances. First, we formalize the equivalence of the SDS generative prior and a simple supervised L2 reconstruction loss. Second, our analysis shows that while image-space diffusion contributes to geometric precision, latent-space diffusion is crucial for vivid color rendition.
  arXiv  Detail & Related papers  (2023-12-02T02:27:58Z)
• Pixelated Reconstruction of Foreground Density and Background Surface Brightness in Gravitational Lensing Systems using Recurrent Inference Machines [116.33694183176617]
  We use a neural network based on the Recurrent Inference Machine to reconstruct an undistorted image of the background source and the lens mass density distribution as pixelated maps. When compared to more traditional parametric models, the proposed method is significantly more expressive and can reconstruct complex mass distributions.
  arXiv  Detail & Related papers  (2023-01-10T19:00:12Z)
• Simulator-Based Self-Supervision for Learned 3D Tomography Reconstruction [34.93595625809309]
  Prior machine learning approaches require reference reconstructions computed by another algorithm for training. We train our model in a fully self-supervised manner using only noisy 2D X-ray data. Our results show significantly higher visual fidelity and better PSNR over techniques that rely on existing reconstructions.
  arXiv  Detail & Related papers  (2022-12-14T13:21:37Z)
• Solving 3D Inverse Problems using Pre-trained 2D Diffusion Models [33.343489006271255]
  Diffusion models have emerged as the new state-of-the-art generative model with high quality samples. We propose to augment the 2D diffusion prior with a model-based prior in the remaining direction at test time, such that one can achieve coherent reconstructions across all dimensions. Our method can be run in a single commodity GPU, and establishes the new state-of-the-art.
  arXiv  Detail & Related papers  (2022-11-19T10:32:21Z)
• DH-GAN: A Physics-driven Untrained Generative Adversarial Network for 3D Microscopic Imaging using Digital Holography [3.4635026053111484]
  Digital holography is a 3D imaging technique by emitting a laser beam with a plane wavefront to an object and measuring the intensity of the diffracted waveform, called holograms. Recently, deep learning (DL) methods have been used for more accurate holographic processing. We propose a new DL architecture based on generative adversarial networks that uses a discriminative network for realizing a semantic measure for reconstruction quality.
  arXiv  Detail & Related papers  (2022-05-25T17:13:45Z)
• Scatter Correction in X-ray CT by Physics-Inspired Deep Learning [26.549671705231145]
  A fundamental problem in X-ray Computed Tomography (CT) is the scatter due to interaction of photons with the imaged object. Scatter correction methods can be divided into two categories: hardware-based; and software-based. In this work, two novel physics-inspired deep-learning-based methods, PhILSCAT and OV-PhILSCAT, are proposed.
  arXiv  Detail & Related papers  (2021-03-21T22:51:20Z)
• Multi-view Depth Estimation using Epipolar Spatio-Temporal Networks [87.50632573601283]
  We present a novel method for multi-view depth estimation from a single video. Our method achieves temporally coherent depth estimation results by using a novel Epipolar Spatio-Temporal (EST) transformer. To reduce the computational cost, inspired by recent Mixture-of-Experts models, we design a compact hybrid network.
  arXiv  Detail & Related papers  (2020-11-26T04:04:21Z)
• 4D Spatio-Temporal Convolutional Networks for Object Position Estimation in OCT Volumes [69.62333053044712]
  3D convolutional neural networks (CNNs) have shown promising performance for pose estimation of a marker object using single OCT images. We extend 3D CNNs to 4D-temporal CNNs to evaluate the impact of additional temporal information for marker object tracking.
  arXiv  Detail & Related papers  (2020-07-02T12:02:20Z)
• Real-time 3D Nanoscale Coherent Imaging via Physics-aware Deep Learning [0.7664249650622356]
  We introduce 3D-CDI-NN, a deep convolutional neural network and differential programming framework trained to predict 3D structure and strain. Our networks are designed to be "physics-aware" in multiple aspects. Our integrated machine learning and differential programming solution is broadly applicable across inverse problems in other application areas.
  arXiv  Detail & Related papers  (2020-06-16T18:35:32Z)
• Deep learning with 4D spatio-temporal data representations for OCT-based force estimation [59.405210617831656]
  We extend the problem of deep learning-based force estimation to 4D volumetric-temporal data with streams of 3D OCT volumes. We show that using 4Dterm-temporal data outperforms all previously used data representations with a mean absolute error of 10.7mN.
  arXiv  Detail & Related papers  (2020-05-20T13:30:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.