Learning the geometry of wave-based imaging

• URL: http://arxiv.org/abs/2006.05854v3
• Date: Tue, 10 Nov 2020 06:34:40 GMT
• Title: Learning the geometry of wave-based imaging
• Authors: Konik Kothari, Maarten de Hoop, Ivan Dokmani\'c
• Abstract summary: We build an interpretable neural architecture inspired by Fourier integral operators (FIOs) which approximate the wave physics. We focus on learning the geometry of wave propagation captured by FIOs, which is implicit in the data, via a loss based on optimal transport. The proposed FIONet performs significantly better than the usual baselines on a number of imaging inverse problems, especially in out-of-distribution tests.
• Score: 24.531973107529584
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose a general physics-based deep learning architecture for wave-based imaging problems. A key difficulty in imaging problems with a varying background wave speed is that the medium "bends" the waves differently depending on their position and direction. This space-bending geometry makes the equivariance to translations of convolutional networks an undesired inductive bias. We build an interpretable neural architecture inspired by Fourier integral operators (FIOs) which approximate the wave physics. FIOs model a wide range of imaging modalities, from seismology and radar to Doppler and ultrasound. We focus on learning the geometry of wave propagation captured by FIOs, which is implicit in the data, via a loss based on optimal transport. The proposed FIONet performs significantly better than the usual baselines on a number of imaging inverse problems, especially in out-of-distribution tests.

Related papers

• WiNet: Wavelet-based Incremental Learning for Efficient Medical Image Registration [68.25711405944239]
  Deep image registration has demonstrated exceptional accuracy and fast inference. Recent advances have adopted either multiple cascades or pyramid architectures to estimate dense deformation fields in a coarse-to-fine manner. We introduce a model-driven WiNet that incrementally estimates scale-wise wavelet coefficients for the displacement/velocity field across various scales.
  arXiv  Detail & Related papers  (2024-07-18T11:51:01Z)
• RFTrans: Leveraging Refractive Flow of Transparent Objects for Surface Normal Estimation and Manipulation [50.10282876199739]
  This paper introduces RFTrans, an RGB-D-based method for surface normal estimation and manipulation of transparent objects. It integrates the RFNet, which predicts refractive flow, object mask, and boundaries, followed by the F2Net, which estimates surface normal from the refractive flow. A real-world robot grasping task witnesses an 83% success rate, proving that refractive flow can help enable direct sim-to-real transfer.
  arXiv  Detail & Related papers  (2023-11-21T07:19:47Z)
• Exploring Invariance in Images through One-way Wave Equations [96.90549064390608]
  In this paper, we empirically reveal an invariance over images-images share a set of one-way wave equations with latent speeds. We demonstrate it using an intuitive encoder-decoder framework where each image is encoded into its corresponding initial condition.
  arXiv  Detail & Related papers  (2023-10-19T17:59:37Z)
• Machine learning for phase-resolved reconstruction of nonlinear ocean wave surface elevations from sparse remote sensing data [37.69303106863453]
  We propose a novel approach for phase-resolved wave surface reconstruction using neural networks. Our approach utilizes synthetic yet highly realistic training data on uniform one-dimensional grids.
  arXiv  Detail & Related papers  (2023-05-18T12:30:26Z)
• Variational waveguide QED simulators [58.720142291102135]
  Waveguide QED simulators are made by quantum emitters interacting with one-dimensional photonic band-gap materials. Here, we demonstrate how these interactions can be a resource to develop more efficient variational quantum algorithms.
  arXiv  Detail & Related papers  (2023-02-03T18:55:08Z)
• A physically-informed Deep-Learning approach for locating sources in a waveguide [0.688204255655161]
  Inverse source problems are central to many applications in acoustics, geophysics, non-destructive testing, and more. Traditional imaging methods suffer from the resolution limit, preventing distinction of sources separated by less than the emitted wavelength. We propose a method based on physically-informed neural-networks for solving the source refocusing problem.
  arXiv  Detail & Related papers  (2022-08-07T19:54:10Z)
• Single Plane-Wave Imaging using Physics-Based Deep Learning [2.1410799064827226]
  In plane-wave imaging, multiple unfocused ultrasound waves are transmitted into a medium of interest from different angles. Deep learning methods have been proposed to improve ultrasound imaging. We propose a data-to-image architecture that incorporates a wave-physics-based image formation algorithm in-between deep convolutional neural networks.
  arXiv  Detail & Related papers  (2021-09-08T14:06:29Z)
• Fourier Neural Operator Networks: A Fast and General Solver for the Photoacoustic Wave Equation [1.7205106391379026]
  We apply a fast data-driven deep learning method for solving the 2D photoacoustic wave equation in a homogeneous medium. We show that the FNO network generated comparable simulations with small errors and was several orders of magnitude faster.
  arXiv  Detail & Related papers  (2021-08-20T21:09:53Z)
• WaveFill: A Wavelet-based Generation Network for Image Inpainting [57.012173791320855]
  WaveFill is a wavelet-based inpainting network that decomposes images into multiple frequency bands. WaveFill decomposes images by using discrete wavelet transform (DWT) that preserves spatial information naturally. It applies L1 reconstruction loss to the low-frequency bands and adversarial loss to high-frequency bands, hence effectively mitigate inter-frequency conflicts.
  arXiv  Detail & Related papers  (2021-07-23T04:44:40Z)
• Prediction of Ultrasonic Guided Wave Propagation in Solid-fluid and their Interface under Uncertainty using Machine Learning [0.0]
  We advance existing research by accounting for uncertainty in the material and geometric properties of a structure. We develop an efficient algorithm that addresses the inherent complexity of solving the multiphysics problem under uncertainty. The proposed approach provides an accurate prediction for the WpFSI problem in the presence of uncertainty.
  arXiv  Detail & Related papers  (2021-03-30T01:05:14Z)
• A Flexible Framework for Designing Trainable Priors with Adaptive Smoothing and Game Encoding [57.1077544780653]
  We introduce a general framework for designing and training neural network layers whose forward passes can be interpreted as solving non-smooth convex optimization problems. We focus on convex games, solved by local agents represented by the nodes of a graph and interacting through regularization functions. This approach is appealing for solving imaging problems, as it allows the use of classical image priors within deep models that are trainable end to end.
  arXiv  Detail & Related papers  (2020-06-26T08:34:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.