Randomized Physics-Informed Machine Learning for Uncertainty
Quantification in High-Dimensional Inverse Problems
- URL: http://arxiv.org/abs/2312.06177v2
- Date: Sat, 23 Dec 2023 13:30:43 GMT
- Title: Randomized Physics-Informed Machine Learning for Uncertainty
Quantification in High-Dimensional Inverse Problems
- Authors: Yifei Zong and David Barajas-Solano and Alexandre M. Tartakovsky
- Abstract summary: We propose a physics-informed machine learning method for uncertainty quantification in high-dimensional inverse problems.
We show analytically and through comparison with Hamiltonian Monte Carlo that the rPICKLE posterior converges to the true posterior given by the Bayes rule.
- Score: 49.1574468325115
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: We propose a physics-informed machine learning method for uncertainty
quantification in high-dimensional inverse problems. In this method, the states
and parameters of partial differential equations (PDEs) are approximated with
truncated conditional Karhunen-Lo\`eve expansions (CKLEs), which, by
construction, match the measurements of the respective variables. The maximum a
posteriori (MAP) solution of the inverse problem is formulated as a
minimization problem over CKLE coefficients where the loss function is the sum
of the norm of PDE residuals and the $\ell_2$ regularization term. This MAP
formulation is known as the physics-informed CKLE (PICKLE) method. Uncertainty
in the inverse solution is quantified in terms of the posterior distribution of
CKLE coefficients, and we sample the posterior by solving a randomized PICKLE
minimization problem, formulated by adding zero-mean Gaussian perturbations in
the PICKLE loss function. We call the proposed approach the randomized PICKLE
(rPICKLE) method.
For linear and low-dimensional nonlinear problems (15 CKLE parameters), we
show analytically and through comparison with Hamiltonian Monte Carlo (HMC)
that the rPICKLE posterior converges to the true posterior given by the Bayes
rule. For high-dimensional non-linear problems with 2000 CKLE parameters, we
numerically demonstrate that rPICKLE posteriors are highly informative--they
provide mean estimates with an accuracy comparable to the estimates given by
the MAP solution and the confidence interval that mostly covers the reference
solution. We are not able to obtain the HMC posterior to validate rPICKLE's
convergence to the true posterior due to the HMC's prohibitive computational
cost for the considered high-dimensional problems. Our results demonstrate the
advantages of rPICKLE over HMC for approximately sampling high-dimensional
posterior distributions subject to physics constraints.
Related papers
- Total Uncertainty Quantification in Inverse PDE Solutions Obtained with Reduced-Order Deep Learning Surrogate Models [50.90868087591973]
We propose an approximate Bayesian method for quantifying the total uncertainty in inverse PDE solutions obtained with machine learning surrogate models.
We test the proposed framework by comparing it with the iterative ensemble smoother and deep ensembling methods for a non-linear diffusion equation.
arXiv Detail & Related papers (2024-08-20T19:06:02Z) - Randomized Physics-Informed Neural Networks for Bayesian Data Assimilation [44.99833362998488]
We propose a randomized physics-informed neural network (PINN) or rPINN method for uncertainty quantification in inverse partial differential equation (PDE) problems with noisy data.
For the linear Poisson equation, HMC and rPINN produce similar distributions, but rPINN is on average 27 times faster than HMC.
For the non-linear Poison and diffusion equations, the HMC method fails to converge because a single HMC chain cannot sample multiple modes of the posterior distribution of the PINN parameters in a reasonable amount of time.
arXiv Detail & Related papers (2024-07-05T16:16:47Z) - Noise-Free Sampling Algorithms via Regularized Wasserstein Proximals [3.4240632942024685]
We consider the problem of sampling from a distribution governed by a potential function.
This work proposes an explicit score based MCMC method that is deterministic, resulting in a deterministic evolution for particles.
arXiv Detail & Related papers (2023-08-28T23:51:33Z) - Object based Bayesian full-waveform inversion for shear elastography [0.0]
We develop a computational framework to quantify uncertainty in shear elastography imaging of anomalies in tissues.
We find the posterior probability of parameter fields representing the geometry of the anomalies and their shear moduli.
We demonstrate the approach on synthetic two dimensional tests with smooth and irregular shapes.
arXiv Detail & Related papers (2023-05-11T08:25:25Z) - Gaussian process regression and conditional Karhunen-Lo\'{e}ve models
for data assimilation in inverse problems [68.8204255655161]
We present a model inversion algorithm, CKLEMAP, for data assimilation and parameter estimation in partial differential equation models.
The CKLEMAP method provides better scalability compared to the standard MAP method.
arXiv Detail & Related papers (2023-01-26T18:14:12Z) - Physics-Informed Neural Network Method for Parabolic Differential
Equations with Sharply Perturbed Initial Conditions [68.8204255655161]
We develop a physics-informed neural network (PINN) model for parabolic problems with a sharply perturbed initial condition.
Localized large gradients in the ADE solution make the (common in PINN) Latin hypercube sampling of the equation's residual highly inefficient.
We propose criteria for weights in the loss function that produce a more accurate PINN solution than those obtained with the weights selected via other methods.
arXiv Detail & Related papers (2022-08-18T05:00:24Z) - Optimal policy evaluation using kernel-based temporal difference methods [78.83926562536791]
We use kernel Hilbert spaces for estimating the value function of an infinite-horizon discounted Markov reward process.
We derive a non-asymptotic upper bound on the error with explicit dependence on the eigenvalues of the associated kernel operator.
We prove minimax lower bounds over sub-classes of MRPs.
arXiv Detail & Related papers (2021-09-24T14:48:20Z) - Physics-Informed Machine Learning Method for Large-Scale Data
Assimilation Problems [48.7576911714538]
We extend the physics-informed conditional Karhunen-Lo'eve expansion (PICKLE) method for modeling subsurface flow with unknown flux (Neumann) and varying head (Dirichlet) boundary conditions.
We demonstrate that the PICKLE method is comparable in accuracy with the standard maximum a posteriori (MAP) method, but is significantly faster than MAP for large-scale problems.
arXiv Detail & Related papers (2021-07-30T18:43:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.