Entropy-based adaptive design for contour finding and estimating
reliability
- URL: http://arxiv.org/abs/2105.11357v1
- Date: Mon, 24 May 2021 15:41:15 GMT
- Title: Entropy-based adaptive design for contour finding and estimating
reliability
- Authors: D. Austin Cole, Robert B. Gramacy, James E. Warner, Geoffrey F.
Bomarito, Patrick E. Leser, William P. Leser
- Abstract summary: In reliability analysis, methods used to estimate failure probability are often limited by the costs associated with model evaluations.
We introduce an entropy-based GP adaptive design that, when paired with MFIS, provides more accurate failure probability estimates.
Illustrative examples are provided on benchmark data as well as an application to an impact damage simulator for National Aeronautics and Space Administration (NASA) spacesuits.
- Score: 0.24466725954625884
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In reliability analysis, methods used to estimate failure probability are
often limited by the costs associated with model evaluations. Many of these
methods, such as multifidelity importance sampling (MFIS), rely upon a
computationally efficient, surrogate model like a Gaussian process (GP) to
quickly generate predictions. The quality of the GP fit, particularly in the
vicinity of the failure region(s), is instrumental in supplying accurately
predicted failures for such strategies. We introduce an entropy-based GP
adaptive design that, when paired with MFIS, provides more accurate failure
probability estimates and with higher confidence. We show that our greedy data
acquisition strategy better identifies multiple failure regions compared to
existing contour-finding schemes. We then extend the method to batch selection,
without sacrificing accuracy. Illustrative examples are provided on benchmark
data as well as an application to an impact damage simulator for National
Aeronautics and Space Administration (NASA) spacesuits.
Related papers
- Stratified Prediction-Powered Inference for Hybrid Language Model Evaluation [62.2436697657307]
Prediction-powered inference (PPI) is a method that improves statistical estimates based on limited human-labeled data.
We propose a method called Stratified Prediction-Powered Inference (StratPPI)
We show that the basic PPI estimates can be considerably improved by employing simple data stratification strategies.
arXiv Detail & Related papers (2024-06-06T17:37:39Z) - Error-based Knockoffs Inference for Controlled Feature Selection [49.99321384855201]
We propose an error-based knockoff inference method by integrating the knockoff features, the error-based feature importance statistics, and the stepdown procedure together.
The proposed inference procedure does not require specifying a regression model and can handle feature selection with theoretical guarantees.
arXiv Detail & Related papers (2022-03-09T01:55:59Z) - Leveraging Unlabeled Data to Predict Out-of-Distribution Performance [63.740181251997306]
Real-world machine learning deployments are characterized by mismatches between the source (training) and target (test) distributions.
In this work, we investigate methods for predicting the target domain accuracy using only labeled source data and unlabeled target data.
We propose Average Thresholded Confidence (ATC), a practical method that learns a threshold on the model's confidence, predicting accuracy as the fraction of unlabeled examples.
arXiv Detail & Related papers (2022-01-11T23:01:12Z) - GANISP: a GAN-assisted Importance SPlitting Probability Estimator [0.0]
The proposed GAN-assisted Importance SPlitting method (GANISP) improves the variance reduction for the system targeted.
An implementation of the method is available in a companion repository.
arXiv Detail & Related papers (2021-12-28T17:13:37Z) - Rare event estimation using stochastic spectral embedding [0.0]
Estimating the probability of rare failure events is an essential step in the reliability assessment of engineering systems.
We propose a set of modifications that tailor the algorithm to efficiently solve rare event estimation problems.
arXiv Detail & Related papers (2021-06-09T16:10:33Z) - Uncertainty-aware Remaining Useful Life predictor [57.74855412811814]
Remaining Useful Life (RUL) estimation is the problem of inferring how long a certain industrial asset can be expected to operate.
In this work, we consider Deep Gaussian Processes (DGPs) as possible solutions to the aforementioned limitations.
The performance of the algorithms is evaluated on the N-CMAPSS dataset from NASA for aircraft engines.
arXiv Detail & Related papers (2021-04-08T08:50:44Z) - Unlabelled Data Improves Bayesian Uncertainty Calibration under
Covariate Shift [100.52588638477862]
We develop an approximate Bayesian inference scheme based on posterior regularisation.
We demonstrate the utility of our method in the context of transferring prognostic models of prostate cancer across globally diverse populations.
arXiv Detail & Related papers (2020-06-26T13:50:19Z) - Uncertainty Estimation Using a Single Deep Deterministic Neural Network [66.26231423824089]
We propose a method for training a deterministic deep model that can find and reject out of distribution data points at test time with a single forward pass.
We scale training in these with a novel loss function and centroid updating scheme and match the accuracy of softmax models.
arXiv Detail & Related papers (2020-03-04T12:27:36Z) - REAK: Reliability analysis through Error rate-based Adaptive Kriging [2.066555810789929]
This paper introduces Reliability analysis through Error rate-based Adaptive Kriging (REAK)
An extension of the Central Limit Theorem based on Lindeberg condition is adopted here to derive the distribution of the number of design samples with wrong sign estimate.
Results indicate that REAK is able to reduce the computational demand by as high as 50% compared to state-of-the-art methods.
arXiv Detail & Related papers (2020-02-04T03:47:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.