Safe Active Learning for Multi-Output Gaussian Processes
- URL: http://arxiv.org/abs/2203.14849v1
- Date: Mon, 28 Mar 2022 15:41:48 GMT
- Title: Safe Active Learning for Multi-Output Gaussian Processes
- Authors: Cen-You Li, Barbara Rakitsch, Christoph Zimmer
- Abstract summary: We propose a safe active learning approach for multi-output Gaussian process regression.
This approach queries the most informative data or output taking the relatedness between the regressors and safety constraints into account.
- Score: 6.0803541683577444
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Multi-output regression problems are commonly encountered in science and
engineering. In particular, multi-output Gaussian processes have been emerged
as a promising tool for modeling these complex systems since they can exploit
the inherent correlations and provide reliable uncertainty estimates. In many
applications, however, acquiring the data is expensive and safety concerns
might arise (e.g. robotics, engineering). We propose a safe active learning
approach for multi-output Gaussian process regression. This approach queries
the most informative data or output taking the relatedness between the
regressors and safety constraints into account. We prove the effectiveness of
our approach by providing theoretical analysis and by demonstrating empirical
results on simulated datasets and on a real-world engineering dataset. On all
datasets, our approach shows improved convergence compared to its competitors.
Related papers
- Generalization Bounds of Surrogate Policies for Combinatorial Optimization Problems [61.580419063416734]
A recent stream of structured learning approaches has improved the practical state of the art for a range of optimization problems.
The key idea is to exploit the statistical distribution over instances instead of dealing with instances separately.
In this article, we investigate methods that smooth the risk by perturbing the policy, which eases optimization and improves the generalization error.
arXiv Detail & Related papers (2024-07-24T12:00:30Z) - Multi-modal Causal Structure Learning and Root Cause Analysis [67.67578590390907]
We propose Mulan, a unified multi-modal causal structure learning method for root cause localization.
We leverage a log-tailored language model to facilitate log representation learning, converting log sequences into time-series data.
We also introduce a novel key performance indicator-aware attention mechanism for assessing modality reliability and co-learning a final causal graph.
arXiv Detail & Related papers (2024-02-04T05:50:38Z) - A spectrum of physics-informed Gaussian processes for regression in
engineering [0.0]
Despite the growing availability of sensing and data in general, we remain unable to fully characterise many in-service engineering systems and structures from a purely data-driven approach.
This paper pursues the combination of machine learning technology and physics-based reasoning to enhance our ability to make predictive models with limited data.
arXiv Detail & Related papers (2023-09-19T14:39:03Z) - Distributionally Robust Model-based Reinforcement Learning with Large
State Spaces [55.14361269378122]
Three major challenges in reinforcement learning are the complex dynamical systems with large state spaces, the costly data acquisition processes, and the deviation of real-world dynamics from the training environment deployment.
We study distributionally robust Markov decision processes with continuous state spaces under the widely used Kullback-Leibler, chi-square, and total variation uncertainty sets.
We propose a model-based approach that utilizes Gaussian Processes and the maximum variance reduction algorithm to efficiently learn multi-output nominal transition dynamics.
arXiv Detail & Related papers (2023-09-05T13:42:11Z) - End-to-End Meta-Bayesian Optimisation with Transformer Neural Processes [52.818579746354665]
This paper proposes the first end-to-end differentiable meta-BO framework that generalises neural processes to learn acquisition functions via transformer architectures.
We enable this end-to-end framework with reinforcement learning (RL) to tackle the lack of labelled acquisition data.
arXiv Detail & Related papers (2023-05-25T10:58:46Z) - HyperImpute: Generalized Iterative Imputation with Automatic Model
Selection [77.86861638371926]
We propose a generalized iterative imputation framework for adaptively and automatically configuring column-wise models.
We provide a concrete implementation with out-of-the-box learners, simulators, and interfaces.
arXiv Detail & Related papers (2022-06-15T19:10:35Z) - Latent Variable Method Demonstrator -- Software for Understanding
Multivariate Data Analytics Algorithms [0.0]
This article describes interactive software - the Latent Variable Demonstrator (LAVADE) - for teaching, learning, and understanding latent variable methods.
Users can interactively compare latent variable methods such as Partial Least Squares (PLS), and Principal Component Regression (PCR) with other regression methods.
The software contains a data generation method and three chemical process datasets, allowing for comparing results of datasets with different levels of complexity.
arXiv Detail & Related papers (2022-05-17T07:02:41Z) - Data Fusion with Latent Map Gaussian Processes [0.0]
Multi-fidelity modeling and calibration are data fusion tasks that ubiquitously arise in engineering design.
We introduce a novel approach based on latent-map Gaussian processes (LMGPs) that enables efficient and accurate data fusion.
arXiv Detail & Related papers (2021-12-04T00:54:19Z) - Privacy-preserving Logistic Regression with Secret Sharing [0.0]
We propose secret sharing-based privacy-preserving logistic regression protocols using the Newton-Raphson method.
Our implementation results show that our improved method can handle large datasets used in securely training a logistic regression from multiple sources.
arXiv Detail & Related papers (2021-05-14T14:53:50Z) - You Only Compress Once: Optimal Data Compression for Estimating Linear
Models [1.2845031126178592]
Many engineering systems that use linear models achieve computational efficiency through distributed systems and expert configuration.
Conditionally sufficient statistics is a unified data compression and estimation strategy.
arXiv Detail & Related papers (2021-02-22T19:00:18Z) - A Hypergradient Approach to Robust Regression without Correspondence [85.49775273716503]
We consider a variant of regression problem, where the correspondence between input and output data is not available.
Most existing methods are only applicable when the sample size is small.
We propose a new computational framework -- ROBOT -- for the shuffled regression problem.
arXiv Detail & Related papers (2020-11-30T21:47:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.