Sequential sparse Gaussian process quantile regression

• URL: http://arxiv.org/abs/2606.31284v1
• Date: Tue, 30 Jun 2026 08:01:45 GMT
• Title: Sequential sparse Gaussian process quantile regression
• Abstract summary: Quantile regression aims to estimate the conditional quantiles of a response variable from observed data.<n>We develop a sparse Gaussian process framework in which the quantile function is represented through a reduced set of inducing variables.<n>A decomposition of the predictive uncertainty into conditional-prior and posterior-induced variance components is then exploited.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Quantile regression aims to estimate the conditional quantiles of a response variable from observed data. In a Bayesian setting, Gaussian process quantile regression provides uncertainty quantification but faces significant computational challenges due to the nonconjugacy of the asymmetric Laplace likelihood and the cost of posterior inference. We develop a sparse Gaussian process framework in which the quantile function is represented through a reduced set of inducing variables and posterior inference is performed using a Laplace approximation. A decomposition of the predictive uncertainty into conditional-prior and posterior-induced variance components is then exploited to drive two complementary adaptive mechanisms: inducing-input infilling and data acquisition. These mechanisms are combined within a sequential algorithm that allocates computational effort toward the dominant source of predictive uncertainty and adaptively controls model complexity. Numerical experiments on benchmark problems demonstrate the accuracy of the Laplace approximation, the benefits of variance-based inducing-input placement, and the effectiveness of the proposed sequential enrichment strategy compared with predefined data-acquisition strategies.

Related papers

• Conditional Diffusion for Nonparametric Instrumental Variable Quantile Regression [18.254578337569264]
  This work proposes a two-stage estimator that combines conditional diffusion modeling with a kernel-parametriced conditional moment formulation.<n>We establish an excess-risk bound for the proposed estimator and derive end-to-end total variation guarantees for the conditional diffusion model.<n> Simulation studies and a real-data application demonstrate that the proposed method outperforms existing nonparametric IVQR approaches.
  arXiv  Detail & Related papers  (2026-08-08T16:01:24Z)
• Quantum Learning of Classical Correlations with continuous-domain Pauli Correlation Encoding [0.0]
  We introduce two quantum covariance estimators: the C-Estimator and the E-Estimator.<n>We analyze the trade-offs between the two estimators in terms of qubit requirements and learning complexity.<n>We show that the barren plateau phenomenon in training the variational quantum circuit for E-estimator can be mitigated.
  arXiv  Detail & Related papers  (2026-04-07T09:39:46Z)
• An Elementary Approach to Scheduling in Generative Diffusion Models [55.171367482496755]
  An elementary approach to characterizing the impact of noise scheduling and time discretization in generative diffusion models is developed.<n> Experiments across different datasets and pretrained models demonstrate that the time discretization strategy selected by our approach consistently outperforms baseline and search-based strategies.
  arXiv  Detail & Related papers  (2026-01-20T05:06:26Z)
• Neural Optimal Transport Meets Multivariate Conformal Prediction [58.43397908730771]
  We propose a framework for conditional vectorile regression (CVQR)<n>CVQR combines neural optimal transport with quantized optimization, and apply it to predictions.
  arXiv  Detail & Related papers  (2025-09-29T19:50:19Z)
• Semiparametric conformal prediction [79.6147286161434]
  We construct a conformal prediction set accounting for the joint correlation structure of the vector-valued non-conformity scores.<n>We flexibly estimate the joint cumulative distribution function (CDF) of the scores.<n>Our method yields desired coverage and competitive efficiency on a range of real-world regression problems.
  arXiv  Detail & Related papers  (2024-11-04T14:29:02Z)
• Combinations of distributional regression algorithms with application in uncertainty estimation of corrected satellite precipitation products [3.8623569699070353]
  We introduce the concept of distributional regression in precipitation dataset creation.<n>New ensemble learning methods can be valuable not only for spatial prediction but also for other prediction problems.<n> Stacking was shown to be superior to individual methods at most quantile levels when evaluated with the quantile loss function.
  arXiv  Detail & Related papers  (2024-06-29T05:58:00Z)
• Structured Radial Basis Function Network: Modelling Diversity for Multiple Hypotheses Prediction [51.82628081279621]
  Multi-modal regression is important in forecasting nonstationary processes or with a complex mixture of distributions. A Structured Radial Basis Function Network is presented as an ensemble of multiple hypotheses predictors for regression problems. It is proved that this structured model can efficiently interpolate this tessellation and approximate the multiple hypotheses target distribution.
  arXiv  Detail & Related papers  (2023-09-02T01:27:53Z)
• Semi-Parametric Inference for Doubly Stochastic Spatial Point Processes: An Approximate Penalized Poisson Likelihood Approach [3.085995273374333]
  Doubly-stochastic point processes model the occurrence of events over a spatial domain as an inhomogeneous process conditioned on the realization of a random intensity function. Existing implementations of doubly-stochastic spatial models are computationally demanding, often have limited theoretical guarantee, and/or rely on restrictive assumptions.
  arXiv  Detail & Related papers  (2023-06-11T19:48:39Z)
• PDE-constrained Gaussian process surrogate modeling with uncertain data locations [1.943678022072958]
  We propose a Bayesian approach that integrates the variability of input data into the Gaussian process regression for function and partial differential equation approximation.<n>A consistently good performance of generalization is observed, and a substantial reduction in the predictive uncertainties is achieved.
  arXiv  Detail & Related papers  (2023-05-19T10:53:08Z)
• Regularized Vector Quantization for Tokenized Image Synthesis [126.96880843754066]
  Quantizing images into discrete representations has been a fundamental problem in unified generative modeling. deterministic quantization suffers from severe codebook collapse and misalignment with inference stage while quantization suffers from low codebook utilization and reconstruction objective. This paper presents a regularized vector quantization framework that allows to mitigate perturbed above issues effectively by applying regularization from two perspectives.
  arXiv  Detail & Related papers  (2023-03-11T15:20:54Z)
• Variational Laplace Autoencoders [53.08170674326728]
  Variational autoencoders employ an amortized inference model to approximate the posterior of latent variables. We present a novel approach that addresses the limited posterior expressiveness of fully-factorized Gaussian assumption. We also present a general framework named Variational Laplace Autoencoders (VLAEs) for training deep generative models.
  arXiv  Detail & Related papers  (2022-11-30T18:59:27Z)
• Communication-Efficient Distributed Quantile Regression with Optimal Statistical Guarantees [2.064612766965483]
  We address the problem of how to achieve optimal inference in distributed quantile regression without stringent scaling conditions. The difficulties are resolved through a double-smoothing approach that is applied to the local (at each data source) and global objective functions. Despite the reliance on a delicate combination of local and global smoothing parameters, the quantile regression model is fully parametric.
  arXiv  Detail & Related papers  (2021-10-25T17:09:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.