A Kernel-Based Approach for Modelling Gaussian Processes with Functional Information

• URL: http://arxiv.org/abs/2201.11023v2
• Date: Tue, 03 Jun 2025 18:25:25 GMT
• Title: A Kernel-Based Approach for Modelling Gaussian Processes with Functional Information
• Abstract summary: In addition to training data, available information is not in the form of a finite collection of points.<n>We propose and construct processes that unify, via reproducing kernel Hilbert space, the typical finite training data case.<n>We show existence of the proposed process and establish that it is the limit of a conventional GP conditioned on an increasing number of training points.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Gaussian processes (GPs) are ubiquitous tools for modeling and predicting continuous processes in physical and engineering sciences. This is partly due to the fact that one may employ a Gaussian process as an interpolator while facilitating straightforward uncertainty quantification at other locations. In addition to training data, it is sometimes the case that available information is not in the form of a finite collection of points. For example, boundary value problems contain information on the boundary of a domain, or underlying physics lead to known behavior on an entire uncountable subset of the domain of interest. While an approximation to such known information may be obtained via pseudo-training points in the known subset, such a procedure is ad hoc with little guidance on the number of points to use, nor the behavior as the number of pseudo-observations grows large. We propose and construct Gaussian processes that unify, via reproducing kernel Hilbert space, the typical finite training data case with the case of having uncountable information by exploiting the equivalence of conditional expectation and orthogonal projections in Hilbert space. We show existence of the proposed process and establish that it is the limit of a conventional GP conditioned on an increasing number of training points. We illustrate the flexibility and advantages of our proposed approach via numerical experiments.

Related papers

• Distributed Quantum Gaussian Processes for Multi-Agent Systems [2.526124003343442]
  Quantum computing offers the potential to overcome limitations by embedding data into exponentially large Hilbert spaces.<n>We propose a Distributed Quantum Gaussian Process (DQGP) method in a multiagent setting to enhance modeling capabilities and scalability.<n>We use real-world, non-stationary elevation datasets of NASA's Shuttle Radar Topography Mission and synthetic datasets generated by Quantum Gaussian Processes.
  arXiv  Detail & Related papers  (2026-02-16T18:46:23Z)
• gp2Scale: A Class of Compactly-Supported Non-Stationary Kernels and Distributed Computing for Exact Gaussian Processes on 10 Million Data Points [3.649118516936603]
  We propose a methodology that scales exact Gaussian processes to more than 10 million data points without relying on inducing points, kernel, or neighborhood-based approximations.<n>We show our method's functionality on several real-world datasets and compare it with state-of-the-art approximation algorithms.
  arXiv  Detail & Related papers  (2025-12-05T20:52:37Z)
• Physics-informed, boundary-constrained Gaussian process regression for the reconstruction of fluid flow fields [0.6999740786886536]
  We present a general method for constraining a prescribed Gaussian process on an arbitrary compact set.<n>We derive physics-informed kernels for simulating two-dimensional velocity fields of an incompressible (divergence-free) flow around aerodynamic profiles.<n>The relevance of the methodology and performances are illustrated by numerical simulations of flows around a cylinder and a NACA 0412 airfoil profile.
  arXiv  Detail & Related papers  (2025-07-23T15:18:15Z)
• Quantum-Assisted Hilbert-Space Gaussian Process Regression [0.0]
  We propose a space approximation-based quantum algorithm for Gaussian process regression. Our method consists of a combination of classical basis function expansion with quantum computing techniques.
  arXiv  Detail & Related papers  (2024-02-01T12:13:35Z)
• Posterior Contraction Rates for Mat\'ern Gaussian Processes on Riemannian Manifolds [51.68005047958965]
  We show that intrinsic Gaussian processes can achieve better performance in practice. Our work shows that finer-grained analyses are needed to distinguish between different levels of data-efficiency.
  arXiv  Detail & Related papers  (2023-09-19T20:30:58Z)
• Score-based Diffusion Models in Function Space [137.70916238028306]
  Diffusion models have recently emerged as a powerful framework for generative modeling.<n>This work introduces a mathematically rigorous framework called Denoising Diffusion Operators (DDOs) for training diffusion models in function space.<n>We show that the corresponding discretized algorithm generates accurate samples at a fixed cost independent of the data resolution.
  arXiv  Detail & Related papers  (2023-02-14T23:50:53Z)
• Sequential Estimation of Gaussian Process-based Deep State-Space Models [1.760402297380953]
  We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models. We present a method based on particle filtering where the parameters of the random feature-based Gaussian processes are integrated out. We show that the method can track the latent processes up to a scale and rotation.
  arXiv  Detail & Related papers  (2023-01-29T20:01:09Z)
• Gaussian Process regression over discrete probability measures: on the non-stationarity relation between Euclidean and Wasserstein Squared Exponential Kernels [0.19116784879310028]
  A non-stationarity relationship between the Wasserstein-based squared exponential kernel and its Euclidean-based counterpart is studied. A transformation is used to transform the input space as Euclidean into a non-stationary and Wasserstein-based Gaussian Process model.
  arXiv  Detail & Related papers  (2022-12-02T17:09:52Z)
• Isotropic Gaussian Processes on Finite Spaces of Graphs [71.26737403006778]
  We propose a principled way to define Gaussian process priors on various sets of unweighted graphs. We go further to consider sets of equivalence classes of unweighted graphs and define the appropriate versions of priors thereon. Inspired by applications in chemistry, we illustrate the proposed techniques on a real molecular property prediction task in the small data regime.
  arXiv  Detail & Related papers  (2022-11-03T10:18:17Z)
• Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces I: the compact case [43.877478563933316]
  In to symmetries is one of the most fundamental forms of prior information one can consider. In this work, we develop constructive and practical techniques for building stationary Gaussian processes on a very large class of non-Euclidean spaces.
  arXiv  Detail & Related papers  (2022-08-31T16:40:40Z)
• Gaussian Processes and Statistical Decision-making in Non-Euclidean Spaces [96.53463532832939]
  We develop techniques for broadening the applicability of Gaussian processes. We introduce a wide class of efficient approximations built from this viewpoint. We develop a collection of Gaussian process models over non-Euclidean spaces.
  arXiv  Detail & Related papers  (2022-02-22T01:42:57Z)
• Vector-valued Gaussian Processes on Riemannian Manifolds via Gauge Equivariant Projected Kernels [108.60991563944351]
  We present a recipe for constructing gauge equivariant kernels, which induce vector-valued Gaussian processes coherent with geometry. We extend standard Gaussian process training methods, such as variational inference, to this setting.
  arXiv  Detail & Related papers  (2021-10-27T13:31:10Z)
• Advanced Stationary and Non-Stationary Kernel Designs for Domain-Aware Gaussian Processes [0.0]
  We propose advanced kernel designs that only allow for functions with certain desirable characteristics to be elements of the reproducing kernel Hilbert space (RKHS) We will show the impact of advanced kernel designs on Gaussian processes using several synthetic and two scientific data sets.
  arXiv  Detail & Related papers  (2021-02-05T22:07:56Z)
• Mat\'ern Gaussian Processes on Graphs [67.13902825728718]
  We leverage the partial differential equation characterization of Mat'ern Gaussian processes to study their analog for undirected graphs. We show that the resulting Gaussian processes inherit various attractive properties of their Euclidean and Euclidian analogs. This enables graph Mat'ern Gaussian processes to be employed in mini-batch and non-conjugate settings.
  arXiv  Detail & Related papers  (2020-10-29T13:08:07Z)
• Mat\'ern Gaussian processes on Riemannian manifolds [81.15349473870816]
  We show how to generalize the widely-used Mat'ern class of Gaussian processes. We also extend the generalization from the Mat'ern to the widely-used squared exponential process.
  arXiv  Detail & Related papers  (2020-06-17T21:05:42Z)
• Convergence Guarantees for Gaussian Process Means With Misspecified Likelihoods and Smoothness [0.7734726150561089]
  We study the properties of Gaussian process means when the smoothness of the model and the likelihood function are misspecified. The answer to this problem is particularly useful since it can inform our choice of model and experimental design.
  arXiv  Detail & Related papers  (2020-01-29T13:28:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.