Universal Approximation of Continuous Functionals on Compact Subsets via Linear Measurements and Scalar Nonlinearities

• URL: http://arxiv.org/abs/2602.03290v1
• Date: Tue, 03 Feb 2026 09:16:50 GMT
• Title: Universal Approximation of Continuous Functionals on Compact Subsets via Linear Measurements and Scalar Nonlinearities
• Abstract summary: We study universal approximation of continuous functionals on compact subsets of products of Hilbert spaces.<n>We extend the approximation principle to maps with values in a Banach space, yielding finite-rank approximations.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We study universal approximation of continuous functionals on compact subsets of products of Hilbert spaces. We prove that any such functional can be uniformly approximated by models that first take finitely many continuous linear measurements of the inputs and then combine these measurements through continuous scalar nonlinearities. We also extend the approximation principle to maps with values in a Banach space, yielding finite-rank approximations. These results provide a compact-set justification for the common ``measure, apply scalar nonlinearities, then combine'' design pattern used in operator learning and imaging.

Related papers

• Dimension Reduction for Curves: Simplified and Generalized [56.23281156053955]
  We revisit random projections for reducing the dimension of high-dimensional polygonal curves.<n>We give a simplified proof of the known $O(varepsilon-2log(nm))$ bound on the target dimension of a random projection.<n>Our proof is based on the concept of sparse oblivious subspace embeddings.
  arXiv  Detail & Related papers  (2026-07-03T08:48:35Z)
• Weighted universal approximation of differentiable maps on infinite-dimensional manifolds [1.552674656890411]
  We generalize the universal approximation theorem for functional input neural networks to differentiable maps.<n>A FNN maps the input from a possibly infinite-dimensional weighted manifold to the real-valued hidden layer.<n>We show that linear functions of the signature are able to approximate path space functionals including their directional derivatives.
  arXiv  Detail & Related papers  (2026-06-08T17:57:40Z)
• Global universality via discrete-time signatures [0.0]
  We show that piecewise linears of Brownian motion satisfies this integrability condition.<n>We obtain $Lp$-approximation results for path-dependent functionals, random ordinary differential equations, and differential equations driven by Brownian motion.
  arXiv  Detail & Related papers  (2026-03-10T15:12:03Z)
• Flow Straight and Fast in Hilbert Space: Functional Rectified Flow [14.747544527069804]
  We establish a rigorous functional formulation of rectified flow in an infinite-dimensional Hilbert space.<n>We show that this framework extends naturally to functional flow matching and functional probability flow ODEs.<n>Our method achieves superior performance compared to existing functional generative models.
  arXiv  Detail & Related papers  (2025-09-12T16:18:16Z)
• Entropic Mirror Descent for Linear Systems: Polyak's Stepsize and Implicit Bias [55.72269695392027]
  This paper focuses on applying entropic mirror descent to solve linear systems.<n>The main challenge for the convergence analysis stems from the unboundedness of the domain.<n>To overcome this without imposing restrictive assumptions, we introduce a variant of Polyak-type stepsizes.
  arXiv  Detail & Related papers  (2025-05-05T12:33:18Z)
• Spingarn's Method and Progressive Decoupling Beyond Elicitable Monotonicity [4.307128674848627]
  We develop a general local convergence analysis in a certain nonmonotone setting.<n>We prove convergence under conditions that link the relaxation parameters to the nonmonotonicity of their respective subspaces.
  arXiv  Detail & Related papers  (2025-04-01T14:26:01Z)
• Convergence of TD(0) under Polynomial Mixing with Nonlinear Function Approximation [49.1574468325115]
  Temporal Difference Learning (TD(0)) is fundamental in reinforcement learning.<n>We provide the first high-probability, finite-sample analysis of vanilla TD(0) on mixing Markov data.
  arXiv  Detail & Related papers  (2025-02-08T22:01:02Z)
• Kernel Operator-Theoretic Bayesian Filter for Nonlinear Dynamical Systems [25.922732994397485]
  We propose a machine-learning alternative based on a functional Bayesian perspective for operator-theoretic modeling. This formulation is directly done in an infinite-dimensional space of linear operators or Hilbert space with universal approximation property. We demonstrate that this practical approach can obtain accurate results and outperform finite-dimensional Koopman decomposition.
  arXiv  Detail & Related papers  (2024-10-31T20:31:31Z)
• Global universal approximation of functional input maps on weighted spaces [3.386401892906348]
  We introduce so-called functional input neural networks defined on a possibly infinite dimensional weighted space with values also in a possibly infinite dimensional output space.<n>We prove a global universal approximation result on weighted spaces for continuous functions going beyond the usual approximation on compact sets.<n>We emphasize that the reproducing Hilbert kernel space of the signature kernels are Cameron-Martin spaces of certain Gaussian processes.
  arXiv  Detail & Related papers  (2023-06-05T23:06:32Z)
• Kernel-based off-policy estimation without overlap: Instance optimality beyond semiparametric efficiency [53.90687548731265]
  We study optimal procedures for estimating a linear functional based on observational data. For any convex and symmetric function class $mathcalF$, we derive a non-asymptotic local minimax bound on the mean-squared error.
  arXiv  Detail & Related papers  (2023-01-16T02:57:37Z)
• Reinforcement Learning from Partial Observation: Linear Function Approximation with Provable Sample Efficiency [111.83670279016599]
  We study reinforcement learning for partially observed decision processes (POMDPs) with infinite observation and state spaces. We make the first attempt at partial observability and function approximation for a class of POMDPs with a linear structure.
  arXiv  Detail & Related papers  (2022-04-20T21:15:38Z)
• The Connection between Discrete- and Continuous-Time Descriptions of Gaussian Continuous Processes [60.35125735474386]
  We show that discretizations yielding consistent estimators have the property of invariance under coarse-graining' This result explains why combining differencing schemes for derivatives reconstruction and local-in-time inference approaches does not work for time series analysis of second or higher order differential equations.
  arXiv  Detail & Related papers  (2021-01-16T17:11:02Z)
• Optimal oracle inequalities for solving projected fixed-point equations [53.31620399640334]
  We study methods that use a collection of random observations to compute approximate solutions by searching over a known low-dimensional subspace of the Hilbert space. We show how our results precisely characterize the error of a class of temporal difference learning methods for the policy evaluation problem with linear function approximation.
  arXiv  Detail & Related papers  (2020-12-09T20:19:32Z)
• Fuzzy Integral = Contextual Linear Order Statistic [0.0]
  The fuzzy integral is a powerful parametric nonlin-ear function with utility in a wide range of applications. We show that it can be represented by a set of contextual linear order statistics.
  arXiv  Detail & Related papers  (2020-07-06T16:37:36Z)
• On Linear Stochastic Approximation: Fine-grained Polyak-Ruppert and Non-Asymptotic Concentration [115.1954841020189]
  We study the inequality and non-asymptotic properties of approximation procedures with Polyak-Ruppert averaging. We prove a central limit theorem (CLT) for the averaged iterates with fixed step size and number of iterations going to infinity.
  arXiv  Detail & Related papers  (2020-04-09T17:54:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.