Global universal approximation with Brownian signatures
- URL: http://arxiv.org/abs/2512.16396v1
- Date: Thu, 18 Dec 2025 10:49:20 GMT
- Title: Global universal approximation with Brownian signatures
- Abstract summary: We show that linear functionals acting on signatures of time-extended rough paths are dense with respect to an $Lp$-distance.<n>We demonstrate that these $Lp$-type universal approximation theorems apply in particular to Brownian motion.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We establish $L^p$-type universal approximation theorems for general and non-anticipative functionals on suitable rough path spaces, showing that linear functionals acting on signatures of time-extended rough paths are dense with respect to an $L^p$-distance. To that end, we derive global universal approximation theorems for weighted rough path spaces. We demonstrate that these $L^p$-type universal approximation theorems apply in particular to Brownian motion. As a consequence, linear functionals on the signature of the time-extended Brownian motion can approximate any $p$-integrable stochastic process adapted to the Brownian filtration, including solutions to stochastic differential equations.
Related papers
- Weighted universal approximation of differentiable maps on infinite-dimensional manifolds [1.552674656890411]
We generalize the universal approximation theorem for functional input neural networks to differentiable maps.<n>A FNN maps the input from a possibly infinite-dimensional weighted manifold to the real-valued hidden layer.<n>We show that linear functions of the signature are able to approximate path space functionals including their directional derivatives.
arXiv Detail & Related papers (2026-06-08T17:57:40Z) - Provably Adaptive Linear Approximation for the Shapley Value and Beyond [73.0940890296463]
A fundamental and long-standing challenge is their efficient approximation.<n>We develop a linear-space algorithm that requires $P(|hatboldsymbol-boldsymbol|_2geq)leq $ for all commonly used semi-values.<n>Our algorithm allows explicit minimization of the mean square error for each specific utility function.
arXiv Detail & Related papers (2026-04-09T16:38:14Z) - Global universality via discrete-time signatures [0.0]
We show that piecewise linears of Brownian motion satisfies this integrability condition.<n>We obtain $Lp$-approximation results for path-dependent functionals, random ordinary differential equations, and differential equations driven by Brownian motion.
arXiv Detail & Related papers (2026-03-10T15:12:03Z) - Universal approximation with signatures of non-geometric rough paths [0.0]
We prove that linear functionals of the signature of the resulting rough paths approximate continuous functionals on rough path spaces uniformly on compact sets.<n>We construct the signature of a path extended by its pathwise quadratic variation terms based on general pathwise integration la Fllmer.
arXiv Detail & Related papers (2026-02-05T17:16:25Z) - Constructive Approximation under Carleman's Condition, with Applications to Smoothed Analysis [13.02728413691724]
We develop a fairly tight analogue of the underlying DenjoyCarleman via complex analysis.<n>We establish $L2$ approximation-theoretic results for functions over general classes of distributions.<n>As another application, we show that the Paley--Wiener class of functions band to $[-,]$ admits superexponential rates of approximation over all strictly sub-exponential distributions.
arXiv Detail & Related papers (2025-12-04T01:40:05Z) - Convergence Analysis of the PAGE Stochastic Algorithm for Weakly Convex Finite-Sum Optimization [56.57092765118707]
The algorithm was designed to find stationary points of averages of work of this type.<n>It provides a continuous non-smooth case ($tautauL$) which improves between the general framework ($tautauL$) and the rate of change.
arXiv Detail & Related papers (2025-08-31T08:06:53Z) - On Uniform Weighted Deep Polynomial approximation [0.0]
We introduce and analyze a class of weighted deep approximants tailored for functions with asymmetric behavior-growing on one side and decaying on the other.<n>We show numerically that this framework outperforms Taylor, Chebyshev, and standard deep approximants, even when all use the same number of parameters.
arXiv Detail & Related papers (2025-06-26T14:25:32Z) - Generalized Gradient Norm Clipping & Non-Euclidean $(L_0,L_1)$-Smoothness [51.302674884611335]
This work introduces a hybrid non-Euclidean optimization method which generalizes norm clipping by combining steepest descent and conditional gradient approaches.<n>We discuss how to instantiate the algorithms for deep learning and demonstrate their properties on image classification and language modeling.
arXiv Detail & Related papers (2025-06-02T17:34:29Z) - Rethinking the Global Convergence of Softmax Policy Gradient with Linear Function Approximation [52.772454746132276]
We show that the approximation error in modeling problem-dependent quantities is irrelevant to the algorithm's global convergence.<n>We prove that $textttLin-SPG$ with any arbitrary constant learning rate can ensure global convergence to the optimal policy.
arXiv Detail & Related papers (2025-05-06T04:03:06Z) - Sample-efficient Learning of Infinite-horizon Average-reward MDPs with General Function Approximation [53.17668583030862]
We study infinite-horizon average-reward Markov decision processes (AMDPs) in the context of general function approximation.
We propose a novel algorithmic framework named Local-fitted Optimization with OPtimism (LOOP)
We show that LOOP achieves a sublinear $tildemathcalO(mathrmpoly(d, mathrmsp(V*)) sqrtTbeta )$ regret, where $d$ and $beta$ correspond to AGEC and log-covering number of the hypothesis class respectively
arXiv Detail & Related papers (2024-04-19T06:24:22Z) - Sampling and estimation on manifolds using the Langevin diffusion [45.57801520690309]
Two estimators of linear functionals of $mu_phi $ based on the discretized Markov process are considered.<n>Error bounds are derived for sampling and estimation using a discretization of an intrinsically defined Langevin diffusion.
arXiv Detail & Related papers (2023-12-22T18:01:11Z) - Global universal approximation of functional input maps on weighted spaces [3.386401892906348]
We introduce so-called functional input neural networks defined on a possibly infinite dimensional weighted space with values also in a possibly infinite dimensional output space.<n>We prove a global universal approximation result on weighted spaces for continuous functions going beyond the usual approximation on compact sets.<n>We emphasize that the reproducing Hilbert kernel space of the signature kernels are Cameron-Martin spaces of certain Gaussian processes.
arXiv Detail & Related papers (2023-06-05T23:06:32Z) - Chaotic Hedging with Iterated Integrals and Neural Networks [3.3379026542599934]
We derive an $Lp$-chaos expansion based on iterated Stratonovich integrals.<n>We show that every $p$-integrable functional, $p in [1,infty)$, can be approximated by a finite sum of iterated Stratonovich integrals.
arXiv Detail & Related papers (2022-09-21T07:57:07Z) - Quantitative Rates and Fundamental Obstructions to Non-Euclidean
Universal Approximation with Deep Narrow Feed-Forward Networks [3.8073142980733]
We quantify the number of narrow layers required for "deep geometric feed-forward neural networks"
We find that both the global and local universal approximation guarantees can only coincide when approximating null-homotopic functions.
arXiv Detail & Related papers (2021-01-13T23:29:40Z) - Minimum Width for Universal Approximation [91.02689252671291]
We prove that the minimum width required for the universal approximation of the $Lp$ functions is exactly $maxd_x+1,d_y$.
We also prove that the same conclusion does not hold for the uniform approximation with ReLU, but does hold with an additional threshold activation function.
arXiv Detail & Related papers (2020-06-16T01:24:21Z) - Reinforcement Learning with General Value Function Approximation:
Provably Efficient Approach via Bounded Eluder Dimension [124.7752517531109]
We establish a provably efficient reinforcement learning algorithm with general value function approximation.
We show that our algorithm achieves a regret bound of $widetildeO(mathrmpoly(dH)sqrtT)$ where $d$ is a complexity measure.
Our theory generalizes recent progress on RL with linear value function approximation and does not make explicit assumptions on the model of the environment.
arXiv Detail & Related papers (2020-05-21T17:36:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.