Mean-Field Generalisation Bounds for Learning Controls in Stochastic Environments

• URL: http://arxiv.org/abs/2508.16001v1
• Date: Thu, 21 Aug 2025 23:24:16 GMT
• Title: Mean-Field Generalisation Bounds for Learning Controls in Stochastic Environments
• Abstract summary: We consider a data-driven formulation of the classical discrete-time control problem.<n>Our approach exploits the natural structure of many such problems, in which significant portions of the system are uncontrolled.
• Score: 2.8369308760896086
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We consider a data-driven formulation of the classical discrete-time stochastic control problem. Our approach exploits the natural structure of many such problems, in which significant portions of the system are uncontrolled. Employing the dynamic programming principle and the mean-field interpretation of single-hidden layer neural networks, we formulate the control problem as a series of infinite-dimensional minimisation problems. When regularised carefully, we provide practically verifiable assumptions for non-asymptotic bounds on the generalisation error achieved by the minimisers to this problem, thus ensuring stability in overparametrised settings, for controls learned using finitely many observations. We explore connections to the traditional noisy stochastic gradient descent algorithm, and subsequently show promising numerical results for some classic control problems.

Related papers

• A Single-Loop Bilevel Deep Learning Method for Optimal Control of Obstacle Problems [10.846737757627638]
  We propose a single-loop bilevel deep learning method, which is mesh-free, scalable to high-dimensional and complex domains, and avoids repeated solution of discretized subproblems.<n>The proposed method achieves satisfactory accuracy while reducing computational cost compared to classical numerical methods.
  arXiv  Detail & Related papers  (2026-01-07T17:30:42Z)
• Physics-informed Gaussian Processes as Linear Model Predictive Controller [5.89889361990138]
  We introduce a novel algorithm for controlling linear time invariant systems in a tracking problem.<n>We show theoretically that our controller satisfies open-loop stability for the optimal control problem.
  arXiv  Detail & Related papers  (2024-12-02T15:37:37Z)
• Error Feedback under $(L_0,L_1)$-Smoothness: Normalization and Momentum [56.37522020675243]
  We provide the first proof of convergence for normalized error feedback algorithms across a wide range of machine learning problems. We show that due to their larger allowable stepsizes, our new normalized error feedback algorithms outperform their non-normalized counterparts on various tasks.
  arXiv  Detail & Related papers  (2024-10-22T10:19:27Z)
• Physics-Informed Kernel Embeddings: Integrating Prior System Knowledge with Data-Driven Control [22.549914935697366]
  We present a method to incorporate priori knowledge into data-driven control algorithms using kernel embeddings. Our proposed approach incorporates prior knowledge of the system dynamics as a bias term in the kernel learning problem. We demonstrate the improved sample efficiency and out-of-sample generalization of our approach over a purely data-driven baseline.
  arXiv  Detail & Related papers  (2023-01-09T18:35:32Z)
• Finite-Time Analysis of Natural Actor-Critic for POMDPs [29.978816372127085]
  We consider the reinforcement learning problem for partially observed Markov decision processes (POMDPs) with large or even countably infinite state spaces. We consider a natural actor-critic method that employs a finite internal memory for policy parameterization. We show that this error can be made small in the case of sliding-block controllers by using larger block sizes.
  arXiv  Detail & Related papers  (2022-02-20T07:42:00Z)
• Deep Learning Approximation of Diffeomorphisms via Linear-Control Systems [91.3755431537592]
  We consider a control system of the form $dot x = sum_i=1lF_i(x)u_i$, with linear dependence in the controls. We use the corresponding flow to approximate the action of a diffeomorphism on a compact ensemble of points.
  arXiv  Detail & Related papers  (2021-10-24T08:57:46Z)
• Generalization of Neural Combinatorial Solvers Through the Lens of Adversarial Robustness [68.97830259849086]
  Most datasets only capture a simpler subproblem and likely suffer from spurious features. We study adversarial robustness - a local generalization property - to reveal hard, model-specific instances and spurious features. Unlike in other applications, where perturbation models are designed around subjective notions of imperceptibility, our perturbation models are efficient and sound. Surprisingly, with such perturbations, a sufficiently expressive neural solver does not suffer from the limitations of the accuracy-robustness trade-off common in supervised learning.
  arXiv  Detail & Related papers  (2021-10-21T07:28:11Z)
• Gaussian Process-based Min-norm Stabilizing Controller for Control-Affine Systems with Uncertain Input Effects and Dynamics [90.81186513537777]
  We propose a novel compound kernel that captures the control-affine nature of the problem. We show that this resulting optimization problem is convex, and we call it Gaussian Process-based Control Lyapunov Function Second-Order Cone Program (GP-CLF-SOCP)
  arXiv  Detail & Related papers  (2020-11-14T01:27:32Z)
• Total Deep Variation: A Stable Regularizer for Inverse Problems [71.90933869570914]
  We introduce the data-driven general-purpose total deep variation regularizer. In its core, a convolutional neural network extracts local features on multiple scales and in successive blocks. We achieve state-of-the-art results for numerous imaging tasks.
  arXiv  Detail & Related papers  (2020-06-15T21:54:15Z)
• Adaptive Control and Regret Minimization in Linear Quadratic Gaussian (LQG) Setting [91.43582419264763]
  We propose LqgOpt, a novel reinforcement learning algorithm based on the principle of optimism in the face of uncertainty. LqgOpt efficiently explores the system dynamics, estimates the model parameters up to their confidence interval, and deploys the controller of the most optimistic model.
  arXiv  Detail & Related papers  (2020-03-12T19:56:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.