MVNN: A Measure-Valued Neural Network for Learning McKean-Vlasov Dynamics from Particle Data
- URL: http://arxiv.org/abs/2604.00333v2
- Date: Mon, 06 Apr 2026 23:06:42 GMT
- Title: MVNN: A Measure-Valued Neural Network for Learning McKean-Vlasov Dynamics from Particle Data
- Abstract summary: We introduce a measure-valued neural network that infers measure-dependent interaction terms from particle-trajectory observations.<n>On the theory side, we establish well-posedness of the resulting dynamics and prove propagation-of-chaos for the associated interacting-particle system.<n> Numerical experiments on first and second order systems, including deterministic and Motsch-Tadmor dynamics, two-dimensional attraction-repulsion aggregation, Cucker-Smale dynamics, and a hierarchical multi-group system, demonstrate accurate prediction and strong out-of-distribution generalization.
- Score: 0.688204255655161
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Collective behaviors that emerge from interactions are fundamental to numerous biological systems. To learn such interacting forces from observations, we introduce a measure-valued neural network that infers measure-dependent interaction (drift) terms directly from particle-trajectory observations. The proposed architecture generalizes standard neural networks to operate on probability measures by learning cylindrical features, using an embedding network that produces scalable distribution-to-vector representations. On the theory side, we establish well-posedness of the resulting dynamics and prove propagation-of-chaos for the associated interacting-particle system. We further show universal approximation and quantitative approximation rates under a low-dimensional measure-dependence assumption. Numerical experiments on first and second order systems, including deterministic and stochastic Motsch-Tadmor dynamics, two-dimensional attraction-repulsion aggregation, Cucker-Smale dynamics, and a hierarchical multi-group system, demonstrate accurate prediction and strong out-of-distribution generalization.
Related papers
- Topological Neural Dynamics: A Neuron-wise Framework for Sequence Modeling [55.07411490538404]
Topological Neural Dynamics (TND) is a sequence modeling framework that shifts from layer-wise to neuron-wise dynamics.<n>TND represents a neural system as a directed neuron graph, an interaction operator, and a local dynamics function.<n>We evaluate TND as a case study on a behavior cloning task in single-player Pong.
arXiv Detail & Related papers (2026-06-19T10:18:24Z) - Quantum fluctuations and chaos in fully connected spin models [84.0552206158625]
We investigate beyond-mean-field dynamics in a fully connected $mathrmSU(3)$ spin-exchange model.<n>Using the two-particle irreducible (2PI) effective action formalism, we derive equations of motion that account for higher-order correlations generated by interactions.<n>Our results show that an accurate treatment of fluctuations is essential for describing macroscopic dynamics in quantum many-body systems.
arXiv Detail & Related papers (2026-05-26T15:53:43Z) - Neuronal Group Communication for Efficient Neural representation [85.36421257648294]
This paper addresses the question of how to build large neural systems that learn efficient, modular, and interpretable representations.<n>We propose Neuronal Group Communication (NGC), a theory-driven framework that reimagines a neural network as a dynamical system of interacting neuronal groups.<n>NGC treats weights as transient interactions between embedding-like neuronal states, with neural computation unfolding through iterative communication among groups of neurons.
arXiv Detail & Related papers (2025-10-19T14:23:35Z) - Diffusion-Guided Renormalization of Neural Systems via Tensor Networks [0.0]
Far from equilibrium, neural systems self-organize across multiple scales.<n>Exploiting multiscale self-organization in neuroscience and artificial intelligence requires a computational framework.<n>I develop a scalable graph inference algorithm for discovering community structure from subsampled neural activity.
arXiv Detail & Related papers (2025-10-07T18:26:10Z) - A Differential Manifold Perspective and Universality Analysis of Continuous Attractors in Artificial Neural Networks [9.36187870834781]
Continuous attractors are critical for information processing in both biological and artificial neural systems.<n>This study establishes a novel framework to investigate continuous attractors in artificial neural networks.
arXiv Detail & Related papers (2025-09-03T09:16:33Z) - Models of Heavy-Tailed Mechanistic Universality [62.107333654304014]
We propose a family of random matrix models to explore attributes that give rise to heavy-tailed behavior in trained neural networks.<n>Under this model, spectral densities with power laws on tails arise through a combination of three independent factors.<n> Implications of our model on other appearances of heavy tails, including neural scaling laws, trajectories, and the five-plus-one phases of neural network training, are discussed.
arXiv Detail & Related papers (2025-06-04T00:55:01Z) - Self-orthogonalizing attractor neural networks emerging from the free energy principle [0.0]
We formalize how attractor networks emerge from the free energy principle applied to a universal partitioning of random dynamical systems.<n>Our approach obviates the need for explicitly imposed learning and inference rules.<n>Our findings offer a unifying theory of self-organizing attractor networks, providing novel insights for AI and neuroscience.
arXiv Detail & Related papers (2025-05-28T18:10:03Z) - Inferring Relational Potentials in Interacting Systems [56.498417950856904]
We propose Neural Interaction Inference with Potentials (NIIP) as an alternative approach to discover such interactions.
NIIP assigns low energy to the subset of trajectories which respect the relational constraints observed.
It allows trajectory manipulation, such as interchanging interaction types across separately trained models, as well as trajectory forecasting.
arXiv Detail & Related papers (2023-10-23T00:44:17Z) - Capturing dynamical correlations using implicit neural representations [85.66456606776552]
We develop an artificial intelligence framework which combines a neural network trained to mimic simulated data from a model Hamiltonian with automatic differentiation to recover unknown parameters from experimental data.
In doing so, we illustrate the ability to build and train a differentiable model only once, which then can be applied in real-time to multi-dimensional scattering data.
arXiv Detail & Related papers (2023-04-08T07:55:36Z) - Stretched and measured neural predictions of complex network dynamics [2.1024950052120417]
Data-driven approximations of differential equations present a promising alternative to traditional methods for uncovering a model of dynamical systems.
A recently employed machine learning tool for studying dynamics is neural networks, which can be used for data-driven solution finding or discovery of differential equations.
We show that extending the model's generalizability beyond traditional statistical learning theory limits is feasible.
arXiv Detail & Related papers (2023-01-12T09:44:59Z) - Spreading of a local excitation in a Quantum Hierarchical Model [62.997667081978825]
We study the dynamics of the quantum Dyson hierarchical model in its paramagnetic phase.
An initial state made by a local excitation of the paramagnetic ground state is considered.
A localization mechanism is found and the excitation remains close to its initial position at arbitrary times.
arXiv Detail & Related papers (2022-07-14T10:05:20Z) - Provably Efficient Neural Estimation of Structural Equation Model: An
Adversarial Approach [144.21892195917758]
We study estimation in a class of generalized Structural equation models (SEMs)
We formulate the linear operator equation as a min-max game, where both players are parameterized by neural networks (NNs), and learn the parameters of these neural networks using a gradient descent.
For the first time we provide a tractable estimation procedure for SEMs based on NNs with provable convergence and without the need for sample splitting.
arXiv Detail & Related papers (2020-07-02T17:55:47Z) - MagNet: Discovering Multi-agent Interaction Dynamics using Neural
Network [11.285833408524708]
MagNet is a neural network-based multi-agent interaction model.
It is trained to discover the core dynamics of a multi-agent system from observations.
It is tuned on-line to learn agent-specific parameters to ensure accurate prediction.
arXiv Detail & Related papers (2020-01-24T13:41:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.