Neural-network solutions to stochastic reaction networks

• URL: http://arxiv.org/abs/2210.01169v1
• Date: Thu, 29 Sep 2022 07:27:59 GMT
• Title: Neural-network solutions to stochastic reaction networks
• Abstract summary: We propose a machine-learning approach using the variational autoregressive network to solve the chemical master equation. The proposed approach tracks the time evolution of the joint probability distribution in the state space of species counts. We demonstrate that it accurately generates the probability distribution over time in the genetic toggle switch and the early life self-replicator.
• Score: 7.021105583098606
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The stochastic reaction network is widely used to model stochastic processes in physics, chemistry and biology. However, the size of the state space increases exponentially with the number of species, making it challenging to investigate the time evolution of the chemical master equation for the reaction network. Here, we propose a machine-learning approach using the variational autoregressive network to solve the chemical master equation. The approach is based on the reinforcement learning framework and does not require any data simulated in prior by another method. Different from simulating single trajectories, the proposed approach tracks the time evolution of the joint probability distribution in the state space of species counts, and supports direct sampling on configurations and computing their normalized joint probabilities. We apply the approach to various systems in physics and biology, and demonstrate that it accurately generates the probability distribution over time in the genetic toggle switch, the early life self-replicator, the epidemic model and the intracellular signaling cascade. The variational autoregressive network exhibits a plasticity in representing the multi-modal distribution by feedback regulations, cooperates with the conservation law, enables time-dependent reaction rates, and is efficient for high-dimensional reaction networks with allowing a flexible upper count limit. The results suggest a general approach to investigate stochastic reaction networks based on modern machine learning.

Related papers

• ChemFusion: A Multimodal Cross-Attention Network for Reaction Yield Prediction [0.8092815324198175]
  We present ChemFusion, a hybrid neural network that fuses conventional electronic features with explicit 3D atomic coordinates.<n>When benchmarked against a diverse library of cross-couplings, this approach delivers exceptional predictive performance.<n>This provides a physically grounded interpretability, demonstrating that spatially aware networks can navigate complex reaction sterics.
  arXiv  Detail & Related papers  (2026-07-19T02:31:29Z)
• A Spiking Neural Network Implementation of Gaussian Belief Propagation [3.05103886673788]
  We investigate a distributed form of Bayesian inference, namely message passing on factor graphs.<n>We perform belief propagation by encoding messages that come into factor nodes as spike-based signals.<n>Three core linear operations, equality (branching), addition, and multiplication, are realized in networks of leaky integrate-and-fire models.
  arXiv  Detail & Related papers  (2025-12-11T13:43:42Z)
• Tracking large chemical reaction networks and rare events by neural networks [14.018667824929878]
  Chemical reaction networks are widely used to model dynamics in chemical kinetics, systems biology and epidemiology.<n>Here, we push the frontier of neural-network approach by exploiting faster optimizations such as natural gradient descent and time-dependent variational principle.<n>We demonstrate reduced computational cost and higher accuracy over the previous neural-network method in challenging reaction networks.
  arXiv  Detail & Related papers  (2025-12-11T05:55:44Z)
• From Pheromones to Policies: Reinforcement Learning for Engineered Biological Swarms [0.0]
  This study establishes a theoretical equivalence between pheromone-mediated aggregation in celeg and reinforcement learning (RL)<n>We model engineered nematode swarms performing foraging tasks, showing that pheromone dynamics mathematically mirror cross-learning updates.<n>Our results demonstrate that stigmergic systems inherently encode distributed RL processes, where environmental signals act as external memory for collective credit assignment.
  arXiv  Detail & Related papers  (2025-09-24T13:16:35Z)
• Autoregressive Typical Thermal States [0.0]
  We introduce an autoregressive framework to calculate finite-temperature properties of a quantum system.<n>By comparing our algorithm to exact results for the spin 1/2 quantum XY chain, we demonstrate that autoregressive typical thermal states are capable of accurately calculating thermal observables.
  arXiv  Detail & Related papers  (2025-08-19T02:20:15Z)
• Symbolic Foundation Regressor on Complex Networks [8.438758359789462]
  We introduce a pre-trained symbolic foundation regressor that can compress complex data with numerous interacting variables.<n>Our model has been rigorously tested on non-network symbolic regression, symbolic regression on complex networks, and the inference of network dynamics across various domains.
  arXiv  Detail & Related papers  (2025-05-28T01:53:29Z)
• KITINet: Kinetics Theory Inspired Network Architectures with PDE Simulation Approaches [43.872190335490515]
  This paper introduces KITINet, a novel architecture that reinterprets feature propagation through the lens of non-equilibrium particle dynamics.<n>At its core, we propose a residual module that models update as the evolution of a particle system.<n>This formulation mimics particle collisions and energy exchange, enabling adaptive feature refinement via physics-informed interactions.
  arXiv  Detail & Related papers  (2025-05-23T13:58:29Z)
• Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matching [33.9461078261722]
  We introduce Adjoint Sampling, a highly scalable and efficient algorithm for learning diffusion processes that sample from unnormalized densities. We show how to incorporate key symmetries, as well as periodic boundary conditions, for modeling molecules in both cartesian and torsional coordinates. We demonstrate the effectiveness of our approach through extensive experiments on classical energy functions, and further scale up to neural network-based energy models.
  arXiv  Detail & Related papers  (2025-04-16T02:20:06Z)
• Allostatic Control of Persistent States in Spiking Neural Networks for perception and computation [79.16635054977068]
  We introduce a novel model for updating perceptual beliefs about the environment by extending the concept of Allostasis to the control of internal representations. In this paper, we focus on an application in numerical cognition, where a bump of activity in an attractor network is used as a spatial numerical representation.
  arXiv  Detail & Related papers  (2025-03-20T12:28:08Z)
• Explosive neural networks via higher-order interactions in curved statistical manifolds [43.496401697112695]
  We introduce curved neural networks as a class of prototypical models with a limited number of parameters.<n>We show that these curved neural networks implement a self-regulating process that can accelerate memory retrieval.<n>We analytically explore their memory-retrieval capacity using the replica trick near ferromagnetic and spin-glass phase boundaries.
  arXiv  Detail & Related papers  (2024-08-05T09:10:29Z)
• Learning Theory of Distribution Regression with Neural Networks [6.961253535504979]
  We establish an approximation theory and a learning theory of distribution regression via a fully connected neural network (FNN) In contrast to the classical regression methods, the input variables of distribution regression are probability measures.
  arXiv  Detail & Related papers  (2023-07-07T09:49:11Z)
• Machine learning in and out of equilibrium [58.88325379746631]
  Our study uses a Fokker-Planck approach, adapted from statistical physics, to explore these parallels. We focus in particular on the stationary state of the system in the long-time limit, which in conventional SGD is out of equilibrium. We propose a new variation of Langevin dynamics (SGLD) that harnesses without replacement minibatching.
  arXiv  Detail & Related papers  (2023-06-06T09:12:49Z)
• Bayesian Inference for Jump-Diffusion Approximations of Biochemical Reaction Networks [26.744964200606784]
  We develop a tractable Bayesian inference algorithm based on Markov chain Monte Carlo. The algorithm is numerically evaluated for a partially observed multi-scale birth-death process example.
  arXiv  Detail & Related papers  (2023-04-13T14:57:22Z)
• Differentiable Programming of Chemical Reaction Networks [63.948465205530916]
  Chemical reaction networks are one of the most fundamental computational substrates used by nature. We study well-mixed single-chamber systems, as well as systems with multiple chambers separated by membranes. We demonstrate that differentiable optimisation, combined with proper regularisation, can discover non-trivial sparse reaction networks.
  arXiv  Detail & Related papers  (2023-02-06T11:41:14Z)
• Path sampling of recurrent neural networks by incorporating known physics [0.0]
  We show a path sampling approach that allows us to include generic thermodynamic or kinetic constraints into recurrent neural networks. We show the method here for a widely used type of recurrent neural network known as long short-term memory network. Our method can be easily generalized to other generative artificial intelligence models and to generic time series in different areas of physical and social sciences.
  arXiv  Detail & Related papers  (2022-03-01T16:35:50Z)
• Influence Estimation and Maximization via Neural Mean-Field Dynamics [60.91291234832546]
  We propose a novel learning framework using neural mean-field (NMF) dynamics for inference and estimation problems. Our framework can simultaneously learn the structure of the diffusion network and the evolution of node infection probabilities.
  arXiv  Detail & Related papers  (2021-06-03T00:02:05Z)
• Deep learning approaches to surrogates for solving the diffusion equation for mechanistic real-world simulations [0.0]
  In medical, biological, physical and engineered models the numerical solution of partial differential equations (PDEs) can make simulations impractically slow. Machine learning surrogates, neural networks trained to provide approximate solutions to such complicated numerical problems, can often provide speed-ups of several orders of magnitude compared to direct calculation. We use a Convolutional Neural Network to approximate the stationary solution to the diffusion equation in the case of two equal-diameter, circular, constant-value sources.
  arXiv  Detail & Related papers  (2021-02-10T16:15:17Z)
• Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Prediction [79.81193813215872]
  We develop a hybrid (graph) neural network that combines a traditional graph convolutional network with an embedded differentiable fluid dynamics simulator inside the network itself. We show that we can both generalize well to new situations and benefit from the substantial speedup of neural network CFD predictions.
  arXiv  Detail & Related papers  (2020-07-08T21:23:19Z)
• Network Diffusions via Neural Mean-Field Dynamics [52.091487866968286]
  We propose a novel learning framework for inference and estimation problems of diffusion on networks. Our framework is derived from the Mori-Zwanzig formalism to obtain an exact evolution of the node infection probabilities. Our approach is versatile and robust to variations of the underlying diffusion network models.
  arXiv  Detail & Related papers  (2020-06-16T18:45:20Z)
• Watch and learn -- a generalized approach for transferrable learning in deep neural networks via physical principles [0.0]
  We demonstrate an unsupervised learning approach that achieves fully transferrable learning for problems in statistical physics across different physical regimes. By coupling a sequence model based on a recurrent neural network to an extensive deep neural network, we are able to learn the equilibrium probability distributions and inter-particle interaction models of classical statistical mechanical systems.
  arXiv  Detail & Related papers  (2020-03-03T18:37:23Z)
• Retrosynthesis Prediction with Conditional Graph Logic Network [118.70437805407728]
  Computer-aided retrosynthesis is finding renewed interest from both chemistry and computer science communities. We propose a new approach to this task using the Conditional Graph Logic Network, a conditional graphical model built upon graph neural networks.
  arXiv  Detail & Related papers  (2020-01-06T05:36:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.