Implementation of reinforcement learning in chemical reaction networks: application to phototaxis as curiosity-driven exploration

• URL: http://arxiv.org/abs/2606.26168v1
• Date: Wed, 24 Jun 2026 08:11:14 GMT
• Title: Implementation of reinforcement learning in chemical reaction networks: application to phototaxis as curiosity-driven exploration
• Abstract summary: In unicellular algae, phototaxis is often modeled as a mechanistic run--tumble process driven by stimulus--response rules.<n>We propose a framework linking a Partially Observable Decision Process with biochemical reaction dynamics.<n>Our model reproduces empirical alignment-to-light distribution, comparable to objective SSA baselines on this dataset.
• Score: 1.433758865948252
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Living systems navigate environments using noisy and incomplete sensory signals. In unicellular algae, phototaxis is often modeled as a mechanistic run--tumble process driven by stimulus--response rules. However, such descriptions overlook how organisms actively sample their environment to reduce sensory ambiguity. From a minimal cognition perspective, we reframe this navigation as a subjective, information-driven sensorimotor process. To this end, we propose a framework linking a Partially Observable Markov Decision Process (POMDP) with biochemical reaction dynamics. Environmental variables are hidden, while the cell updates a minimal internal state from each observation through a memoryless Bayesian step. These internal dynamics balance orienting toward light with exploratory reorientation and can be implemented through Chemical-Reaction-Network Ordinary Differential Equations (CRN--ODEs). Our model includes a biophysical observation process for photoreception and a chemically computable polynomial bound on information gain. Using Inverse Reinforcement Learning (IRL) on 30 experimentally recorded Chlamydomonas trajectories, we infer the behavioral objective consistent with observed phototactic motion and benchmark the resulting dynamics with standard Stochastic Simulation Algorithm (SSA) baselines. Our model reproduces the empirical alignment-to-light distribution, comparable to objective SSA baselines on this dataset. Within this framework, run--tumble alternation emerges as an information-acquisition strategy: tumbling reorients the cell to sample new sensory configurations and resolve sensor ambiguity, demonstrating how intracellular biochemical networks can support adaptive information-seeking behavior in cellular navigation.

Related papers

• Influence-Guided Symbolic Regression: Scientific Discovery via LLM-Driven Equation Search with Granular Feedback [56.69850045068714]
  We introduce textitInfluence-Guided Regression (IGSR), a method that frames equation discovery as an iterative two-step process.<n>We demonstrate IGSRs effectiveness on a diverse suite of benchmarks, including LLM-SRBench, pharmacological PKPD models, an epidemiological simulation, and real-world genomic data.
  arXiv  Detail & Related papers  (2026-05-27T23:48:01Z)
• ChemVA: Advancing Large Language Models on Chemical Reaction Diagrams Understanding [56.94419746470799]
  Large Language Models (LLMs) have revolutionized scientific text processing, but exhibit a significant capability gap when interpreting chemical reaction diagrams.<n>We propose the Chemical Visual Activation (ChemVA) framework, which employs a Visual Anchor mechanism to ground functional groups.<n>We evaluate our approach on OCRD-Bench, a newly constructed dataset featuring dense visual-semantic contexts.
  arXiv  Detail & Related papers  (2026-05-17T01:12:50Z)
• Meta-LegNet: A Transferable and Interpretable Framework for Surface Adsorption Prediction via Self-Defined Adsorption-Environment Learning [8.150979148487787]
  We introduce Meta-LegNet, a graph learning framework that learns transferable representations of local environments across diverse catalyst--adsorbate systems.<n>Our results suggest that learning transferable adsorbing environments provides an accurate, interpretable, and practical route for accelerating catalyst screening.
  arXiv  Detail & Related papers  (2026-05-03T10:55:16Z)
• Learn Weightlessness: Imitate Non-Self-Stabilizing Motions on Humanoid Robot [56.377161933570335]
  Humans naturally exploit a "weightless" state during non-self-stabilizing (NSS) motions.<n>Inspired by this biological mechanism, we propose a weightlessness-state auto-labeling strategy for dataset annotation.<n>Our work bridges the gap between precise trajectory tracking and adaptive environmental interaction, offering a biologically-inspired solution for contact-rich humanoid control.
  arXiv  Detail & Related papers  (2026-04-23T07:10:05Z)
• Causal Representation Meets Stochastic Modeling under Generic Geometry [49.24293444627916]
  We develop causal representation learning for continuous-time latent point processes.<n>We develop MUTATE, an identifiable variational autoencoder framework with a time-adaptive transition module.<n>Across simulated and empirical studies, we find that MUTATE can effectively answer scientific questions.
  arXiv  Detail & Related papers  (2026-02-04T20:40:53Z)
• Curly Flow Matching for Learning Non-gradient Field Dynamics [49.480209466896035]
  We introduce Curly Flow Matching (Curly-FM), a novel approach to learning non-gradient field dynamics.<n>Curly-FM is capable of learning non-gradient field dynamics by designing and solving a Schr"odinger bridge problem.<n>Curly-FM can learn trajectories that better match both the reference process and population marginals.
  arXiv  Detail & Related papers  (2025-10-30T16:11:39Z)
• From Pheromones to Policies: Reinforcement Learning for Engineered Biological Swarms [0.0]
  This study establishes a theoretical equivalence between pheromone-mediated aggregation in celeg and reinforcement learning (RL)<n>We model engineered nematode swarms performing foraging tasks, showing that pheromone dynamics mathematically mirror cross-learning updates.<n>Our results demonstrate that stigmergic systems inherently encode distributed RL processes, where environmental signals act as external memory for collective credit assignment.
  arXiv  Detail & Related papers  (2025-09-24T13:16:35Z)
• Embodied World Models Emerge from Navigational Task in Open-Ended Environments [5.785697934050656]
  We ask whether a recurrent agent, trained solely by sparse rewards to solve procedurally generated planar mazes, can autonomously internalize metric concepts such as direction, distance and obstacle layout.<n>After training, the agent consistently produces near-optimal paths in unseen mazes, behavior that hints at an underlying spatial model.
  arXiv  Detail & Related papers  (2025-04-15T17:35:13Z)
• Allostatic Control of Persistent States in Spiking Neural Networks for perception and computation [79.16635054977068]
  We introduce a novel model for updating perceptual beliefs about the environment by extending the concept of Allostasis to the control of internal representations.<n>In this paper, we focus on an application in numerical cognition, where a bump of activity in an attractor network is used as a spatial numerical representation.
  arXiv  Detail & Related papers  (2025-03-20T12:28:08Z)
• DynaCLR: Contrastive Learning of Cellular Dynamics with Temporal Regularization [0.5385157903509136]
  DynaCLR is a self-supervised method for embedding cell and organelle Dynamics via Contrastive Learning of Representations of time-lapse images.<n>We integrate single-cell tracking and time-aware contrastive sampling to learn robust, temporally regularized representations of cell dynamics.
  arXiv  Detail & Related papers  (2024-10-15T05:01:25Z)
• Interpretable neural architecture search and transfer learning for understanding CRISPR/Cas9 off-target enzymatic reactions [3.5994174958472307]
  Elektrum is a deep learning framework for determining the kinetics of biochemical systems. It employs a novel transfer learning step, where the KINNs are inserted as intermediary layers into deeper convolutional neural networks. We apply Elektrum to predict CRISPR-Cas9 off-target editing probabilities and demonstrate that it achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-05-18T23:49:42Z)
• Contrastive-Signal-Dependent Plasticity: Self-Supervised Learning in Spiking Neural Circuits [61.94533459151743]
  This work addresses the challenge of designing neurobiologically-motivated schemes for adjusting the synapses of spiking networks. Our experimental simulations demonstrate a consistent advantage over other biologically-plausible approaches when training recurrent spiking networks.
  arXiv  Detail & Related papers  (2023-03-30T02:40:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.