Surprise! Using Physiological Stress for Allostatic Regulation Under the Active Inference Framework [Pre-Print]

• URL: http://arxiv.org/abs/2406.08471v1
• Date: Wed, 12 Jun 2024 17:56:15 GMT
• Title: Surprise! Using Physiological Stress for Allostatic Regulation Under the Active Inference Framework [Pre-Print]
• Authors: Imran Khan, Robert Lowe,
• Abstract summary: We develop a model that grounds prediction errors into the secretion of a physiological stress hormone (cortisol) acting as an adaptive mediator on a homeostatically-controlled physiology. Our results find that allostatic functions of cortisol (stress) provide adaptive advantages to the agent's long-term physiological regulation.
• Score: 0.5586191108738563
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Allostasis proposes that long-term viability of a living system is achieved through anticipatory adjustments of its physiology and behaviour: emphasising physiological and affective stress as an adaptive state of adaptation that minimizes long-term prediction errors. More recently, the active inference framework (AIF) has also sought to explain action and long-term adaptation through the minimization of future errors (free energy), through the learning of statistical contingencies of the world, offering a formalism for allostatic regulation. We suggest that framing prediction errors through the lens of biological hormonal dynamics proposed by allostasis offers a way to integrate these two models together in a biologically-plausible manner. In this paper, we describe our initial work in developing a model that grounds prediction errors (surprisal) into the secretion of a physiological stress hormone (cortisol) acting as an adaptive, allostatic mediator on a homeostatically-controlled physiology. We evaluate this using a computational model in simulations using an active inference agent endowed with an artificial physiology, regulated through homeostatic and allostatic control in a stochastic environment. Our results find that allostatic functions of cortisol (stress), secreted as a function of prediction errors, provide adaptive advantages to the agent's long-term physiological regulation. We argue that the coupling of information-theoretic prediction errors to low-level, biological hormonal dynamics of stress can provide a computationally efficient model to long-term regulation for embodied intelligent systems.

Related papers

• Continuous Time Continuous Space Homeostatic Reinforcement Learning (CTCS-HRRL) : Towards Biological Self-Autonomous Agent [0.12068041242343093]
  Homeostasis is a process by which living beings maintain their internal balance. Homeostatic Regulated Reinforcement Learning (HRRL) framework attempts to explain this learned homeostatic behaviour. In this work, we advance the HRRL framework to a continuous time-space environment and validate the CTCS-HRRL framework.
  arXiv  Detail & Related papers  (2024-01-17T06:29:34Z)
• Individualized Dosing Dynamics via Neural Eigen Decomposition [51.62933814971523]
  We introduce the Neural Eigen Differential Equation algorithm (NESDE) NESDE provides individualized modeling, tunable generalization to new treatment policies, and fast, continuous, closed-form prediction. We demonstrate the robustness of NESDE in both synthetic and real medical problems, and use the learned dynamics to publish simulated medical gym environments.
  arXiv  Detail & Related papers  (2023-06-24T17:01:51Z)
• A Neural Active Inference Model of Perceptual-Motor Learning [62.39667564455059]
  The active inference framework (AIF) is a promising new computational framework grounded in contemporary neuroscience. In this study, we test the ability for the AIF to capture the role of anticipation in the visual guidance of action in humans. We present a novel formulation of the prior function that maps a multi-dimensional world-state to a uni-dimensional distribution of free-energy.
  arXiv  Detail & Related papers  (2022-11-16T20:00:38Z)
• The scaling of goals via homeostasis: an evolutionary simulation, experiment and analysis [0.0]
  We propose that evolution pivoted the collective intelligence of cells during morphogenesis into behavioral intelligence by scaling up the goal states at the center of homeostatic processes. We found that these emergent morphogenetic agents exhibit a number of predicted features, including the use of stress propagation dynamics to achieve its target morphology. We propose that this system is a first step toward a quantitative understanding of how evolution scales minimal goal-directed behavior (homeostatic loops) into higher-level problem-solving agents in morphogenetic and other spaces.
  arXiv  Detail & Related papers  (2022-11-15T21:48:44Z)
• Stabilizing Machine Learning Prediction of Dynamics: Noise and Noise-inspired Regularization [58.720142291102135]
  Recent has shown that machine learning (ML) models can be trained to accurately forecast the dynamics of chaotic dynamical systems. In the absence of mitigating techniques, this technique can result in artificially rapid error growth, leading to inaccurate predictions and/or climate instability. We introduce Linearized Multi-Noise Training (LMNT), a regularization technique that deterministically approximates the effect of many small, independent noise realizations added to the model input during training.
  arXiv  Detail & Related papers  (2022-11-09T23:40:52Z)
• PhysioMTL: Personalizing Physiological Patterns using Optimal Transport Multi-Task Regression [21.254400561280296]
  Heart rate variability (HRV) is a practical and noninvasive measure of autonomic nervous system activity. We develop Physiological Multitask-Learning (PhysioMTL) by harnessing Optimal Transport theory within a Multitask-learning framework.
  arXiv  Detail & Related papers  (2022-03-19T19:14:25Z)
• Continuous Forecasting via Neural Eigen Decomposition of Stochastic Dynamics [47.82509795873254]
  We introduce the Neural Eigen-SDE (NESDE) algorithm for sequential prediction with sparse observations and adaptive dynamics. NESDE applies eigen-decomposition to the dynamics model to allow efficient frequent predictions given sparse observations. We are the first to provide a patient-adapted prediction for blood coagulation following Heparin dosing in the MIMIC-IV dataset.
  arXiv  Detail & Related papers  (2022-01-31T22:16:50Z)
• Continuous Homeostatic Reinforcement Learning for Self-Regulated Autonomous Agents [0.0]
  We propose an extension of the homeostatic reinforcement learning theory to a continuous environment in space and time. Inspired by the self-regulating mechanisms abundantly present in biology, we also introduce a model for the dynamics of the agent internal state.
  arXiv  Detail & Related papers  (2021-09-14T11:03:58Z)
• Continuous Learning and Adaptation with Membrane Potential and Activation Threshold Homeostasis [91.3755431537592]
  This paper presents the Membrane Potential and Activation Threshold Homeostasis (MPATH) neuron model. The model allows neurons to maintain a form of dynamic equilibrium by automatically regulating their activity when presented with input. Experiments demonstrate the model's ability to adapt to and continually learn from its input.
  arXiv  Detail & Related papers  (2021-04-22T04:01:32Z)
• Gradient Starvation: A Learning Proclivity in Neural Networks [97.02382916372594]
  Gradient Starvation arises when cross-entropy loss is minimized by capturing only a subset of features relevant for the task. This work provides a theoretical explanation for the emergence of such feature imbalance in neural networks.
  arXiv  Detail & Related papers  (2020-11-18T18:52:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.