Surprise! Using Physiological Stress for Allostatic Regulation Under the Active Inference Framework [Pre-Print]

• URL: http://arxiv.org/abs/2406.08471v1
• Date: Wed, 12 Jun 2024 17:56:15 GMT
• Title: Surprise! Using Physiological Stress for Allostatic Regulation Under the Active Inference Framework [Pre-Print]
• Authors: Imran Khan, Robert Lowe,
• Abstract summary: We develop a model that grounds prediction errors into the secretion of a physiological stress hormone (cortisol) acting as an adaptive mediator on a homeostatically-controlled physiology. Our results find that allostatic functions of cortisol (stress) provide adaptive advantages to the agent's long-term physiological regulation.
• Score: 0.5586191108738563
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Allostasis proposes that long-term viability of a living system is achieved through anticipatory adjustments of its physiology and behaviour: emphasising physiological and affective stress as an adaptive state of adaptation that minimizes long-term prediction errors. More recently, the active inference framework (AIF) has also sought to explain action and long-term adaptation through the minimization of future errors (free energy), through the learning of statistical contingencies of the world, offering a formalism for allostatic regulation. We suggest that framing prediction errors through the lens of biological hormonal dynamics proposed by allostasis offers a way to integrate these two models together in a biologically-plausible manner. In this paper, we describe our initial work in developing a model that grounds prediction errors (surprisal) into the secretion of a physiological stress hormone (cortisol) acting as an adaptive, allostatic mediator on a homeostatically-controlled physiology. We evaluate this using a computational model in simulations using an active inference agent endowed with an artificial physiology, regulated through homeostatic and allostatic control in a stochastic environment. Our results find that allostatic functions of cortisol (stress), secreted as a function of prediction errors, provide adaptive advantages to the agent's long-term physiological regulation. We argue that the coupling of information-theoretic prediction errors to low-level, biological hormonal dynamics of stress can provide a computationally efficient model to long-term regulation for embodied intelligent systems.

Related papers

• Leveraging Cardiovascular Simulations for In-Vivo Prediction of Cardiac Biomarkers [43.17768785084301]
  We train an amortized neural posterior estimator on a newly built large dataset of cardiac simulations. We incorporate elements modeling effects to better align simulated data with real-world measurements. The proposed framework can further integrate in-vivo data sources to refine its predictive capabilities on real-world data.
  arXiv  Detail & Related papers  (2024-12-23T13:05:17Z)
• Self-Healing Machine Learning: A Framework for Autonomous Adaptation in Real-World Environments [50.310636905746975]
  Real-world machine learning systems often encounter model performance degradation due to distributional shifts in the underlying data generating process. Existing approaches to addressing shifts, such as concept drift adaptation, are limited by their reason-agnostic nature. We propose self-healing machine learning (SHML) to overcome these limitations.
  arXiv  Detail & Related papers  (2024-10-31T20:05:51Z)
• Automated Model Discovery for Tensional Homeostasis: Constitutive Machine Learning in Growth and Remodeling [0.0]
  We extend our inelastic Constitutive Artificial Neural Networks (iCANNs) by incorporating kinematic growth and homeostatic surfaces. We evaluate the ability of the proposed network to learn from experimentally obtained tissue equivalent data at the material point level.
  arXiv  Detail & Related papers  (2024-10-17T15:12:55Z)
• A Neural Active Inference Model of Perceptual-Motor Learning [62.39667564455059]
  The active inference framework (AIF) is a promising new computational framework grounded in contemporary neuroscience. In this study, we test the ability for the AIF to capture the role of anticipation in the visual guidance of action in humans. We present a novel formulation of the prior function that maps a multi-dimensional world-state to a uni-dimensional distribution of free-energy.
  arXiv  Detail & Related papers  (2022-11-16T20:00:38Z)
• Stabilizing Machine Learning Prediction of Dynamics: Noise and Noise-inspired Regularization [58.720142291102135]
  Recent has shown that machine learning (ML) models can be trained to accurately forecast the dynamics of chaotic dynamical systems. In the absence of mitigating techniques, this technique can result in artificially rapid error growth, leading to inaccurate predictions and/or climate instability. We introduce Linearized Multi-Noise Training (LMNT), a regularization technique that deterministically approximates the effect of many small, independent noise realizations added to the model input during training.
  arXiv  Detail & Related papers  (2022-11-09T23:40:52Z)
• PhysioMTL: Personalizing Physiological Patterns using Optimal Transport Multi-Task Regression [21.254400561280296]
  Heart rate variability (HRV) is a practical and noninvasive measure of autonomic nervous system activity. We develop Physiological Multitask-Learning (PhysioMTL) by harnessing Optimal Transport theory within a Multitask-learning framework.
  arXiv  Detail & Related papers  (2022-03-19T19:14:25Z)
• Continuous Forecasting via Neural Eigen Decomposition of Stochastic Dynamics [47.82509795873254]
  We introduce the Neural Eigen-SDE (NESDE) algorithm for sequential prediction with sparse observations and adaptive dynamics. NESDE applies eigen-decomposition to the dynamics model to allow efficient frequent predictions given sparse observations. We are the first to provide a patient-adapted prediction for blood coagulation following Heparin dosing in the MIMIC-IV dataset.
  arXiv  Detail & Related papers  (2022-01-31T22:16:50Z)
• Continuous Homeostatic Reinforcement Learning for Self-Regulated Autonomous Agents [0.0]
  We propose an extension of the homeostatic reinforcement learning theory to a continuous environment in space and time. Inspired by the self-regulating mechanisms abundantly present in biology, we also introduce a model for the dynamics of the agent internal state.
  arXiv  Detail & Related papers  (2021-09-14T11:03:58Z)
• Continuous Learning and Adaptation with Membrane Potential and Activation Threshold Homeostasis [91.3755431537592]
  This paper presents the Membrane Potential and Activation Threshold Homeostasis (MPATH) neuron model. The model allows neurons to maintain a form of dynamic equilibrium by automatically regulating their activity when presented with input. Experiments demonstrate the model's ability to adapt to and continually learn from its input.
  arXiv  Detail & Related papers  (2021-04-22T04:01:32Z)
• Gradient Starvation: A Learning Proclivity in Neural Networks [97.02382916372594]
  Gradient Starvation arises when cross-entropy loss is minimized by capturing only a subset of features relevant for the task. This work provides a theoretical explanation for the emergence of such feature imbalance in neural networks.
  arXiv  Detail & Related papers  (2020-11-18T18:52:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.