Reframing the Expected Free Energy: Four Formulations and a Unification

• URL: http://arxiv.org/abs/2402.14460v1
• Date: Thu, 22 Feb 2024 11:38:43 GMT
• Title: Reframing the Expected Free Energy: Four Formulations and a Unification
• Authors: Th\'eophile Champion, Howard Bowman, Dimitrije Markovi\'c, Marek Grze\'s
• Abstract summary: Active inference is based on the expected free energy. This paper seek to formalize the problem of deriving these formulations from a single root expected free energy definition.
• Score: 3.9121134770873733
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Active inference is a leading theory of perception, learning and decision making, which can be applied to neuroscience, robotics, psychology, and machine learning. Active inference is based on the expected free energy, which is mostly justified by the intuitive plausibility of its formulations, e.g., the risk plus ambiguity and information gain / pragmatic value formulations. This paper seek to formalize the problem of deriving these formulations from a single root expected free energy definition, i.e., the unification problem. Then, we study two settings, each one having its own root expected free energy definition. In the first setting, no justification for the expected free energy has been proposed to date, but all the formulations can be recovered from it. However, in this setting, the agent cannot have arbitrary prior preferences over observations. Indeed, only a limited class of prior preferences over observations is compatible with the likelihood mapping of the generative model. In the second setting, a justification of the root expected free energy definition is known, but this setting only accounts for two formulations, i.e., the risk over states plus ambiguity and entropy plus expected energy formulations.

Related papers

• Graph Stochastic Neural Process for Inductive Few-shot Knowledge Graph Completion [63.68647582680998]
  We focus on a task called inductive few-shot knowledge graph completion (I-FKGC) Inspired by the idea of inductive reasoning, we cast I-FKGC as an inductive reasoning problem. We present a neural process-based hypothesis extractor that models the joint distribution of hypothesis, from which we can sample a hypothesis for predictions. In the second module, based on the hypothesis, we propose a graph attention-based predictor to test if the triple in the query set aligns with the extracted hypothesis.
  arXiv  Detail & Related papers  (2024-08-03T13:37:40Z)
• A Semantic Approach to Decidability in Epistemic Planning (Extended Version) [72.77805489645604]
  We use a novel semantic approach to achieve decidability. Specifically, we augment the logic of knowledge S5$_n$ and with an interaction axiom called (knowledge) commutativity. We prove that our framework admits a finitary non-fixpoint characterization of common knowledge, which is of independent interest.
  arXiv  Detail & Related papers  (2023-07-28T11:26:26Z)
• Doubly Stochastic Graph-based Non-autoregressive Reaction Prediction [59.41636061300571]
  We propose a new framework called that combines two doubly self-attention mappings to obtain electron redistribution predictions. We show that our approach consistently improves the predictive performance of non-autoregressive models.
  arXiv  Detail & Related papers  (2023-06-05T14:15:39Z)
• Neuro-Symbolic Entropy Regularization [78.16196949641079]
  In structured prediction, the goal is to jointly predict many output variables that together encode a structured object. One approach -- entropy regularization -- posits that decision boundaries should lie in low-probability regions. We propose a loss, neuro-symbolic entropy regularization, that encourages the model to confidently predict a valid object.
  arXiv  Detail & Related papers  (2022-01-25T06:23:10Z)
• A free energy principle for generic quantum systems [0.0]
  We show how generic quantum systems can be regarded as observers, which with the standard freedom of choice assumption become agents capable of assigning semantics to observational outcomes. We suggest that biological systems employ quantum coherence as a computational resource and - implicitly - as a communication resource.
  arXiv  Detail & Related papers  (2021-12-30T23:34:04Z)
• Active inference, Bayesian optimal design, and expected utility [1.433758865948252]
  We describe how active inference combines Bayesian decision theory and optimal Bayesian design principles to minimize expected free energy. It is this aspect of active inference that allows for the natural emergence of information-seeking behavior. Our Tmaze simulations show optimizing expected free energy produces goal-directed information-seeking behavior while optimizing expected utility induces purely exploitive behavior.
  arXiv  Detail & Related papers  (2021-09-21T20:56:32Z)
• Maximizing Information Gain in Partially Observable Environments via Prediction Reward [64.24528565312463]
  This paper tackles the challenge of using belief-based rewards for a deep RL agent. We derive the exact error between negative entropy and the expected prediction reward. This insight provides theoretical motivation for several fields using prediction rewards.
  arXiv  Detail & Related papers  (2020-05-11T08:13:49Z)
• Computing Absolute Free Energy with Deep Generative Models [2.610895122644814]
  We introduce a general framework for calculating the absolute free energy of a state. A key step of the calculation is the definition of a reference state with tractable deep generative models. The free energy for the state of interest can then be determined as the difference from the reference.
  arXiv  Detail & Related papers  (2020-05-01T22:19:31Z)
• The Two Kinds of Free Energy and the Bayesian Revolution [0.0]
  We argue that there are essentially two different notions of free energy in current models of intelligent agency. One appears when trading off accuracy and uncertainty based on a general maximum entropy principle. The other formulates action selection in terms of minimizing an error measure that quantifies deviations of beliefs and policies from given reference models.
  arXiv  Detail & Related papers  (2020-04-24T14:09:28Z)
• Whence the Expected Free Energy? [68.8204255655161]
  We show that the Expected Free Energy (EFE) is not simply "the free energy in the future" We then develop a novel objective, the Free-Energy of the Expected Future (FEEF)
  arXiv  Detail & Related papers  (2020-04-17T09:06:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.