The Two Kinds of Free Energy and the Bayesian Revolution

• URL: http://arxiv.org/abs/2004.11763v4
• Date: Mon, 7 Dec 2020 00:03:21 GMT
• Title: The Two Kinds of Free Energy and the Bayesian Revolution
• Authors: Sebastian Gottwald, Daniel A. Braun
• Abstract summary: We argue that there are essentially two different notions of free energy in current models of intelligent agency. One appears when trading off accuracy and uncertainty based on a general maximum entropy principle. The other formulates action selection in terms of minimizing an error measure that quantifies deviations of beliefs and policies from given reference models.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The concept of free energy has its origins in 19th century thermodynamics, but has recently found its way into the behavioral and neural sciences, where it has been promoted for its wide applicability and has even been suggested as a fundamental principle of understanding intelligent behavior and brain function. We argue that there are essentially two different notions of free energy in current models of intelligent agency, that can both be considered as applications of Bayesian inference to the problem of action selection: one that appears when trading off accuracy and uncertainty based on a general maximum entropy principle, and one that formulates action selection in terms of minimizing an error measure that quantifies deviations of beliefs and policies from given reference models. The first approach provides a normative rule for action selection in the face of model uncertainty or when information processing capabilities are limited. The second approach directly aims to formulate the action selection problem as an inference problem in the context of Bayesian brain theories, also known as Active Inference in the literature. We elucidate the main ideas and discuss critical technical and conceptual issues revolving around these two notions of free energy that both claim to apply at all levels of decision-making, from the high-level deliberation of reasoning down to the low-level information processing of perception.

Related papers

• Conceptual and Unbiased Reasoning in Language Models [98.90677711523645]
  We propose a novel conceptualization framework that forces models to perform conceptual reasoning on abstract questions. We show that existing large language models fall short on conceptual reasoning, dropping 9% to 28% on various benchmarks. We then discuss how models can improve since high-level abstract reasoning is key to unbiased and generalizable decision-making.
  arXiv  Detail & Related papers  (2024-03-30T00:53:53Z)
• Reframing the Expected Free Energy: Four Formulations and a Unification [3.9121134770873733]
  Active inference is based on the expected free energy. This paper seek to formalize the problem of deriving these formulations from a single root expected free energy definition.
  arXiv  Detail & Related papers  (2024-02-22T11:38:43Z)
• A Semantic Approach to Decidability in Epistemic Planning (Extended Version) [72.77805489645604]
  We use a novel semantic approach to achieve decidability. Specifically, we augment the logic of knowledge S5$_n$ and with an interaction axiom called (knowledge) commutativity. We prove that our framework admits a finitary non-fixpoint characterization of common knowledge, which is of independent interest.
  arXiv  Detail & Related papers  (2023-07-28T11:26:26Z)
• Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization [49.00409552570441]
  We study the role of conceptualization in commonsense reasoning, and formulate a framework to replicate human conceptual induction. We apply the framework to ATOMIC, a large-scale human-annotated CKG, aided by the taxonomy Probase.
  arXiv  Detail & Related papers  (2022-06-03T12:24:49Z)
• Open-system approach to nonequilibrium quantum thermodynamics at arbitrary coupling [77.34726150561087]
  We develop a general theory describing the thermodynamical behavior of open quantum systems coupled to thermal baths. Our approach is based on the exact time-local quantum master equation for the reduced open system states.
  arXiv  Detail & Related papers  (2021-09-24T11:19:22Z)
• A Mathematical Walkthrough and Discussion of the Free Energy Principle [0.0]
  The Free-Energy-Principle (FEP) is an influential and controversial theory which postulates a connection between the thermodynamics of self-organization and learning through variational inference. FEP has been applied extensively in neuroscience, and is beginning to make inroads in machine learning by spurring the construction of novel and powerful algorithms by which action, perception, and learning can all be unified under a single objective. Here, we aim to provide a mathematically detailed, yet intuitive walk-through of the formulation and central claims of the FEP while also providing a discussion of the assumptions necessary and potential limitations of the theory.
  arXiv  Detail & Related papers  (2021-08-30T16:11:49Z)
• Applications of the Free Energy Principle to Machine Learning and Neuroscience [0.0]
  We explore and apply methods inspired by the free energy principle to two important areas in machine learning and neuroscience. We focus on predictive coding, a neurobiologically plausible process theory derived from the free energy principle. Secondly, we study active inference, a neurobiologically grounded account of action through variational message passing. Finally, we investigate biologically plausible methods of credit assignment in the brain.
  arXiv  Detail & Related papers  (2021-06-30T22:53:03Z)
• Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactuals [7.727206277914709]
  We propose a principled causality-based approach for explaining black-box decision-making systems. We show how such counterfactuals can quantify the direct and indirect influences of a variable on decisions made by an algorithm. We show how such counterfactuals can provide actionable recourse for individuals negatively affected by the algorithm's decision.
  arXiv  Detail & Related papers  (2021-03-22T16:20:21Z)
• Causal blankets: Theory and algorithmic framework [59.43413767524033]
  We introduce a novel framework to identify perception-action loops (PALOs) directly from data based on the principles of computational mechanics. Our approach is based on the notion of causal blanket, which captures sensory and active variables as dynamical sufficient statistics.
  arXiv  Detail & Related papers  (2020-08-28T10:26:17Z)
• QuLBIT: Quantum-Like Bayesian Inference Technologies for Cognition and Decision [0.11470070927586014]
  This paper provides the foundations of a unified cognitive decision-making framework (QulBIT) which is derived from quantum theory. We detail the main modules of the unified framework, the explanatory analysis method, and illustrate their application in situations violating the Sure Thing Principle.
  arXiv  Detail & Related papers  (2020-05-30T09:02:03Z)
• Neuro-symbolic Architectures for Context Understanding [59.899606495602406]
  We propose the use of hybrid AI methodology as a framework for combining the strengths of data-driven and knowledge-driven approaches. Specifically, we inherit the concept of neuro-symbolism as a way of using knowledge-bases to guide the learning progress of deep neural networks.
  arXiv  Detail & Related papers  (2020-03-09T15:04:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.