Active Inference or Control as Inference? A Unifying View

• URL: http://arxiv.org/abs/2010.00262v1
• Date: Thu, 1 Oct 2020 09:08:45 GMT
• Title: Active Inference or Control as Inference? A Unifying View
• Abstract summary: We frame active inference through the lens of control as inference (CaI) CaI offers principled, numerically robust optimal control solvers. We show that AI may be framed as partially-observed CaI when the cost function is defined specifically in the observation states.
• Score: 33.361301128504905
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Active inference (AI) is a persuasive theoretical framework from computational neuroscience that seeks to describe action and perception as inference-based computation. However, this framework has yet to provide practical sensorimotor control algorithms that are competitive with alternative approaches. In this work, we frame active inference through the lens of control as inference (CaI), a body of work that presents trajectory optimization as inference. From the wider view of `probabilistic numerics', CaI offers principled, numerically robust optimal control solvers that provide uncertainty quantification, and can scale to nonlinear problems with approximate inference. We show that AI may be framed as partially-observed CaI when the cost function is defined specifically in the observation states.

Related papers

• Spike-based Belief Propagation in Nonlinear Dynamical Systems [3.8108588769749407]
  We propose a brain-like control algorithm capable of operating in uncertain environments.<n>We use the mountain car parking problem as a benchmark with non-linear dynamics.<n>Results highlight the proposed model's potential as a bridge between computational neuroscience and probabilistic control theory.
  arXiv  Detail & Related papers  (2026-08-20T11:20:22Z)
• Active Inference: A method for Phenotyping Agency in AI systems? [0.11904398364437437]
  We argue for a minimal notion open to principled inspection given three criteria.<n> posterior beliefs, prior preferences, and the minimization of expected free energy jointly constitute an agentic action chain.
  arXiv  Detail & Related papers  (2026-04-25T12:41:53Z)
• Stable Inverse Reinforcement Learning: Policies from Control Lyapunov Landscapes [4.229902091180109]
  We propose a novel, stability-certified IRL approach to learning control Lyapunov functions from demonstrations data. By exploiting closed-form expressions for associated control policies, we are able to efficiently search the space of CLFs. We present a theoretical analysis of the optimality properties provided by the CLF and evaluate our approach using both simulated and real-world data.
  arXiv  Detail & Related papers  (2024-05-14T16:40:45Z)
• Advancing Counterfactual Inference through Nonlinear Quantile Regression [77.28323341329461]
  We propose a framework for efficient and effective counterfactual inference implemented with neural networks. The proposed approach enhances the capacity to generalize estimated counterfactual outcomes to unseen data. Empirical results conducted on multiple datasets offer compelling support for our theoretical assertions.
  arXiv  Detail & Related papers  (2023-06-09T08:30:51Z)
• Learning to Optimize with Stochastic Dominance Constraints [103.26714928625582]
  In this paper, we develop a simple yet efficient approach for the problem of comparing uncertain quantities. We recast inner optimization in the Lagrangian as a learning problem for surrogate approximation, which bypasses apparent intractability. The proposed light-SD demonstrates superior performance on several representative problems ranging from finance to supply chain management.
  arXiv  Detail & Related papers  (2022-11-14T21:54:31Z)
• Understanding Approximation for Bayesian Inference in Neural Networks [7.081604594416339]
  I explore approximate inference in Bayesian neural networks. The expected utility of the approximate posterior can measure inference quality. Continual and active learning set-ups pose challenges that have nothing to do with posterior quality.
  arXiv  Detail & Related papers  (2022-11-11T11:31:13Z)
• Active Inference in Robotics and Artificial Agents: Survey and Challenges [51.29077770446286]
  We review the state-of-the-art theory and implementations of active inference for state-estimation, control, planning and learning. We showcase relevant experiments that illustrate its potential in terms of adaptation, generalization and robustness.
  arXiv  Detail & Related papers  (2021-12-03T12:10:26Z)
• Learning Robust Output Control Barrier Functions from Safe Expert Demonstrations [50.37808220291108]
  This paper addresses learning safe output feedback control laws from partial observations of expert demonstrations. We first propose robust output control barrier functions (ROCBFs) as a means to guarantee safety. We then formulate an optimization problem to learn ROCBFs from expert demonstrations that exhibit safe system behavior.
  arXiv  Detail & Related papers  (2021-11-18T23:21:00Z)
• General bound on the performance of counter-diabatic driving acting on dissipative spin systems [0.0]
  Counter-diabatic driving (CD) is a technique in quantum control theory designed to counteract nonadiabatic excitations. We consider a driven spin-boson model as a prototypical setup. We show that if we allow a time-dependent system-bath coupling angle, the obtained bound can be saturated and realizes unit fidelity.
  arXiv  Detail & Related papers  (2021-04-06T09:06:50Z)
• Loss Bounds for Approximate Influence-Based Abstraction [81.13024471616417]
  Influence-based abstraction aims to gain leverage by modeling local subproblems together with the 'influence' that the rest of the system exerts on them. This paper investigates the performance of such approaches from a theoretical perspective. We show that neural networks trained with cross entropy are well suited to learn approximate influence representations.
  arXiv  Detail & Related papers  (2020-11-03T15:33:10Z)
• QuLBIT: Quantum-Like Bayesian Inference Technologies for Cognition and Decision [0.11470070927586014]
  This paper provides the foundations of a unified cognitive decision-making framework (QulBIT) which is derived from quantum theory. We detail the main modules of the unified framework, the explanatory analysis method, and illustrate their application in situations violating the Sure Thing Principle.
  arXiv  Detail & Related papers  (2020-05-30T09:02:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.