Plasticity as the Mirror of Empowerment
- URL: http://arxiv.org/abs/2505.10361v1
- Date: Thu, 15 May 2025 14:52:16 GMT
- Title: Plasticity as the Mirror of Empowerment
- Authors: David Abel, Michael Bowling, André Barreto, Will Dabney, Shi Dong, Steven Hansen, Anna Harutyunyan, Khimya Khetarpal, Clare Lyle, Razvan Pascanu, Georgios Piliouras, Doina Precup, Jonathan Richens, Mark Rowland, Tom Schaul, Satinder Singh,
- Abstract summary: We show that plasticity is identical to the empowerment of the environment.<n>We suggest that plasticity, empowerment, and their relationship are essential to understanding agency.
- Score: 94.91580596320331
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Agents are minimally entities that are influenced by their past observations and act to influence future observations. This latter capacity is captured by empowerment, which has served as a vital framing concept across artificial intelligence and cognitive science. This former capacity, however, is equally foundational: In what ways, and to what extent, can an agent be influenced by what it observes? In this paper, we ground this concept in a universal agent-centric measure that we refer to as plasticity, and reveal a fundamental connection to empowerment. Following a set of desiderata on a suitable definition, we define plasticity using a new information-theoretic quantity we call the generalized directed information. We show that this new quantity strictly generalizes the directed information introduced by Massey (1990) while preserving all of its desirable properties. Our first finding is that plasticity is the mirror of empowerment: The agent's plasticity is identical to the empowerment of the environment, and vice versa. Our second finding establishes a tension between the plasticity and empowerment of an agent, suggesting that agent design needs to be mindful of both characteristics. We explore the implications of these findings, and suggest that plasticity, empowerment, and their relationship are essential to understanding agency.
Related papers
- Toward a Theory of Agents as Tool-Use Decision-Makers [89.26889709510242]
We argue that true autonomy requires agents to be grounded in a coherent epistemic framework that governs what they know, what they need to know, and how to acquire that knowledge efficiently.<n>We propose a unified theory that treats internal reasoning and external actions as equivalent epistemic tools, enabling agents to systematically coordinate introspection and interaction.<n>This perspective shifts the design of agents from mere action executors to knowledge-driven intelligence systems, offering a principled path toward building foundation agents capable of adaptive, efficient, and goal-directed behavior.
arXiv Detail & Related papers (2025-06-01T07:52:16Z) - Belief Attribution as Mental Explanation: The Role of Accuracy, Informativity, and Causality [42.943294683967046]
We investigate the hypothesis that people prefer to attribute beliefs that are good explanations for the behavior they observe.<n>We develop a computational model that quantifies the explanatory strength of a (natural language) statement about an agent's beliefs.<n>Using this model, we study the role of each factor in how people selectively attribute beliefs to other agents.
arXiv Detail & Related papers (2025-05-26T00:21:38Z) - A Theoretical Framework for Explaining Reinforcement Learning with Shapley Values [0.0]
We develop a theoretical framework for explaining reinforcement learning through the influence of state features.<n>We identify three core elements of the agent-environment interaction that benefit from explanation.<n>This approach yields a family of mathematically grounded explanations with clear semantics and theoretical guarantees.
arXiv Detail & Related papers (2025-05-12T17:48:28Z) - Generating Causal Explanations of Vehicular Agent Behavioural Interactions with Learnt Reward Profiles [13.450023647228843]
We learn a weighting of reward metrics for agents such that explanations for agent interactions can be causally inferred.<n>We validate our approach quantitatively and qualitatively across three real-world driving datasets.
arXiv Detail & Related papers (2025-03-18T01:53:59Z) - Agency Is Frame-Dependent [94.91580596320331]
Agency is a system's capacity to steer outcomes toward a goal.<n>We argue that agency is fundamentally frame-dependent.<n>We conclude that any basic science of agency requires frame-dependence.
arXiv Detail & Related papers (2025-02-06T08:34:57Z) - Symmetry and Complexity in Object-Centric Deep Active Inference Models [4.298360054690217]
We show how inherent symmetries of particular objects emerge as symmetries in the latent state space of the generative model learnt under deep active inference.
In particular, we focus on object-centric representations, which are trained from pixels to predict novel object views as the agent moves its viewpoint.
arXiv Detail & Related papers (2023-04-14T10:21:26Z) - Intrinsic Physical Concepts Discovery with Object-Centric Predictive
Models [86.25460882547581]
We introduce the PHYsical Concepts Inference NEtwork (PHYCINE), a system that infers physical concepts in different abstract levels without supervision.
We show that object representations containing the discovered physical concepts variables could help achieve better performance in causal reasoning tasks.
arXiv Detail & Related papers (2023-03-03T11:52:21Z) - Designing Ecosystems of Intelligence from First Principles [34.429740648284685]
This white paper lays out a vision of research and development in the field of artificial intelligence for the next decade (and beyond)
Its denouement is a cyber-physical ecosystem of natural and synthetic sense-making, in which humans are integral participants.
This vision is premised on active inference, a formulation of adaptive behavior that can be read as a physics of intelligence.
arXiv Detail & Related papers (2022-12-02T18:24:06Z) - Information is Power: Intrinsic Control via Information Capture [110.3143711650806]
We argue that a compact and general learning objective is to minimize the entropy of the agent's state visitation estimated using a latent state-space model.
This objective induces an agent to both gather information about its environment, corresponding to reducing uncertainty, and to gain control over its environment, corresponding to reducing the unpredictability of future world states.
arXiv Detail & Related papers (2021-12-07T18:50:42Z) - Properties from Mechanisms: An Equivariance Perspective on Identifiable
Representation Learning [79.4957965474334]
Key goal of unsupervised representation learning is "inverting" a data generating process to recover its latent properties.
This paper asks, "Can we instead identify latent properties by leveraging knowledge of the mechanisms that govern their evolution?"
We provide a complete characterization of the sources of non-identifiability as we vary knowledge about a set of possible mechanisms.
arXiv Detail & Related papers (2021-10-29T14:04:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.