Influence of the Geometry of the world model on Curiosity Based Exploration

• URL: http://arxiv.org/abs/2304.00188v2
• Date: Wed, 18 Oct 2023 14:49:04 GMT
• Title: Influence of the Geometry of the world model on Curiosity Based Exploration
• Authors: Gr\'egoire Sergeant-Perthuis, Nils Ruet, David Rudrauf, Dimitri Ognibene and Yvain Tisserand
• Abstract summary: In human spatial awareness, 3-D projective geometry structures information integration and action planning. We show how geometry can play a key role in information integration and action planning.
• Score: 1.4461582662466375
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In human spatial awareness, 3-D projective geometry structures information integration and action planning through perspective taking within an internal representation space. The way different perspectives are related and transform a world model defines a specific perception and imagination scheme. In mathematics, such collection of transformations corresponds to a 'group', whose 'actions' characterize the geometry of a space. Imbuing world models with a group structure may capture different agents' spatial awareness and affordance schemes. We used group action as a special class of policies for perspective-dependent control. We explored how such geometric structure impacts agents' behavior, comparing how the Euclidean versus projective groups act on epistemic value in active inference, drive curiosity, and exploration behaviors. We formally demonstrate and simulate how the groups induce distinct behaviors in a simple search task. The projective group's nonlinear magnification of information transformed epistemic value according to the choice of frame, generating behaviors of approach toward an object of interest. The projective group structure within the agent's world model contains the Projective Consciousness Model, which is know to capture key features of consciousness. On the other hand, the Euclidean group had no effect on epistemic value : no action was better than the initial idle state. In structuring a priori an agent's internal representation, we show how geometry can play a key role in information integration and action planning.

Related papers

• Zero-Shot Object-Centric Representation Learning [72.43369950684057]
  We study current object-centric methods through the lens of zero-shot generalization. We introduce a benchmark comprising eight different synthetic and real-world datasets. We find that training on diverse real-world images improves transferability to unseen scenarios.
  arXiv  Detail & Related papers  (2024-08-17T10:37:07Z)
• Dynamic planning in hierarchical active inference [0.0]
  We refer to the ability of the human brain to infer and impose motor trajectories related to cognitive decisions. This study distances from traditional views centered on neural networks and reinforcement learning, and points toward a yet unexplored direction in active inference.
  arXiv  Detail & Related papers  (2024-02-18T17:32:53Z)
• Binding Dynamics in Rotating Features [72.80071820194273]
  We propose an alternative "cosine binding" mechanism, which explicitly computes the alignment between features and adjusts weights accordingly. This allows us to draw direct connections to self-attention and biological neural processes, and to shed light on the fundamental dynamics for object-centric representations to emerge in Rotating Features.
  arXiv  Detail & Related papers  (2024-02-08T12:31:08Z)
• Inferring Hierarchical Structure in Multi-Room Maze Environments [4.6956495676681484]
  This paper introduces a hierarchical active inference model addressing the challenge of inferring structure in the world from pixel-based observations. We propose a three-layer hierarchical model consisting of a cognitive map, an allocentric, and an egocentric world model, combining curiosity-driven exploration with goal-oriented behaviour.
  arXiv  Detail & Related papers  (2023-06-23T15:15:57Z)
• Homomorphism Autoencoder -- Learning Group Structured Representations from Observed Transitions [51.71245032890532]
  We propose methods enabling an agent acting upon the world to learn internal representations of sensory information consistent with actions that modify it. In contrast to existing work, our approach does not require prior knowledge of the group and does not restrict the set of actions the agent can perform.
  arXiv  Detail & Related papers  (2022-07-25T11:22:48Z)
• Towards Self-Supervised Category-Level Object Pose and Size Estimation [121.28537953301951]
  This work presents a self-supervised framework for category-level object pose and size estimation from a single depth image. We leverage the geometric consistency residing in point clouds of the same shape for self-supervision.
  arXiv  Detail & Related papers  (2022-03-06T06:02:30Z)
• Hierarchical Relational Inference [80.00374471991246]
  We propose a novel approach to physical reasoning that models objects as hierarchies of parts that may locally behave separately, but also act more globally as a single whole. Unlike prior approaches, our method learns in an unsupervised fashion directly from raw visual images. It explicitly distinguishes multiple levels of abstraction and improves over a strong baseline at modeling synthetic and real-world videos.
  arXiv  Detail & Related papers  (2020-10-07T20:19:10Z)
• Learning abstract structure for drawing by efficient motor program induction [52.13961975752941]
  We develop a naturalistic drawing task to study how humans rapidly acquire structured prior knowledge. We show that people spontaneously learn abstract drawing procedures that support generalization. We propose a model of how learners can discover these reusable drawing programs.
  arXiv  Detail & Related papers  (2020-08-08T13:31:14Z)
• Learning intuitive physics and one-shot imitation using state-action-prediction self-organizing maps [0.0]
  Humans learn by exploration and imitation, build causal models of the world, and use both to flexibly solve new tasks. We suggest a simple but effective unsupervised model which develops such characteristics. We demonstrate its performance on a set of several related, but different one-shot imitation tasks, which the agent flexibly solves in an active inference style.
  arXiv  Detail & Related papers  (2020-07-03T12:29:11Z)
• On the Sensory Commutativity of Action Sequences for Embodied Agents [2.320417845168326]
  We study perception for embodied agents under the mathematical formalism of group theory. We introduce the Sensory Commutativity Probability criterion which measures how much an agent's degree of freedom affects the environment. We empirically illustrate how SCP and the commutative properties of action sequences can be used to learn about objects in the environment.
  arXiv  Detail & Related papers  (2020-02-13T16:58:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.