Hierarchically Organized Latent Modules for Exploratory Search in Morphogenetic Systems

• URL: http://arxiv.org/abs/2007.01195v3
• Date: Thu, 2 Sep 2021 18:13:52 GMT
• Title: Hierarchically Organized Latent Modules for Exploratory Search in Morphogenetic Systems
• Authors: Mayalen Etcheverry, Clement Moulin-Frier, Pierre-Yves Oudeyer
• Abstract summary: We introduce a novel dynamic and modular architecture that enables unsupervised learning of a hierarchy of diverse representations. We show that this system forms a discovery assistant that can efficiently adapt its diversity search towards preferences of a user.
• Score: 21.23182328329019
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Self-organization of complex morphological patterns from local interactions is a fascinating phenomenon in many natural and artificial systems. In the artificial world, typical examples of such morphogenetic systems are cellular automata. Yet, their mechanisms are often very hard to grasp and so far scientific discoveries of novel patterns have primarily been relying on manual tuning and ad hoc exploratory search. The problem of automated diversity-driven discovery in these systems was recently introduced [26, 62], highlighting that two key ingredients are autonomous exploration and unsupervised representation learning to describe "relevant" degrees of variations in the patterns. In this paper, we motivate the need for what we call Meta-diversity search, arguing that there is not a unique ground truth interesting diversity as it strongly depends on the final observer and its motives. Using a continuous game-of-life system for experiments, we provide empirical evidences that relying on monolithic architectures for the behavioral embedding design tends to bias the final discoveries (both for hand-defined and unsupervisedly-learned features) which are unlikely to be aligned with the interest of a final end-user. To address these issues, we introduce a novel dynamic and modular architecture that enables unsupervised learning of a hierarchy of diverse representations. Combined with intrinsically motivated goal exploration algorithms, we show that this system forms a discovery assistant that can efficiently adapt its diversity search towards preferences of a user using only a very small amount of user feedback.

Related papers

• Learning System Dynamics without Forgetting [60.08612207170659]
  Predicting trajectories of systems with unknown dynamics is crucial in various research fields, including physics and biology. We present a novel framework of Mode-switching Graph ODE (MS-GODE), which can continually learn varying dynamics. We construct a novel benchmark of biological dynamic systems, featuring diverse systems with disparate dynamics.
  arXiv  Detail & Related papers  (2024-06-30T14:55:18Z)
• Toward Artificial Open-Ended Evolution within Lenia using Quality-Diversity [5.380545611878407]
  We show that Quality-Diversity is an effective framework for the automatic discovery of diverse self-organizing patterns in complex systems. Our framework, called Leniabreeder, can leverage both manually defined diversity criteria and unsupervised measures of diversity to broaden the scope of discoverable patterns.
  arXiv  Detail & Related papers  (2024-06-06T16:35:27Z)
• Automated Discovery of Coupled Mode Setups [7.555791623885635]
  In optics and photonics, a small number of building blocks, like resonators, waveguides, arbitrary couplings, and parametric interactions, allow the design of a broad variety of devices and functionalities. Usually, the design of such a system is handcrafted by an experienced scientist in a time-consuming process where it remains uncertain whether the simplest possibility has indeed been found. In our work, we develop a discovery algorithm that automates this challenge.
  arXiv  Detail & Related papers  (2024-04-23T10:15:18Z)
• Open-world Machine Learning: A Review and New Outlooks [83.6401132743407]
  This paper aims to provide a comprehensive introduction to the emerging open-world machine learning paradigm. It aims to help researchers build more powerful AI systems in their respective fields, and to promote the development of artificial general intelligence.
  arXiv  Detail & Related papers  (2024-03-04T06:25:26Z)
• Meta-Diversity Search in Complex Systems, A Recipe for Artificial Open-Endedness ? [0.0]
  This article presents what we believe to be some working ingredients for the endless generation of novel increasingly complex artifacts in Minecraft. We simulate an artificial "chemistry" system based on Lenia continuous cellular automaton for generating artifacts, as well as an artificial "discovery assistant" (called Holmes) for the artifact-discovery process.
  arXiv  Detail & Related papers  (2023-12-01T09:40:27Z)
• Large Language Models for Information Retrieval: A Survey [58.30439850203101]
  Information retrieval has evolved from term-based methods to its integration with advanced neural models. Recent research has sought to leverage large language models (LLMs) to improve IR systems. We delve into the confluence of LLMs and IR systems, including crucial aspects such as query rewriters, retrievers, rerankers, and readers.
  arXiv  Detail & Related papers  (2023-08-14T12:47:22Z)
• Incremental procedural and sensorimotor learning in cognitive humanoid robots [52.77024349608834]
  This work presents a cognitive agent that can learn procedures incrementally. We show the cognitive functions required in each substage and how adding new functions helps address tasks previously unsolved by the agent. Results show that this approach is capable of solving complex tasks incrementally.
  arXiv  Detail & Related papers  (2023-04-30T22:51:31Z)
• Dynamical Equations With Bottom-up Self-Organizing Properties Learn Accurate Dynamical Hierarchies Without Any Loss Function [15.122944754472435]
  We propose a learning system where patterns are defined within the realm of nonlinear dynamics with positive and negative feedback loops. Experiments reveal that such a system can map temporal to spatial correlation, enabling hierarchical structures to be learned from sequential data.
  arXiv  Detail & Related papers  (2023-02-04T10:00:14Z)
• Redefining Neural Architecture Search of Heterogeneous Multi-Network Models by Characterizing Variation Operators and Model Components [71.03032589756434]
  We investigate the effect of different variation operators in a complex domain, that of multi-network heterogeneous neural models. We characterize both the variation operators, according to their effect on the complexity and performance of the model; and the models, relying on diverse metrics which estimate the quality of the different parts composing it.
  arXiv  Detail & Related papers  (2021-06-16T17:12:26Z)
• Understanding the wiring evolution in differentiable neural architecture search [114.31723873105082]
  Controversy exists on whether differentiable neural architecture search methods discover wiring topology effectively. We study the underlying mechanism of several existing differentiable NAS frameworks.
  arXiv  Detail & Related papers  (2020-09-02T18:08:34Z)
• Progressive growing of self-organized hierarchical representations for exploration [22.950651316748207]
  A central challenge is how to learn representations in order to progressively build a map of the discovered structures. We aim to build lasting representations and avoid catastrophic forgetting throughout the exploration process. Thirdly, we target representations that can structure the agent discoveries in a coarse-to-fine manner.
  arXiv  Detail & Related papers  (2020-05-13T15:24:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.