Meta-Learning an Evolvable Developmental Encoding

• URL: http://arxiv.org/abs/2406.09020v2
• Date: Fri, 5 Jul 2024 08:41:17 GMT
• Title: Meta-Learning an Evolvable Developmental Encoding
• Authors: Milton L. Montero, Erwan Plantec, Eleni Nisioti, Joachim W. Pedersen, Sebastian Risi,
• Abstract summary: Generative models have shown promise in being learnable representations for black-box optimisation. Here we present a system that can meta-learn such representation by optimising for a representation's ability to generate quality-diversity. In more detail, we show our meta-learning approach can find one Neural Cellular Automata, in which cells can attend to different parts of a "DNA" string genome during development.
• Score: 7.479827648985631
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Representations for black-box optimisation methods (such as evolutionary algorithms) are traditionally constructed using a delicate manual process. This is in contrast to the representation that maps DNAs to phenotypes in biological organisms, which is at the hear of biological complexity and evolvability. Additionally, the core of this process is fundamentally the same across nearly all forms of life, reflecting their shared evolutionary origin. Generative models have shown promise in being learnable representations for black-box optimisation but they are not per se designed to be easily searchable. Here we present a system that can meta-learn such representation by directly optimising for a representation's ability to generate quality-diversity. In more detail, we show our meta-learning approach can find one Neural Cellular Automata, in which cells can attend to different parts of a "DNA" string genome during development, enabling it to grow different solvable 2D maze structures. We show that the evolved genotype-to-phenotype mappings become more and more evolvable, not only resulting in a faster search but also increasing the quality and diversity of grown artefacts.

Related papers

• Neural Echos: Depthwise Convolutional Filters Replicate Biological Receptive Fields [56.69755544814834]
  We present evidence suggesting that depthwise convolutional kernels are effectively replicating the biological receptive fields observed in the mammalian retina. We propose a scheme that draws inspiration from the biological receptive fields.
  arXiv  Detail & Related papers  (2024-01-18T18:06:22Z)
• DARLEI: Deep Accelerated Reinforcement Learning with Evolutionary Intelligence [77.78795329701367]
  We present DARLEI, a framework that combines evolutionary algorithms with parallelized reinforcement learning. We characterize DARLEI's performance under various conditions, revealing factors impacting diversity of evolved morphologies. We hope to extend DARLEI in future work to include interactions between diverse morphologies in richer environments.
  arXiv  Detail & Related papers  (2023-12-08T16:51:10Z)
• Unsupervised ensemble-based phenotyping helps enhance the discoverability of genes related to heart morphology [57.25098075813054]
  We propose a new framework for gene discovery entitled Un Phenotype Ensembles. It builds a redundant yet highly expressive representation by pooling a set of phenotypes learned in an unsupervised manner. These phenotypes are then analyzed via (GWAS), retaining only highly confident and stable associations.
  arXiv  Detail & Related papers  (2023-01-07T18:36:44Z)
• Learning multi-scale functional representations of proteins from single-cell microscopy data [77.34726150561087]
  We show that simple convolutional networks trained on localization classification can learn protein representations that encapsulate diverse functional information. We also propose a robust evaluation strategy to assess quality of protein representations across different scales of biological function.
  arXiv  Detail & Related papers  (2022-05-24T00:00:07Z)
• Variational Neural Cellular Automata [7.863826008567604]
  In nature, the process of cellular growth and differentiation has lead to an amazing diversity of organisms. We propose a generative model, the Variational Cellular Automata (VNCA), which is loosely inspired by the biological processes of cellular growth and differentiation.
  arXiv  Detail & Related papers  (2022-01-28T11:41:53Z)
• Heritability in Morphological Robot Evolution [2.7402733069181]
  We introduce the biological notion of heritability, which captures the amount of phenotypic variation caused by genotypic variation. In our analysis we measure the heritability on the first generation of robots evolved from two different encodings. We show how heritability can be a useful tool to better understand the relationship between genotypes and phenotypes.
  arXiv  Detail & Related papers  (2021-10-21T14:58:17Z)
• Epigenetic opportunities for Evolutionary Computation [0.0]
  Evolutionary Computation is a group of biologically inspired algorithms used to solve complex optimisation problems. It can be split into Evolutionary Algorithms, which take inspiration from genetic inheritance, and Swarm Intelligence algorithms, that take inspiration from cultural inheritance. This paper breaks down successful bio-inspired algorithms under a contemporary biological framework based on the Extended Evolutionary Synthesis.
  arXiv  Detail & Related papers  (2021-08-10T09:44:53Z)
• Epigenetic evolution of deep convolutional models [81.21462458089142]
  We build upon a previously proposed neuroevolution framework to evolve deep convolutional models. We propose a convolutional layer layout which allows kernels of different shapes and sizes to coexist within the same layer. The proposed layout enables the size and shape of individual kernels within a convolutional layer to be evolved with a corresponding new mutation operator.
  arXiv  Detail & Related papers  (2021-04-12T12:45:16Z)
• Population-Based Evolution Optimizes a Meta-Learning Objective [0.6091702876917279]
  We propose that meta-learning and adaptive evolvability optimize for high performance after a set of learning iterations. We demonstrate this claim with a simple evolutionary algorithm, Population-Based Meta Learning.
  arXiv  Detail & Related papers  (2021-03-11T03:45:43Z)
• Modeling the Evolution of Retina Neural Network [0.0]
  retinal circuitry shows many similar structures across a broad array of species. We design a method using genetic algorithm that leads to architectures whose functions are similar to biological retina. We discuss how our framework can come into goal-driven search and sustainable enhancement of neural network models in machine learning.
  arXiv  Detail & Related papers  (2020-11-24T23:57:54Z)
• Neural Cellular Automata Manifold [84.08170531451006]
  We show that the neural network architecture of the Neural Cellular Automata can be encapsulated in a larger NN. This allows us to propose a new model that encodes a manifold of NCA, each of them capable of generating a distinct image. In biological terms, our approach would play the role of the transcription factors, modulating the mapping of genes into specific proteins that drive cellular differentiation.
  arXiv  Detail & Related papers  (2020-06-22T11:41:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.