Morphological Development at the Evolutionary Timescale: Robotic Developmental Evolution

• URL: http://arxiv.org/abs/2010.14894v2
• Date: Tue, 18 Jan 2022 21:29:12 GMT
• Title: Morphological Development at the Evolutionary Timescale: Robotic Developmental Evolution
• Authors: Fabien C. Y. Benureau and Jun Tani
• Abstract summary: We propose to design a developmental process happening at the phylogenetic timescale. We show that this produces better and qualitatively different gaits than an evolutionary search with only adult robots. Our method is conceptually simple, and can be effective on small or large populations of robots.
• Score: 5.000272778136268
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Evolution and development operate at different timescales; generations for the one, a lifetime for the other. These two processes, the basis of much of life on earth, interact in many non-trivial ways, but their temporal hierarchy -- evolution overarching development -- is observed for most multicellular lifeforms. When designing robots however, this tenet lifts: it becomes -- however natural -- a design choice. We propose to inverse this temporal hierarchy and design a developmental process happening at the phylogenetic timescale. Over a classic evolutionary search aimed at finding good gaits for tentacle 2D robots, we add a developmental process over the robots' morphologies. Within a generation, the morphology of the robots does not change. But from one generation to the next, the morphology develops. Much like we become bigger, stronger, and heavier as we age, our robots are bigger, stronger and heavier with each passing generation. Our robots start with baby morphologies, and a few thousand generations later, end-up with adult ones. We show that this produces better and qualitatively different gaits than an evolutionary search with only adult robots, and that it prevents premature convergence by fostering exploration. In addition, we validate our method on voxel lattice 3D robots from the literature and compare it to a recent evolutionary developmental approach. Our method is conceptually simple, and can be effective on small or large populations of robots, and intrinsic to the robot and its morphology, not the task or environment. Furthermore, by recasting the evolutionary search as a learning process, these results can be viewed in the context of developmental learning robotics.

Related papers

• Evolution and learning in differentiable robots [0.0]
  We use differentiable simulations to rapidly and simultaneously optimize individual neural control of behavior across a large population of candidate body plans. Non-differentiable changes to the mechanical structure of each robot in the population were applied by a genetic algorithm in an outer loop of search. One of the highly differentiable morphologies discovered in simulation was realized as a physical robot and shown to retain its optimized behavior.
  arXiv  Detail & Related papers  (2024-05-23T15:45:43Z)
• HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulation [50.616995671367704]
  We present a high-dimensional, simulated robot learning benchmark, HumanoidBench, featuring a humanoid robot equipped with dexterous hands. Our findings reveal that state-of-the-art reinforcement learning algorithms struggle with most tasks, whereas a hierarchical learning approach achieves superior performance when supported by robust low-level policies.
  arXiv  Detail & Related papers  (2024-03-15T17:45:44Z)
• DiffuseBot: Breeding Soft Robots With Physics-Augmented Generative Diffusion Models [102.13968267347553]
  We present DiffuseBot, a physics-augmented diffusion model that generates soft robot morphologies capable of excelling in a wide spectrum of tasks. We showcase a range of simulated and fabricated robots along with their capabilities.
  arXiv  Detail & Related papers  (2023-11-28T18:58:48Z)
• Lamarck's Revenge: Inheritance of Learned Traits Can Make Robot Evolution Better [2.884244918665901]
  We investigate the question What if the 18th-century biologist Lamarck was not completely wrong and individual traits learned during a lifetime could be passed on to offspring through inheritance?'' Within this framework, we compare a Lamarckian system, where learned bits of the brain are inheritable, with a Darwinian system, where they are not.
  arXiv  Detail & Related papers  (2023-09-22T15:29:15Z)
• World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challenges [51.92834011423463]
  We focus on the two concepts of world models and predictive coding. In neuroscience, predictive coding proposes that the brain continuously predicts its inputs and adapts to model its own dynamics and control behavior in its environment.
  arXiv  Detail & Related papers  (2023-01-14T06:38:14Z)
• HERD: Continuous Human-to-Robot Evolution for Learning from Human Demonstration [57.045140028275036]
  We show that manipulation skills can be transferred from a human to a robot through the use of micro-evolutionary reinforcement learning. We propose an algorithm for multi-dimensional evolution path searching that allows joint optimization of both the robot evolution path and the policy.
  arXiv  Detail & Related papers  (2022-12-08T15:56:13Z)
• The Effects of the Environment and Linear Actuators on Robot Morphologies [0.0]
  We study the effect of adding a new module inspired by the skeletal muscle to the existing RoboGen framework: the linear actuator. We find significant differences in the morphologies of robots evolved in a plain environment and robots evolved in a rough environment.
  arXiv  Detail & Related papers  (2022-04-02T20:03:32Z)
• REvolveR: Continuous Evolutionary Models for Robot-to-robot Policy Transfer [57.045140028275036]
  We consider the problem of transferring a policy across two different robots with significantly different parameters such as kinematics and morphology. Existing approaches that train a new policy by matching the action or state transition distribution, including imitation learning methods, fail due to optimal action and/or state distribution being mismatched in different robots. We propose a novel method named $REvolveR$ of using continuous evolutionary models for robotic policy transfer implemented in a physics simulator.
  arXiv  Detail & Related papers  (2022-02-10T18:50:25Z)
• The Introspective Agent: Interdependence of Strategy, Physiology, and Sensing for Embodied Agents [51.94554095091305]
  We argue for an introspective agent, which considers its own abilities in the context of its environment. Just as in nature, we hope to reframe strategy as one tool, among many, to succeed in an environment.
  arXiv  Detail & Related papers  (2022-01-02T20:14:01Z)
• The Effects of Learning in Morphologically Evolving Robot Systems [8.627180519837657]
  We show that learning can greatly increase task performance and reduce the number of generations required to reach a certain fitness level. Although learning only directly affects the controllers, we demonstrate that the evolved morphologies will be also different. We observe that the learning delta, the performance difference between the inherited and the learned brain, is growing throughout the evolutionary process.
  arXiv  Detail & Related papers  (2021-11-18T18:20:33Z)
• The Effects of Learning in Morphologically Evolving Robot Systems [10.592277756185046]
  We set up a system where modular robots can create offspring that inherit the bodies of parents by recombination and mutation. The first approach entails solely evolution which means the brain of a robot child is inherited from its parents. The second approach is evolution plus learning which means the brain of a child is inherited as well, but additionally is developed by a learning algorithm.
  arXiv  Detail & Related papers  (2021-07-17T14:38:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.