Co-optimising Robot Morphology and Controller in a Simulated Open-Ended Environment

• URL: http://arxiv.org/abs/2104.03062v1
• Date: Wed, 7 Apr 2021 11:28:23 GMT
• Title: Co-optimising Robot Morphology and Controller in a Simulated Open-Ended Environment
• Authors: Emma Hjellbrekke Stensby, Kai Olav Ellefsen and Kyrre Glette
• Abstract summary: We show how changing the environment, where the agent locomotes, affects the convergence of morphologies. We show that agent-populations evolving in open-endedly evolving environments exhibit larger morphological diversity than agent-populations evolving in hand crafted curricula of environments.
• Score: 1.4502611532302039
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Designing robots by hand can be costly and time consuming, especially if the robots have to be created with novel materials, or be robust to internal or external changes. In order to create robots automatically, without the need for human intervention, it is necessary to optimise both the behaviour and the body design of the robot. However, when co-optimising the morphology and controller of a locomoting agent the morphology tends to converge prematurely, reaching a local optimum. Approaches such as explicit protection of morphological innovation have been used to reduce this problem, but it might also be possible to increase exploration of morphologies using a more indirect approach. We explore how changing the environment, where the agent locomotes, affects the convergence of morphologies. The agents' morphologies and controllers are co-optimised, while the environments the agents locomote in are evolved open-endedly with the Paired Open-Ended Trailblazer (POET). We compare the diversity, fitness and robustness of agents evolving in environments generated by POET to agents evolved in handcrafted curricula of environments. Our agents each contain of a population of individuals being evolved with a genetic algorithm. This population is called the agent-population. We show that agent-populations evolving in open-endedly evolving environments exhibit larger morphological diversity than agent-populations evolving in hand crafted curricula of environments. POET proved capable of creating a curriculum of environments which encouraged both diversity and quality in the populations. This suggests that POET may be capable of reducing premature convergence in co-optimisation of morphology and controllers.

Related papers

• Investigating Premature Convergence in Co-optimization of Morphology and Control in Evolved Virtual Soft Robots [0.2900810893770134]
  Co-optimization of morphology and control of evolved virtual soft robots is a challenging problem. We show that high-performing regions in the morphology space are not able to be discovered during the co-optimization of the morphology and control. We propose a new body-centric framework to think about the co-optimization problem.
  arXiv  Detail & Related papers  (2024-02-14T15:21:17Z)
• Agent Alignment in Evolving Social Norms [65.45423591744434]
  We propose an evolutionary framework for agent evolution and alignment, named EvolutionaryAgent. In an environment where social norms continuously evolve, agents better adapted to the current social norms will have a higher probability of survival and proliferation. We show that EvolutionaryAgent can align progressively better with the evolving social norms while maintaining its proficiency in general tasks.
  arXiv  Detail & Related papers  (2024-01-09T15:44:44Z)
• Agent AI: Surveying the Horizons of Multimodal Interaction [83.18367129924997]
  "Agent AI" is a class of interactive systems that can perceive visual stimuli, language inputs, and other environmentally-grounded data. We envision a future where people can easily create any virtual reality or simulated scene and interact with agents embodied within the virtual environment.
  arXiv  Detail & Related papers  (2024-01-07T19:11:18Z)
• DARLEI: Deep Accelerated Reinforcement Learning with Evolutionary Intelligence [77.78795329701367]
  We present DARLEI, a framework that combines evolutionary algorithms with parallelized reinforcement learning. We characterize DARLEI's performance under various conditions, revealing factors impacting diversity of evolved morphologies. We hope to extend DARLEI in future work to include interactions between diverse morphologies in richer environments.
  arXiv  Detail & Related papers  (2023-12-08T16:51:10Z)
• DiffuseBot: Breeding Soft Robots With Physics-Augmented Generative Diffusion Models [102.13968267347553]
  We present DiffuseBot, a physics-augmented diffusion model that generates soft robot morphologies capable of excelling in a wide spectrum of tasks. We showcase a range of simulated and fabricated robots along with their capabilities.
  arXiv  Detail & Related papers  (2023-11-28T18:58:48Z)
• Open-endedness induced through a predator-prey scenario using modular robots [0.0]
  This work investigates how a predator-prey scenario can induce the emergence of Open-Ended Evolution (OEE) We utilize modular robots of fixed morphologies whose controllers are subject to evolution.
  arXiv  Detail & Related papers  (2023-09-20T12:58:51Z)
• SoftZoo: A Soft Robot Co-design Benchmark For Locomotion In Diverse Environments [111.91255476270526]
  We introduce SoftZoo, a soft robot co-design platform for locomotion in diverse environments. SoftZoo supports an extensive, naturally-inspired material set, including the ability to simulate environments such as flat ground, desert, wetland, clay, ice, snow, shallow water, and ocean. It provides a variety of tasks relevant for soft robotics, including fast locomotion, agile turning, and path following, as well as differentiable design representations for morphology and control.
  arXiv  Detail & Related papers  (2023-03-16T17:59:50Z)
• Co-evolving morphology and control of soft robots using a single genome [0.0]
  We present a new method to co-evolve morphology and control of robots. Our method derives both the "brain" and the "body" of an agent from a single genome and develops them together. We evaluate the presented methods on four tasks and observe that even if the search space was larger, having a single genome makes the evolution process converge faster.
  arXiv  Detail & Related papers  (2022-12-22T07:34:31Z)
• Collective motion emerging from evolving swarm controllers in different environments using gradient following task [2.7402733069181]
  We consider a challenging task where robots with limited sensing and communication abilities must follow the gradient of an environmental feature. We use Differential Evolution to evolve a neural network controller for simulated Thymio II robots. Experiments confirm the feasibility of our approach, the evolved robot controllers induced swarm behaviour that solved the task.
  arXiv  Detail & Related papers  (2022-03-22T10:08:50Z)
• The Introspective Agent: Interdependence of Strategy, Physiology, and Sensing for Embodied Agents [51.94554095091305]
  We argue for an introspective agent, which considers its own abilities in the context of its environment. Just as in nature, we hope to reframe strategy as one tool, among many, to succeed in an environment.
  arXiv  Detail & Related papers  (2022-01-02T20:14:01Z)
• Environmental Adaptation of Robot Morphology and Control through Real-world Evolution [5.08706161686979]
  We apply evolutionary search to yield combinations of morphology and control for our mechanically self-reconfiguring quadruped robot. We evolve solutions on two distinct physical surfaces and analyze the results in terms of both control and morphology.
  arXiv  Detail & Related papers  (2020-03-30T07:57:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.