Social Learning Strategies for Evolved Virtual Soft Robots
- URL: http://arxiv.org/abs/2604.12482v2
- Date: Fri, 17 Apr 2026 18:12:55 GMT
- Title: Social Learning Strategies for Evolved Virtual Soft Robots
- Abstract summary: We study the effect of inheriting experience from morphologically similar robots due to the tightly coupled body and brain in robot optimization.<n>Our results confirm the effectiveness of building on others' experience, as social learning clearly outperforms learning from scratch under equivalent computational budgets.
- Score: 0.17691324921037177
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Optimizing the body and brain of a robot is a coupled challenge: the morphology determines what control strategies are effective, while the control parameters influence how well the morphology performs. This joint optimization can be done through nested loops of evolutionary and learning processes, where the control parameters of each robot are learned independently. However, the control parameters learned by one robot may contain valuable information for others. Thus, we introduce a social learning approach in which robots can exploit optimized parameters from their peers to accelerate their own brain optimization. Within this framework, we systematically investigate how the selection of teachers, deciding which and how many robots to learn from, affects performance, experimenting with virtual soft robots in four tasks and environments. In particular, we study the effect of inheriting experience from morphologically similar robots due to the tightly coupled body and brain in robot optimization. Our results confirm the effectiveness of building on others' experience, as social learning clearly outperforms learning from scratch under equivalent computational budgets. In addition, while the optimal teacher selection strategy remains open, our findings suggest that incorporating knowledge from multiple teachers can yield more consistent and robust improvements.
Related papers
- Robots Need Some Education: On the complexity of learning in evolutionary robotics [0.0]
Evolutionary Robotics and Robot Learning aim to automatically optimize robot designs.<n>The effects of introducing learning into the evolutionary process are not well-understood.<n>This thesis investigates these intricacies and presents several learning algorithms developed for an Evolutionary Robotics context.
arXiv Detail & Related papers (2026-04-05T17:34:40Z) - SIME: Enhancing Policy Self-Improvement with Modal-level Exploration [49.86173021151849]
We identify the key to successful self-improvement: modal-level exploration and data selection.<n>By incorporating a modal-level exploration mechanism during policy execution, the robot can produce more diverse and multi-modal interactions.<n>We successfully demonstrate effective robot self-improvement on both simulation benchmarks and real-world experiments.
arXiv Detail & Related papers (2025-05-02T17:13:03Z) - On the Effect of Robot Errors on Human Teaching Dynamics [1.7249361224827533]
We investigate how the presence and severity of robot errors affect three dimensions of human teaching dynamics.
Results show that people tend to spend more time teaching robots with errors.
Our findings offer valuable insights for designing effective interfaces for interactive learning.
arXiv Detail & Related papers (2024-09-15T19:02:34Z) - Universal Morphology Control via Contextual Modulation [52.742056836818136]
Learning a universal policy across different robot morphologies can significantly improve learning efficiency and generalization in continuous control.
Existing methods utilize graph neural networks or transformers to handle heterogeneous state and action spaces across different morphologies.
We propose a hierarchical architecture to better model this dependency via contextual modulation.
arXiv Detail & Related papers (2023-02-22T00:04:12Z) - HERD: Continuous Human-to-Robot Evolution for Learning from Human
Demonstration [57.045140028275036]
We show that manipulation skills can be transferred from a human to a robot through the use of micro-evolutionary reinforcement learning.
We propose an algorithm for multi-dimensional evolution path searching that allows joint optimization of both the robot evolution path and the policy.
arXiv Detail & Related papers (2022-12-08T15:56:13Z) - Revisiting the Adversarial Robustness-Accuracy Tradeoff in Robot
Learning [121.9708998627352]
Recent work has shown that, in practical robot learning applications, the effects of adversarial training do not pose a fair trade-off.
This work revisits the robustness-accuracy trade-off in robot learning by analyzing if recent advances in robust training methods and theory can make adversarial training suitable for real-world robot applications.
arXiv Detail & Related papers (2022-04-15T08:12:15Z) - Cognitive architecture aided by working-memory for self-supervised
multi-modal humans recognition [54.749127627191655]
The ability to recognize human partners is an important social skill to build personalized and long-term human-robot interactions.
Deep learning networks have achieved state-of-the-art results and demonstrated to be suitable tools to address such a task.
One solution is to make robots learn from their first-hand sensory data with self-supervision.
arXiv Detail & Related papers (2021-03-16T13:50:24Z) - How to reduce computation time while sparing performance during robot
navigation? A neuro-inspired architecture for autonomous shifting between
model-based and model-free learning [1.3854111346209868]
We present a novel arbitration mechanism between learning systems that explicitly measures performance and cost.
We find that the robot can adapt to environment changes by switching between learning systems so as to maintain a high performance.
When the task is stable, the robot also autonomously shifts to the least costly system, which leads to a drastic reduction in computation cost while keeping a high performance.
arXiv Detail & Related papers (2020-04-30T11:29:16Z) - Rapidly Adaptable Legged Robots via Evolutionary Meta-Learning [65.88200578485316]
We present a new meta-learning method that allows robots to quickly adapt to changes in dynamics.
Our method significantly improves adaptation to changes in dynamics in high noise settings.
We validate our approach on a quadruped robot that learns to walk while subject to changes in dynamics.
arXiv Detail & Related papers (2020-03-02T22:56:27Z) - Learning Directed Locomotion in Modular Robots with Evolvable
Morphologies [11.006321791711175]
This study is based on our interest in evolutionary robot systems where both morphologies and controllers evolve.
In such a system, newborn robots have to learn to control their own body that is a random combination of the bodies of the parents.
arXiv Detail & Related papers (2020-01-21T23:01:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.