Cross Domain Robot Imitation with Invariant Representation

• URL: http://arxiv.org/abs/2109.05940v1
• Date: Mon, 13 Sep 2021 13:05:35 GMT
• Title: Cross Domain Robot Imitation with Invariant Representation
• Authors: Zhao-Heng Yin, Lingfeng Sun, Hengbo Ma, Masayoshi Tomizuka, Wu-Jun Li
• Abstract summary: Cross domain imitation learning (CDIL) is a challenging task in robotics. We introduce an imitation learning algorithm based on invariant representation. We show that our method is able to learn similar representations for different robots with similar behaviors.
• Score: 32.1735585546968
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Animals are able to imitate each others' behavior, despite their difference in biomechanics. In contrast, imitating the other similar robots is a much more challenging task in robotics. This problem is called cross domain imitation learning~(CDIL). In this paper, we consider CDIL on a class of similar robots. We tackle this problem by introducing an imitation learning algorithm based on invariant representation. We propose to learn invariant state and action representations, which aligns the behavior of multiple robots so that CDIL becomes possible. Compared with previous invariant representation learning methods for similar purpose, our method does not require human-labeled pairwise data for training. Instead, we use cycle-consistency and domain confusion to align the representation and increase its robustness. We test the algorithm on multiple robots in simulator and show that unseen new robot instances can be trained with existing expert demonstrations successfully. Qualitative results also demonstrate that the proposed method is able to learn similar representations for different robots with similar behaviors, which is essential for successful CDIL.

Related papers

• Offline Imitation Learning Through Graph Search and Retrieval [57.57306578140857]
  Imitation learning is a powerful machine learning algorithm for a robot to acquire manipulation skills. We propose GSR, a simple yet effective algorithm that learns from suboptimal demonstrations through Graph Search and Retrieval. GSR can achieve a 10% to 30% higher success rate and over 30% higher proficiency compared to baselines.
  arXiv  Detail & Related papers  (2024-07-22T06:12:21Z)
• Correspondence learning between morphologically different robots via task demonstrations [2.1374208474242815]
  We propose a method to learn correspondences among two or more robots that may have different morphologies. A fixed-based manipulator robot with joint control and a differential drive mobile robot can be addressed within the proposed framework. We provide a proof-of-the-concept realization of correspondence learning between a real manipulator robot and a simulated mobile robot.
  arXiv  Detail & Related papers  (2023-10-20T12:42:06Z)
• Robot Learning with Sensorimotor Pre-training [98.7755895548928]
  We present a self-supervised sensorimotor pre-training approach for robotics. Our model, called RPT, is a Transformer that operates on sequences of sensorimotor tokens. We find that sensorimotor pre-training consistently outperforms training from scratch, has favorable scaling properties, and enables transfer across different tasks, environments, and robots.
  arXiv  Detail & Related papers  (2023-06-16T17:58:10Z)
• Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement Learning [54.636562516974884]
  In imitation and reinforcement learning, the cost of human supervision limits the amount of data that robots can be trained on. In this work, we propose MEDAL++, a novel design for self-improving robotic systems. The robot autonomously practices the task by learning to both do and undo the task, simultaneously inferring the reward function from the demonstrations.
  arXiv  Detail & Related papers  (2023-03-02T18:51:38Z)
• Learning Reward Functions for Robotic Manipulation by Observing Humans [92.30657414416527]
  We use unlabeled videos of humans solving a wide range of manipulation tasks to learn a task-agnostic reward function for robotic manipulation policies. The learned rewards are based on distances to a goal in an embedding space learned using a time-contrastive objective.
  arXiv  Detail & Related papers  (2022-11-16T16:26:48Z)
• REvolveR: Continuous Evolutionary Models for Robot-to-robot Policy Transfer [57.045140028275036]
  We consider the problem of transferring a policy across two different robots with significantly different parameters such as kinematics and morphology. Existing approaches that train a new policy by matching the action or state transition distribution, including imitation learning methods, fail due to optimal action and/or state distribution being mismatched in different robots. We propose a novel method named $REvolveR$ of using continuous evolutionary models for robotic policy transfer implemented in a physics simulator.
  arXiv  Detail & Related papers  (2022-02-10T18:50:25Z)
• Learning Bipedal Robot Locomotion from Human Movement [0.791553652441325]
  We present a reinforcement learning based method for teaching a real world bipedal robot to perform movements directly from motion capture data. Our method seamlessly transitions from training in a simulation environment to executing on a physical robot. We demonstrate our method on an internally developed humanoid robot with movements ranging from a dynamic walk cycle to complex balancing and waving.
  arXiv  Detail & Related papers  (2021-05-26T00:49:37Z)
• Learning Cross-Domain Correspondence for Control with Dynamics Cycle-Consistency [60.39133304370604]
  We learn to align dynamic robot behavior across two domains using a cycle-consistency constraint. Our framework is able to align uncalibrated monocular video of a real robot arm to dynamic state-action trajectories of a simulated arm without paired data.
  arXiv  Detail & Related papers  (2020-12-17T18:22:25Z)
• Transformers for One-Shot Visual Imitation [28.69615089950047]
  Humans are able to seamlessly visually imitate others, by inferring their intentions and using past experience to achieve the same end goal. Prior research in robot imitation learning has created agents which can acquire diverse skills from expert human operators. This paper investigates techniques which allow robots to partially bridge these domain gaps, using their past experience.
  arXiv  Detail & Related papers  (2020-11-11T18:41:07Z)
• Caption Generation of Robot Behaviors based on Unsupervised Learning of Action Segments [10.356412004005767]
  Bridging robot action sequences and their natural language captions is an important task to increase explainability of human assisting robots. In this paper, we propose a system for generating natural language captions that describe behaviors of human assisting robots.
  arXiv  Detail & Related papers  (2020-03-23T03:44:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.