TriFinger: An Open-Source Robot for Learning Dexterity
- URL: http://arxiv.org/abs/2008.03596v2
- Date: Thu, 21 Jan 2021 20:00:13 GMT
- Title: TriFinger: An Open-Source Robot for Learning Dexterity
- Abstract summary: We propose an open-source robotic platform which can safely operate without human supervision.
The hardware is inexpensive yet highly dynamic, robust, and capable of complex interaction with external objects.
We illustrate the potential of the proposed platform through a number of experiments, including real-time optimal control, deep reinforcement learning from scratch, throwing, and writing.
- Score: 33.26612195196921
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Dexterous object manipulation remains an open problem in robotics, despite
the rapid progress in machine learning during the past decade. We argue that a
hindrance is the high cost of experimentation on real systems, in terms of both
time and money. We address this problem by proposing an open-source robotic
platform which can safely operate without human supervision. The hardware is
inexpensive (about \SI{5000}[\$]{}) yet highly dynamic, robust, and capable of
complex interaction with external objects. The software operates at 1-kilohertz
and performs safety checks to prevent the hardware from breaking. The
easy-to-use front-end (in C++ and Python) is suitable for real-time control as
well as deep reinforcement learning. In addition, the software framework is
largely robot-agnostic and can hence be used independently of the hardware
proposed herein. Finally, we illustrate the potential of the proposed platform
through a number of experiments, including real-time optimal control, deep
reinforcement learning from scratch, throwing, and writing.
Related papers
- LeRobot: An Open-Source Library for End-to-End Robot Learning [36.567938139028186]
textttlerobot is an open-source library that integrates across the entire robot learning stack.<n>It supports efficient implementations for various state-of-the-art robot learning algorithms as well as a generalized asynchronous inference stack.
arXiv Detail & Related papers (2026-02-26T09:59:50Z) - Imitating What Works: Simulation-Filtered Modular Policy Learning from Human Videos [56.510263910611684]
We tackle prehensile manipulation, in which tasks involve grasping an object before performing various post-grasp motions.<n>Human videos offer strong signals for learning the post-grasp motions, but they are less useful for learning the prerequisite grasping behaviors.<n>We present Perceive-Simulate-Imitate (PSI), a framework for training a modular manipulation policy using human video motion data.
arXiv Detail & Related papers (2026-02-13T18:59:10Z) - Dexterity from Smart Lenses: Multi-Fingered Robot Manipulation with In-the-Wild Human Demonstrations [52.29884993824894]
Learning multi-fingered robot policies from humans performing daily tasks in natural environments has long been a grand goal in the robotics community.<n>AINA enables learning multi-fingered policies from data collected by anyone, anywhere, and in any environment using Aria Gen 2 glasses.
arXiv Detail & Related papers (2025-11-20T18:59:02Z) - When a Robot is More Capable than a Human: Learning from Constrained Demonstrators [4.015444385806047]
Learning from demonstrations enables experts to teach robots complex tasks using interfaces such as kinesthetic teaching, joystick control, and sim-to-real transfer.<n>These interfaces often constrain the expert's ability to demonstrate optimal behavior due to indirect control, setup restrictions, and hardware safety.<n>This raises a key question: Can a robot learn a better policy than the one demonstrated by a constrained expert?<n>We address this by allowing the agent to go beyond direct imitation of expert actions and explore shorter and more efficient trajectories.
arXiv Detail & Related papers (2025-10-10T07:48:12Z) - Enabling Generic Robot Skill Implementation Using Object Oriented Programming [0.0]
We propose a software framework that reduces the effort required to deploy a working robotic system.<n>The focus is solely on providing a concept for simplifying the different interfaces of a modern robot system.<n>The target system is a bin-picking cell containing a Yaskawa Motoman GP4.
arXiv Detail & Related papers (2025-08-14T09:53:41Z) - Ark: An Open-source Python-based Framework for Robot Learning [20.131425969692256]
ARK is an open-source, Python-first robotics framework designed to close that gap.<n>ARK presents a Gym-style environment interface that allows users to collect data, preprocess it, and train policies.<n>ARK ships with reusable modules for control, SLAM, motion planning, system identification, and visualization.
arXiv Detail & Related papers (2025-06-24T20:23:39Z) - AhaRobot: A Low-Cost Open-Source Bimanual Mobile Manipulator for Embodied AI [43.451192919213455]
AhaRobot is a low-cost and fully open-source dual-arm mobile manipulation robot system.
We use handles to control the dual arms and pedals for whole-body movement.
RoboPilot is designed for remote data collection in embodied scenarios.
arXiv Detail & Related papers (2025-03-13T05:34:43Z) - Controlling diverse robots by inferring Jacobian fields with deep networks [48.279199537720714]
Mirroring the complex structures and diverse functions of natural organisms is a long-standing challenge in robotics.<n>We introduce a method that uses deep neural networks to map a video stream of a robot to its visuomotor Jacobian field.<n>Our approach achieves accurate closed-loop control and recovers the causal dynamic structure of each robot.
arXiv Detail & Related papers (2024-07-11T17:55:49Z) - Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Models [81.55156507635286]
Legged robots are physically capable of navigating a diverse variety of environments and overcoming a wide range of obstructions.
Current learning methods often struggle with generalization to the long tail of unexpected situations without heavy human supervision.
We propose a system, VLM-Predictive Control (VLM-PC), combining two key components that we find to be crucial for eliciting on-the-fly, adaptive behavior selection.
arXiv Detail & Related papers (2024-07-02T21:00:30Z) - Safe Reinforcement Learning on the Constraint Manifold: Theory and Applications [21.98309272057848]
We show how we can impose complex safety constraints on learning-based robotics systems in a principled manner.
Our approach is based on the concept of the Constraint Manifold, representing the set of safe robot configurations.
We demonstrate the method's effectiveness in a real-world Robot Air Hockey task.
arXiv Detail & Related papers (2024-04-13T20:55:15Z) - Learning Visual Tracking and Reaching with Deep Reinforcement Learning
on a UR10e Robotic Arm [2.2168889407389445]
Reinforcement learning algorithms provide the potential to enable robots to learn optimal solutions to complete new tasks without reprogramming them.
Current state-of-the-art in reinforcement learning relies on fast simulations and parallelization to achieve optimal performance.
This report outlines our initial research into the application of deep reinforcement learning on an industrial UR10e robot.
arXiv Detail & Related papers (2023-08-28T15:34:43Z) - RoboPianist: Dexterous Piano Playing with Deep Reinforcement Learning [61.10744686260994]
We introduce RoboPianist, a system that enables simulated anthropomorphic hands to learn an extensive repertoire of 150 piano pieces.
We additionally introduce an open-sourced environment, benchmark of tasks, interpretable evaluation metrics, and open challenges for future study.
arXiv Detail & Related papers (2023-04-09T03:53:05Z) - Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement
Learning [54.636562516974884]
In imitation and reinforcement learning, the cost of human supervision limits the amount of data that robots can be trained on.
In this work, we propose MEDAL++, a novel design for self-improving robotic systems.
The robot autonomously practices the task by learning to both do and undo the task, simultaneously inferring the reward function from the demonstrations.
arXiv Detail & Related papers (2023-03-02T18:51:38Z) - ROS-PyBullet Interface: A Framework for Reliable Contact Simulation and
Human-Robot Interaction [17.093672006793984]
We present the ROS-PyBullet Interface, a framework that provides a bridge between the reliable contact/impact simulator PyBullet and the Robot Operating System (ROS)
Furthermore, we provide additional utilities for facilitating Human-Robot Interaction (HRI) in the simulated environment.
arXiv Detail & Related papers (2022-10-13T10:31:36Z) - Model Predictive Control for Fluid Human-to-Robot Handovers [50.72520769938633]
Planning motions that take human comfort into account is not a part of the human-robot handover process.
We propose to generate smooth motions via an efficient model-predictive control framework.
We conduct human-to-robot handover experiments on a diverse set of objects with several users.
arXiv Detail & Related papers (2022-03-31T23:08:20Z) - Dual-Arm Adversarial Robot Learning [0.6091702876917281]
We propose dual-arm settings as platforms for robot learning.
We will discuss the potential benefits of this setup as well as the challenges and research directions that can be pursued.
arXiv Detail & Related papers (2021-10-15T12:51:57Z) - The Ingredients of Real-World Robotic Reinforcement Learning [71.92831985295163]
We discuss the elements that are needed for a robotic learning system that can continually and autonomously improve with data collected in the real world.
We propose a particular instantiation of such a system, using dexterous manipulation as our case study.
We demonstrate that our complete system can learn without any human intervention, acquiring a variety of vision-based skills with a real-world three-fingered hand.
arXiv Detail & Related papers (2020-04-27T03:36:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.