iRoPro: An interactive Robot Programming Framework
- URL: http://arxiv.org/abs/2112.04289v1
- Date: Wed, 8 Dec 2021 13:53:43 GMT
- Title: iRoPro: An interactive Robot Programming Framework
- Authors: Ying Siu Liang, Damien Pellier, Humbert Fiorino and Sylvie Pesty
- Abstract summary: iRoPro allows users with little to no technical background to teach a robot new reusable actions.
We implement iRoPro as an end-to-end system on a Baxter Research Robot.
- Score: 2.7651063843287718
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The great diversity of end-user tasks ranging from manufacturing environments
to personal homes makes pre-programming robots for general purpose applications
extremely challenging. In fact, teaching robots new actions from scratch that
can be reused for previously unseen tasks remains a difficult challenge and is
generally left up to robotics experts. In this work, we present iRoPro, an
interactive Robot Programming framework that allows end-users with little to no
technical background to teach a robot new reusable actions. We combine
Programming by Demonstration and Automated Planning techniques to allow the
user to construct the robot's knowledge base by teaching new actions by
kinesthetic demonstration. The actions are generalised and reused with a task
planner to solve previously unseen problems defined by the user. We implement
iRoPro as an end-to-end system on a Baxter Research Robot to simultaneously
teach low- and high-level actions by demonstration that the user can customise
via a Graphical User Interface to adapt to their specific use case. To evaluate
the feasibility of our approach, we first conducted pre-design experiments to
better understand the user's adoption of involved concepts and the proposed
robot programming process. We compare results with post-design experiments,
where we conducted a user study to validate the usability of our approach with
real end-users. Overall, we showed that users with different programming levels
and educational backgrounds can easily learn and use iRoPro and its robot
programming process.
Related papers
- RoboScript: Code Generation for Free-Form Manipulation Tasks across Real
and Simulation [77.41969287400977]
This paper presents textbfRobotScript, a platform for a deployable robot manipulation pipeline powered by code generation.
We also present a benchmark for a code generation benchmark for robot manipulation tasks in free-form natural language.
We demonstrate the adaptability of our code generation framework across multiple robot embodiments, including the Franka and UR5 robot arms.
arXiv Detail & Related papers (2024-02-22T15:12:00Z) - What Matters to You? Towards Visual Representation Alignment for Robot
Learning [81.30964736676103]
When operating in service of people, robots need to optimize rewards aligned with end-user preferences.
We propose Representation-Aligned Preference-based Learning (RAPL), a method for solving the visual representation alignment problem.
arXiv Detail & Related papers (2023-10-11T23:04:07Z) - A Personalized Household Assistive Robot that Learns and Creates New
Breakfast Options through Human-Robot Interaction [9.475039534437332]
We present a cognitive architecture for a household assistive robot that can learn personalized breakfast options from its users.
The architecture can also use the learned knowledge to create new breakfast options over a longer period of time.
The architecture is integrated with the Fetch mobile manipulator robot and validated, as a proof-of-concept system evaluation.
arXiv Detail & Related papers (2023-06-30T19:57:15Z) - Learning Video-Conditioned Policies for Unseen Manipulation Tasks [83.2240629060453]
Video-conditioned Policy learning maps human demonstrations of previously unseen tasks to robot manipulation skills.
We learn our policy to generate appropriate actions given current scene observations and a video of the target task.
We validate our approach on a set of challenging multi-task robot manipulation environments and outperform state of the art.
arXiv Detail & Related papers (2023-05-10T16:25:42Z) - Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement
Learning [54.636562516974884]
In imitation and reinforcement learning, the cost of human supervision limits the amount of data that robots can be trained on.
In this work, we propose MEDAL++, a novel design for self-improving robotic systems.
The robot autonomously practices the task by learning to both do and undo the task, simultaneously inferring the reward function from the demonstrations.
arXiv Detail & Related papers (2023-03-02T18:51:38Z) - ChatGPT for Robotics: Design Principles and Model Abilities [25.032064314822243]
We outline a strategy that combines design principles for prompt engineering and the creation of a high-level function library.
We focus our evaluations on the effectiveness of different prompt engineering techniques and dialog strategies towards the execution of various types of robotics tasks.
Our study encompasses a range of tasks within the robotics domain, from basic logical, geometrical, and mathematical reasoning all the way to complex domains such as aerial navigation, manipulation, and embodied agents.
arXiv Detail & Related papers (2023-02-20T06:39:06Z) - Logic programming for deliberative robotic task planning [2.610470075814367]
We present a survey on recent advances in the application of logic programming to the problem of task planning.
We analyze different planners and their suitability for specific robotic applications, based on expressivity in domain representation, computational efficiency and software implementation.
arXiv Detail & Related papers (2023-01-18T14:11:55Z) - Scene Editing as Teleoperation: A Case Study in 6DoF Kit Assembly [18.563562557565483]
We propose the framework "Scene Editing as Teleoperation" (SEaT)
Instead of controlling the robot, users focus on specifying the task's goal.
A user can perform teleoperation without any expert knowledge of the robot hardware.
arXiv Detail & Related papers (2021-10-09T04:22:21Z) - Lifelong Robotic Reinforcement Learning by Retaining Experiences [61.79346922421323]
Many multi-task reinforcement learning efforts assume the robot can collect data from all tasks at all times.
In this work, we study a practical sequential multi-task RL problem motivated by the practical constraints of physical robotic systems.
We derive an approach that effectively leverages the data and policies learned for previous tasks to cumulatively grow the robot's skill-set.
arXiv Detail & Related papers (2021-09-19T18:00:51Z) - Learning and Executing Re-usable Behaviour Trees from Natural Language
Instruction [1.4824891788575418]
Behaviour trees can be used in conjunction with natural language instruction to provide a robust and modular control architecture.
We show how behaviour trees generated using our approach can be generalised to novel scenarios.
We validate this work against an existing corpus of natural language instructions.
arXiv Detail & Related papers (2021-06-03T07:47:06Z) - Show Me What You Can Do: Capability Calibration on Reachable Workspace
for Human-Robot Collaboration [83.4081612443128]
We show that a short calibration using REMP can effectively bridge the gap between what a non-expert user thinks a robot can reach and the ground-truth.
We show that this calibration procedure not only results in better user perception, but also promotes more efficient human-robot collaborations.
arXiv Detail & Related papers (2021-03-06T09:14:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.