Reinforcement Learning-based Virtual Fixtures for Teleoperation of Hydraulic Construction Machine

• URL: http://arxiv.org/abs/2306.11897v2
• Date: Fri, 23 Jun 2023 10:02:43 GMT
• Title: Reinforcement Learning-based Virtual Fixtures for Teleoperation of Hydraulic Construction Machine
• Abstract summary: This study proposes a reinforcement learning-based approach to optimize task performance. The control policy acquired through learning is used to provide instructions on efficiently controlling and coordinating multiple joints. The effectiveness of the proposed framework is evaluated by comparing the performance of participants in the presence and absence of virtual fixtures.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The utilization of teleoperation is a crucial aspect of the construction industry, as it enables operators to control machines safely from a distance. However, remote operation of these machines at a joint level using individual joysticks necessitates extensive training for operators to achieve proficiency due to their multiple degrees of freedom. Additionally, verifying the machine resulting motion is only possible after execution, making optimal control challenging. In addressing this issue, this study proposes a reinforcement learning-based approach to optimize task performance. The control policy acquired through learning is used to provide instructions on efficiently controlling and coordinating multiple joints. To evaluate the effectiveness of the proposed framework, a user study is conducted with a Brokk 170 construction machine by assessing its performance in a typical construction task involving inserting a chisel into a borehole. The effectiveness of the proposed framework is evaluated by comparing the performance of participants in the presence and absence of virtual fixtures. This study results demonstrate the proposed framework potential in enhancing the teleoperation process in the construction industry.

Related papers

• Beyond Flat Policies: Hierarchical Post-Training for Embodied Agents in Robotic Manipulation [34.87301719899886]
  Vision-language-action (VLA) models have demonstrated remarkable capabilities in robotic manipulation by leveraging pretrained vision-language models.<n>Existing post-training methods predominantly optimize VLA models as flat policies, making it difficult to explicitly model task progression and perform robust long-horizon manipulation.<n>We propose Hierarchical Robotic Control (HiRoC), a hierarchical post-training framework that decouples high-level task planning from low-level action execution.
  arXiv  Detail & Related papers  (2026-08-06T13:07:56Z)
• EASy: Towards Efficient LLM-Based Agentic System [54.10819421625103]
  We propose EASy, a trainable agentic framework that jointly optimize task performance and computational efficiency through reinforcement learning.<n> EASy equips an LLM-based orchestrator with explicit knowledge of the capability and cost profiles of heterogeneous executors, enabling context-sensitive coordination beyond performance-only routing.<n>It further introduces a milestone-plan-act workflow that decomposes complex tasks into manageable milestones, constructs dependency-aware execution graphs, assigns suitable executors, and parallelizes independent steps while adapting subsequent decisions to intermediate outcomes.
  arXiv  Detail & Related papers  (2026-08-05T08:50:36Z)
• WARL: Wrench-Augmented Reinforcement Learning for Task-Agnostic Learning in Legged Robots [13.919694566467053]
  Wrench-Augmented Reinforcement Learning (WARL) introduces a wrenche (force and torque) into the action space.<n>Experiments using a quadruped robot demonstrated that WARL can learn robustly across diverse terrains.<n>We show that introducing a wrench can encourage behaviors that do not sufficiently exploit the robot's physical embodiment.
  arXiv  Detail & Related papers  (2026-07-27T06:17:42Z)
• KUKAloha: A General, Low-Cost, and Shared-Control based Teleoperation Framework for Construction Robot Arm [3.966748430445195]
  KUKAloha is a general, low-cost, and shared-control teleoperation framework for construction robot arms.<n>We implement the framework on a KUKA robot arm and conduct a usability study with representative construction manipulation tasks.
  arXiv  Detail & Related papers  (2026-03-20T16:51:30Z)
• Teaching Robots to Handle Nuclear Waste: A Teleoperation-Based Learning Approach< [8.587182001055448]
  The proposed framework addresses challenges in nuclear waste handling tasks, which often involve repetitive and meticulous manipulation operations. By capturing operator movements and manipulation forces during teleoperation, the framework utilizes this data to train machine learning models capable of replicating and generalizing human skills.
  arXiv  Detail & Related papers  (2025-04-02T06:46:29Z)
• Rethinking Bimanual Robotic Manipulation: Learning with Decoupled Interaction Framework [51.39847596489193]
  Bimanual robotic manipulation is an emerging and critical topic in the robotics community.<n>We propose a novel decoupled interaction framework that considers the characteristics of different tasks in bimanual manipulation.<n>Our framework achieves outstanding performance, with a 23.5% boost over the SOTA method.
  arXiv  Detail & Related papers  (2025-03-12T09:28:41Z)
• Multi-Task Reinforcement Learning for Quadrotors [18.71563817810032]
  This paper presents a novel multi-task reinforcement learning (MTRL) framework tailored for quadrotor control. By employing a multi-critic architecture and shared task encoders, our framework facilitates knowledge transfer across tasks, enabling a single policy to execute diverse maneuvers.
  arXiv  Detail & Related papers  (2024-12-17T01:10:18Z)
• TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition [61.91764883512776]
  We introduce an innovative PEFT method, TeamLoRA, consisting of a collaboration and competition module for experts. By doing so, TeamLoRA connects the experts as a "Team" with internal collaboration and competition, enabling a faster and more accurate PEFT paradigm for multi-task learning.
  arXiv  Detail & Related papers  (2024-08-19T09:58:53Z)
• Hierarchical Deep Learning for Intention Estimation of Teleoperation Manipulation in Assembly Tasks [2.4913500484755087]
  In human-robot collaboration, shared control presents an opportunity to teleoperate robotic manipulation to improve the efficiency of manufacturing and assembly processes. To this end, robust and prompt intention estimation is needed, relying on behavioral observations. The framework presents an intention estimation technique at hierarchical levels i.e., low-level actions and high-level tasks, by incorporating multi-scale hierarchical information in neural networks. An analysis of the predictive power with various inputs demonstrates the predominance of the deep hierarchical model in the sense of prediction accuracy and early intention identification.
  arXiv  Detail & Related papers  (2024-03-28T18:45:43Z)
• A Reinforcement Learning Approach for Robotic Unloading from Visual Observations [1.420663986837751]
  In this work, we focus on a robotic unloading problem from visual observations. We propose a hierarchical controller structure that combines a high-level decision-making module with classical motion control. Our experiments demonstrate that both these elements play a crucial role in achieving improved learning performance.
  arXiv  Detail & Related papers  (2023-09-12T22:22:28Z)
• Exploiting Symmetry and Heuristic Demonstrations in Off-policy Reinforcement Learning for Robotic Manipulation [1.7901837062462316]
  This paper aims to define and incorporate the natural symmetry present in physical robotic environments. The proposed method is validated via two point-to-point reaching tasks of an industrial arm, with and without an obstacle. A comparison study between the proposed method and a traditional off-policy reinforcement learning algorithm indicates its advantage in learning performance and potential value for applications.
  arXiv  Detail & Related papers  (2023-04-12T11:38:01Z)
• Dexterous Manipulation from Images: Autonomous Real-World RL via Substep Guidance [71.36749876465618]
  We describe a system for vision-based dexterous manipulation that provides a "programming-free" approach for users to define new tasks. Our system includes a framework for users to define a final task and intermediate sub-tasks with image examples. experimental results with a four-finger robotic hand learning multi-stage object manipulation tasks directly in the real world.
  arXiv  Detail & Related papers  (2022-12-19T22:50:40Z)
• Understanding Physical Effects for Effective Tool-use [91.55810923916454]
  We present a robot learning and planning framework that produces an effective tool-use strategy with the least joint efforts. We use a Finite Element Method (FEM)-based simulator that reproduces fine-grained, continuous visual and physical effects given observed tool-use events. In simulation, we demonstrate that the proposed framework can produce more effective tool-use strategies, drastically different from the observed ones in two tasks.
  arXiv  Detail & Related papers  (2022-06-30T03:13:38Z)
• Benchopt: Reproducible, efficient and collaborative optimization benchmarks [67.29240500171532]
  Benchopt is a framework to automate, reproduce and publish optimization benchmarks in machine learning. Benchopt simplifies benchmarking for the community by providing an off-the-shelf tool for running, sharing and extending experiments.
  arXiv  Detail & Related papers  (2022-06-27T16:19:24Z)
• Scenario-Assisted Deep Reinforcement Learning [3.5036351567024275]
  We propose a technique for enhancing the reinforcement learning training process. It allows human engineers to directly contribute their expert knowledge, making the agent under training more likely to comply with relevant constraints. We evaluate our technique using a case-study from the domain of internet congestion control.
  arXiv  Detail & Related papers  (2022-02-09T08:46:13Z)
• Consolidating Kinematic Models to Promote Coordinated Mobile Manipulations [96.03270112422514]
  We construct a Virtual Kinematic Chain (VKC) that consolidates the kinematics of the mobile base, the arm, and the object to be manipulated in mobile manipulations. A mobile manipulation task is represented by altering the state of the constructed VKC, which can be converted to a motion planning problem.
  arXiv  Detail & Related papers  (2021-08-03T02:59:41Z)
• Constrained-Space Optimization and Reinforcement Learning for Complex Tasks [42.648636742651185]
  Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. This paper presents a constrained-space optimization and reinforcement learning scheme for managing complex tasks.
  arXiv  Detail & Related papers  (2020-04-01T21:50:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.