Fast Visuomotor Policy for Robotic Manipulation

• URL: http://arxiv.org/abs/2510.12483v1
• Date: Tue, 14 Oct 2025 13:18:45 GMT
• Title: Fast Visuomotor Policy for Robotic Manipulation
• Abstract summary: Energy Policy is designed for high-frequency robotic tasks and resource-constrained systems.<n>It predicts multimodal actions in a single forward pass, enabling high-precision manipulation at high speed.<n>Results show Energy Policy matches or surpasses the performance of state-of-the-art manipulation methods.
• Score: 31.26284715644132
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: We present a fast and effective policy framework for robotic manipulation, named Energy Policy, designed for high-frequency robotic tasks and resource-constrained systems. Unlike existing robotic policies, Energy Policy natively predicts multimodal actions in a single forward pass, enabling high-precision manipulation at high speed. The framework is built upon two core components. First, we adopt the energy score as the learning objective to facilitate multimodal action modeling. Second, we introduce an energy MLP to implement the proposed objective while keeping the architecture simple and efficient. We conduct comprehensive experiments in both simulated environments and real-world robotic tasks to evaluate the effectiveness of Energy Policy. The results show that Energy Policy matches or surpasses the performance of state-of-the-art manipulation methods while significantly reducing computational overhead. Notably, on the MimicGen benchmark, Energy Policy achieves superior performance with at a faster inference compared to existing approaches.

Related papers

• Managing Task Execution for Unknown Workloads in Batteryless IoT: A Hardware-Agnostic Evaluation [2.435798495038311]
  Internet of Things (IoT) paradigm has been shifting toward batteryless, energy-harvesting architectures.<n>Traditional energy-aware schedulers struggle with unpredictable workloads due to their reliance on static execution thresholds.<n>We propose two novel, hardware-agnostic dynamic scheduling strategies treating applications as a "black box"
  arXiv  Detail & Related papers  (2026-06-23T09:27:59Z)
• PCHC: Enabling Preference Conditioned Humanoid Control via Multi-Objective Reinforcement Learning [50.63196995993855]
  We propose a novel framework leveraging Multi-Objective Reinforcement Learning (MORL) to achieve Preference-Conditioned Humanoid Control (PCHC)<n>Our framework enables a single, preference-conditioned policy to exhibit a wide spectrum of diverse behaviors.
  arXiv  Detail & Related papers  (2026-03-25T07:55:37Z)
• EnergyAction: Unimanual to Bimanual Composition with Energy-Based Models [73.21721376238233]
  EnergyAction is a novel framework that compositionally transfers unimanual manipulation policies to bimanual tasks.<n>First, we model individual unimanual policies as EBMs and leverage their compositional properties to compose left and right arm actions.<n>Second, we introduce an energy-based temporal-spatial coordination mechanism through energy constraints.<n>Third, we propose two different energy-aware denoising strategies that dynamically adapt denoising steps based on action quality assessment.
  arXiv  Detail & Related papers  (2026-03-09T04:50:17Z)
• Energy-Aware Reinforcement Learning for Robotic Manipulation of Articulated Components in Infrastructure Operation and Maintenance [4.019133420452149]
  This paper proposes an articulation-agnostic and energy-aware reinforcement learning framework for robotic manipulation in intelligent infrastructure O&M.<n>The method combines part-guided 3D perception, weighted point sampling, and PointNet-based encoding to obtain a compact geometric representation.<n>Experiments on representative O&M tasks demonstrate 16%-30% reductions in energy consumption, 16%-32% fewer steps to success, and consistently high success rates.
  arXiv  Detail & Related papers  (2026-01-25T18:19:16Z)
• Energy-Efficient Omnidirectional Locomotion for Wheeled Quadrupeds via Predictive Energy-Aware Nominal Gait Selection [17.713242307107166]
  We present a hierarchical control framework that integrates predictive power modeling with residual reinforcement learning to optimize omnidirectional efficiency for wheeled quadrupedal robots.<n>Our approach employs a novel power prediction network that forecasts energy consumption across different gait patterns over a 1-second horizon.<n>A reinforcement learning policy then generates residual adjustments to this nominal gait, fine-tuning the robot's actions to balance energy efficiency with performance objectives.
  arXiv  Detail & Related papers  (2025-12-23T09:56:35Z)
• Compose Your Policies! Improving Diffusion-based or Flow-based Robot Policies via Test-time Distribution-level Composition [52.232968183793986]
  General Policy Composition (GPC) is a training-free method that enhances performance by combining the distributional scores of multiple pre-trained policies.<n>GPC consistently improves performance and adaptability across a diverse set of tasks.
  arXiv  Detail & Related papers  (2025-10-01T16:05:53Z)
• Joint Resource Management for Energy-efficient UAV-assisted SWIPT-MEC: A Deep Reinforcement Learning Approach [50.52139512096988]
  6G Internet of Things (IoT) networks face challenges in remote areas and disaster scenarios where ground infrastructure is unavailable.<n>This paper proposes a novel aerial unmanned vehicle (UAV)-assisted computing (MEC) system enhanced by directional antennas to provide both computational and energy support for ground edge terminals.
  arXiv  Detail & Related papers  (2025-05-06T06:46:19Z)
• Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Robotics [50.191655141020505]
  This work advances model-based reinforcement learning by addressing the challenges of long-horizon prediction, error accumulation, and sim-to-real transfer.<n>By providing a scalable and robust framework, the introduced methods pave the way for adaptive and efficient robotic systems in real-world applications.
  arXiv  Detail & Related papers  (2025-01-17T10:39:09Z)
• Riemannian Flow Matching Policy for Robot Motion Learning [5.724027955589408]
  We introduce a novel model for learning and synthesizing robot visuomotor policies. We show that RFMP provides smoother action trajectories with significantly lower inference times.
  arXiv  Detail & Related papers  (2024-03-15T20:48:41Z)
• Reparameterized Policy Learning for Multimodal Trajectory Optimization [61.13228961771765]
  We investigate the challenge of parametrizing policies for reinforcement learning in high-dimensional continuous action spaces. We propose a principled framework that models the continuous RL policy as a generative model of optimal trajectories. We present a practical model-based RL method, which leverages the multimodal policy parameterization and learned world model.
  arXiv  Detail & Related papers  (2023-07-20T09:05:46Z)
• Learning Robotic Manipulation Skills Using an Adaptive Force-Impedance Action Space [7.116986445066885]
  Reinforcement Learning has led to promising results on a range of challenging decision-making tasks. Fast human-like adaptive control methods can optimize complex robotic interactions, yet fail to integrate multimodal feedback needed for unstructured tasks. We propose to factor the learning problem in a hierarchical learning and adaption architecture to get the best of both worlds.
  arXiv  Detail & Related papers  (2021-10-19T12:09:02Z)
• Enforcing Policy Feasibility Constraints through Differentiable Projection for Energy Optimization [57.88118988775461]
  We propose PROjected Feasibility (PROF) to enforce convex operational constraints within neural policies. We demonstrate PROF on two applications: energy-efficient building operation and inverter control.
  arXiv  Detail & Related papers  (2021-05-19T01:58:10Z)
• Conv1D Energy-Aware Path Planner for Mobile Robots in Unstructured Environments [9.230959086746736]
  Energy consumption plays a major role in the navigation of mobile robots in challenging environments. This paper reports on first results of an energy-aware path planner, which can provide estimates of the driving energy consumption and energy recovery of a robot traversing complex uneven terrains. A novel feature of the method is the use of 1D convolutional neural network to analyse the terrain sequentially in the same temporal order as it would be experienced by the robot when moving.
  arXiv  Detail & Related papers  (2021-04-04T08:13:54Z)
• Risk-Aware Energy Scheduling for Edge Computing with Microgrid: A Multi-Agent Deep Reinforcement Learning Approach [82.6692222294594]
  We study a risk-aware energy scheduling problem for a microgrid-powered MEC network. We derive the solution by applying a multi-agent deep reinforcement learning (MADRL)-based advantage actor-critic (A3C) algorithm with shared neural networks.
  arXiv  Detail & Related papers  (2020-02-21T02:14:38Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.