SpeedTuning: Speeding Up Policy Execution with Lightweight Reinforcement Learning

• URL: http://arxiv.org/abs/2608.09138v2
• Date: Tue, 11 Aug 2026 17:14:09 GMT
• Title: SpeedTuning: Speeding Up Policy Execution with Lightweight Reinforcement Learning
• Abstract summary: We introduce SpeedTuning, a reinforcement learning framework specifically designed to enhance the speed of manipulation policies.<n>SpeedTuning learns to predict the optimal execution speed for actions, thereby complementing a base policy.<n>We provide empirical evidence that SpeedTuning achieves substantial improvements in execution speed, exceeding 2.4x speed-up.
• Score: 44.701558695482476
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: While learned robotic policies hold promise for advancing generalizable manipulation, their practical deployment is often hindered by suboptimal execution speeds. Imitation learning policies are inherently limited by hardware constraints and the speed of the operator during data collection. In addition, there are no established methods for accelerating policies learned via imitation, and the empirical relationship between execution speed and task success remains underexplored. To address these issues, we introduce SpeedTuning, a reinforcement learning framework specifically designed to enhance the speed of manipulation policies. SpeedTuning learns to predict the optimal execution speed for actions, thereby complementing a base policy without necessitating additional data collection. We provide empirical evidence that SpeedTuning achieves substantial improvements in execution speed, exceeding 2.4x speed-up, while preserving an adequate success rate compared to both the original task policy and straightforward speed-up methods such as linear interpolation at a fixed speed. We evaluate our approach across a diverse set of dynamic and precise tasks, including pouring, throwing, and picking, demonstrating its effectiveness and robustness in enhancing real-world robotic manipulation. Videos and code are available at https://daivdyuan.github.io/speed-tuning/

Related papers

• TempoVLA: Learning Speed-Controllable Vision-Language-Action Policies [58.40033352838586]
  Existing Vision-Language-Action models (VLAs) only inherit a single fixed speed from training demonstrations.<n>We observe that the magnitude of each predicted action already governs how fast the robot moves.<n>We turn this observation into TempoVLA, a single VLA whose execution speed is controlled by an explicit condition.
  arXiv  Detail & Related papers  (2026-06-04T17:59:40Z)
• FlashSAC: Fast and Stable Off-Policy Reinforcement Learning for High-Dimensional Robot Control [55.38832429564216]
  Reinforcement learning (RL) is a core approach for robot control when expert demonstrations are unavailable.<n>We present FlashSAC, a fast and stable off-policy RL algorithm built on Soft Actor-Critic.<n>Across over 60 tasks in 10 simulators, FlashSAC consistently outperforms PPO and strong off-policy baselines in both final performance and training efficiency.
  arXiv  Detail & Related papers  (2026-04-06T09:03:41Z)
• Can Users Specify Driving Speed? Bench2Drive-Speed: Benchmark and Baselines for Desired-Speed Conditioned Autonomous Driving [50.09883181221131]
  We present Bench2Drive-Speed, a benchmark with metrics, dataset, and baselines for desired-speed conditioned autonomous driving.<n>We introduce explicit inputs of users' desired target-speed and overtake/follow instructions to driving policy models.<n>Our experiments show that, under proper re-annotation, models trained on regular driving data perform comparably to on expert demonstrations.
  arXiv  Detail & Related papers  (2026-03-26T17:26:41Z)
• Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulation [19.765462206627955]
  Speedup Patch (SuP) is a policy-agnostic framework that enables plug-and-play acceleration using solely offline data.<n>SuP achieves an overall 1.8x execution speedup for diverse policies while maintaining their original success rates.
  arXiv  Detail & Related papers  (2026-03-21T05:29:04Z)
• Mean Flow Policy with Instantaneous Velocity Constraint for One-step Action Generation [65.13627721310613]
  Mean velocity policy (MVP) is a new generative policy function that models the mean velocity field to achieve the fastest one-step action generation.<n>MVP achieves state-of-the-art success rates across several challenging robotic manipulation tasks from Robomimic and OGBench.
  arXiv  Detail & Related papers  (2026-02-14T14:44:06Z)
• SpeedAug: Policy Acceleration via Tempo-Enriched Policy and RL Fine-Tuning [52.29534291796025]
  Reinforcement learning is a promising approach that adapts policies for faster execution without additional demonstration.<n>We propose SpeedAug, an RL-based policy acceleration framework that efficiently adapts pre-trained policies for faster task execution.
  arXiv  Detail & Related papers  (2025-11-24T04:25:47Z)
• SAIL: Faster-than-Demonstration Execution of Imitation Learning Policies [20.52085846080824]
  offline Imitation Learning (IL) methods are effective at acquiring complex robotic manipulation skills.<n>Existing IL-trained policies are confined to executing the task at the same speed as shown in demonstration data.<n>We introduce and formalize the novel problem of enabling faster-than-demonstration execution of visuomotor policies.
  arXiv  Detail & Related papers  (2025-06-13T16:58:20Z)
• Learning Speed Adaptation for Flight in Clutter [3.8876619768726157]
  Animals learn to adapt speed of their movements to their capabilities and the environment they observe. Mobile robots should also demonstrate this ability to trade-off aggressiveness and safety for efficiently accomplishing tasks. This work is to endow flight vehicles with the ability of speed adaptation in prior unknown and partially observable cluttered environments.
  arXiv  Detail & Related papers  (2024-03-07T15:30:54Z)
• Faded-Experience Trust Region Policy Optimization for Model-Free Power Allocation in Interference Channel [28.618312473850974]
  Policy reinforcement learning techniques enable an agent to learn an optimal action policy through the interactions with the environment. Inspired by human decision making approach, we work toward enhancing its convergence speed by augmenting the agent to memorize and use the recently learned policies. Results indicate that with FE-TRPO it is possible to almost double the learning speed compared to TRPO.
  arXiv  Detail & Related papers  (2020-08-04T17:12:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.