cuRoboV2: Dynamics-Aware Motion Generation with Depth-Fused Distance Fields for High-DoF Robots

• URL: http://arxiv.org/abs/2603.05493v1
• Date: Thu, 05 Mar 2026 18:58:04 GMT
• Title: cuRoboV2: Dynamics-Aware Motion Generation with Depth-Fused Distance Fields for High-DoF Robots
• Abstract summary: cuRoboV2 is a motion generation stack that scales from single-arm manipulators to full humanoids.<n>We present three key innovations: (1) B-spline trajectory optimization that enforces smoothness and torque limits; (2) a GPU-native TS/ESDF perception pipeline that generates dense signed distance fields covering the full workspace; and (3) differentiable inverse dynamics map-reduce self-native that achieves up to 61x speedup while also extending to high-DoF humanoids.
• Score: 12.825461775215366
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Effective robot autonomy requires motion generation that is safe, feasible, and reactive. Current methods are fragmented: fast planners output physically unexecutable trajectories, reactive controllers struggle with high-fidelity perception, and existing solvers fail on high-DoF systems. We present cuRoboV2, a unified framework with three key innovations: (1) B-spline trajectory optimization that enforces smoothness and torque limits; (2) a GPU-native TSDF/ESDF perception pipeline that generates dense signed distance fields covering the full workspace, unlike existing methods that only provide distances within sparsely allocated blocks, up to 10x faster and in 8x less memory than the state-of-the-art at manipulation scale, with up to 99% collision recall; and (3) scalable GPU-native whole-body computation, namely topology-aware kinematics, differentiable inverse dynamics, and map-reduce self-collision, that achieves up to 61x speedup while also extending to high-DoF humanoids (where previous GPU implementations fail). On benchmarks, cuRoboV2 achieves 99.7% success under 3kg payload (where baselines achieve only 72--77%), 99.6% collision-free IK on a 48-DoF humanoid (where prior methods fail entirely), and 89.5% retargeting constraint satisfaction (vs. 61% for PyRoki); these collision-free motions yield locomotion policies with 21% lower tracking error than PyRoki and 12x lower cross-seed variance than mink. A ground-up codebase redesign for discoverability enabled LLM coding assistants to author up to 73% of new modules, including hand-optimized CUDA kernels, demonstrating that well-structured robotics code can unlock productive human--LLM collaboration. Together, these advances provide a unified, dynamics-aware motion generation stack that scales from single-arm manipulators to full humanoids.

Related papers

• Non-Prehensile Throwing: A Reinforcement Learning Perspective [4.519185019401122]
  Non-prehensile (grasp-free) throwing is better suited for large, heavy, and/or deformable objects.<n>Existing approaches rely on model-based optimization with simplified contact models.<n>We propose a reinforcement learning approach that directly optimize joint-space trajectories.<n>Our method throws diverse objects including heavy (790 g) and large (20x20x28 cm) items to targets up to 350 cm distance or 180 cm elevation, achieving a 97% real-world success rate.
  arXiv  Detail & Related papers  (2026-09-01T06:00:33Z)
• GigaBrain-WBC-0.5: A Behavior World Model for Robust Whole-Body Control with Environment Interaction [68.67772166423812]
  We present GigaBrain-WBC-0.5, the first Behavior World Model (BWM) for humanoid whole-body control.<n>Rather than a purely reactive tracker, we train a causal Transformer to jointly predict its next action, next state, and the distribution over its next latent behavior command.<n>An automatic terrain-annotation pipeline recovers full 3D contact geometry from retargeted motion, enabling terrain annotation at the scale of existing motion datasets.
  arXiv  Detail & Related papers  (2026-08-18T18:21:36Z)
• SoRoMoX: Fast, Differentiable, and Parallelizable Soft Robot Models [40.64972837908431]
  SoRoMoX implements articulated, Piecewise Constant Strain, and Variable Strain models through a unified, control-ready interface.<n> Sequential CPU rollouts are up to 18.1x faster than state-of-the-art alternatives, while GPU-parallel rollouts increase throughput by up to 234.6x.
  arXiv  Detail & Related papers  (2026-08-06T23:31:47Z)
• PAKE: Learning Whole-Body Loco-Manipulation with Partial Kinematic Embeddings [9.606500800831322]
  We propose a novel whole-body control framework for high-precision loco-manipulation.<n>We introduce a new Kinematic Normalizing Flow model, trained on a large-scale kinematic dataset.<n>We validate our approach on the quadrupedal robot equipped with a six-DoF robotic arm.
  arXiv  Detail & Related papers  (2026-07-13T03:12:09Z)
• LocalNav: Distilling Frontier VLMs and Embodied RL for On-Device Object Goal Navigation [53.88286427894783]
  Vision Language Models (VLMs) have emerged in the robotic domain as a powerful tool that enables environmental perception with language context.<n>Yet, their computational footprint typically confines them to cloud execution, hindering low-latency inference with local deployment on resource-constrained robots.<n>We present a distillation strategy that transfers complex spatial-semantic reasoning from large frontier models into a lightweight, 4B- parameter local VLM for edge execution on embedded GPU devices.
  arXiv  Detail & Related papers  (2026-06-26T09:11:59Z)
• EmbodiSteer: Steering Embodiment-Agnostic Visuomotor Policies with Joint-Space Guidance for Zero-Shot Cross-Embodiment Deployment [7.14164117393883]
  EmbodiSteer is a training-free framework that steers embodiment-agnostic visuomotor policies toward zero-shot, embodiment-aware deployment.<n>It reduces collision rate by 46.1% and improves task success rate by 28.5% across 9 simulated robots.
  arXiv  Detail & Related papers  (2026-06-11T06:49:39Z)
• ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation [55.467742403416175]
  We introduce a physics-driven neural algorithm that translates large-scale motion capture to humanoid embodiments.<n>We learn a unified multimodal controller that supports both dense references and sparse task specifications.<n>Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception.
  arXiv  Detail & Related papers  (2026-03-03T18:59:29Z)
• RoboTracer: Mastering Spatial Trace with Reasoning in Vision-Language Models for Robotics [53.053660003572965]
  We propose RoboTracer, a 3D-aware VLM that first achieves both 3D spatial referring and measuring.<n>RoboTracer advances multi-step metric-grounded reasoning via reinforcement fine-tuning.<n>We present TraceSpatial-Bench, a challenging benchmark to evaluate spatial tracing.
  arXiv  Detail & Related papers  (2025-12-15T18:52:43Z)
• HABIT: Human Action Benchmark for Interactive Traffic in CARLA [0.2905751301655124]
  We introduce HABIT (Human Action Benchmark for Interactive Traffic), a high-fidelity simulation benchmark.<n>From an initial pool of approximately 30,000 retargeted motions, we curate 4,730 traffic-compatible pedestrian motions.<n>Our safety metrics, including Abbreviated Injury Scale (AIS) and False Positive Braking Rate (FPBR), reveal critical failure modes in state-of-the-art AD agents missed by prior evaluations.
  arXiv  Detail & Related papers  (2025-11-24T13:43:39Z)
• Discrete-Guided Diffusion for Scalable and Safe Multi-Robot Motion Planning [56.240199425429445]
  Multi-Robot Motion Planning (MPMP) involves generating trajectories for multiple robots operating in a shared continuous workspace.<n>While discrete multi-agent finding (MAPF) methods are broadly adopted due to their scalability, their coarse discretization trajectory quality.<n>This paper tackles limitations of two approaches by introducing discrete MAPF solvers with constrained generative diffusion models.
  arXiv  Detail & Related papers  (2025-08-27T17:59:36Z)
• RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics [67.11221574129937]
  Spatial referring is a fundamental capability of embodied robots to interact with the 3D physical world.<n>We propose RoboRefer, a 3D-aware VLM that can first achieve precise spatial understanding.<n>RoboRefer advances generalized multi-step spatial reasoning via reinforcement fine-tuning.
  arXiv  Detail & Related papers  (2025-06-04T17:59:27Z)
• RobotDiffuse: Motion Planning for Redundant Manipulator based on Diffusion Model [13.110235244912474]
  Redundant manipulators offer enhanced kinematic performance and versatility.<n>Motion planning for these manipulators is challenging due to increased DOFs and complex, dynamic environments.<n>This paper introduces RobotDiffuse, a diffusion model-based approach for motion planning in redundant manipulators.
  arXiv  Detail & Related papers  (2024-12-27T07:34:54Z)
• ARMOR: Egocentric Perception for Humanoid Robot Collision Avoidance and Motion Planning [10.207814069339735]
  ARMOR is a novel egocentric perception system for humanoid robots.<n>Our distributed perception approach enhances the robot's spatial awareness.<n>We show that our ARMOR perception is superior against a setup with multiple dense head-mounted, and externally mounted depth cameras.
  arXiv  Detail & Related papers  (2024-11-30T08:39:23Z)
• Neuromorphic control for optic-flow-based landings of MAVs using the Loihi processor [3.3861246056563616]
  We present for the very first time a fully embedded application of the Loihi neuromorphic chip prototype in a flying robot. A spiking neural network (SNN) was evolved to compute the thrust command based on the divergence of the ventral optic flow field to perform autonomous landing. Analysis reveals a root-mean-square error of the thrust setpoint as low as 0.005 g, along with a 99.8% matching of the spike sequences in the hidden layer, and 99.7% in the output layer.
  arXiv  Detail & Related papers  (2020-11-01T15:25:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.