Fast and Safe Trajectory Optimization for Mobile Manipulators With Neural Configuration Space Distance Field
- URL: http://arxiv.org/abs/2601.18548v2
- Date: Tue, 27 Jan 2026 06:36:00 GMT
- Title: Fast and Safe Trajectory Optimization for Mobile Manipulators With Neural Configuration Space Distance Field
- Abstract summary: Generalized Space Fields (GCDF) can be used to extend base-arm coupling to mobile manipulators.<n>GCDF encodes whole-body configuration in configuration in unbounded space.<n>We develop a high-performance optimization solver centered on GCDF-based reasoning.
- Score: 34.07401865897874
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Mobile manipulators promise agile, long-horizon behavior by coordinating base and arm motion, yet whole-body trajectory optimization in cluttered, confined spaces remains difficult due to high-dimensional nonconvexity and the need for fast, accurate collision reasoning. Configuration Space Distance Fields (CDF) enable fixed-base manipulators to model collisions directly in configuration space via smooth, implicit distances. This representation holds strong potential to bypass the nonlinear configuration-to-workspace mapping while preserving accurate whole-body geometry and providing optimization-friendly collision costs. Yet, extending this capability to mobile manipulators is hindered by unbounded workspaces and tighter base-arm coupling. We lift this promise to mobile manipulation with Generalized Configuration Space Distance Fields (GCDF), extending CDF to robots with both translational and rotational joints in unbounded workspaces with tighter base-arm coupling. We prove that GCDF preserves Euclidean-like local distance structure and accurately encodes whole-body geometry in configuration space, and develop a data generation and training pipeline that yields continuous neural GCDFs with accurate values and gradients, supporting efficient GPU-batched queries. Building on this representation, we develop a high-performance sequential convex optimization framework centered on GCDF-based collision reasoning. The solver scales to large numbers of implicit constraints through (i) online specification of neural constraints, (ii) sparsity-aware active-set detection with parallel batched evaluation across thousands of constraints, and (iii) incremental constraint management for rapid replanning under scene changes.
Related papers
- Real-time Whole-Body Motion Planning for Mobile Manipulators Carrying Arbitrarily Shaped Payloads via Kinematically-Coupled SVSDF [15.284805246845197]
This letter presents a real-time whole-body motion framework for mobile manipulators carrying payloads arbitrarily shaped.<n>The proposed framework reliably transports large, non-drive payloads through tight passages and cluttered environments.
arXiv Detail & Related papers (2026-08-07T09:20:31Z) - A Task-Space Receding Horizon Controller for Fast Collision Avoidance [0.08594140167290099]
Real-time collision avoidance for robotic manipulators requires fast reactions to unexpected obstacle motion.<n>Full model predictive control can provide this foresight, but its online cost may grow quickly with horizon length, model fidelity, and the number of active geometric constraints.<n>We present a task-space receding-horizon controller that uses a short contact-consistent rollout to generate a terminal kinematic reference.
arXiv Detail & Related papers (2026-07-17T08:13:12Z) - GPU-Accelerated Polygonal Signed Distance Functions for Real-Time Collision Avoidance [2.1993185973565113]
In dense environments, where feasible space is limited, the computational workload often dominates the control-cycle runtime.<n>The proposed Polygonal Signed Distance Function (PSDF) is a geometry-exact signed distance function between a convex polygonal robot footprint and obstacles represented by their boundary edges.<n>PSDF is embedded into model predictive control by locally linearizing the stage-wise safety constraints within a sequential quadratic programming-based real-time iteration scheme.<n>PSDF-MPC maintains real-time feasibility and robust collision avoidance in dense polygonal environments.
arXiv Detail & Related papers (2026-07-05T13:46:59Z) - SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video [88.79625979053873]
We propose a novel framework, SpaceEra, for pre-trained vision-language models (VLMs)<n>We extend the original framework into a comprehensive system, termed SpaceEra++, which spans data construction, model design, training optimization, and prompting inference.<n>In addition, to enhance spatial reasoning, we develop SpaceAlign, which enforces pairwise object constraints by jointly exploiting absolute coordinates and relative spatial relations.
arXiv Detail & Related papers (2026-07-02T06:56:29Z) - SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning [99.49739831030388]
We study how the design of this interface shapes the agent's capacity for open-ended spatial reasoning.<n>We propose SpatialClaw, a training-free framework for spatial reasoning that adopts code as the action interface.
arXiv Detail & Related papers (2026-06-11T17:59:36Z) - Constraint-Enhanced Reinforcement Learning Based on Dynamic Decoupled Spherical Radial Squashing [1.2036262042590717]
Hard limits on how fast each joint can move per control step are unavoidable.<n>Existing methods impose isotropic ball-shaped constraints, exponentially under-covering the true feasible set.<n>This paper proposes Dynamic Decoupled Spherical Radial Squashing (DD-SRad)<n>Experiments with Unitree H1 and G1 humanoid robots confirm end-to-end optimality parameterized directly from official joint specifications.
arXiv Detail & Related papers (2026-05-05T18:24:46Z) - Learning Reactive Dexterous Grasping via Hierarchical Task-Space RL Planning and Joint-Space QP Control [50.28263951510334]
We propose a hybrid hierarchical control framework for reactive dexterous grasping.<n>The proposed framework explicitly decouples high-level spatial intent from low-level joint execution.<n>We extensively validate the proposed framework through a rigorous simulation-to-reality pipeline.
arXiv Detail & Related papers (2026-05-05T04:49:38Z) - CSSDF-Net: Safe Motion Planning Based on Neural Implicit Representations of Configuration Space Distance Field [23.48697826890044]
High-dimensional manipulator operation in unstructured environments requires differentiable, scene-agnostic distance query mechanism.<n>CSSDF-Net learns a continuous signed distance field directly in configuration space to provide joint-space distance and gradient queries.<n> Experiments on a planar arm and a 7-DoF manipulator demonstrate stable gradients, effective collision avoidance in static and dynamic scenes.
arXiv Detail & Related papers (2026-03-19T09:31:41Z) - Vision-Guided MPPI for Agile Drone Racing: Navigating Arbitrary Gate Poses via Neural Signed Distance Fields [8.66703842496129]
Drone racing requires tight coupling of perception, planning, and control under extreme agility.<n>Recent approaches rely on precomputed spatial reference trajectories or explicit 6-DoF gate pose estimation.<n>We propose a vision guided optimal control framework that enables reference-free agile flight through arbitrarily placed and oriented gates.
arXiv Detail & Related papers (2026-03-07T13:18:07Z) - Iterative Convex Optimization with Control Barrier Functions for Obstacle Avoidance among Polytopes [3.8436274588467696]
Obstacle avoidance by polytopic robots is a challenging problem in optimization-based control and trajectory planning.<n>Existing methods rely on hyperiable distance approximations, such as ellipsoids, which distort geometric dynamics.<n>In this paper, we propose a novel iterative convexity- finite-horizon optimization framework for safety-critical navigation programs.
arXiv Detail & Related papers (2026-03-06T05:10:44Z) - IoUCert: Robustness Verification for Anchor-based Object Detectors [58.35703549470485]
We introduce IoUCert, a novel formal verification framework designed specifically to overcome these bottlenecks in anchor-based object detection architectures.<n>We show that our method enables the robustness verification of realistic, anchor-based models including SSD, YOLOv2, and YOLOv3 variants against various input perturbations.
arXiv Detail & Related papers (2026-03-03T14:36:46Z) - Constraining Streaming Flow Models for Adapting Learned Robot Trajectory Distributions [10.615762867055677]
Streaming Flow Policies (SFPs) have emerged as a powerful paradigm for generating robot trajectories by integrating learned velocity fields directly in action space.<n>We propose Constraint-Aware Streaming Flow (CASF), a framework that augments streaming flow policies with constraint-dependent metrics that reshape the learned velocity field during execution.<n>We demonstrate CASF in simulated and real-world manipulation tasks, showing that it produces constraint-satisfying trajectories that remain smooth, feasible, and dynamically consistent.
arXiv Detail & Related papers (2026-02-17T13:27:05Z) - Rethinking Multi-Condition DiTs: Eliminating Redundant Attention via Position-Alignment and Keyword-Scoping [61.459927600301654]
Multi-condition control is bottlenecked by the conventional concatenate-and-attend'' strategy.<n>Our analysis reveals that much of this cross-modal interaction is spatially or semantically redundant.<n>We propose Position-aligned and Keyword-scoped Attention (PKA), a highly efficient framework designed to eliminate these redundancies.
arXiv Detail & Related papers (2026-02-06T16:39:10Z) - Bidirectional Feature-aligned Motion Transformation for Efficient Dynamic Point Cloud Compression [97.66080040613726]
We propose a Bidirectional Feature-aligned Motion Transformation (Bi-FMT) framework that implicitly models motion in the feature space.<n>Bi-FMT aligns features across both past and future frames to produce temporally consistent latent representations.<n>We show Bi-FMT surpasses D-DPCC and AdaDPCC in both compression efficiency and runtime.
arXiv Detail & Related papers (2025-09-18T03:51:06Z) - GC-VLN: Instruction as Graph Constraints for Training-free Vision-and-Language Navigation [61.34589819350429]
We propose a training-free framework for vision-and-language navigation (VLN)<n>Our framework formulates navigation guidance as graph constraint optimization by decomposing instructions into explicit spatial constraints.<n>Our framework can effectively generalize to new environments and instruction sets, paving the way for a more robust and autonomous navigation framework.
arXiv Detail & Related papers (2025-09-12T17:59:58Z) - SAFE--MA--RRT: Multi-Agent Motion Planning with Data-Driven Safety Certificates [6.77934423529734]
This paper proposes a fully data-driven motion-planning framework for homogeneous linear multi-agent systems.<n>Each agent independently learns its closed-loop behavior from experimental data.<n>A sampling-based planner constructs a tree of such waypoints, where transitions are allowed only when adjacent ellipsoids overlap.
arXiv Detail & Related papers (2025-09-04T17:34:59Z) - Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for
Online Collision Avoidance [95.86944752753564]
We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties.
Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates.
The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
arXiv Detail & Related papers (2020-07-28T07:34:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.