ReMoSPLAT: Reactive Mobile Manipulation Control on a Gaussian Splat
- URL: http://arxiv.org/abs/2512.09656v1
- Date: Wed, 10 Dec 2025 13:52:08 GMT
- Title: ReMoSPLAT: Reactive Mobile Manipulation Control on a Gaussian Splat
- Abstract summary: Reactive control can gracefully coordinate the motion of the base and the arm of a mobile manipulator.<n>We present ReMoSPLAT, a reactive controller based on a quadratic program formulation for mobile manipulation.
- Score: 3.983697124458495
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Reactive control can gracefully coordinate the motion of the base and the arm of a mobile manipulator. However, incorporating an accurate representation of the environment to avoid obstacles without involving costly planning remains a challenge. In this work, we present ReMoSPLAT, a reactive controller based on a quadratic program formulation for mobile manipulation that leverages a Gaussian Splat representation for collision avoidance. By integrating additional constraints and costs into the optimisation formulation, a mobile manipulator platform can reach its intended end effector pose while avoiding obstacles, even in cluttered scenes. We investigate the trade-offs of two methods for efficiently calculating robot-obstacle distances, comparing a purely geometric approach with a rasterisation-based approach. Our experiments in simulation on both synthetic and real-world scans demonstrate the feasibility of our method, showing that the proposed approach achieves performance comparable to controllers that rely on perfect ground-truth information.
Related papers
- CosmoH2G: A Hand-to-Gripper Transfer Dataset and Baseline Method for Object Manipulation with Complex Spatial Movements [63.40365657068892]
Transferring human hand demonstrations to robotic grippers has recently emerged as a cost-effective solution for robot learning.<n>Motivated by this gap, we adopt an implicit, data-driven approach guided by fine-grained hand-pose motions.<n>In both simulation and real-robot experiments, our framework enables stable and precise hand-to-gripper transfer of complex spatial manipulations.
arXiv Detail & Related papers (2026-09-07T13:47:22Z) - Real-Time and Accurate Collision-Free Teleoperation via Differentiable Constraint-Based Trajectory Planning [1.4699455652461726]
A common strategy to mitigate this issue is to enhance the operator's input using optimal-control-based trajectory planning.<n>We adapt a recent formulation of differentiable collision-avoidance constraints, based on duality in convex optimization, to the teleoperation setting.<n>Results show that our approach achieves lower computation times while enabling more accurate obstacle modeling.
arXiv Detail & Related papers (2026-06-07T16:39:56Z) - EMMa: End-Effector Stability-Oriented Mobile Manipulation for Tracked Rescue Robots [14.473975238280538]
This paper presents a motion generation framework for tracked mobile manipulators to achieve stable end-effector operation in complex rescue scenarios.<n>The proposed framework consistently outperforms SOTA methods across key metrics, including task success rate and end-effector motion stability.
arXiv Detail & Related papers (2026-04-09T14:28:41Z) - ToMPC: Task-oriented Model Predictive Control via ADMM for Safe Robotic Manipulation [20.83011691536596]
The framework unifies collision-free motion and robot-environment interaction to address diverse scenarios.<n>It also introduces task-oriented obstacle avoidance that leverages kinematic redundancy to enhance manipulation efficiency in obstructed environments.<n>Results demonstrate that the framework can plan motion and/or force trajectories in real time, maximize the manipulation range while avoiding obstacles, and strictly adhere to safety-related hard constraints.
arXiv Detail & Related papers (2026-03-14T13:35:24Z) - Provably Safe Trajectory Generation for Manipulators Under Motion and Environmental Uncertainties [26.41382315967256]
This article proposes a novel risk-bounded motion planning framework to address the unmet need for safe optimal motion planning.<n>Our approach integrates a rigid manipulator deep Koopman operator (RM-DeKO) model to predict the robot's state distribution under motion uncertainty.<n>We then introduce an efficient hierarchical verification method that combines parallel physics simulations with sum-of-squares (SOS) programming as a filter for fine-grained, formal certification of collision risk.
arXiv Detail & Related papers (2026-03-10T01:48:48Z) - Warm-Starting Collision-Free Model Predictive Control With Object-Centric Diffusion [38.363402738466334]
We show that combining diffusion-based warm-starting conditioned with a latent object-centric representation of the scene yields reliable and efficient motion generation under strict time limits.<n>Our approach conditions a diffusion transformer on the system state, task, and surroundings, using an object-centric slot attention mechanism.<n>The sampled trajectories are refined by an optimal control problem that enforces rigid-body dynamics and signed-distance collision constraints.
arXiv Detail & Related papers (2026-01-06T10:02:54Z) - ParaMaP: Parallel Mapping and Collision-free Motion Planning for Reactive Robot Manipulation [17.260700135265267]
Real-time and collision-free motion planning remains challenging for robotic manipulation in unknown environments.<n>We propose a parallel mapping and motion planning framework that tightly integrates Euclidean Distance Transform (EDT)-based environment representation with a sampling-based model predictive control (SMPC) planner.<n>The effectiveness of the proposed framework is validated through extensive simulations and real-world experiments on a 7-DoF robotic manipulator.
arXiv Detail & Related papers (2025-12-27T12:24:10Z) - Layout Sequence Prediction From Noisy Mobile Modality [53.49649231056857]
Trajectory prediction plays a vital role in understanding pedestrian movement for applications such as autonomous driving and robotics.
Current trajectory prediction models depend on long, complete, and accurately observed sequences from visual modalities.
We propose LTrajDiff, a novel approach that treats objects obstructed or out of sight as equally important as those with fully visible trajectories.
arXiv Detail & Related papers (2023-10-09T20:32:49Z) - Tuning Legged Locomotion Controllers via Safe Bayesian Optimization [47.87675010450171]
This paper presents a data-driven strategy to streamline the deployment of model-based controllers in legged robotic hardware platforms.
We leverage a model-free safe learning algorithm to automate the tuning of control gains, addressing the mismatch between the simplified model used in the control formulation and the real system.
arXiv Detail & Related papers (2023-06-12T13:10:14Z) - Nonprehensile Riemannian Motion Predictive Control [57.295751294224765]
We introduce a novel Real-to-Sim reward analysis technique to reliably imagine and predict the outcome of taking possible actions for a real robotic platform.
We produce a closed-loop controller to reactively push objects in a continuous action space.
We observe that RMPC is robust in cluttered as well as occluded environments and outperforms the baselines.
arXiv Detail & Related papers (2021-11-15T18:50:04Z) - Consolidating Kinematic Models to Promote Coordinated Mobile
Manipulations [96.03270112422514]
We construct a Virtual Kinematic Chain (VKC) that consolidates the kinematics of the mobile base, the arm, and the object to be manipulated in mobile manipulations.
A mobile manipulation task is represented by altering the state of the constructed VKC, which can be converted to a motion planning problem.
arXiv Detail & Related papers (2021-08-03T02:59:41Z) - Online Body Schema Adaptation through Cost-Sensitive Active Learning [63.84207660737483]
The work was implemented in a simulation environment, using the 7DoF arm of the iCub robot simulator.
A cost-sensitive active learning approach is used to select optimal joint configurations.
The results show cost-sensitive active learning has similar accuracy to the standard active learning approach, while reducing in about half the executed movement.
arXiv Detail & Related papers (2021-01-26T16:01:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.