Physics-Informed Eikonal Caging for Whole-Arm Manipulation Planning
- URL: http://arxiv.org/abs/2606.22143v1
- Date: Sat, 20 Jun 2026 16:49:17 GMT
- Title: Physics-Informed Eikonal Caging for Whole-Arm Manipulation Planning
- Abstract summary: We introduce caging as a minimum-time escape problem in which the object seeks to leave an enclosing robot geometry in the shortest time.<n>This yields a continuous escape-time field that measures the robot's enclosure quality and we show it satisfies an eikonal equation.<n>We therefore can approximate this field using a physics-informed neural network, producing a smooth differentiable representation that can be embedded directly into manipulation planning.
- Score: 29.754938212556223
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Planning contact-rich whole-arm manipulation is challenging because interactions that involve extended robot geometry give rise to complex contact dynamics that are difficult to model accurately. This creates a need for planning principles that do not rely heavily on precise contact models. Caging offers one such geometric notion of robustness to modeling inaccuracy by restricting object escape through geometrically enclosing the object. However, existing caging formulations are difficult to incorporate into continuous optimization-based manipulation planning. We reformulate caging as a minimum-time escape problem in which the object seeks to leave an enclosing robot geometry in the shortest time. This yields a continuous escape-time field that measures the robot's enclosure quality and we show it satisfies an eikonal equation. We therefore can approximate this field using a physics-informed neural network, producing a smooth differentiable representation that can be embedded directly into manipulation planning. The resulting objective supports whole-arm manipulation planning to favor robot configurations resisting object escape. This improves the manipulation robustness to contact model mismatch, thus enabling planning with simplified contact models, including quasi-dynamic approximations and simplified object geometry. Across simulation and real-world experiments, we show improved robustness to disturbances and contact-model mismatch relative to baselines. These results suggest that geometric enclosure can serve as a practical robustness primitive for whole-arm manipulation. A supplementary video, which includes an intuitive overview of our method and experiment video results, is available on our project webpage.
Related papers
- CosmoH2G: A Hand-to-Gripper Transfer Dataset and Baseline Method for Object Manipulation with Complex Spatial Movements [63.40365657068892]
Transferring human hand demonstrations to robotic grippers has recently emerged as a cost-effective solution for robot learning.<n>Motivated by this gap, we adopt an implicit, data-driven approach guided by fine-grained hand-pose motions.<n>In both simulation and real-robot experiments, our framework enables stable and precise hand-to-gripper transfer of complex spatial manipulations.
arXiv Detail & Related papers (2026-09-07T13:47:22Z) - ArtiTwinSplat: Interactable Digital Twin Reconstruction via Gaussian Splatting from RGB-D videos [47.4010297818512]
ArtiTwinSplat is a framework that automatically constructs articulated, photo-realistic digital twins of objects from RGB-D videos.<n>Our method is built on 3D Gaussian Splatting that preserve geometric fidelity and photometric realism.
arXiv Detail & Related papers (2026-06-23T14:24:07Z) - ManiSplat: Manipulation Trajectory Synthesis from Monocular Video via Decoupled 3D Gaussian Splatting [28.256286705954846]
Reconstructing dynamic and interactive 3D scenes from real-world observations remains a fundamental challenge in computer vision and robotics.<n>We introduce ManiSplat, a unified framework that reconstructs controllable and decoupled Gaussian digital twins directly from robotic videos.<n>Our approach reconstructs interaction-driven dynamic scenes with high fidelity and controllability, effectively supporting downstream robotic tasks and policy learning.
arXiv Detail & Related papers (2026-06-09T09:55:58Z) - Haptic Sorter: A Unified Planning Framework for Online Shape Estimation and Real-Time Pose Inference [5.39302833189819]
We propose a unified model-based geometric framework integrating robotic haptic perception, modeling, and manipulation planning.<n>We deploy our system on a 2D robotic sorting task, and vary object geometries to validate the robustness of our framework in both simulation and a real-world multi-arm setup.
arXiv Detail & Related papers (2026-05-29T14:28:42Z) - Simulation-Driven Evolutionary Motion Parameterization for Contact-Rich Granular Scooping with a Soft Conical Robotic Hand [14.911239660367926]
Tool-based scooping is vital in robot-assisted tasks, enabling interaction with objects of varying sizes, shapes, and material states.<n>Recent studies have shown that flexible, reconfigurable soft robotic end-effectors can adapt their shape to maintain consistent contact during scooping.<n>These soft tools can adjust to varying container sizes and materials without requiring complex sensing or control.<n>This paper presents the development of a physics-based simulation model of a deformable soft conical robotic hand.
arXiv Detail & Related papers (2026-04-07T07:30:21Z) - Detailed Geometry and Appearance from Opportunistic Motion [44.38825288921379]
Reconstructing 3D geometry and appearance from a sparse set of fixed cameras is a foundational task with broad applications.<n>We show that the static cameras effectively orbit'' the object in its local coordinate frame, providing additional virtual viewpoints.<n> Harnessing this object motion, however, poses two challenges: the tight coupling of object pose and geometry estimation and the complex appearance variations of a moving object under static illumination.
arXiv Detail & Related papers (2026-03-27T17:59:16Z) - Push, Press, Slide: Mode-Aware Planar Contact Manipulation via Reduced-Order Models [4.600772894287281]
We propose a mode-aware framework for planar manipulation with one or two robotic arms.<n>Our core insight is that complex wrench-twist limit surface mechanics can be abstracted into a discrete library of physically intuitive models.<n>We demonstrate our fast, optimization-free approach in simulation across diverse single-arm and bimanual manipulation tasks.
arXiv Detail & Related papers (2026-03-12T19:21:19Z) - MeshMimic: Geometry-Aware Humanoid Motion Learning through 3D Scene Reconstruction [54.36564144414704]
MeshMimic is an innovative framework that bridges 3D scene reconstruction and embodied intelligence to enable humanoid robots to learn coupled "motion-terrain" interactions directly from video.<n>By leveraging state-of-the-art 3D vision models, our framework precisely segments and reconstructs both human trajectories and the underlying 3D geometry of terrains and objects.
arXiv Detail & Related papers (2026-02-17T17:09:45Z) - Mirage2Matter: A Physically Grounded Gaussian World Model from Video [87.9732484393686]
We present Simulate Anything, a graphics-driven world modeling and simulation framework.<n>Our approach reconstructs real-world environments into a photorealistic scene representation using 3D Gaussian Splatting (3DGS)<n>We then leverage generative models to recover a physically realistic representation and integrate it into a simulation environment via a precision calibration target.
arXiv Detail & Related papers (2026-01-24T07:43:57Z) - Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objects [59.51185639557874]
We introduce Kinematify, an automated framework that synthesizes articulated objects directly from arbitrary RGB images or textual descriptions.<n>Our method addresses two core challenges: (i) inferring kinematic topologies for high-DoF objects and (ii) estimating joint parameters from static geometry.
arXiv Detail & Related papers (2025-11-03T07:21:42Z) - Nonprehensile Riemannian Motion Predictive Control [57.295751294224765]
We introduce a novel Real-to-Sim reward analysis technique to reliably imagine and predict the outcome of taking possible actions for a real robotic platform.
We produce a closed-loop controller to reactively push objects in a continuous action space.
We observe that RMPC is robust in cluttered as well as occluded environments and outperforms the baselines.
arXiv Detail & Related papers (2021-11-15T18:50:04Z) - Online Body Schema Adaptation through Cost-Sensitive Active Learning [63.84207660737483]
The work was implemented in a simulation environment, using the 7DoF arm of the iCub robot simulator.
A cost-sensitive active learning approach is used to select optimal joint configurations.
The results show cost-sensitive active learning has similar accuracy to the standard active learning approach, while reducing in about half the executed movement.
arXiv Detail & Related papers (2021-01-26T16:01:02Z) - Nothing But Geometric Constraints: A Model-Free Method for Articulated
Object Pose Estimation [89.82169646672872]
We propose an unsupervised vision-based system to estimate the joint configurations of the robot arm from a sequence of RGB or RGB-D images without knowing the model a priori.
We combine a classical geometric formulation with deep learning and extend the use of epipolar multi-rigid-body constraints to solve this task.
arXiv Detail & Related papers (2020-11-30T20:46:48Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.