Learning Transferable Motor Skills for Geometry-Aware Robotic Surface Tasks

• URL: http://arxiv.org/abs/2605.24881v1
• Date: Sun, 24 May 2026 05:49:33 GMT
• Title: Learning Transferable Motor Skills for Geometry-Aware Robotic Surface Tasks
• Abstract summary: Robotic surface-interaction tasks, such as spray painting or welding, require both accurate geometric planning and precise motion execution.<n>We propose a modular framework that decouples geometric motion planning from execution-level expertise.<n>We train a multimodal neural network to infer rule parameters jointly from kinematic trajectory data and CAD model geometry.
• Score: 3.0714301039424776
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Robotic surface-interaction tasks, such as spray painting or welding, require both accurate geometric planning and precise motion execution. While modern motion planners generate valid geometric paths, they often lack the expert motor patterns observed in human operators. Conversely, learning from demonstration often tightly couples task execution to the specific training geometry, limiting transferability. We propose a modular framework that decouples geometric motion planning from execution-level expertise. Expert behavior is represented as a vocabulary of interpretable, atomic motor rules, such as velocity scaling and orientation offsets, that systematically modify a geometrically planned reference path. We train a multimodal neural network to infer rule parameters jointly from kinematic trajectory data and CAD model geometry. We evaluate our approach through dynamic simulation on L-shaped and window-shaped objects, demonstrating on simulated data that the model successfully extracts velocity and orientation rules across both topologies.

Related papers

• TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image [53.206752160427065]
  TourPhysics is an online framework from a single image and a declarative physical configuration.<n>For each action, the simulator computes a finite physical and camera trajectory before the corresponding observation is generated.<n>TourPhysics follows prescribed camera and object trajectories more closely than the evaluated baselines.
  arXiv  Detail & Related papers  (2026-09-04T09:15:03Z)
• Haptic Sorter: A Unified Planning Framework for Online Shape Estimation and Real-Time Pose Inference [5.39302833189819]
  We propose a unified model-based geometric framework integrating robotic haptic perception, modeling, and manipulation planning.<n>We deploy our system on a 2D robotic sorting task, and vary object geometries to validate the robustness of our framework in both simulation and a real-world multi-arm setup.
  arXiv  Detail & Related papers  (2026-05-29T14:28:42Z)
• PGOT: A Physics-Geometry Operator Transformer for Complex PDEs [15.319296758227857]
  We propose the Physics-Geometry Operator Transformer (PGOT) to reconstruct physical feature learning through explicit geometry awareness.<n>PGOT achieves consistent state-of-the-art performance across four standard benchmarks and excels in large-scale industrial tasks including airfoil and car designs.
  arXiv  Detail & Related papers  (2025-12-29T04:05:01Z)
• Online learning of subgrid-scale models for quasi-geostrophic turbulence in planetary interiors [41.99844472131922]
  We study quasi-geostrophic turbulent flow in an axisymmetric bounded domain.<n>Flow is driven by a prescribed analytical forcing.<n>We show that an SGS model trained on data spanning only one turnover time remains stable and accurate over integrations at least a hundred times longer than the training period.
  arXiv  Detail & Related papers  (2025-11-18T15:21:38Z)
• TIGeR: Tool-Integrated Geometric Reasoning in Vision-Language Models for Robotics [53.442362491589726]
  We present TIGeR (Tool-Integrated Geometric Reasoning), a novel framework that transforms Vision-Language Models (VLMs) into geometric computers.<n>Rather than attempting to internalize complex geometric operations within neural networks, TIGeR empowers models to recognize geometric reasoning requirements.<n>We show that TIGeR achieves SOTA performance on geometric reasoning benchmarks while demonstrating centimeter-level precision in real-world robotic manipulation tasks.
  arXiv  Detail & Related papers  (2025-10-08T16:20:23Z)
• Geometric Operator Learning with Optimal Transport [77.16909146519227]
  We propose integrating optimal transport (OT) into operator learning for partial differential equations (PDEs) on complex geometries.<n>For 3D simulations focused on surfaces, our OT-based neural operator embeds the surface geometry into a 2D parameterized latent space.<n> Experiments with Reynolds-averaged Navier-Stokes equations (RANS) on the ShapeNet-Car and DrivAerNet-Car datasets show that our method achieves better accuracy and also reduces computational expenses.
  arXiv  Detail & Related papers  (2025-07-26T21:28:25Z)
• Attention to Detail: Fine-Scale Feature Preservation-Oriented Geometric Pre-training for AI-Driven Surrogate Modeling [6.34618828355523]
  AI-driven surrogate modeling has become an increasingly effective alternative to physics-based simulations for 3D design, analysis, and manufacturing.<n>This work introduces a self-supervised geometric representation learning method designed to capture fine-scale geometric features from non-parametric 3D models.
  arXiv  Detail & Related papers  (2025-04-27T17:10:13Z)
• Geometry-aware Active Learning of Spatiotemporal Dynamic Systems [4.251030047034566]
  This paper proposes a geometry-aware active learning framework for modeling dynamic systems.<n>We develop an adaptive active learning strategy to strategically identify spatial locations for data collection and further maximize the prediction accuracy.
  arXiv  Detail & Related papers  (2025-04-26T19:56:38Z)
• FusionForce: End-to-end Differentiable Neural-Symbolic Layer for Trajectory Prediction [1.03590082373586]
  We propose end-to-end differentiable model that predicts robot trajectories on rough offroad terrain from camera images and/or lidar point clouds.<n>The model integrates a learnable component that predicts robot-terrain interaction forces with a neural-symbolic layer that enforces the laws of classical mechanics.
  arXiv  Detail & Related papers  (2025-02-14T13:36:00Z)
• Automatic Parameterization for Aerodynamic Shape Optimization via Deep Geometric Learning [60.69217130006758]
  We propose two deep learning models that fully automate shape parameterization for aerodynamic shape optimization. Both models are optimized to parameterize via deep geometric learning to embed human prior knowledge into learned geometric patterns. We perform shape optimization experiments on 2D airfoils and discuss the applicable scenarios for the two models.
  arXiv  Detail & Related papers  (2023-05-03T13:45:40Z)
• DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools [96.38972082580294]
  DiffSkill is a novel framework that uses a differentiable physics simulator for skill abstraction to solve deformable object manipulation tasks. In particular, we first obtain short-horizon skills using individual tools from a gradient-based simulator. We then learn a neural skill abstractor from the demonstration trajectories which takes RGBD images as input.
  arXiv  Detail & Related papers  (2022-03-31T17:59:38Z)
• Learning Monocular Depth in Dynamic Scenes via Instance-Aware Projection Consistency [114.02182755620784]
  We present an end-to-end joint training framework that explicitly models 6-DoF motion of multiple dynamic objects, ego-motion and depth in a monocular camera setup without supervision. Our framework is shown to outperform the state-of-the-art depth and motion estimation methods.
  arXiv  Detail & Related papers  (2021-02-04T14:26:42Z)
• Nothing But Geometric Constraints: A Model-Free Method for Articulated Object Pose Estimation [89.82169646672872]
  We propose an unsupervised vision-based system to estimate the joint configurations of the robot arm from a sequence of RGB or RGB-D images without knowing the model a priori. We combine a classical geometric formulation with deep learning and extend the use of epipolar multi-rigid-body constraints to solve this task.
  arXiv  Detail & Related papers  (2020-11-30T20:46:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.