MimicIK: Real-Time Generative Inverse Kinematics from Teleoperation with FK Consistency
- URL: http://arxiv.org/abs/2606.15148v2
- Date: Tue, 16 Jun 2026 04:15:49 GMT
- Title: MimicIK: Real-Time Generative Inverse Kinematics from Teleoperation with FK Consistency
- Abstract summary: Inverse kinematics (IK) remains a critical bottleneck for real-time robot manipulation.<n>MimicIK is a real-time generative inverse kinematics framework that learns smooth and robust joint-space motion priors from teleoperation demonstrations.<n>MimicIK achieves a mean position error of 4.65 mm, a 10 mm success rate of 92.01%, and a trajectory spike rate of only 7.99%.
- Score: 25.059681949019488
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Inverse kinematics (IK) remains a critical bottleneck for real-time robot manipulation. Classical numerical solvers achieve high geometric precision but often suffer from discontinuous branch switching and unstable behavior near kinematic singularities during closed-loop deployment. Meanwhile, learned IK approaches frequently struggle to balance spatial accuracy, motion smoothness, and real-time efficiency, particularly when trained on noisy human teleoperation data. We present \textbf{MimicIK}, a real-time generative inverse kinematics framework that learns smooth and robust joint-space motion priors from teleoperation demonstrations through conditional flow matching. Given the current joint configuration and a target end-effector pose, MimicIK predicts continuous delta-joint commands using an efficient two-step iterative refinement process based on a Minimal Iterative Policy (MIP) backbone. To enforce physical consistency, we further introduce an FK consistency loss, a differentiable forward-kinematics regularization that penalizes task-space deviations from the target pose during training. We evaluate MimicIK on a real-world 6-DOF robot dataset containing 8,848 teleoperation demonstrations. MimicIK achieves a mean position error of 4.65 mm, a 10 mm success rate of 92.01\%, and a trajectory spike rate of only 7.99\%. Compared with a UNet diffusion baseline, our method improves both spatial accuracy and motion smoothness while reducing inference latency from 21.66 ms to 6.74 ms. Furthermore, unlike deterministic MLP baselines that catastrophically diverge under out-of-distribution deployment, MimicIK remains stable near singular configurations and enables robust 20 Hz real-time control on deployment hardware.
Related papers
- FOCUS: Foot Observation Confidence for Robust Humanoid Proprioceptive Odometry [4.918768564334209]
Existing contact-aided estimators rely on binary contact decisions to determine whether FK measurements of an entire foot should be trusted.<n>We propose FOCUS, which predicts a continuous FK reliability weight for each foot instead of estimating binary foot contact.<n>Experiments demonstrate that FOCUS reduces absolute trajectory error (ATE) by 83.7% on simulated walking episodes.
arXiv Detail & Related papers (2026-09-02T07:34:55Z) - MotionDLO: Hybrid Event- and Frame-Based Tracking of Deformable Linear Objects [0.0]
We introduce MotionDLO, a real-time tracking framework specifically designed to overcome limitations in temporal continuity and latency.<n>The method exploits the high temporal resolution and sparsity of event-based cameras and combines segmentation with the Coherent Point Drift (CPD) algorithm.<n>We demonstrate that the proposed framework reliably associates DLO instances across video sequences, enabling robust perception for robotic manipulation tasks.
arXiv Detail & Related papers (2026-08-23T12:53:13Z) - ReactiveBFM: Reactive Closed-Loop Motion Planning Towards Universal Humanoid Whole-Body Control [54.267632784131415]
ReactiveBFM is a real-time-loop planning-control framework for humanoids.<n>It mitigates fatal cumulative exposure bias via a scheduled prefix sampling curriculum.<n>It demonstrates unprecedented physical agility across a vast repertoire of text-conditioned closed-loop motions.
arXiv Detail & Related papers (2026-06-29T14:27:27Z) - Seeing Through Occlusion: Deterministic Arm Kinematic Correction for Robot Teleoperation [6.979012378888037]
This paper presents an Arm Kinematic Correction (AKC) method that improves depth estimation by enforcing geometric constraints based on constant arm lengths.<n> Experimental validation against a Vicon reference system demonstrates reliable performance for both static and dynamic joint motions.<n>The results show that AKC enhances robustness and preserves anatomical consistency under long-duration, severe self-occlusion, even when paired with less reliable temporal filters.
arXiv Detail & Related papers (2026-06-17T16:20:10Z) - Stretch-ICP: A Continuous-Trajectory Registration and Deskewing Algorithm in Scenarios of Aggressive Motions [6.270809447204512]
Loss of stability on uneven or slippery terrain can induce extreme accelerations and angular velocities.<n>We introduce the Tumbling-Induced Gyroscope Saturation dataset, which consists of recordings from a mechanical lidar and an Inertial Measurement Unit (IMU) tumbling down a hill.<n>The dataset contains angular speeds up to four times higher than those in similar datasets and is publicly available.
arXiv Detail & Related papers (2026-05-17T05:13:18Z) - AnchorRefine: Synergy-Manipulation Based on Trajectory Anchor and Residual Refinement for Vision-Language-Action Models [60.04879435087352]
Vision-language-action (VLA) policies generate actions within a single unified space.<n>We propose AnchorRefine, a hierarchical framework that factorizes VLA action modeling into trajectory anchor and residual refinement.<n> Experiments on LIBERO, CALVIN, and real-robot tasks demonstrate that AnchorRefine consistently improves both regression-based and diffusion-based VLA backbones.
arXiv Detail & Related papers (2026-04-20T04:25:24Z) - Bridging Discrete Planning and Continuous Execution for Redundant Robot [12.278986080239692]
Voxel-grid reinforcement learning is widely adopted for path planning in redundant manipulators.<n>However, direct execution through point-wise numerical inverse kinematics on 7-DoF arms often yields step-size jitter.<n>This work proposes a bridging framework between discrete planning and continuous execution without modifying the discrete planner itself.
arXiv Detail & Related papers (2026-04-02T13:23:54Z) - MIRROR: Visual Motion Imitation via Real-time Retargeting and Teleoperation with Parallel Differential Inverse Kinematics [20.41490560492412]
Real-time humanoid teleoperation requires responsive inverse kinematics (IK) that are both responsive and constraint-safe under redundancy and self-collision constraints.<n>We propose a GPU-parallelized, continuation-based differential IK that improves escape from such constraint-induced local minima while preserving real-time performance, promoting safety and stability.<n>The method is paired with a visual skeletal pose estimation pipeline that enables robust, real-time upper-body teleoperation on the THEMIS humanoid robot hardware in real-world tasks.
arXiv Detail & Related papers (2026-03-25T06:49:58Z) - Parallel Continuous-Time Relative Localization with Augmented Clamped Non-Uniform B-Splines [13.396140913210637]
This paper proposes CT-RIO, a novel Continuous-Time Relative-Inertial Odometry framework.<n>We employ Clamped Non-Uniform B-splines (C-NUBS) to represent robot states for the first time, eliminating the query-time delay.<n>It consistently outperforms state-of-the-art methods, with improvements of up to 60% under high-speed motion.
arXiv Detail & Related papers (2026-02-25T15:23:18Z) - SirenPose: Dynamic Scene Reconstruction via Geometric Supervision [12.966077380225856]
We introduce SirenPose, a geometry-aware loss formulation that integrates the periodic activation of properties sinusoidal representation networks with keypoint-based geometric supervision.<n>In pose estimation, SirenPose outperforms Monst3R with lower absolute trajectory error as well as reduced translational and rotational relative pose error.
arXiv Detail & Related papers (2025-12-23T17:23:21Z) - Error-Propagation-Free Learned Video Compression With Dual-Domain Progressive Temporal Alignment [92.57576987521107]
We propose a novel unifiedtransform framework with dual-domain progressive temporal alignment and quality-conditioned mixture-of-expert (QCMoE)<n>QCMoE allows continuous and consistent rate control with appealing R-D performance.<n> Experimental results show that the proposed method achieves competitive R-D performance compared with the state-of-the-arts.
arXiv Detail & Related papers (2025-12-11T09:14:51Z) - Bidirectional Feature-aligned Motion Transformation for Efficient Dynamic Point Cloud Compression [97.66080040613726]
We propose a Bidirectional Feature-aligned Motion Transformation (Bi-FMT) framework that implicitly models motion in the feature space.<n>Bi-FMT aligns features across both past and future frames to produce temporally consistent latent representations.<n>We show Bi-FMT surpasses D-DPCC and AdaDPCC in both compression efficiency and runtime.
arXiv Detail & Related papers (2025-09-18T03:51:06Z) - ReCoM: Realistic Co-Speech Motion Generation with Recurrent Embedded Transformer [58.49950218437718]
We present ReCoM, an efficient framework for generating high-fidelity and generalizable human body motions synchronized with speech.<n>The core innovation lies in the Recurrent Embedded Transformer (RET), which integrates Dynamic Embedding Regularization (DER) into a Vision Transformer (ViT) core architecture.<n>To enhance model robustness, we incorporate the proposed DER strategy, which equips the model with dual capabilities of noise resistance and cross-domain generalization.
arXiv Detail & Related papers (2025-03-27T16:39:40Z) - Spatial-Temporal Graph Diffusion Policy with Kinematic Modeling for Bimanual Robotic Manipulation [88.83749146867665]
Existing approaches learn a policy to predict a distant next-best end-effector pose.<n>They then compute the corresponding joint rotation angles for motion using inverse kinematics.<n>We propose Kinematics enhanced Spatial-TemporAl gRaph diffuser.
arXiv Detail & Related papers (2025-03-13T17:48:35Z) - Online Body Schema Adaptation through Cost-Sensitive Active Learning [63.84207660737483]
The work was implemented in a simulation environment, using the 7DoF arm of the iCub robot simulator.
A cost-sensitive active learning approach is used to select optimal joint configurations.
The results show cost-sensitive active learning has similar accuracy to the standard active learning approach, while reducing in about half the executed movement.
arXiv Detail & Related papers (2021-01-26T16:01:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.