RAM: Recover Any 3D Human Motion in-the-Wild

• URL: http://arxiv.org/abs/2603.19929v1
• Date: Fri, 20 Mar 2026 13:17:05 GMT
• Title: RAM: Recover Any 3D Human Motion in-the-Wild
• Abstract summary: RAM incorporates a motion-aware semantic tracker with adaptive Kalman filtering to achieve robust association identity.<n> RAM substantially outperforms previous state-of-the-art in both Zero-shot tracking stability and 3D accuracy.
• Score: 28.649214706624196
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: RAM incorporates a motion-aware semantic tracker with adaptive Kalman filtering to achieve robust identity association under severe occlusions and dynamic interactions. A memory-augmented Temporal HMR module further enhances human motion reconstruction by injecting spatio-temporal priors for consistent and smooth motion estimation. Moreover, a lightweight Predictor module forecasts future poses to maintain reconstruction continuity, while a gated combiner adaptively fuses reconstructed and predicted features to ensure coherence and robustness. Experiments on in-the-wild multi-person benchmarks such as PoseTrack and 3DPW, demonstrate that RAM substantially outperforms previous state-of-the-art in both Zero-shot tracking stability and 3D accuracy, offering a generalizable paradigm for markerless 3D human motion capture in-the-wild.

Related papers

• EvTrajGS: Accurate and Efficient 3D Gaussian Splatting from Unposed Event Streams [108.45551580182384]
  EvTrajGS is an accurate and efficient 3D Gaussian Splatting framework for unposed event streams.<n>Our method enables reliable joint pose-scene optimization from coarse pose priors, eliminating the need for computationally expensive SLAM-style pipelines.
  arXiv  Detail & Related papers  (2026-08-09T09:00:30Z)
• Natural Human Motion Recovery by Aligning High-Order Temporal Dynamics from Monocular Videos [65.51845732149306]
  We introduce HTD-Refine, a post-processing framework that augments Human Motion Recovery (HMR) pipelines using explicitly estimated high-order temporal dynamics.<n>At the core of our system is PVA-Net, a temporal transformer that infers per-joint 2D positions, 3D velocities, and 3D accelerations directly from a monocular video.
  arXiv  Detail & Related papers  (2026-05-26T11:38:36Z)
• Bézier Degradation Modeling for LiDAR-based Human Motion Capture [21.718401755735773]
  BMLiCap is a coarse-to-fine framework that models motion using temporally compressible Bézier curves.<n>It achieves state-of-the-art accuracy and temporal continuity in complex scenes.
  arXiv  Detail & Related papers  (2026-05-19T09:56:52Z)
• E-3DPSM: A State Machine for Event-Based Egocentric 3D Human Pose Estimation [73.63705002652638]
  Event cameras offer advantages in monocular egocentric 3D human pose estimation from head-mounted devices.<n> Existing methods suffer from low 3D estimation accuracy, insufficient in many applications.<n>This paper introduces E-3DPSM, an event-driven continuous pose state machine for event-based egocentric 3D human pose estimation.
  arXiv  Detail & Related papers  (2026-04-09T17:59:52Z)
• Mango-GS: Enhancing Spatio-Temporal Consistency in Dynamic Scenes Reconstruction using Multi-Frame Node-Guided 4D Gaussian Splatting [17.957935001501106]
  We present Mango-GS, a node-guided framework for high-fidelity 4D reconstruction.<n>We leverage a temporal Transformer to model motion dependencies within a short window of frames.<n>Mango-GS achieves state-of-the-art reconstruction quality and real-time rendering speed.
  arXiv  Detail & Related papers  (2026-03-12T05:00:16Z)
• Towards Geometry-Aware and Motion-Guided Video Human Mesh Recovery [60.51998732898099]
  We introduce HMRMamba, a new paradigm for 3D Human Mesh Recovery.<n>It pioneers the use of Structured State Space Models for their efficiency and long-range modeling prowess.<n>Our framework is distinguished by two core contributions. First, the Geometry-Aware Lifting Module, featuring a novel dual-scan Mamba architecture.
  arXiv  Detail & Related papers  (2026-01-29T08:05:02Z)
• StarPose: 3D Human Pose Estimation via Spatial-Temporal Autoregressive Diffusion [29.682018018059043]
  StarPose is an autoregressive diffusion framework for 3D human pose estimation.<n>It incorporates historical 3D pose predictions and spatial-temporal physical guidance.<n>It achieves superior accuracy and temporal consistency in 3D human pose estimation.
  arXiv  Detail & Related papers  (2025-08-04T04:50:05Z)
• ReCoM: Realistic Co-Speech Motion Generation with Recurrent Embedded Transformer [58.49950218437718]
  We present ReCoM, an efficient framework for generating high-fidelity and generalizable human body motions synchronized with speech.<n>The core innovation lies in the Recurrent Embedded Transformer (RET), which integrates Dynamic Embedding Regularization (DER) into a Vision Transformer (ViT) core architecture.<n>To enhance model robustness, we incorporate the proposed DER strategy, which equips the model with dual capabilities of noise resistance and cross-domain generalization.
  arXiv  Detail & Related papers  (2025-03-27T16:39:40Z)
• EMoTive: Event-guided Trajectory Modeling for 3D Motion Estimation [59.33052312107478]
  Event cameras offer possibilities for 3D motion estimation through continuous adaptive pixel-level responses to scene changes.<n>This paper presents EMove, a novel event-based framework that models-uniform trajectories via event-guided parametric curves.<n>For motion representation, we introduce a density-aware adaptation mechanism to fuse spatial and temporal features under event guidance.<n>The final 3D motion estimation is achieved through multi-temporal sampling of parametric trajectories, flows and depth motion fields.
  arXiv  Detail & Related papers  (2025-03-14T13:15:54Z)
• Event-boosted Deformable 3D Gaussians for Dynamic Scene Reconstruction [50.873820265165975]
  We introduce the first approach combining event cameras, which capture high-temporal-resolution, continuous motion data, with deformable 3D-GS for dynamic scene reconstruction.<n>We propose a GS-Threshold Joint Modeling strategy, creating a mutually reinforcing process that greatly improves both 3D reconstruction and threshold modeling.<n>We contribute the first event-inclusive 4D benchmark with synthetic and real-world dynamic scenes, on which our method achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-11-25T08:23:38Z)
• ReMP: Reusable Motion Prior for Multi-domain 3D Human Pose Estimation and Motion Inbetweening [10.813269931915364]
  We learn rich motion from prior sequence of complete parametric models of human body shape. Our prior can easily estimate poses in missing frames or noisy measurements. ReMP consistently outperforms the baseline method on diverse and practical 3D motion data.
  arXiv  Detail & Related papers  (2024-11-13T02:42:07Z)
• ALOcc: Adaptive Lifting-Based 3D Semantic Occupancy and Cost Volume-Based Flow Predictions [91.55655961014027]
  3D semantic occupancy and flow prediction are fundamental to understanding scene scene.<n>This paper proposes a vision-based framework with three targeted improvements.<n>Our purely convolutional architecture establishes new SOTA performance on multiple benchmarks for both semantic occupancy and joint semantic-flow prediction.
  arXiv  Detail & Related papers  (2024-11-12T11:32:56Z)
• 3D Pose Estimation and Future Motion Prediction from 2D Images [26.28886209268217]
  This paper considers to jointly tackle the highly correlated tasks of estimating 3D human body poses and predicting future 3D motions from RGB image sequences. Based on Lie algebra pose representation, a novel self-projection mechanism is proposed that naturally preserves human motion kinematics.
  arXiv  Detail & Related papers  (2021-11-26T01:02:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.