Step2Motion: Locomotion Reconstruction from Pressure Sensing Insoles
- URL: http://arxiv.org/abs/2510.22712v1
- Date: Sun, 26 Oct 2025 15:12:02 GMT
- Title: Step2Motion: Locomotion Reconstruction from Pressure Sensing Insoles
- Abstract summary: We present Step2Motion, the first approach to reconstruct human locomotion from multi-modal insole sensors.<n>Our method utilizes pressure and inertial data-accelerations and angular rates-captured by the insoles to reconstruct human motion.<n>We evaluate the effectiveness of our approach across a range of experiments to show its versatility for diverse locomotion styles.
- Score: 27.10671084209085
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Human motion is fundamentally driven by continuous physical interaction with the environment. Whether walking, running, or simply standing, the forces exchanged between our feet and the ground provide crucial insights for understanding and reconstructing human movement. Recent advances in wearable insole devices offer a compelling solution for capturing these forces in diverse, real-world scenarios. Sensor insoles pose no constraint on the users' motion (unlike mocap suits) and are unaffected by line-of-sight limitations (in contrast to optical systems). These qualities make sensor insoles an ideal choice for robust, unconstrained motion capture, particularly in outdoor environments. Surprisingly, leveraging these devices with recent motion reconstruction methods remains largely unexplored. Aiming to fill this gap, we present Step2Motion, the first approach to reconstruct human locomotion from multi-modal insole sensors. Our method utilizes pressure and inertial data-accelerations and angular rates-captured by the insoles to reconstruct human motion. We evaluate the effectiveness of our approach across a range of experiments to show its versatility for diverse locomotion styles, from simple ones like walking or jogging up to moving sideways, on tiptoes, slightly crouching, or dancing.
Related papers
- Dressing in Motion: A Human Motion-Aware Diffusion Policy for Robot-Assisted Dressing [11.869204127828944]
We propose a visuomotor policy that learns dressing skills from static expert demonstrations and generalizes to dynamic user-motion scenarios.<n>A diffusion policy tailored to garment--human interaction geometry learns from partially observed point clouds with varied arm postures.<n>We evaluate our method in simulation and a real-world human study involving nine participants, three garment types, and six arm-motion patterns.
arXiv Detail & Related papers (2026-09-04T05:42:04Z) - Towards Real-World Wearable Motion Reconstruction [68.1355376294881]
We present a large-scale dataset synchronizing consumer-grade sensors with ground-truth 3D motion.<n>Second, we propose WHIP, a baseline generative model that reconstructs motion from arbitrary subsets of available sensors.<n>Third, we conduct a systematic study of sensor complementarity, quantifying how different modalities complement one another.
arXiv Detail & Related papers (2026-07-08T11:56:02Z) - Learn Weightlessness: Imitate Non-Self-Stabilizing Motions on Humanoid Robot [56.377161933570335]
Humans naturally exploit a "weightless" state during non-self-stabilizing (NSS) motions.<n>Inspired by this biological mechanism, we propose a weightlessness-state auto-labeling strategy for dataset annotation.<n>Our work bridges the gap between precise trajectory tracking and adaptive environmental interaction, offering a biologically-inspired solution for contact-rich humanoid control.
arXiv Detail & Related papers (2026-04-23T07:10:05Z) - Deep Whole-body Parkour [33.232856360240106]
We present a framework where exteroceptive sensing is integrated into whole-body motion tracking.<n>We demonstrate the non-trivial benefit of integrating perception into the control loop.<n>Results show that this framework enables robust, highly dynamic multi-contact motions, such as vaulting and dive-rolling, on unstructured terrain.
arXiv Detail & Related papers (2026-01-12T16:33:16Z) - FUSION: Full-Body Unified Motion Prior for Body and Hands via Diffusion [49.026972478098266]
Hands are central to interacting with our surroundings and conveying gestures.<n>Existing human motion synthesis methods fall short.<n>Key obstacle is the lack of large-scale datasets that jointly capture diverse full-body motion.
arXiv Detail & Related papers (2026-01-07T14:18:59Z) - Locomotion Beyond Feet [35.148387990120014]
Locomotion Beyond Feet is a comprehensive system for whole-body humanoid locomotion across challenging terrains.<n>Our approach addresses two key challenges: contact-rich motion planning and generalization across diverse terrains.<n>Keyframes encode human knowledge of motor skills, are embodiment-specific, and can be readily validated in simulation or on hardware.
arXiv Detail & Related papers (2026-01-07T05:36:39Z) - Bugs with Features: Vision-Based Fault-Tolerant Collective Motion Inspired by Nature [0.0]
In collective motion, perceptually-limited individuals move in an ordered manner, without centralized control.<n>This paper presents mechanisms for robust collective motion inspired by studies of locusts.
arXiv Detail & Related papers (2025-12-27T03:29:50Z) - Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning [54.26816599309778]
We propose a novel whole-body locomotion algorithm based on dynamic balance and Reinforcement Learning (RL)<n> Specifically, we introduce a dynamic balance mechanism by leveraging an extended measure of Zero-Moment Point (ZMP)-driven rewards and task-driven rewards in a whole-body actor-critic framework.<n> Experiments conducted on a full-sized Unitree H1-2 robot verify the ability of our method to maintain balance on extremely narrow terrains.
arXiv Detail & Related papers (2025-02-24T14:53:45Z) - Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfer [55.109778609058154]
Existing diffusion-based motion editing methods overlook the profound potential of the prior embedded within the weights of pre-trained models.
We uncover the roles and interactions of attention elements in capturing and representing motion patterns.
We integrate these elements to transfer a leader motion to a follower one while maintaining the nuanced characteristics of the follower, resulting in zero-shot motion transfer.
arXiv Detail & Related papers (2024-06-10T17:47:14Z) - DivaTrack: Diverse Bodies and Motions from Acceleration-Enhanced
Three-Point Trackers [13.258923087528354]
Full-body avatar presence is crucial for immersive social and environmental interactions in digital reality.
Current devices only provide three six degrees of freedom (DOF) poses from the headset and two controllers.
We propose a deep learning framework, DivaTrack, which outperforms existing methods when applied to diverse body sizes and activities.
arXiv Detail & Related papers (2024-02-14T14:46:03Z) - Universal Humanoid Motion Representations for Physics-Based Control [71.46142106079292]
We present a universal motion representation that encompasses a comprehensive range of motor skills for physics-based humanoid control.
We first learn a motion imitator that can imitate all of human motion from a large, unstructured motion dataset.
We then create our motion representation by distilling skills directly from the imitator.
arXiv Detail & Related papers (2023-10-06T20:48:43Z) - QuestSim: Human Motion Tracking from Sparse Sensors with Simulated
Avatars [80.05743236282564]
Real-time tracking of human body motion is crucial for immersive experiences in AR/VR.
We present a reinforcement learning framework that takes in sparse signals from an HMD and two controllers.
We show that a single policy can be robust to diverse locomotion styles, different body sizes, and novel environments.
arXiv Detail & Related papers (2022-09-20T00:25:54Z) - VAE-Loco: Versatile Quadruped Locomotion by Learning a Disentangled Gait
Representation [78.92147339883137]
We show that it is pivotal in increasing controller robustness by learning a latent space capturing the key stance phases constituting a particular gait.
We demonstrate that specific properties of the drive signal map directly to gait parameters such as cadence, footstep height and full stance duration.
The use of a generative model facilitates the detection and mitigation of disturbances to provide a versatile and robust planning framework.
arXiv Detail & Related papers (2022-05-02T19:49:53Z) - Learning to Jump from Pixels [23.17535989519855]
We present Depth-based Impulse Control (DIC), a method for synthesizing highly agile visually-guided behaviors.
DIC affords the flexibility of model-free learning but regularizes behavior through explicit model-based optimization of ground reaction forces.
We evaluate the proposed method both in simulation and in the real world.
arXiv Detail & Related papers (2021-10-28T17:53:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.