GAIT: Legged Robot Proprioceptive State Estimation with Attention over Inertial-Leg Tokens

• URL: http://arxiv.org/abs/2606.14160v1
• Date: Fri, 12 Jun 2026 06:34:53 GMT
• Title: GAIT: Legged Robot Proprioceptive State Estimation with Attention over Inertial-Leg Tokens
• Abstract summary: We propose a method that applies Inertial-Leg tokenization to an attention-based network for proprioceptive state estimation in legged robots.<n>Unlike existing learning-based state estimators that achieves all sensor measurements into a single flat vector, the proposed architecture represents inertial measurements and leg-wise measurements as individual tokens.
• Score: 7.416166787003273
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we propose a method that applies Inertial-Leg (IL) tokenization to an attention-based network for proprioceptive state estimation in legged robots. Unlike existing learning-based state estimators that concatenate all sensor measurements into a single flat vector, the proposed architecture represents inertial measurements and leg-wise measurements as individual tokens and uses an attention mechanism to learn the relative importance of each measurement.This design allows the network to reweight each measurement according to the current contact condition, reflecting the fact that the reliability of forward kinematic measurements depends on whether the corresponding foot is in contact. Unlike conventional contact-aided estimators, however, the proposed method learns this behavior without relying on an explicit contact estimator or on explicit measurement updates based on a stationary contact assumption. To validate the proposed method, we conducted experiments on a Unitree Go1 robot, including debris terrain not modeled in simulation and gait patterns not seen during training. Experimental results show that the proposed method achieves better estimation performance than existing learning-based state estimators under unseen gait patterns and also improves performance over contact-aided model-based methods.

Related papers

• A comprehensive and trustworthy benchmark of AI methods for change detection in Earth observation [6.608286365425497]
  Change detection in Earth observation is critical for monitoring land surface transformations.<n>We present a standardized, open-source benchmark for evaluating state-of-the-art (SOTA) deep learning methods for change detection.
  arXiv  Detail & Related papers  (2026-08-28T12:04:39Z)
• TRACE: Learned Proprioceptive Odometry for Legged Robots under Unreliable Contact Conditions [4.317571381146645]
  We present TRACE (Tokenized Robust Attention for Contact-Aware Estimation), an end-to-end learned proprioceptive odometry estimator for legged robots.<n>The proposed estimator directly predicts relative displacement, relative rotation, and body-frame velocity from a recent history of onboard inertial and joint measurements.<n>To improve robustness under unreliable contact conditions, we introduce a foot-aware cross-attention module that adaptively weights IMU and leg-wise kinematic tokens.
  arXiv  Detail & Related papers  (2026-08-06T12:53:33Z)
• Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues? [75.43540911934191]
  Hand-object interaction (HOI) recognition requires capturing both hand manipulations and object transformations.<n>We propose a new learning paradigm that combines hand-object masked training and an HOI-dynamics-aware decoder.<n>We show that our training strategy exploits hand- and object-centric information more effectively than existing models.
  arXiv  Detail & Related papers  (2026-07-09T14:09:29Z)
• How NOT to benchmark your SITE metric: Beyond Static Leaderboards and Towards Realistic Evaluation [11.33816414982401]
  Transferability estimation metrics are used to find a high-performing pre-trained model for a given target task.<n>Despite the growing interest in developing such metrics, the benchmarks used to measure their progress have gone largely unexamined.<n>We argue that the benchmarks on which these metrics are evaluated are fundamentally flawed.
  arXiv  Detail & Related papers  (2025-10-07T20:38:12Z)
• RelCon: Relative Contrastive Learning for a Motion Foundation Model for Wearable Data [14.097517115921184]
  We present RelCon, a novel self-supervised Relative Contrastive learning approach for training a motion foundation model from wearable accelerometry sensors.<n>First, a learnable distance measure is trained to capture motif similarity and domain-specific semantic information.<n>We are the first to show the generalizability of a foundation model with motion data from wearables across distinct evaluation tasks.
  arXiv  Detail & Related papers  (2024-11-27T23:51:53Z)
• Benchmarks as Microscopes: A Call for Model Metrology [76.64402390208576]
  Modern language models (LMs) pose a new challenge in capability assessment. To be confident in our metrics, we need a new discipline of model metrology.
  arXiv  Detail & Related papers  (2024-07-22T17:52:12Z)
• Data-driven Force Observer for Human-Robot Interaction with Series Elastic Actuators using Gaussian Processes [4.229902091180109]
  In this work, we learn the unknown dynamics components using Gaussian process (GP) regression. We derive guaranteed estimation error bounds, thus, facilitating the use in safety-critical applications. We demonstrate the effectiveness of the proposed approach experimentally in a human-exoskeleton interaction scenario.
  arXiv  Detail & Related papers  (2024-05-14T15:51:52Z)
• Towards Motion Forecasting with Real-World Perception Inputs: Are End-to-End Approaches Competitive? [93.10694819127608]
  We propose a unified evaluation pipeline for forecasting methods with real-world perception inputs. Our in-depth study uncovers a substantial performance gap when transitioning from curated to perception-based data.
  arXiv  Detail & Related papers  (2023-06-15T17:03:14Z)
• Robust Contact State Estimation in Humanoid Walking Gaits [3.1866319932300953]
  We propose a deep learning framework that provides a unified approach to the problem of leg contact detection in humanoid robot walking gaits. Our formulation accomplishes to accurately and robustly estimate the contact state probability for each leg. Our implementation is offered as an open-source ROS/Python package, coined Legged Contact Detection (LCD)
  arXiv  Detail & Related papers  (2022-07-30T17:19:47Z)
• Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encoding [121.66374635092097]
  Trajectories obtained from object detection and tracking are inevitably noisy. We propose a trajectory predictor directly based on detection results without relying on explicitly formed trajectories.
  arXiv  Detail & Related papers  (2022-02-03T09:09:56Z)
• Contact-Aware Retargeting of Skinned Motion [49.71236739408685]
  This paper introduces a motion estimation method that preserves self-contacts and prevents interpenetration. The method identifies self-contacts and ground contacts in the input motion, and optimize the motion to apply to the output skeleton. In experiments, our results quantitatively outperform previous methods and we conduct a user study where our retargeted motions are rated as higher-quality than those produced by recent works.
  arXiv  Detail & Related papers  (2021-09-15T17:05:02Z)
• MINIMALIST: Mutual INformatIon Maximization for Amortized Likelihood Inference from Sampled Trajectories [61.3299263929289]
  Simulation-based inference enables learning the parameters of a model even when its likelihood cannot be computed in practice. One class of methods uses data simulated with different parameters to infer an amortized estimator for the likelihood-to-evidence ratio. We show that this approach can be formulated in terms of mutual information between model parameters and simulated data.
  arXiv  Detail & Related papers  (2021-06-03T12:59:16Z)
• Evaluating the Safety of Deep Reinforcement Learning Models using Semi-Formal Verification [81.32981236437395]
  We present a semi-formal verification approach for decision-making tasks based on interval analysis. Our method obtains comparable results over standard benchmarks with respect to formal verifiers. Our approach allows to efficiently evaluate safety properties for decision-making models in practical applications.
  arXiv  Detail & Related papers  (2020-10-19T11:18:06Z)
• Robust Unsupervised Learning of Temporal Dynamic Interactions [21.928675010305543]
  In this paper we introduce a model-free metric based on the Procrustes distance for robust representation learning of interactions. We also introduce an optimal transport based distance metric for comparing between distributions of interaction primitives. Their usefulness will be demonstrated in unsupervised learning of vehicle-to-vechicle interactions extracted from the Safety Pilot database.
  arXiv  Detail & Related papers  (2020-06-18T02:39:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.