Perceptive Variable-Timing Footstep Planning for Humanoid Locomotion on Disconnected Footholds
- URL: http://arxiv.org/abs/2603.07400v1
- Date: Sun, 08 Mar 2026 01:04:30 GMT
- Title: Perceptive Variable-Timing Footstep Planning for Humanoid Locomotion on Disconnected Footholds
- Abstract summary: We propose an onboard, perceptive mixed-integer model predictive control framework that jointly plans foot placement and step duration.<n>We evaluate the approach in simulation on Digit on randomized stepping-stone fields, including external pushes.
- Score: 2.963101656293054
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Many real-world walking scenarios contain obstacles and unsafe ground patches (e.g., slippery or cluttered areas), leaving a disconnected set of admissible footholds that can be modeled as stepping-stone-like regions. We propose an onboard, perceptive mixed-integer model predictive control framework that jointly plans foot placement and step duration using step-to-step Divergent Component of Motion (DCM) dynamics. Ego-centric depth images are fused into a probabilistic local heightmap, from which we extract a union of convex steppable regions. Region membership is enforced with binary variables in a mixed-integer quadratic program (MIQP). To keep the optimization tractable while certifying safety, we embed capturability bounds in the DCM space: a lateral one-step condition (preventing leg crossing) and a sagittal infinite-step bound that limits unstable growth. We further re-plan within the step by back-propagating the measured instantaneous DCM to update the initial DCM, improving robustness to model mismatch and external disturbances. We evaluate the approach in simulation on Digit on randomized stepping-stone fields, including external pushes. The planner generates terrain-aware, dynamically consistent footstep sequences with adaptive timing and millisecond-level solve times.
Related papers
- Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking [78.30338456206984]
We introduce a novel framework for training general-purpose 3D foothold-tracking policies.<n>By dynamically providing footstep support through a goal sampler, this method enables the learned policy to be agnostic to specific terrains.<n>Our new target representation effectively mitigates challenges arising in the real world, such as noisy and inaccurate pose estimation and foot contact estimation.
arXiv Detail & Related papers (2026-06-06T16:44:56Z) - TinySDP: Real Time Semidefinite Optimization for Certifiable and Agile Edge Robotics [18.604754784265253]
Semidefinite cul (SDP) provides a principled framework for convex relaxations in motion planning.<n>Tiny-Riccati-based computational structure solver for embedded dynamic tractability.
arXiv Detail & Related papers (2026-05-13T16:30:32Z) - Hypergraph-State Collaborative Reasoning for Multi-Object Tracking [63.32950991964095]
We propose a collaborative reasoning framework that enhances motion estimation through joint inference among multiple correlated objects.<n>By allowing objects with similar motion states to mutually constrain and refine each other, our framework stabilizes noisy trajectories and infers plausible motion continuity even when target is occluded.
arXiv Detail & Related papers (2026-04-14T12:37:39Z) - Flickering Multi-Armed Bandits [7.465238700168576]
We introduce Flickering Multi-Armed Bandits (FMAB), a new MAB framework where the set of available arms (or actions) can change at each round.<n>We model this constrained, evolving availability using random graph processes, where arms are nodes and the agent's movement is restricted to its local neighborhood.<n>We show that our algorithm is near-optimal by establishing a matching information-theoretic lower bound for this problem class.
arXiv Detail & Related papers (2026-02-19T12:24:01Z) - Toward Operationalizing Rasmussen: Drift Observability on the Simplex for Evolving Systems [0.0]
Monitoring drift into failure is hindered by Euclidean anomaly detection.<n>Rasmussen's dynamic safety model motivates drift under competing pressures.<n>We propose a vision for drift observability on the simplex.
arXiv Detail & Related papers (2026-02-05T09:41:49Z) - ParaMaP: Parallel Mapping and Collision-free Motion Planning for Reactive Robot Manipulation [17.260700135265267]
Real-time and collision-free motion planning remains challenging for robotic manipulation in unknown environments.<n>We propose a parallel mapping and motion planning framework that tightly integrates Euclidean Distance Transform (EDT)-based environment representation with a sampling-based model predictive control (SMPC) planner.<n>The effectiveness of the proposed framework is validated through extensive simulations and real-world experiments on a 7-DoF robotic manipulator.
arXiv Detail & Related papers (2025-12-27T12:24:10Z) - LocoMamba: Vision-Driven Locomotion via End-to-End Deep Reinforcement Learning with Mamba [2.26464274357758]
We introduce a vision-driven cross-modal DRL framework built on selective state-space models, specifically leveraging Mamba.<n>LocoMamba achieves near-linear-time sequence modeling, effectively captures long-range dependencies, and enables efficient training with longer sequences.<n>We evaluate our method in challenging simulated environments with static and moving obstacles as well as uneven terrain.
arXiv Detail & Related papers (2025-08-16T00:13:24Z) - Dynamic Neural Potential Field: Online Trajectory Optimization in the Presence of Moving Obstacles [45.02872365395957]
We present Dynamic Potential Field (NPFieldGPT) as a learning predictive model control (MPC) framework.<n>NPField-GPT produces safer, more conservative trajectories under motion changes.<n>We also compare with the CIAO* and MPPI baselines.
arXiv Detail & Related papers (2024-10-09T12:27:09Z) - Model Checking for Closed-Loop Robot Reactive Planning [0.0]
We show how model checking can be used to create multistep plans for a differential drive wheeled robot so that it can avoid immediate danger.
Using a small, purpose built model checking algorithm in situ we generate plans in real-time in a way that reflects the egocentric reactive response of simple biological agents.
arXiv Detail & Related papers (2023-11-16T11:02:29Z) - Simultaneous Contact-Rich Grasping and Locomotion via Distributed
Optimization Enabling Free-Climbing for Multi-Limbed Robots [60.06216976204385]
We present an efficient motion planning framework for simultaneously solving locomotion, grasping, and contact problems.
We demonstrate our proposed framework in the hardware experiments, showing that the multi-limbed robot is able to realize various motions including free-climbing at a slope angle 45deg with a much shorter planning time.
arXiv Detail & Related papers (2022-07-04T13:52:10Z) - Reinforcement Learning with a Terminator [80.34572413850186]
We learn the parameters of the TerMDP and leverage the structure of the estimation problem to provide state-wise confidence bounds.
We use these to construct a provably-efficient algorithm, which accounts for termination, and bound its regret.
arXiv Detail & Related papers (2022-05-30T18:40:28Z) - Modular Deep Reinforcement Learning for Continuous Motion Planning with
Temporal Logic [59.94347858883343]
This paper investigates the motion planning of autonomous dynamical systems modeled by Markov decision processes (MDP)
The novelty is to design an embedded product MDP (EP-MDP) between the LDGBA and the MDP.
The proposed LDGBA-based reward shaping and discounting schemes for the model-free reinforcement learning (RL) only depend on the EP-MDP states.
arXiv Detail & Related papers (2021-02-24T01:11:25Z) - Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for
Online Collision Avoidance [95.86944752753564]
We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties.
Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates.
The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
arXiv Detail & Related papers (2020-07-28T07:34:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.