Towards Safe Maneuvering of Double-Ackermann-Steering Robots with a Soft Actor-Critic Framework

• URL: http://arxiv.org/abs/2510.10332v2
• Date: Tue, 14 Oct 2025 07:59:35 GMT
• Title: Towards Safe Maneuvering of Double-Ackermann-Steering Robots with a Soft Actor-Critic Framework
• Abstract summary: We present a reinforcement learning framework for safe and precise maneuvering of double-Ackermann-steering mobile robots (DASMRs)<n>Our framework leverages the Hindsight Experience Replay (HER) and the CrossQ overlay to encourage maneuvering efficiency while avoiding obstacles.<n> Simulation results with a heavy four-wheel-steering rover show that the learned policy can robustly reach up to 97% of target positions while avoiding obstacles.
• Score: 0.7322887425853787
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a deep reinforcement learning framework based on Soft Actor-Critic (SAC) for safe and precise maneuvering of double-Ackermann-steering mobile robots (DASMRs). Unlike holonomic or simpler non-holonomic robots such as differential-drive robots, DASMRs face strong kinematic constraints that make classical planners brittle in cluttered environments. Our framework leverages the Hindsight Experience Replay (HER) and the CrossQ overlay to encourage maneuvering efficiency while avoiding obstacles. Simulation results with a heavy four-wheel-steering rover show that the learned policy can robustly reach up to 97% of target positions while avoiding obstacles. Our framework does not rely on handcrafted trajectories or expert demonstrations.

Related papers

• Learning Fault-Tolerant Locomotion with Adaptive Gait Timing [1.1156827035309405]
  Hardware failures require legged robots to reorganize coordination and gait timing to maintain stability and mobility.<n>We propose a deep reinforcement learning approach for fault-tolerant locomotion under actuator power loss.<n>The approach is validated in high-fidelity simulation on uneven terrain and real-world experiments on flat ground using a 68 kg quadruped robot.
  arXiv  Detail & Related papers  (2026-08-07T15:27:03Z)
• Unleashing the Agility of Wheeled-Legged Robots for High-Dynamic Reflexive Obstacle Evasion [2.3784505606578916]
  AWARE is a hierarchical reinforcement learning framework for high-dynamic obstacle avoidance in wheeled-legged robots.<n>We show that AWARE achieves robust and agile obstacle avoidance while revealing behaviorally distinct evasive strategies.
  arXiv  Detail & Related papers  (2026-04-26T15:21:33Z)
• RPG: Robust Policy Gating for Smooth Multi-Skill Transitions in Humanoid Fighting [52.18271301977709]
  We propose RPG, a hybrid expert policy framework, for smooth and stable humanoid multi-skills transition.<n>Our approach incorporates motion transition randomization and temporal randomization to train a unified policy that generates agile fighting actions.<n>We design a control pipeline that integrates walking/running locomotion with fighting skills, allowing humanlike long-time combat of arbitrary duration.
  arXiv  Detail & Related papers  (2026-04-23T07:14:35Z)
• Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching [77.28042137892943]
  We present Perceptive Humanoid Parkour (PHP), a modular framework that enables humanoid robots to autonomously perform long-horizon, vision-based parkour.<n>We train motion-tracking reinforcement learning expert policies for these composed motions, and distill them into a single depth-based, multi-skill student policy.<n>We validate our framework with extensive real-world experiments on a Unitree G1 humanoid robot.
  arXiv  Detail & Related papers  (2026-02-17T18:59:11Z)
• Bipedalism for Quadrupedal Robots: Versatile Loco-Manipulation through Risk-Adaptive Reinforcement Learning [21.938067330028066]
  We introduce bipedalism for quadrupedal robots, freeing the front legs for versatile interactions with the environment.<n>We propose a risk-adaptive distributional Reinforcement Learning framework designed for quadrupedal robots walking on their hind legs.
  arXiv  Detail & Related papers  (2025-07-27T18:51:34Z)
• Spatial-Temporal Graph Diffusion Policy with Kinematic Modeling for Bimanual Robotic Manipulation [88.83749146867665]
  Existing approaches learn a policy to predict a distant next-best end-effector pose.<n>They then compute the corresponding joint rotation angles for motion using inverse kinematics.<n>We propose Kinematics enhanced Spatial-TemporAl gRaph diffuser.
  arXiv  Detail & Related papers  (2025-03-13T17:48:35Z)
• Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning [54.26816599309778]
  We propose a novel whole-body locomotion algorithm based on dynamic balance and Reinforcement Learning (RL)<n> Specifically, we introduce a dynamic balance mechanism by leveraging an extended measure of Zero-Moment Point (ZMP)-driven rewards and task-driven rewards in a whole-body actor-critic framework.<n> Experiments conducted on a full-sized Unitree H1-2 robot verify the ability of our method to maintain balance on extremely narrow terrains.
  arXiv  Detail & Related papers  (2025-02-24T14:53:45Z)
• Robot Navigation with Entity-Based Collision Avoidance using Deep Reinforcement Learning [0.0]
  We present a novel deep reinforcement learning approach that improves robot navigation and interaction with different types of agents and obstacles.<n>Our approach uses information about the entity types, improving collision avoidance and ensuring safer navigation.<n>We introduce a new reward function that penalizes the robot for being close to or colliding with different entities.
  arXiv  Detail & Related papers  (2024-08-26T11:16:03Z)
• Kinematically Constrained Human-like Bimanual Robot-to-Human Handovers [19.052211315080044]
  Bimanual handovers are crucial for transferring large, deformable or delicate objects. This paper proposes a framework for generating kinematically constrained human-like bimanual robot motions.
  arXiv  Detail & Related papers  (2024-02-22T13:19:02Z)
• VAE-Loco: Versatile Quadruped Locomotion by Learning a Disentangled Gait Representation [78.92147339883137]
  We show that it is pivotal in increasing controller robustness by learning a latent space capturing the key stance phases constituting a particular gait. We demonstrate that specific properties of the drive signal map directly to gait parameters such as cadence, footstep height and full stance duration. The use of a generative model facilitates the detection and mitigation of disturbances to provide a versatile and robust planning framework.
  arXiv  Detail & Related papers  (2022-05-02T19:49:53Z)
• Next Steps: Learning a Disentangled Gait Representation for Versatile Quadruped Locomotion [69.87112582900363]
  Current planners are unable to vary key gait parameters continuously while the robot is in motion. In this work we address this limitation by learning a latent space capturing the key stance phases constituting a particular gait. We demonstrate that specific properties of the drive signal map directly to gait parameters such as cadence, foot step height and full stance duration.
  arXiv  Detail & Related papers  (2021-12-09T10:02:02Z)
• Reinforcement Learning with Adaptive Curriculum Dynamics Randomization for Fault-Tolerant Robot Control [4.9631159466100305]
  The ACDR algorithm can adaptively train a quadruped robot in random actuator failure conditions. The ACDR algorithm can be used to build a robot system that does not require additional modules for detecting actuator failures.
  arXiv  Detail & Related papers  (2021-11-19T01:55:57Z)
• Learning Agile Locomotion via Adversarial Training [59.03007947334165]
  In this paper, we present a multi-agent learning system, in which a quadruped robot (protagonist) learns to chase another robot (adversary) while the latter learns to escape. We find that this adversarial training process not only encourages agile behaviors but also effectively alleviates the laborious environment design effort. In contrast to prior works that used only one adversary, we find that training an ensemble of adversaries, each of which specializes in a different escaping strategy, is essential for the protagonist to master agility.
  arXiv  Detail & Related papers  (2020-08-03T01:20:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.