MorFiC: Fixing Value Miscalibration for Zero-Shot Quadruped Transfer

• URL: http://arxiv.org/abs/2603.14554v1
• Date: Sun, 15 Mar 2026 19:03:34 GMT
• Title: MorFiC: Fixing Value Miscalibration for Zero-Shot Quadruped Transfer
• Abstract summary: Generalizing learned locomotion policies across quadrupedal robots with different morphologies remains a challenge.<n>We present MorFiC, a reinforcement learning approach for zero-shot cross-morphology locomotion using a single shared policy.<n>We show that MorFiC reduces the value-prediction error variance across morphologies and stabilizes the advantage estimates.
• Score: 50.54752207285298
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generalizing learned locomotion policies across quadrupedal robots with different morphologies remain a challenge. Policies trained on a single robot often break when deployed on embodiments with different mass distributions, kinematics, joint limits, or actuation constraints, forcing per robot retraining. We present MorFiC, a reinforcement learning approach for zero-shot cross-morphology locomotion using a single shared policy. MorFiC resolves a key failure mode in multi-morphology actor-critic training: a shared critic tends to average incompatible value targets across embodiments, yielding miscalibrated advantages. To address this, MorFiC conditions the critic via morphology-aware modulation driven by robot physical and control parameters, generating morphology-specific value estimates within a shared network. Trained with a single source robot with morphology randomization in simulation, MorFiC can transfer to unseen robots and surpasses morphology-conditioned PPO baselines by improving stable average speed and longest stable run on multiple targets, including speed gains of +16.1% on A1, ~2x on Cheetah, and ~5x on B1. We additionally show that MorFiC reduces the value-prediction error variance across morphologies and stabilizes the advantage estimates, demonstrating that the improved value-function calibration corresponds to a stronger transfer performance. Finally, we demonstrate zero-shot deployment on two Unitree Go1 and Go2 robots without fine-tuning, indicating that critic-side conditioning is a practical approach for cross-morphology generalization.

Related papers

• Rapid Embodiment Adaptation for Quadrupedal Locomotion [34.58092949618632]
  Humans readily adapt their movements as their bodies change through aging, injury, or load carrying, but learning-based robot policies often break when hardware properties shift.<n>We introduce an online embodiment adaptation framework for quadrupedal locomotion that infers embodiment parameters from short interaction histories.<n>Our method pairs a generalist policy trained under embodiment randomization with a lightweight adaptation module that identifies physical changes within half a second.
  arXiv  Detail & Related papers  (2026-08-02T21:31:49Z)
• Toward Hardware-Agnostic Quadrupedal World Models via Morphology Conditioning [29.296527466383242]
  We take a step towards a framework for training a generalizable Quadrupedal World Model.<n>We explicitly condition the generative dynamics on the robot's engineering specifications.<n>We introduce, for the first time, a world model that enables zero-shot generalization to new morphologies for locomotion.
  arXiv  Detail & Related papers  (2026-04-09T21:31:24Z)
• MOTIF: Learning Action Motifs for Few-shot Cross-Embodiment Transfer [55.982504915794514]
  Cross-embodiment policies typically rely on shared-private architectures.<n>We introduce MOTIF for efficient few-shot cross-embodiment transfer.<n>We show that MOTIF significantly outperforms strong baselines in few-shot transfer scenarios.
  arXiv  Detail & Related papers  (2026-02-14T13:21:40Z)
• AdaMorph: Unified Motion Retargeting via Embodiment-Aware Adaptive Transformers [49.796014934503184]
  We present a unified neural framework that enables a single model to adapt human motion to diverse robot morphologies.<n> Experimental results on 12 distinct humanoid robots demonstrate that AdaMorph effectively control across heterogeneous topologies.
  arXiv  Detail & Related papers  (2026-01-12T07:39:38Z)
• InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulation [77.07565723756119]
  We present InternVLA-A1, a vision-language-action model with dynamic predictive capabilities.<n>We pre-train these models on heterogeneous data sources over real-world robot data, synthetic simulation data, and human videos.<n>We evaluate InternVLA-A1 on 12 real-world robotic tasks and a simulation benchmark.
  arXiv  Detail & Related papers  (2026-01-05T18:54:29Z)
• The One RING: a Robotic Indoor Navigation Generalist [58.30694487843546]
  RING (Robotic Indoor Navigation Generalist) is an embodiment-agnostic policy that turns any mobile robot into an effective indoor semantic navigator.<n>Trained entirely in simulation, RING leverages large-scale randomization over robot embodiments to enable robust generalization to many real-world platforms.
  arXiv  Detail & Related papers  (2024-12-18T23:15:41Z)
• HeteroMorpheus: Universal Control Based on Morphological Heterogeneity Modeling [12.771577344846282]
  HeteroMorpheus is a novel method based on heterogeneous graph Transformer. We demonstrate the superiority of HeteroMorpheus against state-of-the-art methods in the capability of policy generalization.
  arXiv  Detail & Related papers  (2024-08-02T12:40:01Z)
• Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Response [25.52492911765911]
  We introduce Hybrid Internal Model to estimate external states according to the response of the robot. The response, which we refer to as the hybrid internal embedding, contains the robot's explicit velocity and implicit stability representation. A wealth of real-world experiments demonstrates its agility, even in high-difficulty tasks and cases never occurred during the training process.
  arXiv  Detail & Related papers  (2023-12-18T18:59:06Z)
• ManyQuadrupeds: Learning a Single Locomotion Policy for Diverse Quadruped Robots [4.557963624437784]
  We show that drawing inspiration from animal motor control allows us to effectively train a single locomotion policy for quadruped robots. Our policy modulates a representation of the Central Pattern Generator (CPG) in the spinal cord. We observe robust performance, even when adding a 15 kg load, equivalent to 125% of the A1 robot's nominal mass.
  arXiv  Detail & Related papers  (2023-10-16T15:06:16Z)
• Combining model-predictive control and predictive reinforcement learning for stable quadrupedal robot locomotion [0.0]
  We study how this can be achieved by a combination of model-predictive and predictive reinforcement learning controllers. In this work, we combine both control methods to address the quadrupedal robot stable gate generation problem.
  arXiv  Detail & Related papers  (2023-07-15T09:22:37Z)
• Universal Morphology Control via Contextual Modulation [52.742056836818136]
  Learning a universal policy across different robot morphologies can significantly improve learning efficiency and generalization in continuous control. Existing methods utilize graph neural networks or transformers to handle heterogeneous state and action spaces across different morphologies. We propose a hierarchical architecture to better model this dependency via contextual modulation.
  arXiv  Detail & Related papers  (2023-02-22T00:04:12Z)
• Domain Adaptive Robotic Gesture Recognition with Unsupervised Kinematic-Visual Data Alignment [60.31418655784291]
  We propose a novel unsupervised domain adaptation framework which can simultaneously transfer multi-modality knowledge, i.e., both kinematic and visual data, from simulator to real robot. It remedies the domain gap with enhanced transferable features by using temporal cues in videos, and inherent correlations in multi-modal towards recognizing gesture. Results show that our approach recovers the performance with great improvement gains, up to 12.91% in ACC and 20.16% in F1score without using any annotations in real robot.
  arXiv  Detail & Related papers  (2021-03-06T09:10:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.