ER-Pose: Rethinking Keypoint-Driven Representation Learning for Real-Time Human Pose Estimation

• URL: http://arxiv.org/abs/2603.08681v1
• Date: Mon, 09 Mar 2026 17:49:46 GMT
• Title: ER-Pose: Rethinking Keypoint-Driven Representation Learning for Real-Time Human Pose Estimation
• Abstract summary: Single-stage multi-person pose estimation aims to jointly perform human localization and keypoint prediction.<n>Box-driven single-stage pose estimation is implicitly constrained by bounding-box supervision during training.<n>We propose a keypoint-driven learning paradigm that elevates pose estimation to a primary prediction objective.<n>On MS COCO and CrowdPose, ER-Pose-n achieves AP improvements of 3.2/6.7 without pre-training and 7.4/4.9 with pre-training respectively.
• Score: 2.2248409468073143
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Single-stage multi-person pose estimation aims to jointly perform human localization and keypoint prediction within a unified framework, offering advantages in inference efficiency and architectural simplicity. Consequently, multi-scale real-time detection architectures, such as YOLO-like models, are widely adopted for real-time pose estimation. However, these approaches typically inherit a box-driven modeling paradigm from object detection, in which pose estimation is implicitly constrained by bounding-box supervision during training. This formulation introduces biases in sample assignment and feature representation, resulting in task misalignment and ultimately limiting pose estimation accuracy. In this work, we revisit box-driven single-stage pose estimation from a keypoint-driven perspective and identify semantic conflicts among parallel objectives as a key source of performance degradation. To address this issue, we propose a keypoint-driven learning paradigm that elevates pose estimation to a primary prediction objective. Specifically, we remove bounding-box prediction and redesign the prediction head to better accommodate the high-dimensional structured representations for pose estimation. We further introduce a keypoint-driven dynamic sample assignment strategy to align training objectives with pose evaluation metrics, enabling dense supervision during training and efficient NMS-free inference. In addition, we propose a smooth OKS-based loss function to stabilize optimization in regression-based pose estimation. Based on these designs, we develop a single-stage multi-person pose estimation framework, termed ER-Pose. On MS COCO and CrowdPose, ER-Pose-n achieves AP improvements of 3.2/6.7 without pre-training and 7.4/4.9 with pre-training respectively compared with the baseline YOLO-Pose. These improvements are achieved with fewer parameters and higher inference efficiency.

Related papers

• Temporally Consistent Object 6D Pose Estimation for Robot Control [16.973122634563314]
  We develop a factor graph approach to enforce temporal consistency of the object pose estimates.<n>We experimentally validate the stability of the proposed approach for a feedback-based robot control task.
  arXiv  Detail & Related papers  (2026-05-04T15:15:09Z)
• RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimation [8.3336796041978]
  We propose a new framework, RFM-Pose, that accelerates category-level 6D object pose generation while actively evaluating sampled hypotheses.<n> Experiments on the REAL275 benchmark demonstrate that RFM-Pose achieves favorable performance while significantly reducing computational cost.
  arXiv  Detail & Related papers  (2026-02-05T03:26:15Z)
• WALDO: Where Unseen Model-based 6D Pose Estimation Meets Occlusion [13.760323763554448]
  We propose four novel extensions to model-based 6D pose estimation methods.<n>We show that our proposed approach achieves more than 5% improvement in accuracy on ICBIN and more than 2% on BOP dataset benchmarks.
  arXiv  Detail & Related papers  (2025-11-19T21:01:49Z)
• Scriboora: Rethinking Human Pose Forecasting [44.79834103607383]
  This paper evaluates a wide range of pose forecasting algorithms in the task of absolute pose forecasting.<n>Recent speech models can be efficiently adapted to the task of pose forecasting, and improve current state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-11-19T15:58:33Z)
• UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image [86.7128543480229]
  Unseen object pose estimation methods often rely on CAD models or multiple reference views.<n>To simplify reference acquisition, we aim to estimate the unseen object's pose through a single unposed RGB-D reference image.<n>We present a novel approach and benchmark, termed UNOPose, for unseen one-reference-based object pose estimation.
  arXiv  Detail & Related papers  (2024-11-25T05:36:00Z)
• Manifold-Aware Self-Training for Unsupervised Domain Adaptation on Regressing 6D Object Pose [69.14556386954325]
  Domain gap between synthetic and real data in visual regression is bridged in this paper via global feature alignment and local refinement. Our method incorporates an explicit self-supervised manifold regularization, revealing consistent cumulative target dependency across domains. Learning unified implicit neural functions to estimate relative direction and distance of targets to their nearest class bins aims to refine target classification predictions.
  arXiv  Detail & Related papers  (2023-05-18T08:42:41Z)
• Self-Constrained Inference Optimization on Structural Groups for Human Pose Estimation [19.630070553319506]
  Group-wise structural correlation can be explored to improve the accuracy and robustness of human pose estimation. We develop a self-constrained prediction-verification network to characterize and learn the structural correlation between keypoints during training. During the inference stage, the feedback information from the verification network allows us to perform further optimization of pose prediction.
  arXiv  Detail & Related papers  (2022-07-06T03:53:02Z)
• Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimation [70.32536356351706]
  We introduce MRP-Net that constitutes a common deep network backbone with two output heads subscribing to two diverse configurations. We derive suitable measures to quantify prediction uncertainty at both pose and joint level. We present a comprehensive evaluation of the proposed approach and demonstrate state-of-the-art performance on benchmark datasets.
  arXiv  Detail & Related papers  (2022-03-29T07:14:58Z)
• Dynamic Iterative Refinement for Efficient 3D Hand Pose Estimation [87.54604263202941]
  We propose a tiny deep neural network of which partial layers are iteratively exploited for refining its previous estimations. We employ learned gating criteria to decide whether to exit from the weight-sharing loop, allowing per-sample adaptation in our model. Our method consistently outperforms state-of-the-art 2D/3D hand pose estimation approaches in terms of both accuracy and efficiency for widely used benchmarks.
  arXiv  Detail & Related papers  (2021-11-11T23:31:34Z)
• TFPose: Direct Human Pose Estimation with Transformers [83.03424247905869]
  We formulate the pose estimation task into a sequence prediction problem that can effectively be solved by transformers. Our framework is simple and direct, bypassing the drawbacks of the heatmap-based pose estimation. Experiments on the MS-COCO and MPII datasets demonstrate that our method can significantly improve the state-of-the-art of regression-based pose estimation.
  arXiv  Detail & Related papers  (2021-03-29T04:18:54Z)
• Kinematic-Structure-Preserved Representation for Unsupervised 3D Human Pose Estimation [58.72192168935338]
  Generalizability of human pose estimation models developed using supervision on large-scale in-studio datasets remains questionable. We propose a novel kinematic-structure-preserved unsupervised 3D pose estimation framework, which is not restrained by any paired or unpaired weak supervisions. Our proposed model employs three consecutive differentiable transformations named as forward-kinematics, camera-projection and spatial-map transformation.
  arXiv  Detail & Related papers  (2020-06-24T23:56:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.