Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimation

• URL: http://arxiv.org/abs/2309.07654v1
• Date: Thu, 14 Sep 2023 12:17:38 GMT
• Title: Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimation
• Authors: Thorsten Hempel and Ahmed A. Abdelrahman and Ayoub Al-Hamadi
• Abstract summary: We present a novel method for unconstrained end-to-end head pose estimation. We propose a continuous 6D rotation matrix representation for efficient and robust direct regression. Our method significantly outperforms other state-of-the-art methods in an efficient and robust manner.
• Score: 2.915868985330569
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Estimating the head pose of a person is a crucial problem for numerous applications that is yet mainly addressed as a subtask of frontal pose prediction. We present a novel method for unconstrained end-to-end head pose estimation to tackle the challenging task of full range of orientation head pose prediction. We address the issue of ambiguous rotation labels by introducing the rotation matrix formalism for our ground truth data and propose a continuous 6D rotation matrix representation for efficient and robust direct regression. This allows to efficiently learn full rotation appearance and to overcome the limitations of the current state-of-the-art. Together with new accumulated training data that provides full head pose rotation data and a geodesic loss approach for stable learning, we design an advanced model that is able to predict an extended range of head orientations. An extensive evaluation on public datasets demonstrates that our method significantly outperforms other state-of-the-art methods in an efficient and robust manner, while its advanced prediction range allows the expansion of the application area. We open-source our training and testing code along with our trained models: https://github.com/thohemp/6DRepNet360.

Related papers

• Semi-Supervised Unconstrained Head Pose Estimation in the Wild [60.08319512840091]
  We propose the first semi-supervised unconstrained head pose estimation method SemiUHPE. Our method is based on the observation that the aspect-ratio invariant cropping of wild heads is superior to the previous landmark-based affine alignment. Experiments and ablation studies show that SemiUHPE outperforms existing methods greatly on public benchmarks.
  arXiv  Detail & Related papers  (2024-04-03T08:01:00Z)
• Prior-guided Source-free Domain Adaptation for Human Pose Estimation [24.50953879583841]
  Domain adaptation methods for 2D human pose estimation typically require continuous access to the source data. We present Prior-guided Self-training (POST), a pseudo-labeling approach that builds on the popular Mean Teacher framework.
  arXiv  Detail & Related papers  (2023-08-26T20:30:04Z)
• Self-Distillation for Further Pre-training of Transformers [83.84227016847096]
  We propose self-distillation as a regularization for a further pre-training stage. We empirically validate the efficacy of self-distillation on a variety of benchmark datasets for image and text classification tasks.
  arXiv  Detail & Related papers  (2022-09-30T02:25:12Z)
• Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimation [88.8963330073454]
  We propose a novel monocular 6D pose estimation approach by means of self-supervised learning. We leverage current trends in noisy student training and differentiable rendering to further self-supervise the model. Our proposed self-supervision outperforms all other methods relying on synthetic data.
  arXiv  Detail & Related papers  (2022-03-19T15:12:06Z)
• 6D Rotation Representation For Unconstrained Head Pose Estimation [2.1485350418225244]
  We address the problem of ambiguous rotation labels by introducing the rotation matrix formalism for our ground truth data. This way, our method can learn the full rotation appearance which is contrary to previous approaches that restrict the pose prediction to a narrow-angle. Experiments on the public AFLW2000 and BIWI datasets demonstrate that our proposed method significantly outperforms other state-of-the-art methods by up to 20%.
  arXiv  Detail & Related papers  (2022-02-25T08:41:13Z)
• Learning Oriented Remote Sensing Object Detection via Naive Geometric Computing [38.508709334835316]
  We propose a mechanism that learns the regression of horizontal proposals, oriented proposals, and rotation angles of objects in a consistent manner. Our proposed idea is simple and intuitive that can be readily implemented.
  arXiv  Detail & Related papers  (2021-12-01T13:58:42Z)
• Pose Guided Person Image Generation with Hidden p-Norm Regression [113.41144529452663]
  We propose a novel approach to solve the pose guided person image generation task. Our method estimates a pose-invariant feature matrix for each identity, and uses it to predict the target appearance conditioned on the target pose. Our method yields competitive performance in all the aforementioned variant scenarios.
  arXiv  Detail & Related papers  (2021-02-19T17:03:54Z)
• Spatial Attention Improves Iterative 6D Object Pose Estimation [52.365075652976735]
  We propose a new method for 6D pose estimation refinement from RGB images. Our main insight is that after the initial pose estimate, it is important to pay attention to distinct spatial features of the object. We experimentally show that this approach learns to attend to salient spatial features and learns to ignore occluded parts of the object, leading to better pose estimation across datasets.
  arXiv  Detail & Related papers  (2021-01-05T17:18:52Z)
• REDE: End-to-end Object 6D Pose Robust Estimation Using Differentiable Outliers Elimination [15.736699709454857]
  We propose REDE, a novel end-to-end object pose estimator using RGB-D data. We also propose a differentiable outliers elimination method that regresses the candidate result and the confidence simultaneously. The experimental results on three benchmark datasets show that REDE slightly outperforms the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-10-24T06:45:39Z)
• WHENet: Real-time Fine-Grained Estimation for Wide Range Head Pose [1.8275108630751844]
  We present an end-to-end head-pose estimation network designed to predict Euler angles through the full range head yaws from a single RGB image. Our network builds on multi-loss approaches with changes to loss functions and training strategies adapted to wide range estimation.
  arXiv  Detail & Related papers  (2020-05-20T20:53:01Z)
• Self6D: Self-Supervised Monocular 6D Object Pose Estimation [114.18496727590481]
  We propose the idea of monocular 6D pose estimation by means of self-supervised learning. We leverage recent advances in neural rendering to further self-supervise the model on unannotated real RGB-D data.
  arXiv  Detail & Related papers  (2020-04-14T13:16:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.