Pose-Robust Calibration Strategy for Point-of-Gaze Estimation on Mobile Phones

• URL: http://arxiv.org/abs/2508.10268v1
• Date: Thu, 14 Aug 2025 01:28:30 GMT
• Title: Pose-Robust Calibration Strategy for Point-of-Gaze Estimation on Mobile Phones
• Authors: Yujie Zhao, Jiabei Zeng, Shiguang Shan,
• Abstract summary: We analyze how the diversity of calibration points and head poses influences estimation accuracy.<n>Experiments show that introducing a wider range of head poses during calibration improves the estimator's ability to handle pose variation.<n>We propose a dynamic calibration strategy in which users fixate on calibration points while moving their phones.
• Score: 52.87468614536999
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although appearance-based point-of-gaze (PoG) estimation has improved, the estimators still struggle to generalize across individuals due to personal differences. Therefore, person-specific calibration is required for accurate PoG estimation. However, calibrated PoG estimators are often sensitive to head pose variations. To address this, we investigate the key factors influencing calibrated estimators and explore pose-robust calibration strategies. Specifically, we first construct a benchmark, MobilePoG, which includes facial images from 32 individuals focusing on designated points under either fixed or continuously changing head poses. Using this benchmark, we systematically analyze how the diversity of calibration points and head poses influences estimation accuracy. Our experiments show that introducing a wider range of head poses during calibration improves the estimator's ability to handle pose variation. Building on this insight, we propose a dynamic calibration strategy in which users fixate on calibration points while moving their phones. This strategy naturally introduces head pose variation during a user-friendly and efficient calibration process, ultimately producing a better calibrated PoG estimator that is less sensitive to head pose variations than those using conventional calibration strategies. Codes and datasets are available at our project page.

Related papers

• Scalable Utility-Aware Multiclass Calibration [53.28176049547449]
  Utility calibration is a general framework that measures the calibration error relative to a specific utility function.<n>We demonstrate how this framework can unify and re-interpret several existing calibration metrics.
  arXiv  Detail & Related papers  (2025-10-29T12:32:14Z)
• Understanding Model Calibration -- A gentle introduction and visual exploration of calibration and the expected calibration error (ECE) [0.0]
  In this blogpost we'll take a look at the most commonly used definition for calibration.<n>We'll then cover some of the drawbacks of this measure and how these surfaced the need for additional notions of calibration.
  arXiv  Detail & Related papers  (2025-01-31T11:18:45Z)
• UniCal: Unified Neural Sensor Calibration [32.7372115947273]
  Self-driving vehicles (SDVs) require accurate calibration of LiDARs and cameras to fuse sensor data accurately for autonomy. Traditional calibration methods leverage fiducials captured in a controlled and structured scene and compute correspondences to optimize over. We propose UniCal, a unified framework for effortlessly calibrating SDVs equipped with multiple LiDARs and cameras.
  arXiv  Detail & Related papers  (2024-09-27T17:56:04Z)
• Kalib: Easy Hand-Eye Calibration with Reference Point Tracking [52.4190876409222]
  Kalib is an automatic hand-eye calibration method that leverages the generalizability of visual foundation models to overcome challenges.<n>During calibration, a kinematic reference point is tracked in the camera coordinate 3D coordinates in the space behind the robot.<n>Kalib's user-friendly design and minimal setup requirements make it a possible solution for continuous operation in unstructured environments.
  arXiv  Detail & Related papers  (2024-08-20T06:03:40Z)
• Calibration by Distribution Matching: Trainable Kernel Calibration Metrics [56.629245030893685]
  We introduce kernel-based calibration metrics that unify and generalize popular forms of calibration for both classification and regression. These metrics admit differentiable sample estimates, making it easy to incorporate a calibration objective into empirical risk minimization. We provide intuitive mechanisms to tailor calibration metrics to a decision task, and enforce accurate loss estimation and no regret decisions.
  arXiv  Detail & Related papers  (2023-10-31T06:19:40Z)
• EasyHeC: Accurate and Automatic Hand-eye Calibration via Differentiable Rendering and Space Exploration [49.90228618894857]
  We introduce a new approach to hand-eye calibration called EasyHeC, which is markerless, white-box, and delivers superior accuracy and robustness. We propose to use two key technologies: differentiable rendering-based camera pose optimization and consistency-based joint space exploration. Our evaluation demonstrates superior performance in synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2023-05-02T03:49:54Z)
• On Calibrating Semantic Segmentation Models: Analyses and An Algorithm [51.85289816613351]
  We study the problem of semantic segmentation calibration. Model capacity, crop size, multi-scale testing, and prediction correctness have impact on calibration. We propose a simple, unifying, and effective approach, namely selective scaling.
  arXiv  Detail & Related papers  (2022-12-22T22:05:16Z)
• A Closer Look at the Calibration of Differentially Private Learners [33.715727551832785]
  We study the calibration of classifiers trained with differentially private descent gradient (DP-SGD) Our analysis identifies per-example gradient clipping in DP-SGD as a major cause of miscalibration. We show that differentially private variants of post-processing calibration methods such as temperature scaling and Platt scaling are surprisingly effective.
  arXiv  Detail & Related papers  (2022-10-15T10:16:18Z)
• Online Marker-free Extrinsic Camera Calibration using Person Keypoint Detections [25.393382192511716]
  We propose a marker-free online method for the extrinsic calibration of multiple smart edge sensors. Our method assumes the intrinsic camera parameters to be known and requires priming with a rough initial estimate of the camera poses. We show that the calibration with our method achieves lower reprojection errors compared to a reference calibration generated by an offline method.
  arXiv  Detail & Related papers  (2022-09-15T15:54:21Z)
• Localized Calibration: Metrics and Recalibration [133.07044916594361]
  We propose a fine-grained calibration metric that spans the gap between fully global and fully individualized calibration. We then introduce a localized recalibration method, LoRe, that improves the LCE better than existing recalibration methods.
  arXiv  Detail & Related papers  (2021-02-22T07:22:12Z)
• Camera Calibration with Pose Guidance [1.0152838128195465]
  Camera calibration plays a critical role in various computer vision tasks such as autonomous driving or augmented reality. We propose a calibration system called with Pose Guidance to improve calibration accuracy, reduce calibration variance among different users or different trials of the same person.
  arXiv  Detail & Related papers  (2021-02-19T23:23:54Z)
• Bottom-Up Human Pose Estimation by Ranking Heatmap-Guided Adaptive Keypoint Estimates [76.51095823248104]
  We present several schemes that are rarely or unthoroughly studied before for improving keypoint detection and grouping (keypoint regression) performance. First, we exploit the keypoint heatmaps for pixel-wise keypoint regression instead of separating them for improving keypoint regression. Second, we adopt a pixel-wise spatial transformer network to learn adaptive representations for handling the scale and orientation variance. Third, we present a joint shape and heatvalue scoring scheme to promote the estimated poses that are more likely to be true poses.
  arXiv  Detail & Related papers  (2020-06-28T01:14:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.