Robust Camera-to-Mocap Calibration and Verification for Large-Scale Multi-Camera Data Capture

• URL: http://arxiv.org/abs/2604.22118v1
• Date: Thu, 23 Apr 2026 23:37:00 GMT
• Title: Robust Camera-to-Mocap Calibration and Verification for Large-Scale Multi-Camera Data Capture
• Abstract summary: We present a calibration and verification system for fisheye cameras.<n>lollypop provides fast, operator-independent assessment through a measurement chain entirely independent of the calibration data.<n>The system has been deployed in production data collection pipelines.
• Score: 18.22576487999375
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Optical motion capture (mocap) systems are widely used for ground-truth capture in AR/VR, SLAM and robotics datasets. These datasets require extrinsic calibration to align mocap coordinates to external camera frames -- a step that is subject to multiple sources of error in practice, and failures often go undetected until they corrupt downstream data. These issues are compounded for fisheye cameras, where spatially non-uniform distortion makes both calibration and verification more challenging. We present a calibration and verification system designed for this setting. Concretely, we target robustness to board-to-marker attachment variation, optimization initialization ambiguity, and session-to-session calibration drift after deployment. The calibration jointly estimates camera extrinsics and the board-to-marker transform, and uses a staged solver to improve convergence reliability under ambiguous initialization. The verification component, \lollypop, provides fast, operator-independent assessment through a measurement chain entirely independent of the calibration data. In experiments on a Meta Quest 3 headset with fisheye cameras, our calibration outperforms existing benchwork, and lollypop reliably detects calibration degradation over time. The system has been deployed in production data collection pipelines.

Related papers

• A Height-Constrained 2-Point Minimal Solver for Pose Estimation from Active LED Markers with Event Cameras [51.7262911415172]
  We develop an event-based active marker system to collect real-world data with ground truth from a motion capture system.<n>Experiments on both synthetic and real data demonstrate improved accuracy over the state-of-the-art P2P solver.
  arXiv  Detail & Related papers  (2026-08-10T12:19:24Z)
• Observation Quality Matters: Robust Multi-Fisheye Calibration via Failure-Oriented Analysis [24.416862810556534]
  CO-Calib is a plug-in calibration-data construction framework that combines a robust learning-based target detector with an error-analysis-guided frame selector.<n>Experiments on synthetic and real multi-fisheye systems demonstrate that CO-Calib improves the overall success rate from 68.1% to 99.3%.
  arXiv  Detail & Related papers  (2026-07-07T03:07:23Z)
• DST-Calib: A Dual-Path, Self-Supervised, Target-Free LiDAR-Camera Extrinsic Calibration Network [57.22935789233992]
  This article presents the first self-supervised LiDAR-camera extrinsic calibration network that operates in an online fashion.<n>The proposed method significantly outperforms existing approaches in terms of generalizability.
  arXiv  Detail & Related papers  (2026-01-03T13:57:01Z)
• UniCal: Unified Neural Sensor Calibration [32.7372115947273]
  Self-driving vehicles (SDVs) require accurate calibration of LiDARs and cameras to fuse sensor data accurately for autonomy. Traditional calibration methods leverage fiducials captured in a controlled and structured scene and compute correspondences to optimize over. We propose UniCal, a unified framework for effortlessly calibrating SDVs equipped with multiple LiDARs and cameras.
  arXiv  Detail & Related papers  (2024-09-27T17:56:04Z)
• A re-calibration method for object detection with multi-modal alignment bias in autonomous driving [6.672552664633057]
  Multi-modal object detection in autonomous driving has achieved great breakthroughs due to the usage of fusing complementary information from different sensors.<n>The calibration in fusion between sensors such as LiDAR and camera was always supposed to be precise in previous work.<n>In reality, calibration matrices are fixed when the vehicles leave the factory, but mechanical vibration, road bumps, and data lags may cause calibration bias.
  arXiv  Detail & Related papers  (2024-05-27T05:46:37Z)
• W-HMR: Monocular Human Mesh Recovery in World Space with Weak-Supervised Calibration [57.37135310143126]
  Previous methods for 3D motion recovery from monocular images often fall short due to reliance on camera coordinates. We introduce W-HMR, a weak-supervised calibration method that predicts "reasonable" focal lengths based on body distortion information. We also present the OrientCorrect module, which corrects body orientation for plausible reconstructions in world space.
  arXiv  Detail & Related papers  (2023-11-29T09:02:07Z)
• E-Calib: A Fast, Robust and Accurate Calibration Toolbox for Event Cameras [18.54225086007182]
  We present E-Calib, a novel, fast, robust, and accurate calibration toolbox for event cameras. The proposed method is tested in a variety of rigorous experiments for different event camera models.
  arXiv  Detail & Related papers  (2023-06-15T12:16:38Z)
• Learning Adaptive Warping for Real-World Rolling Shutter Correction [52.45689075940234]
  This paper proposes the first real-world rolling shutter (RS) correction dataset, BS-RSC, and a corresponding model to correct the RS frames in a distorted video. Mobile devices in the consumer market with CMOS-based sensors for video capture often result in rolling shutter effects when relative movements occur during the video acquisition process.
  arXiv  Detail & Related papers  (2022-04-29T05:13:50Z)
• Continuous-Time Spatiotemporal Calibration of a Rolling Shutter Camera---IMU System [8.201100713224003]
  The shutter (RS) mechanism is widely used by consumer-grade cameras, which are essential parts in smartphones and autonomous vehicles. This work takes the camera-IMU system as an example and looks into the RS effect on itstemporal calibration.
  arXiv  Detail & Related papers  (2021-08-16T16:09:22Z)
• How to Calibrate Your Event Camera [58.80418612800161]
  We propose a generic event camera calibration framework using image reconstruction. We show that neural-network-based image reconstruction is well suited for the task of intrinsic and extrinsic calibration of event cameras.
  arXiv  Detail & Related papers  (2021-05-26T07:06:58Z)
• Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setups [68.8204255655161]
  We present a method to calibrate the parameters of any pair of sensors involving LiDARs, monocular or stereo cameras. The proposed approach can handle devices with very different resolutions and poses, as usually found in vehicle setups.
  arXiv  Detail & Related papers  (2021-01-12T12:02:26Z)
• Learning Camera Miscalibration Detection [83.38916296044394]
  This paper focuses on a data-driven approach to learn the detection of miscalibration in vision sensors, specifically RGB cameras. Our contributions include a proposed miscalibration metric for RGB cameras and a novel semi-synthetic dataset generation pipeline based on this metric. By training a deep convolutional neural network, we demonstrate the effectiveness of our pipeline to identify whether a recalibration of the camera's intrinsic parameters is required or not.
  arXiv  Detail & Related papers  (2020-05-24T10:32:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.