Beyond Reprojection Error: Camera Calibration with 3D Targets

• URL: http://arxiv.org/abs/2608.05066v1
• Date: Wed, 05 Aug 2026 17:12:21 GMT
• Title: Beyond Reprojection Error: Camera Calibration with 3D Targets
• Abstract summary: This work proposes a framework tailored for 3D reconstruction that is based on predicting scene rays.<n>New metrics, reconstruction and intersection error, derived from predicted scene rays are employed.<n>An icosahedral calibration target is designed to enrich calibration information for 3D reconstruction.
• Score: 2.948448698895806
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In 3D reconstruction, camera calibration is an essential element for achieving high fidelity and accuracy of the reconstructed geometry. While existing approaches rely upon 2D planar calibration, this work proposes a framework tailored for 3D reconstruction that is based on predicting scene rays, which adds flexibility to the reconstruction pipeline and enables the use of recent advances in camera models. Novel metrics, reconstruction and intersection error, derived from predicted scene rays are employed in combination with a bootstrapping procedure that statistically evaluates different calibration objects and calibration pipelines for both intrinsic and extrinsic camera parameters. The results show that the generalized distortion model more faithfully captures physical camera effects and yields an improvement in calibration accuracy. Reprojection error is shown to be a potentially misleading indicator of 3D accuracy, and the proposed ray-based metrics provide a more holistic assessment. An icosahedron calibration target is designed to enrich calibration information for 3D reconstruction together with a ring-feature-based detector. The icosahedral target yields approximately 40% lower mean intersection and more stable calibration across bootstrap trials on synthetic data, while real-data performance demands very tight fabrication tolerances.

Related papers

• EvTrajGS: Accurate and Efficient 3D Gaussian Splatting from Unposed Event Streams [108.45551580182384]
  EvTrajGS is an accurate and efficient 3D Gaussian Splatting framework for unposed event streams.<n>Our method enables reliable joint pose-scene optimization from coarse pose priors, eliminating the need for computationally expensive SLAM-style pipelines.
  arXiv  Detail & Related papers  (2026-08-09T09:00:30Z)
• Implicit Multi-Camera System Calibration Using Gaussian Processes [0.0]
  This paper proposes a novel framework for implicit multi-camera system calibration utilizing Gaussian Process (GP) regression.<n>Our GP-based model directly learns the complex, non-linear mapping from 2D image coordinates across all cameras to a 3D world coordinate.<n>Our experiments show that the uncertainty for the 3D predictions is higher closer to the cameras.
  arXiv  Detail & Related papers  (2026-05-08T09:29:58Z)
• Marker-Based Extrinsic Calibration Method for Accurate Multi-Camera 3D Reconstruction [0.23749905164931198]
  In this paper, we introduce an iterative extrinsic calibration method that leverages the geometric constraints provided by a three-dimensional marker.<n>We validate our method comprehensively in both controlled environments and practical real-world settings within the Tech4Diet project.<n> Experimental results demonstrate substantial reductions in alignment errors, facilitating accurate and reliable 3D reconstructions.
  arXiv  Detail & Related papers  (2025-05-05T10:21:41Z)
• AlignDiff: Learning Physically-Grounded Camera Alignment via Diffusion [0.5277756703318045]
  We introduce a novel framework that addresses camera intrinsic and extrinsic parameters using a generic ray camera model.<n>Unlike previous approaches, AlignDiff shifts focus from semantic to geometric features, enabling more accurate modeling of local distortions.<n>Our experiments demonstrate that the proposed method significantly reduces the angular error of estimated ray bundles by 8.2 degrees and overall calibration accuracy, outperforming existing approaches on challenging, real-world datasets.
  arXiv  Detail & Related papers  (2025-03-27T14:59:59Z)
• PF3plat: Pose-Free Feed-Forward 3D Gaussian Splatting [54.7468067660037]
  PF3plat sets a new state-of-the-art across all benchmarks, supported by comprehensive ablation studies validating our design choices.<n>Our framework capitalizes on fast speed, scalability, and high-quality 3D reconstruction and view synthesis capabilities of 3DGS.
  arXiv  Detail & Related papers  (2024-10-29T15:28:15Z)
• Visual SLAM with 3D Gaussian Primitives and Depth Priors Enabling Novel View Synthesis [11.236094544193605]
  Conventional geometry-based SLAM systems lack dense 3D reconstruction capabilities. We propose a real-time RGB-D SLAM system that incorporates a novel view synthesis technique, 3D Gaussian Splatting.
  arXiv  Detail & Related papers  (2024-08-10T21:23:08Z)
• Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding [55.32861154245772]
  Calib3D is a pioneering effort to benchmark and scrutinize the reliability of 3D scene understanding models.<n>We comprehensively evaluate 28 state-of-the-art models across 10 diverse 3D datasets.<n>We introduce DeptS, a novel depth-aware scaling approach aimed at enhancing 3D model calibration.
  arXiv  Detail & Related papers  (2024-03-25T17:59:59Z)
• Neural Lens Modeling [50.57409162437732]
  NeuroLens is a neural lens model for distortion and vignetting that can be used for point projection and ray casting. It can be used to perform pre-capture calibration using classical calibration targets, and can later be used to perform calibration or refinement during 3D reconstruction. The model generalizes across many lens types and is trivial to integrate into existing 3D reconstruction and rendering systems.
  arXiv  Detail & Related papers  (2023-04-10T20:09:17Z)
• Uncertainty-Aware Camera Pose Estimation from Points and Lines [101.03675842534415]
  Perspective-n-Point-and-Line (Pn$PL) aims at fast, accurate and robust camera localizations with respect to a 3D model from 2D-3D feature coordinates.
  arXiv  Detail & Related papers  (2021-07-08T15:19:36Z)
• How to Calibrate Your Event Camera [58.80418612800161]
  We propose a generic event camera calibration framework using image reconstruction. We show that neural-network-based image reconstruction is well suited for the task of intrinsic and extrinsic calibration of event cameras.
  arXiv  Detail & Related papers  (2021-05-26T07:06:58Z)
• Stereo camera system calibration: the need of two sets of parameters [0.0]
  The reconstruction of a scene via a stereo-camera system is a two-steps process. At first images from different cameras are matched to identify the set of point-to-point correspondences that then will actually be reconstructed in the real world. We propose to calibrate the system twice to estimate two different sets of parameters.
  arXiv  Detail & Related papers  (2021-01-14T17:03:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.