PnLCalib: Sports Field Registration via Points and Lines Optimization

• URL: http://arxiv.org/abs/2404.08401v4
• Date: Thu, 24 Oct 2024 14:41:42 GMT
• Title: PnLCalib: Sports Field Registration via Points and Lines Optimization
• Authors: Marc Gutiérrez-Pérez, Antonio Agudo,
• Abstract summary: Camera calibration in broadcast sports videos presents numerous challenges for accurate sports field registration. Traditional search-based methods depend on initial camera pose estimates, which can struggle in non-standard positions. We propose an optimization-based calibration pipeline that leverages a 3D soccer field model and a predefined set of keypoints to overcome these limitations.
• Score: 16.278222277579655
• License:
• Abstract: Camera calibration in broadcast sports videos presents numerous challenges for accurate sports field registration due to multiple camera angles, varying camera parameters, and frequent occlusions of the field. Traditional search-based methods depend on initial camera pose estimates, which can struggle in non-standard positions and dynamic environments. In response, we propose an optimization-based calibration pipeline that leverages a 3D soccer field model and a predefined set of keypoints to overcome these limitations. Our method also introduces a novel refinement module that improves initial calibration by using detected field lines in a non-linear optimization process. This approach outperforms existing techniques in both multi-view and single-view 3D camera calibration tasks, while maintaining competitive performance in homography estimation. Extensive experimentation on real-world soccer datasets, including SoccerNet-Calibration, WorldCup 2014, and TS-WorldCup, highlights the robustness and accuracy of our method across diverse broadcast scenarios. Our approach offers significant improvements in camera calibration precision and reliability.

Related papers

• Enhancing Soccer Camera Calibration Through Keypoint Exploitation [0.0]
  This paper introduces a multi-stage pipeline that addresses the challenge of obtaining a sufficient number of high-quality point pairs. Our approach significantly increases the number of usable points for calibration by exploiting line-line and line-conic intersections, points on the conics, and other geometric features. We evaluated our approach on the largest football broadcast camera calibration dataset available, and secured the top position in the SoccerNet Camera Challenge 2023.
  arXiv  Detail & Related papers  (2024-10-09T20:01:14Z)
• ESC: Evolutionary Stitched Camera Calibration in the Wild [0.15346678870160887]
  We identify the source of significant calibration errors in multi-camera environments. We propose the Evolutionary Stitched Camera calibration algorithm to bridge this gap. We demonstrate the superior performance of our approach compared to state-of-the-art methods across diverse real-life football fields.
  arXiv  Detail & Related papers  (2024-04-19T07:50:13Z)
• A Universal Protocol to Benchmark Camera Calibration for Sports [6.011159943695013]
  We present a new benchmarking protocol for camera calibration in sports analytics. We show that our protocol provides fairer evaluations of camera calibration methods. We hope to pave the way for a new stage in camera calibration for sports applications with high accuracy standards.
  arXiv  Detail & Related papers  (2024-04-15T14:03:31Z)
• VICAN: Very Efficient Calibration Algorithm for Large Camera Networks [49.17165360280794]
  We introduce a novel methodology that extends Pose Graph Optimization techniques. We consider the bipartite graph encompassing cameras, object poses evolving dynamically, and camera-object relative transformations at each time step. Our framework retains compatibility with traditional PGO solvers, but its efficacy benefits from a custom-tailored optimization scheme.
  arXiv  Detail & Related papers  (2024-03-25T17:47:03Z)
• Multi-Modal Dataset Acquisition for Photometrically Challenging Object [56.30027922063559]
  This paper addresses the limitations of current datasets for 3D vision tasks in terms of accuracy, size, realism, and suitable imaging modalities for photometrically challenging objects. We propose a novel annotation and acquisition pipeline that enhances existing 3D perception and 6D object pose datasets.
  arXiv  Detail & Related papers  (2023-08-21T10:38:32Z)
• E-Calib: A Fast, Robust and Accurate Calibration Toolbox for Event Cameras [18.54225086007182]
  We present E-Calib, a novel, fast, robust, and accurate calibration toolbox for event cameras. The proposed method is tested in a variety of rigorous experiments for different event camera models.
  arXiv  Detail & Related papers  (2023-06-15T12:16:38Z)
• EasyHeC: Accurate and Automatic Hand-eye Calibration via Differentiable Rendering and Space Exploration [49.90228618894857]
  We introduce a new approach to hand-eye calibration called EasyHeC, which is markerless, white-box, and delivers superior accuracy and robustness. We propose to use two key technologies: differentiable rendering-based camera pose optimization and consistency-based joint space exploration. Our evaluation demonstrates superior performance in synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2023-05-02T03:49:54Z)
• Towards Nonlinear-Motion-Aware and Occlusion-Robust Rolling Shutter Correction [54.00007868515432]
  Existing methods face challenges in estimating the accurate correction field due to the uniform velocity assumption. We propose a geometry-based Quadratic Rolling Shutter (QRS) motion solver, which precisely estimates the high-order correction field of individual pixels. Our method surpasses the state-of-the-art by +4.98, +0.77, and +4.33 of PSNR on Carla-RS, Fastec-RS, and BS-RSC datasets, respectively.
  arXiv  Detail & Related papers  (2023-03-31T15:09:18Z)
• Deep Learning for Camera Calibration and Beyond: A Survey [100.75060862015945]
  Camera calibration involves estimating camera parameters to infer geometric features from captured sequences. Recent efforts show that learning-based solutions have the potential to be used in place of the repeatability works of manual calibrations.
  arXiv  Detail & Related papers  (2023-03-19T04:00:05Z)
• Keypoint-less Camera Calibration for Sports Field Registration in Soccer [11.374200381593267]
  We introduce a differentiable objective function that is able to learn the camera pose and focal length from segment correspondences. We propose a novel approach for 3D sports field registration from broadcast soccer images.
  arXiv  Detail & Related papers  (2022-07-24T10:31:25Z)
• Infrastructure-based Multi-Camera Calibration using Radial Projections [117.22654577367246]
  Pattern-based calibration techniques can be used to calibrate the intrinsics of the cameras individually. Infrastucture-based calibration techniques are able to estimate the extrinsics using 3D maps pre-built via SLAM or Structure-from-Motion. We propose to fully calibrate a multi-camera system from scratch using an infrastructure-based approach.
  arXiv  Detail & Related papers  (2020-07-30T09:21:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.