Keypoint-less Camera Calibration for Sports Field Registration in Soccer

• URL: http://arxiv.org/abs/2207.11709v1
• Date: Sun, 24 Jul 2022 10:31:25 GMT
• Title: Keypoint-less Camera Calibration for Sports Field Registration in Soccer
• Authors: Jonas Theiner and Ralph Ewerth
• Abstract summary: We introduce a differentiable objective function that is able to learn the camera pose and focal length from segment correspondences. We propose a novel approach for 3D sports field registration from broadcast soccer images.
• Score: 11.374200381593267
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Sports field registration in broadcast videos is typically interpreted as the task of homography estimation, which provides a mapping between a planar field and the corresponding visible area of the image. In contrast to previous approaches, we consider the task as a camera calibration problem. First, we introduce a differentiable objective function that is able to learn the camera pose and focal length from segment correspondences (e.g., lines, point clouds), based on pixel-level annotations for segments of a known calibration object, i.e., the sports field. The calibration module iteratively minimizes the segment reprojection error induced by the estimated camera parameters. Second, we propose a novel approach for 3D sports field registration from broadcast soccer images. The calibration module does not require any training data and compared to the typical solution, which subsequently refines an initial estimation, our solution does it in one step. The proposed method is evaluated for sports field registration on two datasets and achieves superior results compared to two state-of-the-art approaches.

Related papers

• Enhancing Soccer Camera Calibration Through Keypoint Exploitation [0.0]
  This paper introduces a multi-stage pipeline that addresses the challenge of obtaining a sufficient number of high-quality point pairs. Our approach significantly increases the number of usable points for calibration by exploiting line-line and line-conic intersections, points on the conics, and other geometric features. We evaluated our approach on the largest football broadcast camera calibration dataset available, and secured the top position in the SoccerNet Camera Challenge 2023.
  arXiv  Detail & Related papers  (2024-10-09T20:01:14Z)
• A Universal Protocol to Benchmark Camera Calibration for Sports [6.011159943695013]
  We present a new benchmarking protocol for camera calibration in sports analytics. We show that our protocol provides fairer evaluations of camera calibration methods. We hope to pave the way for a new stage in camera calibration for sports applications with high accuracy standards.
  arXiv  Detail & Related papers  (2024-04-15T14:03:31Z)
• PnLCalib: Sports Field Registration via Points and Lines Optimization [16.278222277579655]
  Camera calibration in broadcast sports videos presents numerous challenges for accurate sports field registration. Traditional search-based methods depend on initial camera pose estimates, which can struggle in non-standard positions. We propose an optimization-based calibration pipeline that leverages a 3D soccer field model and a predefined set of keypoints to overcome these limitations.
  arXiv  Detail & Related papers  (2024-04-12T11:15:15Z)
• Deep Learning for Camera Calibration and Beyond: A Survey [100.75060862015945]
  Camera calibration involves estimating camera parameters to infer geometric features from captured sequences. Recent efforts show that learning-based solutions have the potential to be used in place of the repeatability works of manual calibrations.
  arXiv  Detail & Related papers  (2023-03-19T04:00:05Z)
• Continuous-Time Gaussian Process Motion-Compensation for Event-vision Pattern Tracking with Distance Fields [4.168157981135697]
  This work addresses the issue of motion compensation and pattern tracking in event camera data. The proposed method decomposes the tracking problem into a local SE(2) motion-compensation step followed by a homography registration of small motion-compensated event batches. Our open-source implementation performs high-accuracy motion compensation and produces high-quality tracks in real-world scenarios.
  arXiv  Detail & Related papers  (2023-03-05T13:48:20Z)
• Self-Supervised Camera Self-Calibration from Video [34.35533943247917]
  We propose a learning algorithm to regress per-sequence calibration parameters using an efficient family of general camera models. Our procedure achieves self-calibration results with sub-pixel reprojection error, outperforming other learning-based methods.
  arXiv  Detail & Related papers  (2021-12-06T19:42:05Z)
• Attentive and Contrastive Learning for Joint Depth and Motion Field Estimation [76.58256020932312]
  Estimating the motion of the camera together with the 3D structure of the scene from a monocular vision system is a complex task. We present a self-supervised learning framework for 3D object motion field estimation from monocular videos.
  arXiv  Detail & Related papers  (2021-10-13T16:45:01Z)
• Bridging the Gap between Events and Frames through Unsupervised Domain Adaptation [57.22705137545853]
  We propose a task transfer method that allows models to be trained directly with labeled images and unlabeled event data. We leverage the generative event model to split event features into content and motion features. Our approach unlocks the vast amount of existing image datasets for the training of event-based neural networks.
  arXiv  Detail & Related papers  (2021-09-06T17:31:37Z)
• DeepI2P: Image-to-Point Cloud Registration via Deep Classification [71.3121124994105]
  DeepI2P is a novel approach for cross-modality registration between an image and a point cloud. Our method estimates the relative rigid transformation between the coordinate frames of the camera and Lidar. We circumvent the difficulty by converting the registration problem into a classification and inverse camera projection optimization problem.
  arXiv  Detail & Related papers  (2021-04-08T04:27:32Z)
• Calibrated and Partially Calibrated Semi-Generalized Homographies [65.29477277713205]
  We propose the first minimal solutions for estimating the semi-generalized homography given a perspective and a generalized camera. The proposed solvers are stable and efficient as demonstrated by a number of synthetic and real-world experiments.
  arXiv  Detail & Related papers  (2021-03-11T08:56:24Z)
• Event-based Motion Segmentation with Spatio-Temporal Graph Cuts [51.17064599766138]
  We have developed a method to identify independently objects acquired with an event-based camera. The method performs on par or better than the state of the art without having to predetermine the number of expected moving objects.
  arXiv  Detail & Related papers  (2020-12-16T04:06:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.