Video-based Sequential Bayesian Homography Estimation for Soccer Field Registration

• URL: http://arxiv.org/abs/2311.10361v2
• Date: Sat, 4 May 2024 06:54:11 GMT
• Title: Video-based Sequential Bayesian Homography Estimation for Soccer Field Registration
• Authors: Paul J. Claasen, J. P. de Villiers,
• Abstract summary: A novel Bayesian framework is proposed, which explicitly relates the homography of one video frame to the next through an affine transformation. The proposed method, Bayesian Homography Inference from Tracked Keypoints (BHITK), employs a two-stage Kalman filter and significantly improves existing methods.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: A novel Bayesian framework is proposed, which explicitly relates the homography of one video frame to the next through an affine transformation while explicitly modelling keypoint uncertainty. The literature has previously used differential homography between subsequent frames, but not in a Bayesian setting. In cases where Bayesian methods have been applied, camera motion is not adequately modelled, and keypoints are treated as deterministic. The proposed method, Bayesian Homography Inference from Tracked Keypoints (BHITK), employs a two-stage Kalman filter and significantly improves existing methods. Existing keypoint detection methods may be easily augmented with BHITK. It enables less sophisticated and less computationally expensive methods to outperform the state-of-the-art approaches in most homography evaluation metrics. Furthermore, the homography annotations of the WorldCup and TS-WorldCup datasets have been refined using a custom homography annotation tool that has been released for public use. The refined datasets are consolidated and released as the consolidated and refined WorldCup (CARWC) dataset.

Related papers

• CodingHomo: Bootstrapping Deep Homography With Video Coding [49.69268313796418]
  Homography estimation is a fundamental task in computer vision with applications in diverse fields. Recent advances in deep learning have improved homography estimation, particularly with unsupervised learning approaches. We present CodingHomo, an unsupervised framework for homography estimation.
  arXiv  Detail & Related papers  (2025-04-16T15:18:11Z)
• A Bayesian Approach to Weakly-supervised Laparoscopic Image Segmentation [1.9639956888747314]
  We study weakly-supervised laparoscopic image segmentation with sparse annotations. We introduce a novel Bayesian deep learning approach designed to enhance both the accuracy and interpretability of the model's segmentation.
  arXiv  Detail & Related papers  (2024-10-11T04:19:48Z)
• Rethinking Few-shot 3D Point Cloud Semantic Segmentation [62.80639841429669]
  This paper revisits few-shot 3D point cloud semantic segmentation (FS-PCS) We focus on two significant issues in the state-of-the-art: foreground leakage and sparse point distribution. To address these issues, we introduce a standardized FS-PCS setting, upon which a new benchmark is built.
  arXiv  Detail & Related papers  (2024-03-01T15:14:47Z)
• View Consistent Purification for Accurate Cross-View Localization [59.48131378244399]
  This paper proposes a fine-grained self-localization method for outdoor robotics. The proposed method addresses limitations in existing cross-view localization methods. It is the first sparse visual-only method that enhances perception in dynamic environments.
  arXiv  Detail & Related papers  (2023-08-16T02:51:52Z)
• GPGait: Generalized Pose-based Gait Recognition [11.316545213493223]
  Recent works on pose-based gait recognition have demonstrated the potential of using such simple information to achieve results comparable to silhouette-based methods. To improve the generalization ability of pose-based methods across datasets, we propose a textbfGeneralized textbfPose-based textbfGait recognition framework.
  arXiv  Detail & Related papers  (2023-03-09T13:17:13Z)
• ATCON: Attention Consistency for Vision Models [0.8312466807725921]
  We propose an unsupervised fine-tuning method that improves the consistency of attention maps. We show results on Grad-CAM and Integrated Gradients in an ablation study. Those improved attention maps may help clinicians better understand vision model predictions.
  arXiv  Detail & Related papers  (2022-10-18T09:30:20Z)
• Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusion [62.269219152425556]
  segmentation-based scene text detection methods have drawn extensive attention in the scene text detection field. We propose a Differentiable Binarization (DB) module that integrates the binarization process into a segmentation network. An efficient Adaptive Scale Fusion (ASF) module is proposed to improve the scale robustness by fusing features of different scales adaptively.
  arXiv  Detail & Related papers  (2022-02-21T15:30:14Z)
• HSolo: Homography from a single affine aware correspondence [0.0]
  We present a novel procedure for homography estimation that is particularly well suited for inlier-poor domains. Especially at low inlier rates, our novel algorithm provides dramatic performance improvements.
  arXiv  Detail & Related papers  (2020-09-10T17:13:23Z)
• Deep Keypoint-Based Camera Pose Estimation with Geometric Constraints [80.60538408386016]
  Estimating relative camera poses from consecutive frames is a fundamental problem in visual odometry. We propose an end-to-end trainable framework consisting of learnable modules for detection, feature extraction, matching and outlier rejection.
  arXiv  Detail & Related papers  (2020-07-29T21:41:31Z)
• Making Affine Correspondences Work in Camera Geometry Computation [62.7633180470428]
  Local features provide region-to-region rather than point-to-point correspondences. We propose guidelines for effective use of region-to-region matches in the course of a full model estimation pipeline. Experiments show that affine solvers can achieve accuracy comparable to point-based solvers at faster run-times.
  arXiv  Detail & Related papers  (2020-07-20T12:07:48Z)
• Image Matching across Wide Baselines: From Paper to Practice [80.9424750998559]
  We introduce a comprehensive benchmark for local features and robust estimation algorithms. Our pipeline's modular structure allows easy integration, configuration, and combination of different methods. We show that with proper settings, classical solutions may still outperform the perceived state of the art.
  arXiv  Detail & Related papers  (2020-03-03T15:20:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.