Self-Supervised Online Camera Calibration for Automated Driving and Parking Applications

• URL: http://arxiv.org/abs/2308.08495v1
• Date: Wed, 16 Aug 2023 16:49:50 GMT
• Title: Self-Supervised Online Camera Calibration for Automated Driving and Parking Applications
• Authors: Ciar\'an Hogan, Ganesh Sistu, Ciar\'an Eising
• Abstract summary: This paper proposes a framework to learn intrinsic and extrinsic calibration of the camera in real time. The framework is self-supervised and doesn't require any labelling or supervision to learn the calibration parameters.
• Score: 1.6921067573076216
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Camera-based perception systems play a central role in modern autonomous vehicles. These camera based perception algorithms require an accurate calibration to map the real world distances to image pixels. In practice, calibration is a laborious procedure requiring specialised data collection and careful tuning. This process must be repeated whenever the parameters of the camera change, which can be a frequent occurrence in autonomous vehicles. Hence there is a need to calibrate at regular intervals to ensure the camera is accurate. Proposed is a deep learning framework to learn intrinsic and extrinsic calibration of the camera in real time. The framework is self-supervised and doesn't require any labelling or supervision to learn the calibration parameters. The framework learns calibration without the need for any physical targets or to drive the car on special planar surfaces.

Related papers

• Kalib: Markerless Hand-Eye Calibration with Keypoint Tracking [52.4190876409222]
  Hand-eye calibration involves estimating the transformation between the camera and the robot. Recent advancements in deep learning offer markerless techniques, but they present challenges. We propose Kalib, an automatic and universal markerless hand-eye calibration pipeline.
  arXiv  Detail & Related papers  (2024-08-20T06:03:40Z)
• Automated Static Camera Calibration with Intelligent Vehicles [58.908194559319405]
  We present a robust calibration method for automated geo-referenced camera calibration. Our method requires a calibration vehicle equipped with a combined filtering/RTK receiver and an inertial measurement unit (IMU) for self-localization. Our method does not require any human interaction with the information recorded by both the infrastructure and the vehicle.
  arXiv  Detail & Related papers  (2023-04-21T08:50:52Z)
• SceneCalib: Automatic Targetless Calibration of Cameras and Lidars in Autonomous Driving [10.517099201352414]
  SceneCalib is a novel method for simultaneous self-calibration of extrinsic and intrinsic parameters in a system containing multiple cameras and a lidar sensor. We resolve issues with a fully automatic method that requires no explicit correspondences between camera images and lidar point clouds.
  arXiv  Detail & Related papers  (2023-04-11T23:02:16Z)
• Online Camera-to-ground Calibration for Autonomous Driving [26.357898919134833]
  We propose an online monocular camera-to-ground calibration solution that does not utilize any specific targets while driving. We provide metrics to quantify calibration performance and stopping criteria to report/broadcast our satisfying calibration results.
  arXiv  Detail & Related papers  (2023-03-30T04:01:48Z)
• Deep Learning for Camera Calibration and Beyond: A Survey [100.75060862015945]
  Camera calibration involves estimating camera parameters to infer geometric features from captured sequences. Recent efforts show that learning-based solutions have the potential to be used in place of the repeatability works of manual calibrations.
  arXiv  Detail & Related papers  (2023-03-19T04:00:05Z)
• Online Marker-free Extrinsic Camera Calibration using Person Keypoint Detections [25.393382192511716]
  We propose a marker-free online method for the extrinsic calibration of multiple smart edge sensors. Our method assumes the intrinsic camera parameters to be known and requires priming with a rough initial estimate of the camera poses. We show that the calibration with our method achieves lower reprojection errors compared to a reference calibration generated by an offline method.
  arXiv  Detail & Related papers  (2022-09-15T15:54:21Z)
• Extrinsic Camera Calibration with Semantic Segmentation [60.330549990863624]
  We present an extrinsic camera calibration approach that automatizes the parameter estimation by utilizing semantic segmentation information. Our approach relies on a coarse initial measurement of the camera pose and builds on lidar sensors mounted on a vehicle. We evaluate our method on simulated and real-world data to demonstrate low error measurements in the calibration results.
  arXiv  Detail & Related papers  (2022-08-08T07:25:03Z)
• Lasers to Events: Automatic Extrinsic Calibration of Lidars and Event Cameras [67.84498757689776]
  This paper presents the first direct calibration method between event cameras and lidars. It removes dependencies on frame-based camera intermediaries and/or highly-accurate hand measurements.
  arXiv  Detail & Related papers  (2022-07-03T11:05:45Z)
• Dynamic Event Camera Calibration [27.852239869987947]
  We present the first dynamic event camera calibration algorithm. It calibrates directly from events captured during relative motion between camera and calibration pattern. As demonstrated through our results, the obtained calibration method is highly convenient and reliably calibrates from data sequences spanning less than 10 seconds.
  arXiv  Detail & Related papers  (2021-07-14T14:52:58Z)
• How to Calibrate Your Event Camera [58.80418612800161]
  We propose a generic event camera calibration framework using image reconstruction. We show that neural-network-based image reconstruction is well suited for the task of intrinsic and extrinsic calibration of event cameras.
  arXiv  Detail & Related papers  (2021-05-26T07:06:58Z)
• Autocamera Calibration for traffic surveillance cameras with wide angle lenses [0.6091702876917281]
  We propose a method for automatic calibration of a traffic surveillance camera with wide-angle lenses. Video footage of a few minutes is sufficient for the entire calibration process to take place.
  arXiv  Detail & Related papers  (2020-01-20T20:37:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.