YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systems

• URL: http://arxiv.org/abs/2407.18043v1
• Date: Thu, 25 Jul 2024 13:44:49 GMT
• Title: YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systems
• Authors: Tianle Zeng, Dengke He, Feifan Yan, Meixi He,
• Abstract summary: In a multi-sensor fusion system composed of cameras and LiDAR, precise extrinsic calibration contributes to the system's long-term stability and accurate perception of the environment. This paper proposes a novel fully automatic extrinsic calibration method for LiDAR-camera systems that circumvents the need for corresponding point registration.
• Score: 0.5999777817331317
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In a multi-sensor fusion system composed of cameras and LiDAR, precise extrinsic calibration contributes to the system's long-term stability and accurate perception of the environment. However, methods based on extracting and registering corresponding points still face challenges in terms of automation and precision. This paper proposes a novel fully automatic extrinsic calibration method for LiDAR-camera systems that circumvents the need for corresponding point registration. In our approach, a novel algorithm to extract required LiDAR correspondence point is proposed. This method can effectively filter out irrelevant points by computing the orientation of plane point clouds and extracting points by applying distance- and density-based thresholds. We avoid the need for corresponding point registration by introducing extrinsic parameters between the LiDAR and camera into the projection of extracted points and constructing co-planar constraints. These parameters are then optimized to solve for the extrinsic. We validated our method across multiple sets of LiDAR-camera systems. In synthetic experiments, our method demonstrates superior performance compared to current calibration techniques. Real-world data experiments further confirm the precision and robustness of the proposed algorithm, with average rotation and translation calibration errors between LiDAR and camera of less than 0.05 degree and 0.015m, respectively. This method enables automatic and accurate extrinsic calibration in a single one step, emphasizing the potential of calibration algorithms beyond using corresponding point registration to enhance the automation and precision of LiDAR-camera system calibration.

Related papers

• Kalib: Markerless Hand-Eye Calibration with Keypoint Tracking [52.4190876409222]
  Hand-eye calibration involves estimating the transformation between the camera and the robot. Recent advancements in deep learning offer markerless techniques, but they present challenges. We propose Kalib, an automatic and universal markerless hand-eye calibration pipeline.
  arXiv  Detail & Related papers  (2024-08-20T06:03:40Z)
• SPARE: Symmetrized Point-to-Plane Distance for Robust Non-Rigid Registration [76.40993825836222]
  We propose SPARE, a novel formulation that utilizes a symmetrized point-to-plane distance for robust non-rigid registration. The proposed method greatly improves the accuracy of non-rigid registration problems and maintains relatively high solution efficiency.
  arXiv  Detail & Related papers  (2024-05-30T15:55:04Z)
• EdgeCalib: Multi-Frame Weighted Edge Features for Automatic Targetless LiDAR-Camera Calibration [15.057994140880373]
  We introduce an edge-based approach for automatic online calibration of LiDAR and cameras in real-world scenarios. The edge features, which are prevalent in various environments, are aligned in both images and point clouds to determine the extrinsic parameters. The results show a state-of-the-art rotation accuracy of 0.086deg and a translation accuracy of 0.977 cm, outperforming existing edge-based calibration methods in both precision and robustness.
  arXiv  Detail & Related papers  (2023-10-25T13:27:56Z)
• Continuous Online Extrinsic Calibration of Fisheye Camera and LiDAR [7.906477322731106]
  An accurate extrinsic calibration is required to fuse the camera and LiDAR data into a common spatial reference frame required by high-level perception functions. There is a need for continuous online extrinsic calibration algorithms which can automatically update the value of the camera-LiDAR calibration during the life of the vehicle using only sensor data. We propose using mutual information between the camera image's depth estimate, provided by commonly available monocular depth estimation networks, and the LiDAR pointcloud's geometric distance as a optimization metric for extrinsic calibration.
  arXiv  Detail & Related papers  (2023-06-22T23:16:31Z)
• Automated Static Camera Calibration with Intelligent Vehicles [58.908194559319405]
  We present a robust calibration method for automated geo-referenced camera calibration. Our method requires a calibration vehicle equipped with a combined filtering/RTK receiver and an inertial measurement unit (IMU) for self-localization. Our method does not require any human interaction with the information recorded by both the infrastructure and the vehicle.
  arXiv  Detail & Related papers  (2023-04-21T08:50:52Z)
• CRLF: Automatic Calibration and Refinement based on Line Feature for LiDAR and Camera in Road Scenes [16.201111055979453]
  We propose a novel method to calibrate the extrinsic parameter for LiDAR and camera in road scenes. Our method introduces line features from static straight-line-shaped objects such as road lanes and poles in both image and point cloud. We conduct extensive experiments on KITTI and our in-house dataset, quantitative and qualitative results demonstrate the robustness and accuracy of our method.
  arXiv  Detail & Related papers  (2021-03-08T06:02:44Z)
• Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setups [68.8204255655161]
  We present a method to calibrate the parameters of any pair of sensors involving LiDARs, monocular or stereo cameras. The proposed approach can handle devices with very different resolutions and poses, as usually found in vehicle setups.
  arXiv  Detail & Related papers  (2021-01-12T12:02:26Z)
• ACSC: Automatic Calibration for Non-repetitive Scanning Solid-State LiDAR and Camera Systems [11.787271829250805]
  Solid-State LiDAR (SSL) enables low-cost and efficient obtainment of 3D point clouds from the environment. We propose a fully automatic calibration method for the non-repetitive scanning SSL and camera systems. We evaluate the proposed method on different types of LiDAR and camera sensor combinations in real conditions.
  arXiv  Detail & Related papers  (2020-11-17T09:11:28Z)
• Accurate Alignment Inspection System for Low-resolution Automotive and Mobility LiDAR [125.41260574344933]
  An accurate inspection system is proposed for estimating a LiDAR alignment error after sensor attachment on a mobility system such as a vehicle or robot. The proposed method uses only a single target board at the fixed position to estimate the three orientations (roll, tilt, and yaw) and the horizontal position of the LiDAR attachment with sub-degree and millimeter level accuracy.
  arXiv  Detail & Related papers  (2020-08-24T17:47:59Z)
• Automatic LiDAR Extrinsic Calibration System using Photodetector and Planar Board for Large-scale Applications [110.32028864986918]
  This study proposes a new concept of a target board with embedded photodetector arrays, named the PD-target system, to find the precise position of the correspondence laser beams on the target surface. The experimental evaluation of the proposed system on low-resolution LiDAR showed that the LiDAR offset pose can be estimated within 0.1 degree and 3 mm levels of precision.
  arXiv  Detail & Related papers  (2020-08-24T16:28:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.