SOIC: Semantic Online Initialization and Calibration for LiDAR and Camera

• URL: http://arxiv.org/abs/2003.04260v1
• Date: Mon, 9 Mar 2020 17:02:31 GMT
• Title: SOIC: Semantic Online Initialization and Calibration for LiDAR and Camera
• Authors: Weimin Wang, Shohei Nobuhara, Ryosuke Nakamura, Ken Sakurada
• Abstract summary: This paper presents a novel semantic-based online calibration approach, SOIC, for LiDAR and camera sensors. We evaluate the proposed method either with GT or predicted on KITTI dataset.
• Score: 18.51029962714994
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper presents a novel semantic-based online extrinsic calibration approach, SOIC (so, I see), for Light Detection and Ranging (LiDAR) and camera sensors. Previous online calibration methods usually need prior knowledge of rough initial values for optimization. The proposed approach removes this limitation by converting the initialization problem to a Perspective-n-Point (PnP) problem with the introduction of semantic centroids (SCs). The closed-form solution of this PnP problem has been well researched and can be found with existing PnP methods. Since the semantic centroid of the point cloud usually does not accurately match with that of the corresponding image, the accuracy of parameters are not improved even after a nonlinear refinement process. Thus, a cost function based on the constraint of the correspondence between semantic elements from both point cloud and image data is formulated. Subsequently, optimal extrinsic parameters are estimated by minimizing the cost function. We evaluate the proposed method either with GT or predicted semantics on KITTI dataset. Experimental results and comparisons with the baseline method verify the feasibility of the initialization strategy and the accuracy of the calibration approach. In addition, we release the source code at https://github.com/--/SOIC.

Related papers

• SPARE: Symmetrized Point-to-Plane Distance for Robust Non-Rigid Registration [76.40993825836222]
  We propose SPARE, a novel formulation that utilizes a symmetrized point-to-plane distance for robust non-rigid registration. The proposed method greatly improves the accuracy of non-rigid registration problems and maintains relatively high solution efficiency.
  arXiv  Detail & Related papers  (2024-05-30T15:55:04Z)
• Vanishing Point Estimation in Uncalibrated Images with Prior Gravity Direction [82.72686460985297]
  We tackle the problem of estimating a Manhattan frame. We derive two new 2-line solvers, one of which does not suffer from singularities affecting existing solvers. We also design a new non-minimal method, running on an arbitrary number of lines, to boost the performance in local optimization.
  arXiv  Detail & Related papers  (2023-08-21T13:03:25Z)
• An Optimization-based Deep Equilibrium Model for Hyperspectral Image Deconvolution with Convergence Guarantees [71.57324258813675]
  We propose a novel methodology for addressing the hyperspectral image deconvolution problem. A new optimization problem is formulated, leveraging a learnable regularizer in the form of a neural network. The derived iterative solver is then expressed as a fixed-point calculation problem within the Deep Equilibrium framework.
  arXiv  Detail & Related papers  (2023-06-10T08:25:16Z)
• OSPC: Online Sequential Photometric Calibration [0.0]
  Photometric calibration is essential to many computer vision applications. We propose a novel method that solves for photometric parameters using a sequential estimation approach.
  arXiv  Detail & Related papers  (2023-05-28T09:44:58Z)
• Proximal Point Imitation Learning [48.50107891696562]
  We develop new algorithms with rigorous efficiency guarantees for infinite horizon imitation learning. We leverage classical tools from optimization, in particular, the proximal-point method (PPM) and dual smoothing. We achieve convincing empirical performance for both linear and neural network function approximation.
  arXiv  Detail & Related papers  (2022-09-22T12:40:21Z)
• Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setups [68.8204255655161]
  We present a method to calibrate the parameters of any pair of sensors involving LiDARs, monocular or stereo cameras. The proposed approach can handle devices with very different resolutions and poses, as usually found in vehicle setups.
  arXiv  Detail & Related papers  (2021-01-12T12:02:26Z)
• Lidar and Camera Self-Calibration using CostVolume Network [3.793450497896671]
  Instead of regressing the parameters between LiDAR and camera directly, we predict the decalibrated deviation from initial calibration to the ground truth. Our approach outperforms CNN-based state-of-the-art methods in terms of a mean absolute calibration error of 0.297cm in translation and 0.017deg in rotation with miscalibration magnitudes of up to 1.5m and 20deg.
  arXiv  Detail & Related papers  (2020-12-27T09:41:45Z)
• Deep Magnification-Flexible Upsampling over 3D Point Clouds [103.09504572409449]
  We propose a novel end-to-end learning-based framework to generate dense point clouds. We first formulate the problem explicitly, which boils down to determining the weights and high-order approximation errors. Then, we design a lightweight neural network to adaptively learn unified and sorted weights as well as the high-order refinements.
  arXiv  Detail & Related papers  (2020-11-25T14:00:18Z)
• Facilitate the Parametric Dimension Reduction by Gradient Clipping [1.9671123873378715]
  We extend a well-known dimension reduction method, t-distributed neighbor embedding (t-SNE), from non-parametric to parametric by training neural networks. Our method achieves an embedding quality that is compatible with the non-parametric t-SNE while enjoying the ability of generalization.
  arXiv  Detail & Related papers  (2020-09-30T01:21:22Z)
• Feature-metric Registration: A Fast Semi-supervised Approach for Robust Point Cloud Registration without Correspondences [8.636298281155602]
  We present a fast feature-metric point cloud registration framework. It enforces the optimisation of registration by minimising a feature-metric projection error without correspondences. We train the proposed method in a semi-supervised or unsupervised approach.
  arXiv  Detail & Related papers  (2020-05-03T07:26:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.