Robot Hand-Eye Calibration using Structure-from-Motion
- URL: http://arxiv.org/abs/2311.11808v2
- Date: Tue, 21 Nov 2023 09:18:14 GMT
- Title: Robot Hand-Eye Calibration using Structure-from-Motion
- Authors: Nicolas Andreff, Radu Horaud and Bernard Espiau
- Abstract summary: We propose a new flexible method for hand-eye calibration.
We show that the solution can be obtained in linear form.
We conduct a large number of experiments which validate the quality of the method by comparing it with existing ones.
- Score: 9.64487611393378
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this paper we propose a new flexible method for hand-eye calibration. The
vast majority of existing hand-eye calibration techniques requires a
calibration rig which is used in conjunction with camera pose estimation
methods. Instead, we combine structure-from-motion with known robot motions and
we show that the solution can be obtained in linear form. The latter solves for
both the hand-eye parameters and for the unknown scale factor inherent with
structure-from-motion methods. The algebraic analysis that is made possible
with such a linear formulation allows to investigate not only the well known
case of general screw motions but also such singular motions as pure
translations, pure rotations, and planar motions. In essence, the robot-mounted
camera looks to an unknown rigid layout, tracks points over an image sequence
and estimates the camera-to-robot relationship. Such a self calibration process
is relevant for unmanned vehicles, robots working in remote places, and so
forth. We conduct a large number of experiments which validate the quality of
the method by comparing it with existing ones.
Related papers
- Kalib: Markerless Hand-Eye Calibration with Keypoint Tracking [52.4190876409222]
Hand-eye calibration involves estimating the transformation between the camera and the robot.
Recent advancements in deep learning offer markerless techniques, but they present challenges.
We propose Kalib, an automatic and universal markerless hand-eye calibration pipeline.
arXiv Detail & Related papers (2024-08-20T06:03:40Z) - Multi-Camera Hand-Eye Calibration for Human-Robot Collaboration in Industrial Robotic Workcells [3.76054468268713]
In industrial scenarios, effective human-robot collaboration relies on multi-camera systems to robustly monitor human operators.
We introduce an innovative and robust multi-camera hand-eye calibration method, designed to optimize each camera's pose relative to both the robot's base and to each other camera.
We demonstrate the superior performance of our method through comprehensive experiments employing the METRIC dataset and real-world data collected on industrial scenarios.
arXiv Detail & Related papers (2024-06-17T10:23:30Z) - Robust Surgical Tool Tracking with Pixel-based Probabilities for
Projected Geometric Primitives [28.857732667640068]
Controlling robotic manipulators via visual feedback requires a known coordinate frame transformation between the robot and the camera.
Uncertainties in mechanical systems as well as camera calibration create errors in this coordinate frame transformation.
We estimate the camera-to-base transform and joint angle measurement errors for surgical robotic tools using an image based insertion-shaft detection algorithm and probabilistic models.
arXiv Detail & Related papers (2024-03-08T00:57:03Z) - Hand-Eye Calibration [23.28928112775409]
We show two possible formulations of the hand-eye calibration problem.
We develop a common mathematical framework to solve for the hand-eye calibration problem.
We present two methods, (i) a rotation then translation and (ii) a non-linear solver for rotation and translation.
arXiv Detail & Related papers (2023-11-21T14:57:24Z) - EasyHeC: Accurate and Automatic Hand-eye Calibration via Differentiable
Rendering and Space Exploration [49.90228618894857]
We introduce a new approach to hand-eye calibration called EasyHeC, which is markerless, white-box, and delivers superior accuracy and robustness.
We propose to use two key technologies: differentiable rendering-based camera pose optimization and consistency-based joint space exploration.
Our evaluation demonstrates superior performance in synthetic and real-world datasets.
arXiv Detail & Related papers (2023-05-02T03:49:54Z) - Deep Learning for Camera Calibration and Beyond: A Survey [100.75060862015945]
Camera calibration involves estimating camera parameters to infer geometric features from captured sequences.
Recent efforts show that learning-based solutions have the potential to be used in place of the repeatability works of manual calibrations.
arXiv Detail & Related papers (2023-03-19T04:00:05Z) - Extrinsic Camera Calibration with Semantic Segmentation [60.330549990863624]
We present an extrinsic camera calibration approach that automatizes the parameter estimation by utilizing semantic segmentation information.
Our approach relies on a coarse initial measurement of the camera pose and builds on lidar sensors mounted on a vehicle.
We evaluate our method on simulated and real-world data to demonstrate low error measurements in the calibration results.
arXiv Detail & Related papers (2022-08-08T07:25:03Z) - Self-Supervised Camera Self-Calibration from Video [34.35533943247917]
We propose a learning algorithm to regress per-sequence calibration parameters using an efficient family of general camera models.
Our procedure achieves self-calibration results with sub-pixel reprojection error, outperforming other learning-based methods.
arXiv Detail & Related papers (2021-12-06T19:42:05Z) - Nothing But Geometric Constraints: A Model-Free Method for Articulated
Object Pose Estimation [89.82169646672872]
We propose an unsupervised vision-based system to estimate the joint configurations of the robot arm from a sequence of RGB or RGB-D images without knowing the model a priori.
We combine a classical geometric formulation with deep learning and extend the use of epipolar multi-rigid-body constraints to solve this task.
arXiv Detail & Related papers (2020-11-30T20:46:48Z) - Infrastructure-based Multi-Camera Calibration using Radial Projections [117.22654577367246]
Pattern-based calibration techniques can be used to calibrate the intrinsics of the cameras individually.
Infrastucture-based calibration techniques are able to estimate the extrinsics using 3D maps pre-built via SLAM or Structure-from-Motion.
We propose to fully calibrate a multi-camera system from scratch using an infrastructure-based approach.
arXiv Detail & Related papers (2020-07-30T09:21:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.