Correcting Decalibration of Stereo Cameras in Self-Driving Vehicles
- URL: http://arxiv.org/abs/2001.05267v1
- Date: Wed, 15 Jan 2020 12:28:01 GMT
- Title: Correcting Decalibration of Stereo Cameras in Self-Driving Vehicles
- Authors: Jon Muhovi\v{c}, Janez Per\v{s}
- Abstract summary: We address the problem of optical decalibration in mobile stereo camera setups, especially in context of autonomous vehicles.
Our method is based on optimization of camera geometry parameters and plugs directly into the output of the stereo matching algorithm.
Our simulation confirms that the method can run constantly in parallel to stereo estimation and thus help keep the system calibrated in real time.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We address the problem of optical decalibration in mobile stereo camera
setups, especially in context of autonomous vehicles. In real world conditions,
an optical system is subject to various sources of anticipated and
unanticipated mechanical stress (vibration, rough handling, collisions).
Mechanical stress changes the geometry between the cameras that make up the
stereo pair, and as a consequence, the pre-calculated epipolar geometry is no
longer valid. Our method is based on optimization of camera geometry parameters
and plugs directly into the output of the stereo matching algorithm. Therefore,
it is able to recover calibration parameters on image pairs obtained from a
decalibrated stereo system with minimal use of additional computing resources.
The number of successfully recovered depth pixels is used as an objective
function, which we aim to maximize. Our simulation confirms that the method can
run constantly in parallel to stereo estimation and thus help keep the system
calibrated in real time. Results confirm that the method is able to recalibrate
all the parameters except for the baseline distance, which scales the absolute
depth readings. However, that scaling factor could be uniquely determined using
any kind of absolute range finding methods (e.g. a single beam time-of-flight
sensor).
Related papers
- Camera Calibration using a Collimator System [5.138012450471437]
This paper introduces a novel camera calibration method using a collimator system.
Based on the optical geometry of the collimator system, we prove that the relative motion between the target and camera conforms to the spherical motion model.
A closed-form solver for multiple views and a minimal solver for two views are proposed for camera calibration.
arXiv Detail & Related papers (2024-09-30T07:40:41Z) - Single-image camera calibration with model-free distortion correction [0.0]
This paper proposes a method for estimating the complete set of calibration parameters from a single image of a planar speckle pattern covering the entire sensor.
The correspondence between image points and physical points on the calibration target is obtained using Digital Image Correlation.
At the end of the procedure, a dense and uniform model-free distortion map is obtained over the entire image.
arXiv Detail & Related papers (2024-03-02T16:51:35Z) - Dive Deeper into Rectifying Homography for Stereo Camera Online
Self-Calibration [18.089940434364234]
We develop a novel online self-calibration algorithm for stereo cameras.
We introduce four new evaluation metrics to quantify the robustness and accuracy of extrinsic parameter estimation.
Our source code, demo video, and supplement are publicly available at mias.group/StereoCalibrator.
arXiv Detail & Related papers (2023-09-19T04:52:13Z) - Online Camera-to-ground Calibration for Autonomous Driving [26.357898919134833]
We propose an online monocular camera-to-ground calibration solution that does not utilize any specific targets while driving.
We provide metrics to quantify calibration performance and stopping criteria to report/broadcast our satisfying calibration results.
arXiv Detail & Related papers (2023-03-30T04:01:48Z) - An Adaptive Method for Camera Attribution under Complex Radial
Distortion Corrections [77.34726150561087]
In-camera or out-camera software/firmware alters the supporting grid of the image so as to hamper PRNU-based camera attribution.
Existing solutions to deal with this problem try to invert/estimate the correction using radial transformations parameterized with few variables in order to restrain the computational load.
We propose an adaptive algorithm that by dividing the image into concentric annuli is able to deal with sophisticated corrections like those applied out-camera by third party software like Adobe Lightroom, Photoshop, Gimp and PT-Lens.
arXiv Detail & Related papers (2023-02-28T08:44:00Z) - Self-calibrating Photometric Stereo by Neural Inverse Rendering [88.67603644930466]
This paper tackles the task of uncalibrated photometric stereo for 3D object reconstruction.
We propose a new method that jointly optimize object shape, light directions, and light intensities.
Our method demonstrates state-of-the-art accuracy in light estimation and shape recovery on real-world datasets.
arXiv Detail & Related papers (2022-07-16T02:46:15Z) - Degradation-agnostic Correspondence from Resolution-asymmetric Stereo [96.03964515969652]
We study the problem of stereo matching from a pair of images with different resolutions, e.g., those acquired with a tele-wide camera system.
We propose to impose the consistency between two views in a feature space instead of the image space, named feature-metric consistency.
We find that, although a stereo matching network trained with the photometric loss is not optimal, its feature extractor can produce degradation-agnostic and matching-specific features.
arXiv Detail & Related papers (2022-04-04T12:24:34Z) - Self-Supervised Camera Self-Calibration from Video [34.35533943247917]
We propose a learning algorithm to regress per-sequence calibration parameters using an efficient family of general camera models.
Our procedure achieves self-calibration results with sub-pixel reprojection error, outperforming other learning-based methods.
arXiv Detail & Related papers (2021-12-06T19:42:05Z) - Leveraging Spatial and Photometric Context for Calibrated Non-Lambertian
Photometric Stereo [61.6260594326246]
We introduce an efficient fully-convolutional architecture that can leverage both spatial and photometric context simultaneously.
Using separable 4D convolutions and 2D heat-maps reduces the size and makes more efficient.
arXiv Detail & Related papers (2021-03-22T18:06:58Z) - Calibrated and Partially Calibrated Semi-Generalized Homographies [65.29477277713205]
We propose the first minimal solutions for estimating the semi-generalized homography given a perspective and a generalized camera.
The proposed solvers are stable and efficient as demonstrated by a number of synthetic and real-world experiments.
arXiv Detail & Related papers (2021-03-11T08:56:24Z) - Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset
for Spatially Varying Isotropic Materials [65.95928593628128]
We present a method to capture both 3D shape and spatially varying reflectance with a multi-view photometric stereo technique.
Our algorithm is suitable for perspective cameras and nearby point light sources.
arXiv Detail & Related papers (2020-01-18T12:26:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.