AnyCalib: On-Manifold Learning for Model-Agnostic Single-View Camera Calibration
- URL: http://arxiv.org/abs/2503.12701v1
- Date: Sun, 16 Mar 2025 23:59:21 GMT
- Title: AnyCalib: On-Manifold Learning for Model-Agnostic Single-View Camera Calibration
- Authors: Javier Tirado-Garín, Javier Civera,
- Abstract summary: We present AnyCalib, a method for calibrating the intrinsic parameters of a camera from a single in-the-wild image.<n>We show, for the first time, that this intermediate representation allows for a closed-form recovery of the intrinsics for a wide range of camera models.
- Score: 9.192660643226372
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present AnyCalib, a method for calibrating the intrinsic parameters of a camera from a single in-the-wild image, that is agnostic to the camera model. Current methods are predominantly tailored to specific camera models and/or require extrinsic cues, such as the direction of gravity, to be visible in the image. In contrast, we argue that the perspective and distortion cues inherent in images are sufficient for model-agnostic camera calibration. To demonstrate this, we frame the calibration process as the regression of the rays corresponding to each pixel. We show, for the first time, that this intermediate representation allows for a closed-form recovery of the intrinsics for a wide range of camera models, including but not limited to: pinhole, Brown-Conrady and Kannala-Brandt. Our approach also applies to edited -- cropped and stretched -- images. Experimentally, we demonstrate that AnyCalib consistently outperforms alternative methods, including 3D foundation models, despite being trained on orders of magnitude less data. Code is available at https://github.com/javrtg/AnyCalib.
Related papers
- Cameras as Rays: Pose Estimation via Ray Diffusion [54.098613859015856]
Estimating camera poses is a fundamental task for 3D reconstruction and remains challenging given sparsely sampled views.
We propose a distributed representation of camera pose that treats a camera as a bundle of rays.
Our proposed methods, both regression- and diffusion-based, demonstrate state-of-the-art performance on camera pose estimation on CO3D.
arXiv Detail & Related papers (2024-02-22T18:59:56Z) - The Influence of Autofocus Lenses in the Camera Calibration Process [0.0]
Camera calibration process consists of adjusting a set of data to a pin-hole model.
Pin-hole model does not represent the camera behavior accurately if the focus is considered.
A pin-hole model with distance dependent focal length is proposed to improve the calibration process substantially.
arXiv Detail & Related papers (2024-02-07T09:20:01Z) - How to turn your camera into a perfect pinhole model [0.38233569758620056]
We propose a novel approach that involves a pre-processing step to remove distortions from images.
Our method does not need to assume any distortion model and can be applied to severely warped images.
This model allows for a serious upgrade of many algorithms and applications.
arXiv Detail & Related papers (2023-09-20T13:54:29Z) - Deep Learning for Camera Calibration and Beyond: A Survey [100.75060862015945]
Camera calibration involves estimating camera parameters to infer geometric features from captured sequences.<n>Recent efforts show that learning-based solutions have the potential to be used in place of the repeatability works of manual calibrations.
arXiv Detail & Related papers (2023-03-19T04:00:05Z) - A Deep Perceptual Measure for Lens and Camera Calibration [35.03926427249506]
In place of the traditional multi-image calibration process, we propose to infer the camera calibration parameters directly from a single image.
We train this network using automatically generated samples from a large-scale panorama dataset.
We conduct a large-scale human perception study where we ask participants to judge the realism of 3D objects composited with correct and biased camera calibration parameters.
arXiv Detail & Related papers (2022-08-25T18:40:45Z) - BabelCalib: A Universal Approach to Calibrating Central Cameras [24.662262051346087]
Existing calibration methods occasionally fail for large field-of-view cameras.
We propose a solver to calibrate the parameters in terms of a back-projection model and then regress the parameters for a target forward model.
These steps are incorporated in a robust estimation framework to cope with outlying detections.
arXiv Detail & Related papers (2021-09-20T17:21:57Z) - Self-Calibrating Neural Radiance Fields [68.64327335620708]
We jointly learn the geometry of the scene and the accurate camera parameters without any calibration objects.
Our camera model consists of a pinhole model, a fourth order radial distortion, and a generic noise model that can learn arbitrary non-linear camera distortions.
arXiv Detail & Related papers (2021-08-31T13:34:28Z) - How to Calibrate Your Event Camera [58.80418612800161]
We propose a generic event camera calibration framework using image reconstruction.
We show that neural-network-based image reconstruction is well suited for the task of intrinsic and extrinsic calibration of event cameras.
arXiv Detail & Related papers (2021-05-26T07:06:58Z) - Wide-angle Image Rectification: A Survey [86.36118799330802]
wide-angle images contain distortions that violate the assumptions underlying pinhole camera models.
Image rectification, which aims to correct these distortions, can solve these problems.
We present a detailed description and discussion of the camera models used in different approaches.
Next, we review both traditional geometry-based image rectification methods and deep learning-based methods.
arXiv Detail & Related papers (2020-10-30T17:28:40Z) - Infrastructure-based Multi-Camera Calibration using Radial Projections [117.22654577367246]
Pattern-based calibration techniques can be used to calibrate the intrinsics of the cameras individually.
Infrastucture-based calibration techniques are able to estimate the extrinsics using 3D maps pre-built via SLAM or Structure-from-Motion.
We propose to fully calibrate a multi-camera system from scratch using an infrastructure-based approach.
arXiv Detail & Related papers (2020-07-30T09:21:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.