Online Refractive Camera Model Calibration in Visual Inertial Odometry

• URL: http://arxiv.org/abs/2409.12074v1
• Date: Wed, 18 Sep 2024 15:48:05 GMT
• Title: Online Refractive Camera Model Calibration in Visual Inertial Odometry
• Authors: Mohit Singh, Kostas Alexis,
• Abstract summary: This paper presents a general refractive camera model and online co-estimation of odometry and the refractive index of unknown media. The refractive index is estimated online as a state variable of a monocular visual-inertial odometry framework. The method was verified on data collected using an underwater robot traversing inside a pool.
• Score: 13.462106704905132
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper presents a general refractive camera model and online co-estimation of odometry and the refractive index of unknown media. This enables operation in diverse and varying refractive fluids, given only the camera calibration in air. The refractive index is estimated online as a state variable of a monocular visual-inertial odometry framework in an iterative formulation using the proposed camera model. The method was verified on data collected using an underwater robot traversing inside a pool. The evaluations demonstrate convergence to the ideal refractive index for water despite significant perturbations in the initialization. Simultaneously, the approach enables on-par visual-inertial odometry performance in refractive media without prior knowledge of the refractive index or requirement of medium-specific camera calibration.

Related papers

• Harnessing the Diamond-Air Interface as an Efficient Photon Antenna for Solid-State Emitters [0.0]
  Extracting photons from defect centers is challenging due to the high refractive index of typical substrates.<n>For nitrogen-vacancy centers in diamond, reaching saturation count rates above $2.5times105,mathrmcounts/mathrms$ so far requires nanofabricated optics.<n>Our results indicate that photon count rates approaching those of nanofabricated optics can also be achieved by oil-immersion optics.
  arXiv  Detail & Related papers  (2025-09-30T10:46:08Z)
• Examining the Impact of Optical Aberrations to Image Classification and Object Detection Models [58.98742597810023]
  Vision models have to behave in a robust way to disturbances such as noise or blur. This paper studies two datasets of blur corruptions, which we denote OpticsBench and LensCorruptions. Evaluations for image classification and object detection on ImageNet and MSCOCO show that for a variety of different pre-trained models, the performance on OpticsBench and LensCorruptions varies significantly.
  arXiv  Detail & Related papers  (2025-04-25T17:23:47Z)
• AlignDiff: Learning Physically-Grounded Camera Alignment via Diffusion [0.5277756703318045]
  We introduce a novel framework that addresses camera intrinsic and extrinsic parameters using a generic ray camera model. Unlike previous approaches, AlignDiff shifts focus from semantic to geometric features, enabling more accurate modeling of local distortions. Our experiments demonstrate that the proposed method significantly reduces the angular error of estimated ray bundles by 8.2 degrees and overall calibration accuracy, outperforming existing approaches on challenging, real-world datasets.
  arXiv  Detail & Related papers  (2025-03-27T14:59:59Z)
• Physically-Based Photometric Bundle Adjustment in Non-Lambertian Environments [59.96101889715997]
  Photometric bundle adjustment (PBA) is widely used in estimating the camera pose and 3D geometry by assuming a Lambertian world. The assumption of photometric consistency is often violated since the non-diffuse reflection is common in real-world environments. We propose a novel physically-based PBA method to solve this problem.
  arXiv  Detail & Related papers  (2024-09-18T10:22:07Z)
• CodedVO: Coded Visual Odometry [11.33375308762075]
  We present CodedVO, a novel monocular visual odometry method that overcomes the scale ambiguity problem. We demonstrate our method in diverse indoor environments and demonstrate its robustness and adaptability.
  arXiv  Detail & Related papers  (2024-07-25T17:54:58Z)
• RoFIR: Robust Fisheye Image Rectification Framework Impervious to Optical Center Deviation [88.54817424560056]
  We propose a distortion vector map (DVM) that measures the degree and direction of local distortion. By learning the DVM, the model can independently identify local distortions at each pixel without relying on global distortion patterns. In the pre-training stage, it predicts the distortion vector map and perceives the local distortion features of each pixel. In the fine-tuning stage, it predicts a pixel-wise flow map for deviated fisheye image rectification.
  arXiv  Detail & Related papers  (2024-06-27T06:38:56Z)
• Deep Equilibrium Diffusion Restoration with Parallel Sampling [120.15039525209106]
  Diffusion model-based image restoration (IR) aims to use diffusion models to recover high-quality (HQ) images from degraded images, achieving promising performance. Most existing methods need long serial sampling chains to restore HQ images step-by-step, resulting in expensive sampling time and high computation costs. In this work, we aim to rethink the diffusion model-based IR models through a different perspective, i.e., a deep equilibrium (DEQ) fixed point system, called DeqIR.
  arXiv  Detail & Related papers  (2023-11-20T08:27:56Z)
• EDI: ESKF-based Disjoint Initialization for Visual-Inertial SLAM Systems [9.937997167972743]
  We propose a novel approach for fast, accurate, and robust visual-inertial initialization. Our method achieves an average scale error of 5.8% in less than 3 seconds.
  arXiv  Detail & Related papers  (2023-08-04T19:06:58Z)
• Neural Invertible Variable-degree Optical Aberrations Correction [6.6855248718044225]
  We propose a novel aberration correction method with an invertible architecture by leveraging its information-lossless property. Within the architecture, we develop conditional invertible blocks to allow the processing of aberrations with variable degrees. Our method is evaluated on both a synthetic dataset from physics-based imaging simulation and a real captured dataset.
  arXiv  Detail & Related papers  (2023-04-12T01:56:42Z)
• Dense Prediction Transformer for Scale Estimation in Monocular Visual Odometry [0.0]
  This paper contributes by showing an application of the dense prediction transformer model for scale estimation in monocular visual odometry systems. Experimental results show that the scale drift problem of monocular systems can be reduced through the accurate estimation of the depth map.
  arXiv  Detail & Related papers  (2022-10-04T16:29:21Z)
• Rethinking Generic Camera Models for Deep Single Image Camera Calibration to Recover Rotation and Fisheye Distortion [8.877834897951578]
  We propose a generic camera model that has the potential to address various types of distortion. Our proposed method outperformed conventional methods on two largescale datasets and images captured by off-the-shelf fisheye cameras.
  arXiv  Detail & Related papers  (2021-11-25T05:58:23Z)
• Dense Optical Flow from Event Cameras [55.79329250951028]
  We propose to incorporate feature correlation and sequential processing into dense optical flow estimation from event cameras. Our proposed approach computes dense optical flow and reduces the end-point error by 23% on MVSEC.
  arXiv  Detail & Related papers  (2021-08-24T07:39:08Z)
• Optical Flow Estimation from a Single Motion-blurred Image [66.2061278123057]
  Motion blur in an image may have practical interests in fundamental computer vision problems. We propose a novel framework to estimate optical flow from a single motion-blurred image in an end-to-end manner.
  arXiv  Detail & Related papers  (2021-03-04T12:45:18Z)
• Joint Unsupervised Learning of Optical Flow and Egomotion with Bi-Level Optimization [59.9673626329892]
  We exploit the global relationship between optical flow and camera motion using epipolar geometry. We use implicit differentiation to enable back-propagation through the lower-level geometric optimization layer independent of its implementation.
  arXiv  Detail & Related papers  (2020-02-26T22:28:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.