Rolling Shutter Camera Self-Calibration

• URL: http://arxiv.org/abs/2608.01509v1
• Date: Sun, 02 Aug 2026 21:43:46 GMT
• Title: Rolling Shutter Camera Self-Calibration
• Abstract summary: Rolling shutter (RS) cameras are widely used in consumer devices, but their row-wise exposure causes distortions under motion.<n>Existing RS calibration methods rely on calibration targets or specialised hardware, limiting their use in unconstrained settings.<n>We present the first self-calibration method for RS cameras that directly estimates camera intrinsics and the readout time ratio from image sequences.
• Score: 16.655500623025226
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Rolling shutter (RS) cameras are widely used in consumer devices, but their row-wise exposure causes distortions under motion, making geometric 3D vision problems dependent on both camera intrinsics and readout time ratio. Existing RS calibration methods rely on calibration targets or specialised hardware, limiting their use in unconstrained settings. We present the first self-calibration method for RS cameras that directly estimates camera intrinsics and the readout time ratio from image sequences, without requiring calibration targets. The method is implemented as a self-calibrating bundle adjustment (BA), which critically depends on the RS imaging model. We combine two known complementary models. The first formulates RS imaging as continuous-time trajectory estimation under a row-wise pose representation. The second interprets RS images as temporally distorted global shutter (GS) images and requires to estimate correction fields. The combination is non-trivial and results in a unified dual-projection model, in which each 3D point is simultaneously constrained at both row-dependent and reference timestamps along a shared continuous trajectory, enforcing stronger geometric and temporal consistency. Extensive simulations analyse the applicability of several implementations under varying conditions, and real data experiments demonstrate the accuracy, robustness, and practical effectiveness of the proposed approach.

Related papers

• Simplified Cross-Modal Calibration for Heterogeneous Event-RGB Stereo Systems [0.6117371161379207]
  Existing approaches require sensor or target motion, precise synchronization, or computationally expensive event-to-image reconstruction.<n>We propose a motion-free cross-modal calibration framework that uses a temporally modulated, blended ChArUco target presented on standard consumer displays.<n>Our approach reduces the mean reprojection error by $44%$ and $6%$, respectively, while substantially simplifying the calibration procedure.
  arXiv  Detail & Related papers  (2026-08-24T08:29:35Z)
• Two-Stage Camera Calibration Method for Multi-Camera Systems Using Scene Geometry [52.27010615715154]
  This paper presents a novel two-stage calibration method for multi-camera tracking systems.<n>In the first stage, partial calibration of individual cameras is performed based on an operator's annotation of natural geometric primitives.<n>In the second stage, precise system calibration is achieved through interactive manipulation of the projected Effective Field of View.
  arXiv  Detail & Related papers  (2025-12-04T16:47:39Z)
• CalibRefine: Deep Learning-Based Online Automatic Targetless LiDAR-Camera Calibration with Iterative and Attention-Driven Post-Refinement [7.736775961390864]
  CalibRefine is a fully automatic, targetless, and online calibration framework.<n>It directly processes raw LiDAR point clouds and camera images.<n>Our results show that robust object-level feature matching, combined with iterative refinement and self-supervised attention-based refinement, enables reliable sensor alignment.
  arXiv  Detail & Related papers  (2025-02-24T20:53:42Z)
• Neural Real-Time Recalibration for Infrared Multi-Camera Systems [2.249916681499244]
  There are no learning-free or neural techniques for real-time recalibration of infrared multi-camera systems. We propose a neural network-based method capable of dynamic real-time calibration.
  arXiv  Detail & Related papers  (2024-10-18T14:37:37Z)
• Towards Nonlinear-Motion-Aware and Occlusion-Robust Rolling Shutter Correction [54.00007868515432]
  Existing methods face challenges in estimating the accurate correction field due to the uniform velocity assumption. We propose a geometry-based Quadratic Rolling Shutter (QRS) motion solver, which precisely estimates the high-order correction field of individual pixels. Our method surpasses the state-of-the-art by +4.98, +0.77, and +4.33 of PSNR on Carla-RS, Fastec-RS, and BS-RSC datasets, respectively.
  arXiv  Detail & Related papers  (2023-03-31T15:09:18Z)
• Rolling Shutter Inversion: Bring Rolling Shutter Images to High Framerate Global Shutter Video [111.08121952640766]
  This paper presents a novel deep-learning based solution to the RS temporal super-resolution problem. By leveraging the multi-view geometry relationship of the RS imaging process, our framework successfully achieves high framerate GS generation. Our method can produce high-quality GS image sequences with rich details, outperforming the state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-10-06T16:47:12Z)
• Learning Adaptive Warping for Real-World Rolling Shutter Correction [52.45689075940234]
  This paper proposes the first real-world rolling shutter (RS) correction dataset, BS-RSC, and a corresponding model to correct the RS frames in a distorted video. Mobile devices in the consumer market with CMOS-based sensors for video capture often result in rolling shutter effects when relative movements occur during the video acquisition process.
  arXiv  Detail & Related papers  (2022-04-29T05:13:50Z)
• Bringing Rolling Shutter Images Alive with Dual Reversed Distortion [75.78003680510193]
  Rolling shutter (RS) distortion can be interpreted as the result of picking a row of pixels from instant global shutter (GS) frames over time. We develop a novel end-to-end model, IFED, to generate dual optical flow sequence through iterative learning of the velocity field during the RS time.
  arXiv  Detail & Related papers  (2022-03-12T14:57:49Z)
• Continuous-Time Spatiotemporal Calibration of a Rolling Shutter Camera---IMU System [8.201100713224003]
  The shutter (RS) mechanism is widely used by consumer-grade cameras, which are essential parts in smartphones and autonomous vehicles. This work takes the camera-IMU system as an example and looks into the RS effect on itstemporal calibration.
  arXiv  Detail & Related papers  (2021-08-16T16:09:22Z)
• Self-Calibration Supported Robust Projective Structure-from-Motion [80.15392629310507]
  We propose a unified Structure-from-Motion (SfM) method, in which the matching process is supported by self-calibration constraints. We show experimental results demonstrating robust multiview matching and accurate camera calibration by exploiting these constraints.
  arXiv  Detail & Related papers  (2020-07-04T08:47:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.