From two rolling shutters to one global shutter
- URL: http://arxiv.org/abs/2006.01964v1
- Date: Tue, 2 Jun 2020 22:18:43 GMT
- Title: From two rolling shutters to one global shutter
- Authors: Cenek Albl, Zuzana Kukelova, Viktor Larsson, Tomas Pajdla, Konrad
Schindler
- Abstract summary: We explore a surprisingly simple camera configuration that makes it possible to undo the rolling shutter distortion.
Such a setup is easy and cheap to build and it possesses the geometric constraints needed to correct rolling shutter distortion.
We derive equations that describe the underlying geometry for general and special motions and present an efficient method for finding their solutions.
- Score: 57.431998188805665
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Most consumer cameras are equipped with electronic rolling shutter, leading
to image distortions when the camera moves during image capture. We explore a
surprisingly simple camera configuration that makes it possible to undo the
rolling shutter distortion: two cameras mounted to have different rolling
shutter directions. Such a setup is easy and cheap to build and it possesses
the geometric constraints needed to correct rolling shutter distortion using
only a sparse set of point correspondences between the two images. We derive
equations that describe the underlying geometry for general and special motions
and present an efficient method for finding their solutions. Our synthetic and
real experiments demonstrate that our approach is able to remove large rolling
shutter distortions of all types without relying on any specific scene
structure.
Related papers
- Motion Blur Decomposition with Cross-shutter Guidance [33.72961622720793]
Motion blur is an artifact under insufficient illumination where exposure time has to be prolonged so as to collect more photons for a bright enough image.
Recent researches have aimed at decomposing a blurry image into multiple sharp images with spatial and temporal coherence.
We propose to utilize the ordered scanline-wise delay in a rolling shutter image to robustify motion decomposition of a single blurry image.
arXiv Detail & Related papers (2024-04-01T13:55:40Z) - ExBluRF: Efficient Radiance Fields for Extreme Motion Blurred Images [58.24910105459957]
We present ExBluRF, a novel view synthesis method for extreme motion blurred images.
Our approach consists of two main components: 6-DOF camera trajectory-based motion blur formulation and voxel-based radiance fields.
Compared with the existing works, our approach restores much sharper 3D scenes with the order of 10 times less training time and GPU memory consumption.
arXiv Detail & Related papers (2023-09-16T11:17:25Z) - Towards Nonlinear-Motion-Aware and Occlusion-Robust Rolling Shutter
Correction [54.00007868515432]
Existing methods face challenges in estimating the accurate correction field due to the uniform velocity assumption.
We propose a geometry-based Quadratic Rolling Shutter (QRS) motion solver, which precisely estimates the high-order correction field of individual pixels.
Our method surpasses the state-of-the-art by +4.98, +0.77, and +4.33 of PSNR on Carla-RS, Fastec-RS, and BS-RSC datasets, respectively.
arXiv Detail & Related papers (2023-03-31T15:09:18Z) - Bringing Rolling Shutter Images Alive with Dual Reversed Distortion [75.78003680510193]
Rolling shutter (RS) distortion can be interpreted as the result of picking a row of pixels from instant global shutter (GS) frames over time.
We develop a novel end-to-end model, IFED, to generate dual optical flow sequence through iterative learning of the velocity field during the RS time.
arXiv Detail & Related papers (2022-03-12T14:57:49Z) - Lightweight Multi-person Total Motion Capture Using Sparse Multi-view
Cameras [35.67288909201899]
We propose a lightweight total motion capture system for multi-person interactive scenarios using only sparse multi-view cameras.
Our method is capable of efficient localization and accurate association of the hands and faces even on severe occluded occasions.
Overall, we propose the first light-weight total capture system and achieves fast, robust and accurate multi-person total motion capture performance.
arXiv Detail & Related papers (2021-08-23T19:23:35Z) - SUNet: Symmetric Undistortion Network for Rolling Shutter Correction [40.19666306693269]
We present a novel deep network to solve the generic rolling shutter correction problem with two consecutive frames.
Our pipeline is symmetrically designed to predict the global shutter image corresponding to the intermediate time of these two frames.
arXiv Detail & Related papers (2021-08-10T16:43:13Z) - Calibrated and Partially Calibrated Semi-Generalized Homographies [65.29477277713205]
We propose the first minimal solutions for estimating the semi-generalized homography given a perspective and a generalized camera.
The proposed solvers are stable and efficient as demonstrated by a number of synthetic and real-world experiments.
arXiv Detail & Related papers (2021-03-11T08:56:24Z) - Minimal Solutions for Panoramic Stitching Given Gravity Prior [53.047330182598124]
We propose new minimal solutions to panoramic image stitching of images taken by cameras with coinciding optical centers.
We consider four practical camera configurations, assuming unknown fixed or varying focal length with or without radial distortion.
The solvers are tested both on synthetic scenes and on more than 500k real image pairs from the Sun360 dataset and from scenes captured by us using two smartphones equipped with IMUs.
arXiv Detail & Related papers (2020-12-01T13:17:36Z) - Image Stitching and Rectification for Hand-Held Cameras [17.694946451997815]
We derive a new differential homography that can account for the scanline-varying camera poses in Rolling Shutter (RS) cameras.
We show superior performance over state-of-the-art methods both in RS image stitching and rectification, especially for images captured by hand-held shaking cameras.
arXiv Detail & Related papers (2020-08-20T23:31:23Z) - Minimal Rolling Shutter Absolute Pose with Unknown Focal Length and
Radial Distortion [41.237097915374115]
We present the first minimal solutions for the absolute pose of a rolling shutter camera with unknown rolling shutter parameters, focal length, and radial distortion.
Our new solvers provide accurate estimates of the camera pose, rolling shutter parameters, focal length, and radial distortion parameters.
arXiv Detail & Related papers (2020-04-29T10:03:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.