Learning Exposure Correction in Dynamic Scenes
- URL: http://arxiv.org/abs/2402.17296v2
- Date: Sun, 10 Mar 2024 08:51:29 GMT
- Title: Learning Exposure Correction in Dynamic Scenes
- Authors: Jin Liu, Bo Wang, Chuanming Wang, Huiyuan Fu, Huadong Ma
- Abstract summary: We construct the first real-world paired video dataset, including both underexposure and overexposure dynamic scenes.
To achieve spatial alignment, we utilize two DSLR cameras and a beam splitter to simultaneously capture improper and normal exposure videos.
We propose a Video Exposure Correction Network (VECNet) based on Retinex theory, which incorporates a two-stream illumination learning mechanism to enhance the overexposure and underexposure factors.
- Score: 26.072632568435306
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Capturing videos with wrong exposure usually produces unsatisfactory visual
effects. While image exposure correction is a popular topic, the video
counterpart is less explored in the literature. Directly applying prior
image-based methods to input videos often results in temporal incoherence with
low visual quality. Existing research in this area is also limited by the lack
of high-quality benchmark datasets. To address these issues, we construct the
first real-world paired video dataset, including both underexposure and
overexposure dynamic scenes. To achieve spatial alignment, we utilize two DSLR
cameras and a beam splitter to simultaneously capture improper and normal
exposure videos. In addition, we propose a Video Exposure Correction Network
(VECNet) based on Retinex theory, which incorporates a two-stream illumination
learning mechanism to enhance the overexposure and underexposure factors,
respectively. The estimated multi-frame reflectance and dual-path illumination
components are fused at both feature and image levels, leading to visually
appealing results. Experimental results demonstrate that the proposed method
outperforms existing image exposure correction and underexposed video
enhancement methods. The code and dataset will be available soon.
Related papers
- BVI-RLV: A Fully Registered Dataset and Benchmarks for Low-Light Video Enhancement [56.97766265018334]
This paper introduces a low-light video dataset, consisting of 40 scenes with various motion scenarios under two distinct low-lighting conditions.
We provide fully registered ground truth data captured in normal light using a programmable motorized dolly and refine it via an image-based approach for pixel-wise frame alignment across different light levels.
Our experimental results demonstrate the significance of fully registered video pairs for low-light video enhancement (LLVE) and the comprehensive evaluation shows that the models trained with our dataset outperform those trained with the existing datasets.
arXiv Detail & Related papers (2024-07-03T22:41:49Z) - BVI-Lowlight: Fully Registered Benchmark Dataset for Low-Light Video Enhancement [44.1973928137492]
This paper introduces a novel low-light video dataset, consisting of 40 scenes in various motion scenarios under two low-lighting conditions.
We provide fully registered ground truth data captured in normal light using a programmable motorized dolly.
We refine them via image-based post-processing to ensure the pixel-wise alignment of frames in different light levels.
arXiv Detail & Related papers (2024-02-03T00:40:22Z) - Exposure Bracketing is All You Need for Unifying Image Restoration and Enhancement Tasks [50.822601495422916]
We propose to utilize exposure bracketing photography to unify image restoration and enhancement tasks.
Due to the difficulty in collecting real-world pairs, we suggest a solution that first pre-trains the model with synthetic paired data.
In particular, a temporally modulated recurrent network (TMRNet) and self-supervised adaptation method are proposed.
arXiv Detail & Related papers (2024-01-01T14:14:35Z) - Joint Video Multi-Frame Interpolation and Deblurring under Unknown
Exposure Time [101.91824315554682]
In this work, we aim ambitiously for a more realistic and challenging task - joint video multi-frame and deblurring under unknown exposure time.
We first adopt a variant of supervised contrastive learning to construct an exposure-aware representation from input blurred frames.
We then build our video reconstruction network upon the exposure and motion representation by progressive exposure-adaptive convolution and motion refinement.
arXiv Detail & Related papers (2023-03-27T09:43:42Z) - ExReg: Wide-range Photo Exposure Correction via a Multi-dimensional
Regressor with Attention [6.142272540492936]
Photo exposure correction is widely investigated, but fewer studies focus on correcting under and over-exposed images simultaneously.
We propose a novel exposure correction network, ExReg, to address the challenges by formulating exposure correction as a multi-dimensional regression process.
Experiments show that ExReg can generate well-exposed results and outperform the SOTA method by 1.3dB in PSNR for extensive exposure problems.
arXiv Detail & Related papers (2022-12-14T15:45:10Z) - Motion-blurred Video Interpolation and Extrapolation [72.3254384191509]
We present a novel framework for deblurring, interpolating and extrapolating sharp frames from a motion-blurred video in an end-to-end manner.
To ensure temporal coherence across predicted frames and address potential temporal ambiguity, we propose a simple, yet effective flow-based rule.
arXiv Detail & Related papers (2021-03-04T12:18:25Z) - Unsupervised Low-light Image Enhancement with Decoupled Networks [103.74355338972123]
We learn a two-stage GAN-based framework to enhance the real-world low-light images in a fully unsupervised fashion.
Our proposed method outperforms the state-of-the-art unsupervised image enhancement methods in terms of both illumination enhancement and noise reduction.
arXiv Detail & Related papers (2020-05-06T13:37:08Z) - Learning Multi-Scale Photo Exposure Correction [51.57836446833474]
Capturing photographs with wrong exposures remains a major source of errors in camera-based imaging.
We propose a coarse-to-fine deep neural network (DNN) model, trainable in an end-to-end manner, that addresses each sub-problem separately.
Our method achieves results on par with existing state-of-the-art methods on underexposed images.
arXiv Detail & Related papers (2020-03-25T19:33:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.