Towards Low Light Enhancement with RAW Images
- URL: http://arxiv.org/abs/2112.14022v1
- Date: Tue, 28 Dec 2021 07:27:51 GMT
- Title: Towards Low Light Enhancement with RAW Images
- Authors: Haofeng Huang, Wenhan Yang, Yueyu Hu, Jiaying Liu and Ling-Yu Duan
- Abstract summary: We make the first benchmark effort to elaborate on the superiority of using RAW images in the low light enhancement.
We develop a new evaluation framework, Factorized Enhancement Model (FEM), which decomposes the properties of RAW images into measurable factors.
A RAW-guiding Exposure Enhancement Network (REENet) is developed, which makes trade-offs between the advantages and inaccessibility of RAW images in real applications.
- Score: 101.35754364753409
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we make the first benchmark effort to elaborate on the
superiority of using RAW images in the low light enhancement and develop a
novel alternative route to utilize RAW images in a more flexible and practical
way. Inspired by a full consideration on the typical image processing pipeline,
we are inspired to develop a new evaluation framework, Factorized Enhancement
Model (FEM), which decomposes the properties of RAW images into measurable
factors and provides a tool for exploring how properties of RAW images affect
the enhancement performance empirically. The empirical benchmark results show
that the Linearity of data and Exposure Time recorded in meta-data play the
most critical role, which brings distinct performance gains in various measures
over the approaches taking the sRGB images as input. With the insights obtained
from the benchmark results in mind, a RAW-guiding Exposure Enhancement Network
(REENet) is developed, which makes trade-offs between the advantages and
inaccessibility of RAW images in real applications in a way of using RAW images
only in the training phase. REENet projects sRGB images into linear RAW domains
to apply constraints with corresponding RAW images to reduce the difficulty of
modeling training. After that, in the testing phase, our REENet does not rely
on RAW images. Experimental results demonstrate not only the superiority of
REENet to state-of-the-art sRGB-based methods and but also the effectiveness of
the RAW guidance and all components.
Related papers
- BSRAW: Improving Blind RAW Image Super-Resolution [63.408484584265985]
We tackle blind image super-resolution in the RAW domain.
We design a realistic degradation pipeline tailored specifically for training models with raw sensor data.
Our BSRAW models trained with our pipeline can upscale real-scene RAW images and improve their quality.
arXiv Detail & Related papers (2023-12-24T14:17:28Z) - Self-Supervised Reversed Image Signal Processing via Reference-Guided
Dynamic Parameter Selection [1.1602089225841632]
We propose a self-supervised reversed ISP method that does not require metadata and paired images.
The proposed method converts a RGB image into a RAW-like image taken in the same environment with the same sensor as a reference RAW image.
We show that the proposed method is able to learn various reversed ISPs with comparable accuracy to other state-of-the-art supervised methods.
arXiv Detail & Related papers (2023-03-24T11:12:05Z) - Raw Image Reconstruction with Learned Compact Metadata [61.62454853089346]
We propose a novel framework to learn a compact representation in the latent space serving as the metadata in an end-to-end manner.
We show how the proposed raw image compression scheme can adaptively allocate more bits to image regions that are important from a global perspective.
arXiv Detail & Related papers (2023-02-25T05:29:45Z) - Reversed Image Signal Processing and RAW Reconstruction. AIM 2022
Challenge Report [109.2135194765743]
This paper introduces the AIM 2022 Challenge on Reversed Image Signal Processing and RAW Reconstruction.
We aim to recover raw sensor images from the corresponding RGBs without metadata and, by doing this, "reverse" the ISP transformation.
arXiv Detail & Related papers (2022-10-20T10:43:53Z) - Model-Based Image Signal Processors via Learnable Dictionaries [6.766416093990318]
Digital cameras transform sensor RAW readings into RGB images by means of their Image Signal Processor (ISP)
Recent approaches have attempted to bridge this gap by estimating the RGB to RAW mapping.
We present a novel hybrid model-based and data-driven ISP that is both learnable and interpretable.
arXiv Detail & Related papers (2022-01-10T08:36:10Z) - Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervision [76.41657124981549]
This paper presents a joint learning model for image alignment and RAW-to-sRGB mapping.
Experiments show that our method performs favorably against state-of-the-arts on ZRR and SR-RAW datasets.
arXiv Detail & Related papers (2021-08-18T12:41:36Z) - Invertible Image Signal Processing [42.109752151834456]
Invertible Image Signal Processing (InvISP) pipeline enables rendering visually appealing sRGB images.
We can reconstruct realistic RAW data instead of synthesizing RAW data from sRGB images without any memory overhead.
arXiv Detail & Related papers (2021-03-28T06:30:15Z) - Raw Image Deblurring [24.525466412146358]
We build a new dataset containing both RAW images and processed sRGB images and design a new model to utilize the unique characteristics of RAW images.
The proposed deblurring model, trained solely from RAW images, achieves the state-of-art performance and outweighs those trained on processed sRGB images.
arXiv Detail & Related papers (2020-12-08T08:03:09Z) - Characteristic Regularisation for Super-Resolving Face Images [81.84939112201377]
Existing facial image super-resolution (SR) methods focus mostly on improving artificially down-sampled low-resolution (LR) imagery.
Previous unsupervised domain adaptation (UDA) methods address this issue by training a model using unpaired genuine LR and HR data.
This renders the model overstretched with two tasks: consistifying the visual characteristics and enhancing the image resolution.
We formulate a method that joins the advantages of conventional SR and UDA models.
arXiv Detail & Related papers (2019-12-30T16:27:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.