Raw Image Deblurring
- URL: http://arxiv.org/abs/2012.04264v1
- Date: Tue, 8 Dec 2020 08:03:09 GMT
- Title: Raw Image Deblurring
- Authors: Chih-Hung Liang, Yu-An Chen, Yueh-Cheng Liu, Winston H. Hsu
- Abstract summary: We build a new dataset containing both RAW images and processed sRGB images and design a new model to utilize the unique characteristics of RAW images.
The proposed deblurring model, trained solely from RAW images, achieves the state-of-art performance and outweighs those trained on processed sRGB images.
- Score: 24.525466412146358
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep learning-based blind image deblurring plays an essential role in solving
image blur since all existing kernels are limited in modeling the real world
blur. Thus far, researchers focus on powerful models to handle the deblurring
problem and achieve decent results. For this work, in a new aspect, we discover
the great opportunity for image enhancement (e.g., deblurring) directly from
RAW images and investigate novel neural network structures benefiting RAW-based
learning. However, to the best of our knowledge, there is no available RAW
image deblurring dataset. Therefore, we built a new dataset containing both RAW
images and processed sRGB images and design a new model to utilize the unique
characteristics of RAW images. The proposed deblurring model, trained solely
from RAW images, achieves the state-of-art performance and outweighs those
trained on processed sRGB images. Furthermore, with fine-tuning, the proposed
model, trained on our new dataset, can generalize to other sensors.
Additionally, by a series of experiments, we demonstrate that existing
deblurring models can also be improved by training on the RAW images in our new
dataset. Ultimately, we show a new venue for further opportunities based on the
devised novel raw-based deblurring method and the brand-new Deblur-RAW dataset.
Related papers
- Rawformer: Unpaired Raw-to-Raw Translation for Learnable Camera ISPs [53.68932498994655]
This paper introduces a novel method for unpaired learning of raw-to-raw translation across diverse cameras.
It accurately maps raw images captured by a certain camera to the target camera, facilitating the generalization of learnable ISPs to new unseen cameras.
Our method demonstrates superior performance on real camera datasets, achieving higher accuracy compared to previous state-of-the-art techniques.
arXiv Detail & Related papers (2024-04-16T16:17:48Z) - BSRAW: Improving Blind RAW Image Super-Resolution [63.408484584265985]
We tackle blind image super-resolution in the RAW domain.
We design a realistic degradation pipeline tailored specifically for training models with raw sensor data.
Our BSRAW models trained with our pipeline can upscale real-scene RAW images and improve their quality.
arXiv Detail & Related papers (2023-12-24T14:17:28Z) - Raw Image Reconstruction with Learned Compact Metadata [61.62454853089346]
We propose a novel framework to learn a compact representation in the latent space serving as the metadata in an end-to-end manner.
We show how the proposed raw image compression scheme can adaptively allocate more bits to image regions that are important from a global perspective.
arXiv Detail & Related papers (2023-02-25T05:29:45Z) - Efficient Visual Computing with Camera RAW Snapshots [41.9863557302409]
Conventional cameras capture image irradiance on a sensor and convert it to RGB images using an image signal processor (ISP)
One can argue that since RAW images contain all the captured information, the conversion of RAW to RGB using an ISP is not necessary for visual computing.
We propose a novel $rho$-Vision framework to perform high-level semantic understanding and low-level compression using RAW images.
arXiv Detail & Related papers (2022-12-15T12:54:21Z) - Reversed Image Signal Processing and RAW Reconstruction. AIM 2022
Challenge Report [109.2135194765743]
This paper introduces the AIM 2022 Challenge on Reversed Image Signal Processing and RAW Reconstruction.
We aim to recover raw sensor images from the corresponding RGBs without metadata and, by doing this, "reverse" the ISP transformation.
arXiv Detail & Related papers (2022-10-20T10:43:53Z) - Model-Based Image Signal Processors via Learnable Dictionaries [6.766416093990318]
Digital cameras transform sensor RAW readings into RGB images by means of their Image Signal Processor (ISP)
Recent approaches have attempted to bridge this gap by estimating the RGB to RAW mapping.
We present a novel hybrid model-based and data-driven ISP that is both learnable and interpretable.
arXiv Detail & Related papers (2022-01-10T08:36:10Z) - Towards Low Light Enhancement with RAW Images [101.35754364753409]
We make the first benchmark effort to elaborate on the superiority of using RAW images in the low light enhancement.
We develop a new evaluation framework, Factorized Enhancement Model (FEM), which decomposes the properties of RAW images into measurable factors.
A RAW-guiding Exposure Enhancement Network (REENet) is developed, which makes trade-offs between the advantages and inaccessibility of RAW images in real applications.
arXiv Detail & Related papers (2021-12-28T07:27:51Z) - Invertible Image Signal Processing [42.109752151834456]
Invertible Image Signal Processing (InvISP) pipeline enables rendering visually appealing sRGB images.
We can reconstruct realistic RAW data instead of synthesizing RAW data from sRGB images without any memory overhead.
arXiv Detail & Related papers (2021-03-28T06:30:15Z) - ISP Distillation [38.19032198060534]
High-level machine vision models, such as object recognition or semantic segmentation, assume images are transformed into some canonical image space by the camera.
The camera ISP is optimized for producing visually pleasing images for human observers and not for machines.
We show that our performance on RAW images for object classification and semantic segmentation is significantly better than models trained on labeled RAW images.
arXiv Detail & Related papers (2021-01-25T16:12:24Z) - Deblurring by Realistic Blurring [110.54173799114785]
We propose a new method which combines two GAN models, i.e., a learning-to-blurr GAN (BGAN) and learning-to-DeBlur GAN (DBGAN)
The first model, BGAN, learns how to blur sharp images with unpaired sharp and blurry image sets, and then guides the second model, DBGAN, to learn how to correctly deblur such images.
As an additional contribution, this paper also introduces a Real-World Blurred Image (RWBI) dataset including diverse blurry images.
arXiv Detail & Related papers (2020-04-04T05:25:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.