Raw Instinct: Trust Your Classifiers and Skip the Conversion
- URL: http://arxiv.org/abs/2403.14439v1
- Date: Thu, 21 Mar 2024 14:45:41 GMT
- Title: Raw Instinct: Trust Your Classifiers and Skip the Conversion
- Authors: Christos Kantas, Bjørk Antoniussen, Mathias V. Andersen, Rasmus Munksø, Shobhit Kotnala, Simon B. Jensen, Andreas Møgelmose, Lau Nørgaard, Thomas B. Moeslund,
- Abstract summary: We show that a sufficiently advanced classifier can yield equivalent results on RAW input compared to RGB.
We furthermore show that the total computation time from RAW image data to classification results for RAW images can be up to 8.46 times faster than RGB.
- Score: 12.323236593352698
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Using RAW-images in computer vision problems is surprisingly underexplored considering that converting from RAW to RGB does not introduce any new capture information. In this paper, we show that a sufficiently advanced classifier can yield equivalent results on RAW input compared to RGB and present a new public dataset consisting of RAW images and the corresponding converted RGB images. Classifying images directly from RAW is attractive, as it allows for skipping the conversion to RGB, lowering computation time significantly. Two CNN classifiers are used to classify the images in both formats, confirming that classification performance can indeed be preserved. We furthermore show that the total computation time from RAW image data to classification results for RAW images can be up to 8.46 times faster than RGB. These results contribute to the evidence found in related works, that using RAW images as direct input to computer vision algorithms looks very promising.
Related papers
- BSRAW: Improving Blind RAW Image Super-Resolution [63.408484584265985]
We tackle blind image super-resolution in the RAW domain.
We design a realistic degradation pipeline tailored specifically for training models with raw sensor data.
Our BSRAW models trained with our pipeline can upscale real-scene RAW images and improve their quality.
arXiv Detail & Related papers (2023-12-24T14:17:28Z) - Self-Supervised Reversed Image Signal Processing via Reference-Guided
Dynamic Parameter Selection [1.1602089225841632]
We propose a self-supervised reversed ISP method that does not require metadata and paired images.
The proposed method converts a RGB image into a RAW-like image taken in the same environment with the same sensor as a reference RAW image.
We show that the proposed method is able to learn various reversed ISPs with comparable accuracy to other state-of-the-art supervised methods.
arXiv Detail & Related papers (2023-03-24T11:12:05Z) - Efficient Visual Computing with Camera RAW Snapshots [41.9863557302409]
Conventional cameras capture image irradiance on a sensor and convert it to RGB images using an image signal processor (ISP)
One can argue that since RAW images contain all the captured information, the conversion of RAW to RGB using an ISP is not necessary for visual computing.
We propose a novel $rho$-Vision framework to perform high-level semantic understanding and low-level compression using RAW images.
arXiv Detail & Related papers (2022-12-15T12:54:21Z) - Reversed Image Signal Processing and RAW Reconstruction. AIM 2022
Challenge Report [109.2135194765743]
This paper introduces the AIM 2022 Challenge on Reversed Image Signal Processing and RAW Reconstruction.
We aim to recover raw sensor images from the corresponding RGBs without metadata and, by doing this, "reverse" the ISP transformation.
arXiv Detail & Related papers (2022-10-20T10:43:53Z) - Learning sRGB-to-Raw-RGB De-rendering with Content-Aware Metadata [46.28281823015191]
We show how to improve the de-rendering results by jointly learning sampling and reconstruction.
Our experiments show that our learned sampling can adapt to the image content to produce better raw reconstructions than existing methods.
arXiv Detail & Related papers (2022-06-03T20:43:17Z) - Towards Low Light Enhancement with RAW Images [101.35754364753409]
We make the first benchmark effort to elaborate on the superiority of using RAW images in the low light enhancement.
We develop a new evaluation framework, Factorized Enhancement Model (FEM), which decomposes the properties of RAW images into measurable factors.
A RAW-guiding Exposure Enhancement Network (REENet) is developed, which makes trade-offs between the advantages and inaccessibility of RAW images in real applications.
arXiv Detail & Related papers (2021-12-28T07:27:51Z) - Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervision [76.41657124981549]
This paper presents a joint learning model for image alignment and RAW-to-sRGB mapping.
Experiments show that our method performs favorably against state-of-the-arts on ZRR and SR-RAW datasets.
arXiv Detail & Related papers (2021-08-18T12:41:36Z) - Invertible Image Signal Processing [42.109752151834456]
Invertible Image Signal Processing (InvISP) pipeline enables rendering visually appealing sRGB images.
We can reconstruct realistic RAW data instead of synthesizing RAW data from sRGB images without any memory overhead.
arXiv Detail & Related papers (2021-03-28T06:30:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.