Rendering Nighttime Image Via Cascaded Color and Brightness Compensation

• URL: http://arxiv.org/abs/2204.08970v2
• Date: Thu, 21 Apr 2022 17:23:11 GMT
• Title: Rendering Nighttime Image Via Cascaded Color and Brightness Compensation
• Authors: Zhihao Li, Si Yi, Zhan Ma
• Abstract summary: We build a high-resolution nighttime RAW-RGB dataset with white balance and tone mapping annotated by experts. We then develop the CBUnet, a two-stage NN ISP to cascade the compensation of color and brightness attributes. Experiments show that our method has better visual quality compared to traditional ISP pipeline.
• Score: 22.633061635144887
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Image signal processing (ISP) is crucial for camera imaging, and neural networks (NN) solutions are extensively deployed for daytime scenes. The lack of sufficient nighttime image dataset and insights on nighttime illumination characteristics poses a great challenge for high-quality rendering using existing NN ISPs. To tackle it, we first built a high-resolution nighttime RAW-RGB (NR2R) dataset with white balance and tone mapping annotated by expert professionals. Meanwhile, to best capture the characteristics of nighttime illumination light sources, we develop the CBUnet, a two-stage NN ISP to cascade the compensation of color and brightness attributes. Experiments show that our method has better visual quality compared to traditional ISP pipeline, and is ranked at the second place in the NTIRE 2022 Night Photography Rendering Challenge for two tracks by respective People's and Professional Photographer's choices. The code and relevant materials are avaiable on our website: https://njuvision.github.io/CBUnet.

Related papers

• You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement [50.37253008333166]
  Low-Light Image Enhancement (LLIE) task tends to restore the details and visual information from corrupted low-light images. We propose a novel trainable color space, named Horizontal/Vertical-Intensity (HVI) It not only decouples brightness and color from RGB channels to mitigate the instability during enhancement but also adapts to low-light images in different illumination ranges due to the trainable parameters.
  arXiv  Detail & Related papers  (2024-02-08T16:47:43Z)
• D2HNet: Joint Denoising and Deblurring with Hierarchical Network for Robust Night Image Restoration [17.6005530147501]
  Night imaging with modern smartphone cameras is troublesome due to low photon count and unavoidable noise in the imaging system. We develop a D2HNet framework to recover a high-quality image by deblurring and enhancing a long-exposure image under the guidance of a short-exposure image. The results on the validation set and real photos demonstrate our methods achieve better visual quality and state-of-the-art quantitative scores.
  arXiv  Detail & Related papers  (2022-07-07T13:42:05Z)
• When the Sun Goes Down: Repairing Photometric Losses for All-Day Depth Estimation [47.617222712429026]
  We show how to use a combination of three techniques to allow the existing photometric losses to work for both day and nighttime images. First, we introduce a per-pixel neural intensity transformation to compensate for the light changes that occur between successive frames. Second, we predict a per-pixel residual flow map that we use to correct the reprojection correspondences induced by the estimated ego-motion and depth.
  arXiv  Detail & Related papers  (2022-06-28T09:29:55Z)
• Day-to-Night Image Synthesis for Training Nighttime Neural ISPs [39.37467397777888]
  We propose a method that synthesizes nighttime images from daytime images. Daytime images are easy to capture, exhibit low-noise and rarely suffer from motion blur. We show the effectiveness of our synthesis framework by training neural ISPs for nightmode rendering.
  arXiv  Detail & Related papers  (2022-06-06T16:15:45Z)
• Shallow camera pipeline for night photography rendering [20.683831741296444]
  We introduce a camera pipeline for rendering photographs in low light conditions, as part of the NTIRE2022 Night Photography Rendering challenge. Our pipeline exploits a local light enhancer as a form of high dynamic range correction, followed by a global adjustment of the image histogram to prevent washed-out results. The solution reached the fifth place in the competition, with a preference vote count comparable to those of other entries, based on deep convolutional neural networks.
  arXiv  Detail & Related papers  (2022-04-19T16:18:21Z)
• Nighttime Dehazing with a Synthetic Benchmark [147.21955799938115]
  We propose a novel synthetic method called 3R to simulate nighttime hazy images from daytime clear images. We generate realistic nighttime hazy images by sampling real-world light colors from a prior empirical distribution. Experiment results demonstrate their superiority over state-of-the-art methods in terms of both image quality and runtime.
  arXiv  Detail & Related papers  (2020-08-10T02:16:46Z)
• An Integrated Enhancement Solution for 24-hour Colorful Imaging [51.782600936647235]
  Current industry practice for 24-hour outdoor imaging is to use a silicon camera supplemented with near-infrared (NIR) illumination. This will result in color images with poor contrast at daytime and absence of chrominance at nighttime. We propose a novel and integrated enhancement solution that produces clear color images, whether at abundant sunlight daytime or extremely low-light nighttime.
  arXiv  Detail & Related papers  (2020-05-10T05:11:34Z)
• Deep White-Balance Editing [50.08927449718674]
  Cameras capture sensor images that are rendered by their integrated signal processor (ISP) to a standard RGB (sRGB) color space encoding. Recent work by [3] showed that sRGB images that were rendered with the incorrect white balance cannot be easily corrected due to the ISP's nonlinear rendering. We propose to solve this problem with a deep neural network (DNN) architecture trained in an end-to-end manner to learn the correct white balance.
  arXiv  Detail & Related papers  (2020-04-03T03:18:42Z)
• Night-time Scene Parsing with a Large Real Dataset [67.11211537439152]
  We aim to address the night-time scene parsing (NTSP) problem, which has two main challenges. To tackle the scarcity of night-time data, we collect a novel labeled dataset, named it NightCity, of 4,297 real night-time images. We also propose an exposure-aware framework to address the NTSP problem through augmenting the segmentation process with explicitly learned exposure features.
  arXiv  Detail & Related papers  (2020-03-15T18:11:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.