RSFNet: A White-Box Image Retouching Approach using Region-Specific Color Filters

• URL: http://arxiv.org/abs/2303.08682v2
• Date: Sat, 19 Aug 2023 05:31:30 GMT
• Title: RSFNet: A White-Box Image Retouching Approach using Region-Specific Color Filters
• Authors: Wenqi Ouyang, Yi Dong, Xiaoyang Kang, Peiran Ren, Xin Xu, Xuansong Xie
• Abstract summary: We develop a white-box framework for photo retouching using parallel region-specific filters, called RSFNet. Our model generates filter arguments and attention maps of regions for each filter simultaneously. Our experiments demonstrate that RSFNet achieves state-of-the-art results, offering satisfying aesthetic appeal and increased user convenience for editable white-box retouching.
• Score: 25.666027585116176
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Retouching images is an essential aspect of enhancing the visual appeal of photos. Although users often share common aesthetic preferences, their retouching methods may vary based on their individual preferences. Therefore, there is a need for white-box approaches that produce satisfying results and enable users to conveniently edit their images simultaneously. Recent white-box retouching methods rely on cascaded global filters that provide image-level filter arguments but cannot perform fine-grained retouching. In contrast, colorists typically employ a divide-and-conquer approach, performing a series of region-specific fine-grained enhancements when using traditional tools like Davinci Resolve. We draw on this insight to develop a white-box framework for photo retouching using parallel region-specific filters, called RSFNet. Our model generates filter arguments (e.g., saturation, contrast, hue) and attention maps of regions for each filter simultaneously. Instead of cascading filters, RSFNet employs linear summations of filters, allowing for a more diverse range of filter classes that can be trained more easily. Our experiments demonstrate that RSFNet achieves state-of-the-art results, offering satisfying aesthetic appeal and increased user convenience for editable white-box retouching.

Related papers

• Prompt-Guided Image-Adaptive Neural Implicit Lookup Tables for Interpretable Image Enhancement [4.233370898095789]
  interpretable image enhancement is a technique that enhances image quality by adjusting filter parameters with easily understandable names such as "Exposure" and "Contrast" We introduce an image-adaptive neural implicit lookup table, which uses a multilayer perceptron to implicitly define the transformation from input feature space to output color space. We evaluate visual impressions of enhancement results, such as exposure and contrast, using a vision and language model along with guiding prompts.
  arXiv  Detail & Related papers  (2024-08-20T17:59:01Z)
• Simple Image Signal Processing using Global Context Guidance [56.41827271721955]
  Deep learning-based ISPs aim to transform RAW images into DSLR-like RGB images using deep neural networks. We propose a novel module that can be integrated into any neural ISP to capture the global context information from the full RAW images. Our model achieves state-of-the-art results on different benchmarks using diverse and real smartphone images.
  arXiv  Detail & Related papers  (2024-04-17T17:11:47Z)
• Enhancing Low-Light Images Using Infrared-Encoded Images [81.8710581927427]
  Previous arts mainly focus on the low-light images captured in the visible spectrum using pixel-wise loss. We propose a novel approach to increase the visibility of images captured under low-light environments by removing the in-camera infrared (IR) cut-off filter.
  arXiv  Detail & Related papers  (2023-07-09T08:29:19Z)
• Transform your Smartphone into a DSLR Camera: Learning the ISP in the Wild [159.71025525493354]
  We propose a trainable Image Signal Processing framework that produces DSLR quality images given RAW images captured by a smartphone. To address the color misalignments between training image pairs, we employ a color-conditional ISP network and optimize a novel parametric color mapping between each input RAW and reference DSLR image.
  arXiv  Detail & Related papers  (2022-03-20T20:13:59Z)
• Image Edge Restoring Filter [4.060948640328565]
  We propose the image Edge Restoring Filter (ERF) to restore the blur edge pixels in the output of local smoothing filters to be clear. The proposed filter can been implemented after many local smoothing filter.
  arXiv  Detail & Related papers  (2021-12-27T07:02:01Z)
• Unsharp Mask Guided Filtering [53.14430987860308]
  The goal of this paper is guided image filtering, which emphasizes the importance of structure transfer during filtering. We propose a new and simplified formulation of the guided filter inspired by unsharp masking. Our formulation enjoys a filtering prior to a low-pass filter and enables explicit structure transfer by estimating a single coefficient.
  arXiv  Detail & Related papers  (2021-06-02T19:15:34Z)
• Instagram Filter Removal on Fashionable Images [2.1485350418225244]
  We introduce Instagram Filter Removal Network (IFRNet) to mitigate the effects of image filters for social media analysis applications. Experiments demonstrate IFRNet outperforms all compared methods in quantitative and qualitative comparisons. We present the filter classification performance of our proposed model, and analyze the dominant color estimation on the images unfiltered by all compared methods.
  arXiv  Detail & Related papers  (2021-04-11T18:44:43Z)
• Adaptive Debanding Filter [55.42929350861115]
  Banding artifacts manifest as staircase-like color bands on pictures or video frames. We propose a content-adaptive smoothing filtering followed by dithered quantization, as a post-processing module. Experimental results show that our proposed debanding filter outperforms state-of-the-art false contour removing algorithms both visually and quantitatively.
  arXiv  Detail & Related papers  (2020-09-22T20:44:20Z)
• Designing Color Filters that Make Cameras MoreColorimetric [14.097215740999408]
  In this paper, we solve for the filter which returns the modified sensitivities as close to being a linear transformation from the color matching functions of human visual system as possible. Experiments demonstrate that, by taking pictures through our optimised color filters we can make cameras significantly more colorimetric.
  arXiv  Detail & Related papers  (2020-03-27T21:41:30Z)
• Recognizing Instagram Filtered Images with Feature De-stylization [81.38905784617089]
  This paper presents a study on how popular pretrained models are affected by commonly used Instagram filters. Our analysis suggests that simple structure preserving filters which only alter the global appearance of an image can lead to large differences in the convolutional feature space. We introduce a lightweight de-stylization module that predicts parameters used for scaling and shifting feature maps to "undo" the changes incurred by filters.
  arXiv  Detail & Related papers  (2019-12-30T16:48:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.