Crowd-Powered Photo Enhancement Featuring an Active Learning Based Local Filter

• URL: http://arxiv.org/abs/2306.09321v1
• Date: Thu, 15 Jun 2023 17:55:11 GMT
• Title: Crowd-Powered Photo Enhancement Featuring an Active Learning Based Local Filter
• Authors: Satoshi Kosugi, Toshihiko Yamasaki
• Abstract summary: We propose a crowd-powered local enhancement method for content-aware local enhancement. To make it easier to locally optimize the parameters, we propose an active learning based local filter. Our experiments show that the proposed filter outperforms existing filters.
• Score: 42.400427631514596
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this study, we address local photo enhancement to improve the aesthetic quality of an input image by applying different effects to different regions. Existing photo enhancement methods are either not content-aware or not local; therefore, we propose a crowd-powered local enhancement method for content-aware local enhancement, which is achieved by asking crowd workers to locally optimize parameters for image editing functions. To make it easier to locally optimize the parameters, we propose an active learning based local filter. The parameters need to be determined at only a few key pixels selected by an active learning method, and the parameters at the other pixels are automatically predicted using a regression model. The parameters at the selected key pixels are independently optimized, breaking down the optimization problem into a sequence of single-slider adjustments. Our experiments show that the proposed filter outperforms existing filters, and our enhanced results are more visually pleasing than the results by the existing enhancement methods. Our source code and results are available at https://github.com/satoshi-kosugi/crowd-powered.

Related papers

• Local Descriptors Weighted Adaptive Threshold Filtering For Few-Shot Learning [0.0]
  Few-shot image classification is a challenging task in the field of machine learning. We propose an innovative weighted adaptive threshold filtering (WATF) strategy for local descriptors. Our method maintains a simple and lightweight design philosophy without additional learnable parameters.
  arXiv  Detail & Related papers  (2024-08-28T16:36:23Z)
• Prompt-Guided Image-Adaptive Neural Implicit Lookup Tables for Interpretable Image Enhancement [4.233370898095789]
  interpretable image enhancement is a technique that enhances image quality by adjusting filter parameters with easily understandable names such as "Exposure" and "Contrast" We introduce an image-adaptive neural implicit lookup table, which uses a multilayer perceptron to implicitly define the transformation from input feature space to output color space. We evaluate visual impressions of enhancement results, such as exposure and contrast, using a vision and language model along with guiding prompts.
  arXiv  Detail & Related papers  (2024-08-20T17:59:01Z)
• Controllable Image Enhancement [66.18525728881711]
  We present a semiautomatic image enhancement algorithm that can generate high-quality images with multiple styles by controlling a few parameters. An encoder-decoder framework encodes the retouching skills into latent codes and decodes them into the parameters of image signal processing functions.
  arXiv  Detail & Related papers  (2022-06-16T23:54:53Z)
• When A Conventional Filter Meets Deep Learning: Basis Composition Learning on Image Filters [20.506636435344333]
  We propose basis composition learning on single image filters to automatically determine their optimal formulas. Our method is simple yet effective in practice; it renders filters to be user-friendly and benefits fundamental low-level vision problems.
  arXiv  Detail & Related papers  (2022-03-01T06:34:54Z)
• Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution [51.274657266928315]
  We propose a PSF aware plug-and-play deep network, which takes the aberrant image and PSF map as input and produces the latent high quality version via incorporating lens-specific deep priors. Specifically, we pre-train a base model from a set of diverse lenses and then adapt it to a given lens by quickly refining the parameters.
  arXiv  Detail & Related papers  (2021-04-07T12:00:38Z)
• Look here! A parametric learning based approach to redirect visual attention [49.609412873346386]
  We introduce an automatic method to make an image region more attention-capturing via subtle image edits. Our model predicts a distinct set of global parametric transformations to be applied to the foreground and background image regions. Our edits enable inference at interactive rates on any image size, and easily generalize to videos.
  arXiv  Detail & Related papers  (2020-08-12T16:08:36Z)
• DeepLPF: Deep Local Parametric Filters for Image Enhancement [12.515536526953127]
  We introduce a novel approach to automatically enhance images using learned spatially local filters of three different types. DeepLPF regresses the parameters of these spatially localized filters that are then automatically applied to enhance the image. We report on multiple benchmarks and show that DeepLPF produces state-of-the-art performance on two variants of the MIT-Adobe-5K dataset.
  arXiv  Detail & Related papers  (2020-03-31T06:51:21Z)
• Attentive CutMix: An Enhanced Data Augmentation Approach for Deep Learning Based Image Classification [58.20132466198622]
  We propose Attentive CutMix, a naturally enhanced augmentation strategy based on CutMix. In each training iteration, we choose the most descriptive regions based on the intermediate attention maps from a feature extractor. Our proposed method is simple yet effective, easy to implement and can boost the baseline significantly.
  arXiv  Detail & Related papers  (2020-03-29T15:01:05Z)
• Progressive Local Filter Pruning for Image Retrieval Acceleration [43.97722250091591]
  We propose a new Progressive Local Filter Pruning (PLFP) method for image retrieval acceleration. Specifically, layer by layer, we analyze the local geometric properties of each filter and select the one that can be replaced by the neighbors. In this way, the representation ability of the model is preserved.
  arXiv  Detail & Related papers  (2020-01-24T04:28:44Z)
• Recognizing Instagram Filtered Images with Feature De-stylization [81.38905784617089]
  This paper presents a study on how popular pretrained models are affected by commonly used Instagram filters. Our analysis suggests that simple structure preserving filters which only alter the global appearance of an image can lead to large differences in the convolutional feature space. We introduce a lightweight de-stylization module that predicts parameters used for scaling and shifting feature maps to "undo" the changes incurred by filters.
  arXiv  Detail & Related papers  (2019-12-30T16:48:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.