Patch-wise Contrastive Style Learning for Instagram Filter Removal

• URL: http://arxiv.org/abs/2204.07486v1
• Date: Fri, 15 Apr 2022 14:38:28 GMT
• Title: Patch-wise Contrastive Style Learning for Instagram Filter Removal
• Authors: Furkan K{\i}nl{\i}, Bar{\i}\c{s} \"Ozcan, Furkan K{\i}ra\c{c}
• Abstract summary: Social media filters are one of the most common resources of various corruptions and perturbations for real-world visual analysis applications. We introduce Contrastive Instagram Filter Removal Network (CIFR), which enhances this idea for Instagram filter removal by employing a novel multi-layer patch-wise contrastive style learning mechanism.
• Score: 3.867363075280544
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Image-level corruptions and perturbations degrade the performance of CNNs on different downstream vision tasks. Social media filters are one of the most common resources of various corruptions and perturbations for real-world visual analysis applications. The negative effects of these distractive factors can be alleviated by recovering the original images with their pure style for the inference of the downstream vision tasks. Assuming these filters substantially inject a piece of additional style information to the social media images, we can formulate the problem of recovering the original versions as a reverse style transfer problem. We introduce Contrastive Instagram Filter Removal Network (CIFR), which enhances this idea for Instagram filter removal by employing a novel multi-layer patch-wise contrastive style learning mechanism. Experiments show our proposed strategy produces better qualitative and quantitative results than the previous studies. Moreover, we present the results of our additional experiments for proposed architecture within different settings. Finally, we present the inference outputs and quantitative comparison of filtered and recovered images on localization and segmentation tasks to encourage the main motivation for this problem.

Related papers

• Catch-Up Mix: Catch-Up Class for Struggling Filters in CNN [15.3232203753165]
  Deep learning models often face challenges related to complexity and overfitting. One notable concern is that the model often relies heavily on a limited subset of filters for making predictions. We present a novel method called Catch-up Mix, which provides learning opportunities to a wide range of filters during training.
  arXiv  Detail & Related papers  (2024-01-24T02:42:50Z)
• AIM 2022 Challenge on Instagram Filter Removal: Methods and Results [66.98814754338841]
  This paper introduces the methods and the results of AIM 2022 challenge on Instagram Filter Removal. The main goal of this challenge is to produce realistic and visually plausible images where the impact of the filters applied is mitigated while preserving the content. There are two prior studies on this task as the baseline, and a total of 9 teams have competed in the final phase of the challenge.
  arXiv  Detail & Related papers  (2022-10-17T12:21:59Z)
• Hierarchical Similarity Learning for Aliasing Suppression Image Super-Resolution [64.15915577164894]
  A hierarchical image super-resolution network (HSRNet) is proposed to suppress the influence of aliasing. HSRNet achieves better quantitative and visual performance than other works, and remits the aliasing more effectively.
  arXiv  Detail & Related papers  (2022-06-07T14:55:32Z)
• Deep Image Deblurring: A Survey [165.32391279761006]
  Deblurring is a classic problem in low-level computer vision, which aims to recover a sharp image from a blurred input image. Recent advances in deep learning have led to significant progress in solving this problem.
  arXiv  Detail & Related papers  (2022-01-26T01:31:30Z)
• Instagram Filter Removal on Fashionable Images [2.1485350418225244]
  We introduce Instagram Filter Removal Network (IFRNet) to mitigate the effects of image filters for social media analysis applications. Experiments demonstrate IFRNet outperforms all compared methods in quantitative and qualitative comparisons. We present the filter classification performance of our proposed model, and analyze the dominant color estimation on the images unfiltered by all compared methods.
  arXiv  Detail & Related papers  (2021-04-11T18:44:43Z)
• Image Restoration by Deep Projected GSURE [115.57142046076164]
  Ill-posed inverse problems appear in many image processing applications, such as deblurring and super-resolution. We propose a new image restoration framework that is based on minimizing a loss function that includes a "projected-version" of the Generalized SteinUnbiased Risk Estimator (GSURE) and parameterization of the latent image by a CNN.
  arXiv  Detail & Related papers  (2021-02-04T08:52:46Z)
• Recognizing Instagram Filtered Images with Feature De-stylization [81.38905784617089]
  This paper presents a study on how popular pretrained models are affected by commonly used Instagram filters. Our analysis suggests that simple structure preserving filters which only alter the global appearance of an image can lead to large differences in the convolutional feature space. We introduce a lightweight de-stylization module that predicts parameters used for scaling and shifting feature maps to "undo" the changes incurred by filters.
  arXiv  Detail & Related papers  (2019-12-30T16:48:16Z)
• Single image reflection removal via learning with multi-image constraints [50.54095311597466]
  We propose a novel learning-based solution that combines the advantages of the aforementioned approaches and overcomes their drawbacks. Our algorithm works by learning a deep neural network to optimize the target with joint constraints enhanced among multiple input images. Our algorithm runs in real-time and state-of-the-art reflection removal performance on real images.
  arXiv  Detail & Related papers  (2019-12-08T06:10:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.