Instagram Filter Removal on Fashionable Images
- URL: http://arxiv.org/abs/2104.05072v1
- Date: Sun, 11 Apr 2021 18:44:43 GMT
- Title: Instagram Filter Removal on Fashionable Images
- Authors: Furkan K{\i}nl{\i}, Bar{\i}\c{s} \"Ozcan, Furkan K{\i}ra\c{c}
- Abstract summary: We introduce Instagram Filter Removal Network (IFRNet) to mitigate the effects of image filters for social media analysis applications.
Experiments demonstrate IFRNet outperforms all compared methods in quantitative and qualitative comparisons.
We present the filter classification performance of our proposed model, and analyze the dominant color estimation on the images unfiltered by all compared methods.
- Score: 2.1485350418225244
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Social media images are generally transformed by filtering to obtain
aesthetically more pleasing appearances. However, CNNs generally fail to
interpret both the image and its filtered version as the same in the visual
analysis of social media images. We introduce Instagram Filter Removal Network
(IFRNet) to mitigate the effects of image filters for social media analysis
applications. To achieve this, we assume any filter applied to an image
substantially injects a piece of additional style information to it, and we
consider this problem as a reverse style transfer problem. The visual effects
of filtering can be directly removed by adaptively normalizing external style
information in each level of the encoder. Experiments demonstrate that IFRNet
outperforms all compared methods in quantitative and qualitative comparisons,
and has the ability to remove the visual effects to a great extent.
Additionally, we present the filter classification performance of our proposed
model, and analyze the dominant color estimation on the images unfiltered by
all compared methods.
Related papers
- Prompt-Guided Image-Adaptive Neural Implicit Lookup Tables for Interpretable Image Enhancement [4.233370898095789]
interpretable image enhancement is a technique that enhances image quality by adjusting filter parameters with easily understandable names such as "Exposure" and "Contrast"
We introduce an image-adaptive neural implicit lookup table, which uses a multilayer perceptron to implicitly define the transformation from input feature space to output color space.
We evaluate visual impressions of enhancement results, such as exposure and contrast, using a vision and language model along with guiding prompts.
arXiv Detail & Related papers (2024-08-20T17:59:01Z) - FaceFilterSense: A Filter-Resistant Face Recognition and Facial Attribute Analysis Framework [1.673834743879962]
Fun selfie filters have come into tremendous mainstream use affecting the functioning of facial biometric systems.
Current AR-based filters and filters which distort facial key points are in vogue recently and make the faces highly unrecognizable even to the naked eye.
To mitigate these limitations, we aim to perform a holistic impact analysis of the latest filters and propose an user recognition model with the filtered images.
arXiv Detail & Related papers (2024-04-12T07:04:56Z) - AIM 2022 Challenge on Instagram Filter Removal: Methods and Results [66.98814754338841]
This paper introduces the methods and the results of AIM 2022 challenge on Instagram Filter Removal.
The main goal of this challenge is to produce realistic and visually plausible images where the impact of the filters applied is mitigated while preserving the content.
There are two prior studies on this task as the baseline, and a total of 9 teams have competed in the final phase of the challenge.
arXiv Detail & Related papers (2022-10-17T12:21:59Z) - Patch-wise Contrastive Style Learning for Instagram Filter Removal [3.867363075280544]
Social media filters are one of the most common resources of various corruptions and perturbations for real-world visual analysis applications.
We introduce Contrastive Instagram Filter Removal Network (CIFR), which enhances this idea for Instagram filter removal by employing a novel multi-layer patch-wise contrastive style learning mechanism.
arXiv Detail & Related papers (2022-04-15T14:38:28Z) - Unsharp Mask Guided Filtering [53.14430987860308]
The goal of this paper is guided image filtering, which emphasizes the importance of structure transfer during filtering.
We propose a new and simplified formulation of the guided filter inspired by unsharp masking.
Our formulation enjoys a filtering prior to a low-pass filter and enables explicit structure transfer by estimating a single coefficient.
arXiv Detail & Related papers (2021-06-02T19:15:34Z) - Adaptive Debanding Filter [55.42929350861115]
Banding artifacts manifest as staircase-like color bands on pictures or video frames.
We propose a content-adaptive smoothing filtering followed by dithered quantization, as a post-processing module.
Experimental results show that our proposed debanding filter outperforms state-of-the-art false contour removing algorithms both visually and quantitatively.
arXiv Detail & Related papers (2020-09-22T20:44:20Z) - Filter Grafting for Deep Neural Networks: Reason, Method, and
Cultivation [86.91324735966766]
Filter is the key component in modern convolutional neural networks (CNNs)
In this paper, we introduce filter grafting (textbfMethod) to achieve this goal.
We develop a novel criterion to measure the information of filters and an adaptive weighting strategy to balance the grafted information among networks.
arXiv Detail & Related papers (2020-04-26T08:36:26Z) - Convolutional Neural Network Pruning Using Filter Attenuation [10.282782377635106]
Filters are essential elements in convolutional neural networks (CNNs)
In filter pruning methods, a filter with all of its components, including channels and connections, are removed.
We propose a CNN pruning method based on filter attenuation in which weak filters are not directly removed.
arXiv Detail & Related papers (2020-02-09T06:31:24Z) - Filter Grafting for Deep Neural Networks [71.39169475500324]
Filter grafting aims to improve the representation capability of Deep Neural Networks (DNNs)
We develop an entropy-based criterion to measure the information of filters and an adaptive weighting strategy for balancing the grafted information among networks.
For example, the grafted MobileNetV2 outperforms the non-grafted MobileNetV2 by about 7 percent on CIFAR-100 dataset.
arXiv Detail & Related papers (2020-01-15T03:18:57Z) - Recognizing Instagram Filtered Images with Feature De-stylization [81.38905784617089]
This paper presents a study on how popular pretrained models are affected by commonly used Instagram filters.
Our analysis suggests that simple structure preserving filters which only alter the global appearance of an image can lead to large differences in the convolutional feature space.
We introduce a lightweight de-stylization module that predicts parameters used for scaling and shifting feature maps to "undo" the changes incurred by filters.
arXiv Detail & Related papers (2019-12-30T16:48:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.