Human vs Objective Evaluation of Colourisation Performance
- URL: http://arxiv.org/abs/2204.05200v1
- Date: Mon, 11 Apr 2022 15:43:23 GMT
- Title: Human vs Objective Evaluation of Colourisation Performance
- Authors: Se\'an Mullery and Paul F. Whelan
- Abstract summary: This work assesses how well commonly used objective measures correlate with human opinion.
For each of 20 images from the BSD dataset, we create 65 recolourisations made up of local and global changes.
Opinion scores are then crowd sourced using the Amazon Mechanical Turk and together with the images this forms the Human Evaluated Colourisation dataset.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automatic colourisation of grey-scale images is the process of creating a
full-colour image from the grey-scale prior. It is an ill-posed problem, as
there are many plausible colourisations for a given grey-scale prior. The
current SOTA in auto-colourisation involves image-to-image type Deep
Convolutional Neural Networks with Generative Adversarial Networks showing the
greatest promise. The end goal of colourisation is to produce full colour
images that appear plausible to the human viewer, but human assessment is
costly and time consuming. This work assesses how well commonly used objective
measures correlate with human opinion. We also attempt to determine what facets
of colourisation have the most significant effect on human opinion. For each of
20 images from the BSD dataset, we create 65 recolourisations made up of local
and global changes. Opinion scores are then crowd sourced using the Amazon
Mechanical Turk and together with the images this forms an extensible dataset
called the Human Evaluated Colourisation Dataset (HECD). While we find
statistically significant correlations between human-opinion scores and a small
number of objective measures, the strength of the correlations is low. There is
also evidence that human observers are most intolerant to an incorrect hue of
naturally occurring objects.
Related papers
- Evaluating Multiview Object Consistency in Humans and Image Models [68.36073530804296]
We leverage an experimental design from the cognitive sciences which requires zero-shot visual inferences about object shape.
We collect 35K trials of behavioral data from over 500 participants.
We then evaluate the performance of common vision models.
arXiv Detail & Related papers (2024-09-09T17:59:13Z) - Comparative Analysis Of Color Models For Human Perception And Visual Color Difference [0.0]
The study evaluates color models such as RGB, HSV, HSL, XYZ, CIELAB, and CIELUV to assess their effectiveness in accurately representing how humans perceive color.
In image processing, accurate assessment of color difference is essential for applications ranging from digital design to quality control.
arXiv Detail & Related papers (2024-06-27T20:41:49Z) - UniHuman: A Unified Model for Editing Human Images in the Wild [49.896715833075106]
We propose UniHuman, a unified model that addresses multiple facets of human image editing in real-world settings.
To enhance the model's generation quality and generalization capacity, we leverage guidance from human visual encoders.
In user studies, UniHuman is preferred by the users in an average of 77% of cases.
arXiv Detail & Related papers (2023-12-22T05:00:30Z) - Incorporating Ensemble and Transfer Learning For An End-To-End
Auto-Colorized Image Detection Model [0.0]
This paper presents a novel approach that combines the advantages of transfer and ensemble learning approaches to help reduce training time and resource requirements.
The proposed model shows promising results, with accuracy ranging from 94.55% to 99.13%.
arXiv Detail & Related papers (2023-09-25T19:22:57Z) - What's color got to do with it? Face recognition in grayscale [9.252410144412089]
State-of-the-art deep CNN face matchers are typically created using extensive training sets of color face images.
Our study reveals that such matchers attain virtually identical accuracy when trained on either grayscale or color versions of the training set.
shallower models, lacking the capacity to model complex representations, rely more heavily on low-level features such as those associated with color.
arXiv Detail & Related papers (2023-09-11T00:32:26Z) - Astronomical Image Colorization and upscaling with Generative
Adversarial Networks [0.0]
This research aims to provide an automated approach for the problem by focusing on a very specific domain of images, namely astronomical images.
We explore the usage of various models in two different color spaces, RGB and L*a*b.
The model produces visually appealing images which hallucinate high resolution, colorized data in these results which does not exist in the original image.
arXiv Detail & Related papers (2021-12-27T19:01:20Z) - Assessing The Importance Of Colours For CNNs In Object Recognition [70.70151719764021]
Convolutional neural networks (CNNs) have been shown to exhibit conflicting properties.
We demonstrate that CNNs often rely heavily on colour information while making a prediction.
We evaluate a model trained with congruent images on congruent, greyscale, and incongruent images.
arXiv Detail & Related papers (2020-12-12T22:55:06Z) - Appearance Consensus Driven Self-Supervised Human Mesh Recovery [67.20942777949793]
We present a self-supervised human mesh recovery framework to infer human pose and shape from monocular images.
We achieve state-of-the-art results on the standard model-based 3D pose estimation benchmarks.
The resulting colored mesh prediction opens up the usage of our framework for a variety of appearance-related tasks beyond the pose and shape estimation.
arXiv Detail & Related papers (2020-08-04T05:40:39Z) - Semantic-driven Colorization [78.88814849391352]
Recent colorization works implicitly predict the semantic information while learning to colorize black-and-white images.
In this study, we simulate that human-like action to let our network first learn to understand the photo, then colorize it.
arXiv Detail & Related papers (2020-06-13T08:13:30Z) - Instance-aware Image Colorization [51.12040118366072]
In this paper, we propose a method for achieving instance-aware colorization.
Our network architecture leverages an off-the-shelf object detector to obtain cropped object images.
We use a similar network to extract the full-image features and apply a fusion module to predict the final colors.
arXiv Detail & Related papers (2020-05-21T17:59:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.