Influence of Color Spaces for Deep Learning Image Colorization

• URL: http://arxiv.org/abs/2204.02850v1
• Date: Wed, 6 Apr 2022 14:14:07 GMT
• Title: Influence of Color Spaces for Deep Learning Image Colorization
• Authors: Coloma Ballester, Aur\'elie Bugeau, Hernan Carrillo, Micha\"el Cl\'ement, R\'emi Giraud, Lara Raad, Patricia Vitoria
• Abstract summary: Existing colorization methods rely on different color spaces: RGB, YUV, Lab, etc. In this chapter, we aim to study their influence on the results obtained by training a deep neural network. We compare the results obtained with the same deep neural network architecture with RGB, YUV and Lab color spaces.
• Score: 2.3705923859070217
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Colorization is a process that converts a grayscale image into a color one that looks as natural as possible. Over the years this task has received a lot of attention. Existing colorization methods rely on different color spaces: RGB, YUV, Lab, etc. In this chapter, we aim to study their influence on the results obtained by training a deep neural network, to answer the question: "Is it crucial to correctly choose the right color space in deep-learning based colorization?". First, we briefly summarize the literature and, in particular, deep learning-based methods. We then compare the results obtained with the same deep neural network architecture with RGB, YUV and Lab color spaces. Qualitative and quantitative analysis do not conclude similarly on which color space is better. We then show the importance of carefully designing the architecture and evaluation protocols depending on the types of images that are being processed and their specificities: strong/small contours, few/many objects, recent/archive images.

Related papers

• Name Your Colour For the Task: Artificially Discover Colour Naming via Colour Quantisation Transformer [62.75343115345667]
  We propose a novel colour quantisation transformer, CQFormer, that quantises colour space while maintaining machine recognition on the quantised images. We observe the consistent evolution pattern between our artificial colour system and basic colour terms across human languages. Our colour quantisation method also offers an efficient quantisation method that effectively compresses the image storage.
  arXiv  Detail & Related papers  (2022-12-07T03:39:18Z)
• Learning to Structure an Image with Few Colors and Beyond [59.34619548026885]
  We propose a color quantization network, ColorCNN, which learns to structure an image in limited color spaces by minimizing the classification loss. We introduce ColorCNN+, which supports multiple color space size configurations, and addresses the previous issues of poor recognition accuracy and undesirable visual fidelity under large color spaces. For potential applications, we show that ColorCNNs can be used as image compression methods for network recognition.
  arXiv  Detail & Related papers  (2022-08-17T17:59:15Z)
• TUCaN: Progressively Teaching Colourisation to Capsules [13.50327471049997]
  We introduce a novel downsampling upsampling architecture named TUCaN (Tiny UCapsNet) We pose the problem as a per pixel colour classification task that identifies colours as a bin in a quantized space. To train the network, in contrast with the standard end to end learning method, we propose the progressive learning scheme to extract the context of objects.
  arXiv  Detail & Related papers  (2021-06-29T08:44:15Z)
• Assessing The Importance Of Colours For CNNs In Object Recognition [70.70151719764021]
  Convolutional neural networks (CNNs) have been shown to exhibit conflicting properties. We demonstrate that CNNs often rely heavily on colour information while making a prediction. We evaluate a model trained with congruent images on congruent, greyscale, and incongruent images.
  arXiv  Detail & Related papers  (2020-12-12T22:55:06Z)
• The Utility of Decorrelating Colour Spaces in Vector Quantised Variational Autoencoders [1.7792264784100689]
  We propose colour space conversion to enforce a network learning structured representations. We trained several instances of VQ-VAE whose input is an image in one colour space, and its output in another.
  arXiv  Detail & Related papers  (2020-09-30T07:44:01Z)
• Image Colorization: A Survey and Dataset [94.59768013860668]
  This article presents a comprehensive survey of state-of-the-art deep learning-based image colorization techniques. It categorizes the existing colorization techniques into seven classes and discusses important factors governing their performance. We perform an extensive experimental evaluation of existing image colorization methods using both existing datasets and our proposed one.
  arXiv  Detail & Related papers  (2020-08-25T01:22:52Z)
• Instance-aware Image Colorization [51.12040118366072]
  In this paper, we propose a method for achieving instance-aware colorization. Our network architecture leverages an off-the-shelf object detector to obtain cropped object images. We use a similar network to extract the full-image features and apply a fusion module to predict the final colors.
  arXiv  Detail & Related papers  (2020-05-21T17:59:23Z)
• Learning to Structure an Image with Few Colors [59.34619548026885]
  We propose a color quantization network, ColorCNN, which learns to structure the images from the classification loss in an end-to-end manner. With only a 1-bit color space (i.e., two colors), the proposed network achieves 82.1% top-1 accuracy on the CIFAR10 dataset. For applications, when encoded with PNG, the proposed color quantization shows superiority over other image compression methods in the extremely low bit-rate regime.
  arXiv  Detail & Related papers  (2020-03-17T17:56:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.