Image Colorization: A Survey and Dataset

• URL: http://arxiv.org/abs/2008.10774v3
• Date: Thu, 27 Jan 2022 02:16:15 GMT
• Title: Image Colorization: A Survey and Dataset
• Authors: Saeed Anwar, Muhammad Tahir, Chongyi Li, Ajmal Mian, Fahad Shahbaz Khan, Abdul Wahab Muzaffar
• Abstract summary: This article presents a comprehensive survey of state-of-the-art deep learning-based image colorization techniques. It categorizes the existing colorization techniques into seven classes and discusses important factors governing their performance. Using the existing datasets and our new one, we perform an extensive experimental evaluation of existing image colorization methods.
• Score: 78.89573261114428
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Image colorization is the process of estimating RGB colors for grayscale images or video frames to improve their aesthetic and perceptual quality. Deep learning techniques for image colorization have progressed notably over the last decade, calling the need for a systematic survey and benchmarking of these techniques. This article presents a comprehensive survey of recent state-of-the-art deep learning-based image colorization techniques, describing their fundamental block architectures, inputs, optimizers, loss functions, training protocols, and training data \textit{etc.} It categorizes the existing colorization techniques into seven classes and discusses important factors governing their performance, such as benchmark datasets and evaluation metrics. We highlight the limitations of existing datasets and introduce a new dataset specific to colorization. Using the existing datasets and our new one, we perform an extensive experimental evaluation of existing image colorization methods. Finally, we discuss the limitations of existing methods and recommend possible solutions as well as future research directions for this rapidly evolving topic of deep image colorization. Dataset and codes for evaluation are publicly available at https://github.com/saeed-anwar/ColorSurvey

Related papers

• Convolutional Deep Colorization for Image Compression: A Color Grid Based Approach [0.0]
  This work focuses on optimizing a color grid based approach to fully-automated image color information retention. We want to minimize the amount of color information that is stored while still being able to faithfully re-color images. Our results yielded a promising image compression ratio, while still allowing for successful image recolorization reaching high CSIM values.
  arXiv  Detail & Related papers  (2025-02-08T01:26:05Z)
• Computer-aided Colorization State-of-the-science: A Survey [18.15986565500203]
  This paper reviews published research in the field of computer-aided colorization technology. We argue that the colorization task originates from computer graphics, prospers by introducing computer vision, and tends to the fusion of vision and graphics.
  arXiv  Detail & Related papers  (2024-10-03T08:13:26Z)
• DiffColor: Toward High Fidelity Text-Guided Image Colorization with Diffusion Models [12.897939032560537]
  We propose a new method called DiffColor to recover vivid colors conditioned on a prompt text. We first fine-tune a pre-trained text-to-image model to generate colorized images using a CLIP-based contrastive loss. Then we try to obtain an optimized text embedding aligning the colorized image and the text prompt, and a fine-tuned diffusion model enabling high-quality image reconstruction. Our method can produce vivid and diverse colors with a few iterations, and keep the structure and background intact while having colors well-aligned with the target language guidance.
  arXiv  Detail & Related papers  (2023-08-03T09:38:35Z)
• Improving Video Colorization by Test-Time Tuning [79.67548221384202]
  We propose an effective method, which aims to enhance video colorization through test-time tuning. By exploiting the reference to construct additional training samples during testing, our approach achieves a performance boost of 13 dB in PSNR on average.
  arXiv  Detail & Related papers  (2023-06-25T05:36:40Z)
• ParaColorizer: Realistic Image Colorization using Parallel Generative Networks [1.7778609937758327]
  Grayscale image colorization is a fascinating application of AI for information restoration. We present a parallel GAN-based colorization framework. We show the shortcomings of the non-perceptual evaluation metrics commonly used to assess multi-modal problems.
  arXiv  Detail & Related papers  (2022-08-17T13:49:44Z)
• Detecting Recolored Image by Spatial Correlation [60.08643417333974]
  Image recoloring is an emerging editing technique that can manipulate the color values of an image to give it a new style. In this paper, we explore a solution from the perspective of the spatial correlation, which exhibits the generic detection capability for both conventional and deep learning-based recoloring. Our method achieves the state-of-the-art detection accuracy on multiple benchmark datasets and exhibits well generalization for unknown types of recoloring methods.
  arXiv  Detail & Related papers  (2022-04-23T01:54:06Z)
• Influence of Color Spaces for Deep Learning Image Colorization [2.3705923859070217]
  Existing colorization methods rely on different color spaces: RGB, YUV, Lab, etc. In this chapter, we aim to study their influence on the results obtained by training a deep neural network. We compare the results obtained with the same deep neural network architecture with RGB, YUV and Lab color spaces.
  arXiv  Detail & Related papers  (2022-04-06T14:14:07Z)
• TUCaN: Progressively Teaching Colourisation to Capsules [13.50327471049997]
  We introduce a novel downsampling upsampling architecture named TUCaN (Tiny UCapsNet) We pose the problem as a per pixel colour classification task that identifies colours as a bin in a quantized space. To train the network, in contrast with the standard end to end learning method, we propose the progressive learning scheme to extract the context of objects.
  arXiv  Detail & Related papers  (2021-06-29T08:44:15Z)
• CoRe: Color Regression for Multicolor Fashion Garments [80.57724826629176]
  In this paper, we handle color detection as a regression problem to predict the exact RGB values. We include a second regression stage for refinement in our newly proposed architecture. This architecture is modular and easily expanded to detect the RGBs of all colors in a multicolor garment.
  arXiv  Detail & Related papers  (2020-10-06T16:12:30Z)
• Instance-aware Image Colorization [51.12040118366072]
  In this paper, we propose a method for achieving instance-aware colorization. Our network architecture leverages an off-the-shelf object detector to obtain cropped object images. We use a similar network to extract the full-image features and apply a fusion module to predict the final colors.
  arXiv  Detail & Related papers  (2020-05-21T17:59:23Z)
• Learning to Structure an Image with Few Colors [59.34619548026885]
  We propose a color quantization network, ColorCNN, which learns to structure the images from the classification loss in an end-to-end manner. With only a 1-bit color space (i.e., two colors), the proposed network achieves 82.1% top-1 accuracy on the CIFAR10 dataset. For applications, when encoded with PNG, the proposed color quantization shows superiority over other image compression methods in the extremely low bit-rate regime.
  arXiv  Detail & Related papers  (2020-03-17T17:56:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.