Image Colorization: A Survey and Dataset
- URL: http://arxiv.org/abs/2008.10774v3
- Date: Thu, 27 Jan 2022 02:16:15 GMT
- Title: Image Colorization: A Survey and Dataset
- Authors: Saeed Anwar, Muhammad Tahir, Chongyi Li, Ajmal Mian, Fahad Shahbaz
Khan, Abdul Wahab Muzaffar
- Abstract summary: This article presents a comprehensive survey of state-of-the-art deep learning-based image colorization techniques.
It categorizes the existing colorization techniques into seven classes and discusses important factors governing their performance.
Using the existing datasets and our new one, we perform an extensive experimental evaluation of existing image colorization methods.
- Score: 78.89573261114428
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Image colorization is the process of estimating RGB colors for grayscale
images or video frames to improve their aesthetic and perceptual quality. Deep
learning techniques for image colorization have progressed notably over the
last decade, calling the need for a systematic survey and benchmarking of these
techniques. This article presents a comprehensive survey of recent
state-of-the-art deep learning-based image colorization techniques, describing
their fundamental block architectures, inputs, optimizers, loss functions,
training protocols, and training data \textit{etc.} It categorizes the existing
colorization techniques into seven classes and discusses important factors
governing their performance, such as benchmark datasets and evaluation metrics.
We highlight the limitations of existing datasets and introduce a new dataset
specific to colorization. Using the existing datasets and our new one, we
perform an extensive experimental evaluation of existing image colorization
methods. Finally, we discuss the limitations of existing methods and recommend
possible solutions as well as future research directions for this rapidly
evolving topic of deep image colorization. Dataset and codes for evaluation are
publicly available at https://github.com/saeed-anwar/ColorSurvey
Related papers
- Improving Video Colorization by Test-Time Tuning [79.67548221384202]
We propose an effective method, which aims to enhance video colorization through test-time tuning.
By exploiting the reference to construct additional training samples during testing, our approach achieves a performance boost of 13 dB in PSNR on average.
arXiv Detail & Related papers (2023-06-25T05:36:40Z) - MMC: Multi-Modal Colorization of Images using Textual Descriptions [22.666387184216678]
We propose a deep network that takes two inputs (grayscale image and the respective encoded text description) and tries to predict the relevant color components.
Also, we have predicted each object in the image and have colorized them with their individual description to incorporate their specific attributes in the colorization process.
In terms of performance, the proposed method outperforms existing colorization techniques in terms of LPIPS, PSNR and SSIM metrics.
arXiv Detail & Related papers (2023-04-24T10:53:13Z) - ParaColorizer: Realistic Image Colorization using Parallel Generative
Networks [1.7778609937758327]
Grayscale image colorization is a fascinating application of AI for information restoration.
We present a parallel GAN-based colorization framework.
We show the shortcomings of the non-perceptual evaluation metrics commonly used to assess multi-modal problems.
arXiv Detail & Related papers (2022-08-17T13:49:44Z) - TIC: Text-Guided Image Colorization [24.317541784957285]
We propose a novel deep network that takes two inputs (the grayscale image and the respective encoded text description) and tries to predict the relevant color gamut.
As the respective textual descriptions contain color information of the objects present in the scene, the text encoding helps to improve the overall quality of the predicted colors.
We have evaluated our proposed model using different metrics and found that it outperforms the state-of-the-art colorization algorithms both qualitatively and quantitatively.
arXiv Detail & Related papers (2022-08-04T18:40:20Z) - Detecting Recolored Image by Spatial Correlation [60.08643417333974]
Image recoloring is an emerging editing technique that can manipulate the color values of an image to give it a new style.
In this paper, we explore a solution from the perspective of the spatial correlation, which exhibits the generic detection capability for both conventional and deep learning-based recoloring.
Our method achieves the state-of-the-art detection accuracy on multiple benchmark datasets and exhibits well generalization for unknown types of recoloring methods.
arXiv Detail & Related papers (2022-04-23T01:54:06Z) - Influence of Color Spaces for Deep Learning Image Colorization [2.3705923859070217]
Existing colorization methods rely on different color spaces: RGB, YUV, Lab, etc.
In this chapter, we aim to study their influence on the results obtained by training a deep neural network.
We compare the results obtained with the same deep neural network architecture with RGB, YUV and Lab color spaces.
arXiv Detail & Related papers (2022-04-06T14:14:07Z) - TUCaN: Progressively Teaching Colourisation to Capsules [13.50327471049997]
We introduce a novel downsampling upsampling architecture named TUCaN (Tiny UCapsNet)
We pose the problem as a per pixel colour classification task that identifies colours as a bin in a quantized space.
To train the network, in contrast with the standard end to end learning method, we propose the progressive learning scheme to extract the context of objects.
arXiv Detail & Related papers (2021-06-29T08:44:15Z) - CoRe: Color Regression for Multicolor Fashion Garments [80.57724826629176]
In this paper, we handle color detection as a regression problem to predict the exact RGB values.
We include a second regression stage for refinement in our newly proposed architecture.
This architecture is modular and easily expanded to detect the RGBs of all colors in a multicolor garment.
arXiv Detail & Related papers (2020-10-06T16:12:30Z) - Instance-aware Image Colorization [51.12040118366072]
In this paper, we propose a method for achieving instance-aware colorization.
Our network architecture leverages an off-the-shelf object detector to obtain cropped object images.
We use a similar network to extract the full-image features and apply a fusion module to predict the final colors.
arXiv Detail & Related papers (2020-05-21T17:59:23Z) - Learning to Structure an Image with Few Colors [59.34619548026885]
We propose a color quantization network, ColorCNN, which learns to structure the images from the classification loss in an end-to-end manner.
With only a 1-bit color space (i.e., two colors), the proposed network achieves 82.1% top-1 accuracy on the CIFAR10 dataset.
For applications, when encoded with PNG, the proposed color quantization shows superiority over other image compression methods in the extremely low bit-rate regime.
arXiv Detail & Related papers (2020-03-17T17:56:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.