Image Colorization using U-Net with Skip Connections and Fusion Layer on Landscape Images

• URL: http://arxiv.org/abs/2205.12867v1
• Date: Wed, 25 May 2022 15:41:01 GMT
• Title: Image Colorization using U-Net with Skip Connections and Fusion Layer on Landscape Images
• Authors: Muhammad Hisyam Zayd, Novanto Yudistira, Randy Cahya Wihandika
• Abstract summary: We present a novel technique to automatically colorize grayscale images that combine the U-Net model and Fusion Layer features. This approach allows the model to learn the colorization of images from pre-trained U-Net.
• Score: 1.784933900656067
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: We present a novel technique to automatically colorize grayscale images that combine the U-Net model and Fusion Layer features. This approach allows the model to learn the colorization of images from pre-trained U-Net. Moreover, the Fusion layer is applied to merge local information results dependent on small image patches with global priors of an entire image on each class, forming visually more compelling colorization results. Finally, we validate our approach with a user study evaluation and compare it against state-of-the-art, resulting in improvements.

Related papers

• Automatic Controllable Colorization via Imagination [55.489416987587305]
  We propose a framework for automatic colorization that allows for iterative editing and modifications. By understanding the content within a grayscale image, we utilize a pre-trained image generation model to generate multiple images that contain the same content. These images serve as references for coloring, mimicking the process of human experts.
  arXiv  Detail & Related papers  (2024-04-08T16:46:07Z)
• BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-based Video Colorization [70.14893481468525]
  We present an effective BiSTNet to explore colors of reference exemplars and utilize them to help video colorization. We first establish the semantic correspondence between each frame and the reference exemplars in deep feature space to explore color information from reference exemplars. We develop a mixed expert block to extract semantic information for modeling the object boundaries of frames so that the semantic image prior can better guide the colorization process.
  arXiv  Detail & Related papers  (2022-12-05T13:47:15Z)
• Exemplar-Based Image Colorization with A Learning Framework [7.793461393970992]
  We propose an automatic colorization method with a learning framework. It decouples the colorization process and learning process so as to generate various color styles for the same gray image. It achieves comparable performance against the state-of-the-art colorization algorithms.
  arXiv  Detail & Related papers  (2022-09-13T07:15:25Z)
• ParaColorizer: Realistic Image Colorization using Parallel Generative Networks [1.7778609937758327]
  Grayscale image colorization is a fascinating application of AI for information restoration. We present a parallel GAN-based colorization framework. We show the shortcomings of the non-perceptual evaluation metrics commonly used to assess multi-modal problems.
  arXiv  Detail & Related papers  (2022-08-17T13:49:44Z)
• Semantic Image Fusion [2.4366811507669124]
  This paper proposes a novel system for the semantic combination of visual content using pre-trained CNN network architectures. Simple "choose maximum" and "local majority" filter based fusion rules are utilised for feature map fusion. The developed methods are able to give equivalent low-level fusion performance to state of the art methods.
  arXiv  Detail & Related papers  (2021-10-13T13:15:16Z)
• Image Colorization: A Survey and Dataset [94.59768013860668]
  This article presents a comprehensive survey of state-of-the-art deep learning-based image colorization techniques. It categorizes the existing colorization techniques into seven classes and discusses important factors governing their performance. We perform an extensive experimental evaluation of existing image colorization methods using both existing datasets and our proposed one.
  arXiv  Detail & Related papers  (2020-08-25T01:22:52Z)
• Instance-aware Image Colorization [51.12040118366072]
  In this paper, we propose a method for achieving instance-aware colorization. Our network architecture leverages an off-the-shelf object detector to obtain cropped object images. We use a similar network to extract the full-image features and apply a fusion module to predict the final colors.
  arXiv  Detail & Related papers  (2020-05-21T17:59:23Z)
• Deep Line Art Video Colorization with a Few References [49.7139016311314]
  We propose a deep architecture to automatically color line art videos with the same color style as the given reference images. Our framework consists of a color transform network and a temporal constraint network. Our model can achieve even better coloring results by fine-tuning the parameters with only a small amount of samples.
  arXiv  Detail & Related papers  (2020-03-24T06:57:40Z)
• Supervised and Unsupervised Learning of Parameterized Color Enhancement [112.88623543850224]
  We tackle the problem of color enhancement as an image translation task using both supervised and unsupervised learning. We achieve state-of-the-art results compared to both supervised (paired data) and unsupervised (unpaired data) image enhancement methods on the MIT-Adobe FiveK benchmark. We show the generalization capability of our method, by applying it on photos from the early 20th century and to dark video frames.
  arXiv  Detail & Related papers  (2019-12-30T13:57:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.