Color Transfer with Modulated Flows

• URL: http://arxiv.org/abs/2503.19062v1
• Date: Mon, 24 Mar 2025 18:39:54 GMT
• Title: Color Transfer with Modulated Flows
• Authors: Maria Larchenko, Alexander Lobashev, Dmitry Guskov, Vladimir Vladimirovich Palyulin,
• Abstract summary: Modulated Flows is a novel approach for color transfer between images based on rectified flows.<n>Our technique is based on optimal transport and executes color transfer as an invertible transformation within the RGB color space.<n>The presented method is capable of processing 4K images and achieves the state-of-the-art performance in terms of content and style similarity.
• Score: 41.94295877935867
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this work, we introduce Modulated Flows (ModFlows), a novel approach for color transfer between images based on rectified flows. The primary goal of the color transfer is to adjust the colors of a target image to match the color distribution of a reference image. Our technique is based on optimal transport and executes color transfer as an invertible transformation within the RGB color space. The ModFlows utilizes the bijective property of flows, enabling us to introduce a common intermediate color distribution and build a dataset of rectified flows. We train an encoder on this dataset to predict the weights of a rectified model for new images. After training on a set of optimal transport plans, our approach can generate plans for new pairs of distributions without additional fine-tuning. We additionally show that the trained encoder provides an image embedding, associated only with its color style. The presented method is capable of processing 4K images and achieves the state-of-the-art performance in terms of content and style similarity. Our source code is available at https://github.com/maria-larchenko/modflows

Related papers

• Color Conditional Generation with Sliced Wasserstein Guidance [44.99833362998488]
  SW-Guidance is a training-free approach for image generation conditioned on the color distribution of a reference image.<n>Our method outperforms state-of-the-art techniques for color-conditional generation in terms of color similarity to the reference.
  arXiv  Detail & Related papers  (2025-03-24T18:06:03Z)
• ColorFlow: Retrieval-Augmented Image Sequence Colorization [65.93834649502898]
  We propose a three-stage diffusion-based framework tailored for image sequence colorization in industrial applications.<n>Unlike existing methods that require per-ID finetuning or explicit ID embedding extraction, we propose a novel Retrieval Augmented Colorization pipeline.<n>Our pipeline also features a dual-branch design: one branch for color identity extraction and the other for colorization.
  arXiv  Detail & Related papers  (2024-12-16T14:32:49Z)
• Training-free Color-Style Disentanglement for Constrained Text-to-Image Synthesis [16.634138745034733]
  We present the first training-free, test-time-only method to disentangle and condition text-to-image models on color and style attributes from reference image.
  arXiv  Detail & Related papers  (2024-09-04T04:16:58Z)
• Palette-based Color Transfer between Images [9.471264982229508]
  We propose a new palette-based color transfer method that can automatically generate a new color scheme. With a redesigned palette-based clustering method, pixels can be classified into different segments according to color distribution. Our method exhibits significant advantages over peer methods in terms of natural realism, color consistency, generality, and robustness.
  arXiv  Detail & Related papers  (2024-05-14T01:41:19Z)
• Automatic Controllable Colorization via Imagination [55.489416987587305]
  We propose a framework for automatic colorization that allows for iterative editing and modifications. By understanding the content within a grayscale image, we utilize a pre-trained image generation model to generate multiple images that contain the same content. These images serve as references for coloring, mimicking the process of human experts.
  arXiv  Detail & Related papers  (2024-04-08T16:46:07Z)
• Control Color: Multimodal Diffusion-based Interactive Image Colorization [81.68817300796644]
  Control Color (Ctrl Color) is a multi-modal colorization method that leverages the pre-trained Stable Diffusion (SD) model. We present an effective way to encode user strokes to enable precise local color manipulation. We also introduce a novel module based on self-attention and a content-guided deformable autoencoder to address the long-standing issues of color overflow and inaccurate coloring.
  arXiv  Detail & Related papers  (2024-02-16T17:51:13Z)
• Dequantization and Color Transfer with Diffusion Models [5.228564799458042]
  quantized images offer easy abstraction for patch-based edits and palette transfer.<n>We show that our model can generate natural images that respect the color palette the user asked for.<n>Our method can be usefully extended to another practical edit: recoloring patches of an image while respecting the source texture.
  arXiv  Detail & Related papers  (2023-07-06T00:07:32Z)
• Learning Diverse Tone Styles for Image Retouching [73.60013618215328]
  We propose to learn diverse image retouching with normalizing flow-based architectures. A joint-training pipeline is composed of a style encoder, a conditional RetouchNet, and the image tone style normalizing flow (TSFlow) module. Our proposed method performs favorably against state-of-the-art methods and is effective in generating diverse results.
  arXiv  Detail & Related papers  (2022-07-12T09:49:21Z)
• Immiscible Color Flows in Optimal Transport Networks for Image Classification [68.8204255655161]
  We propose a physics-inspired system that adapts Optimal Transport principles to leverage color distributions of images. Our dynamics regulates immiscible of colors traveling on a network built from images. Our method outperforms competitor algorithms on image classification tasks in datasets where color information matters.
  arXiv  Detail & Related papers  (2022-05-04T12:41:36Z)
• Patch based Colour Transfer using SIFT Flow [2.8790548120668573]
  We propose a new colour transfer method with Optimal Transport (OT) to transfer the colour of a sourceimage to match the colour of a target image. Experiments show quantitative andqualitative improvements over previous state of the art colour transfer methods.
  arXiv  Detail & Related papers  (2020-05-18T18:22:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.