Example-based Color Transfer with Gaussian Mixture Modeling

• URL: http://arxiv.org/abs/2008.13626v3
• Date: Thu, 6 Jan 2022 10:58:01 GMT
• Title: Example-based Color Transfer with Gaussian Mixture Modeling
• Authors: Chunzhi Gu, Xuequan Lu, Chao Zhang
• Abstract summary: We model color transfer under a probability framework and cast it as a parameter estimation problem. We employ the Expectation-Maximization (EM) algorithm (E-step and M-step) for optimization. Our method is able to generate continuous color transfer results with increasing EM iterations.
• Score: 16.880968031370767
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Color transfer, which plays a key role in image editing, has attracted noticeable attention recently. It has remained a challenge to date due to various issues such as time-consuming manual adjustments and prior segmentation issues. In this paper, we propose to model color transfer under a probability framework and cast it as a parameter estimation problem. In particular, we relate the transferred image with the example image under the Gaussian Mixture Model (GMM) and regard the transferred image color as the GMM centroids. We employ the Expectation-Maximization (EM) algorithm (E-step and M-step) for optimization. To better preserve gradient information, we introduce a Laplacian based regularization term to the objective function at the M-step which is solved by deriving a gradient descent algorithm. Given the input of a source image and an example image, our method is able to generate continuous color transfer results with increasing EM iterations. Various experiments show that our approach generally outperforms other competitive color transfer methods, both visually and quantitatively.

Related papers

• Generalized Consistency Trajectory Models for Image Manipulation [59.576781858809355]
  Diffusion models (DMs) excel in unconditional generation, as well as on applications such as image editing and restoration. This work aims to unlock the full potential of consistency trajectory models (CTMs) by proposing generalized CTMs (GCTMs) We discuss the design space of GCTMs and demonstrate their efficacy in various image manipulation tasks such as image-to-image translation, restoration, and editing.
  arXiv  Detail & Related papers  (2024-03-19T07:24:54Z)
• Gaussian Mixture Solvers for Diffusion Models [84.83349474361204]
  We introduce a novel class of SDE-based solvers called GMS for diffusion models. Our solver outperforms numerous SDE-based solvers in terms of sample quality in image generation and stroke-based synthesis.
  arXiv  Detail & Related papers  (2023-11-02T02:05:38Z)
• DARC: Distribution-Aware Re-Coloring Model for Generalizable Nucleus Segmentation [68.43628183890007]
  We argue that domain gaps can also be caused by different foreground (nucleus)-background ratios. First, we introduce a re-coloring method that relieves dramatic image color variations between different domains. Second, we propose a new instance normalization method that is robust to the variation in the foreground-background ratios.
  arXiv  Detail & Related papers  (2023-09-01T01:01:13Z)
• Generative Modeling in Structural-Hankel Domain for Color Image Inpainting [17.04134647990754]
  This study aims to construct the low-rank structural-Hankel matrices-assisted score-based generative model (SHGM) for color image inpainting task. Experimental results demonstrated the remarkable performance and diversity of SHGM.
  arXiv  Detail & Related papers  (2022-11-25T01:56:17Z)
• Estimating Appearance Models for Image Segmentation via Tensor Factorization [0.0]
  We propose a new approach to directly estimate appearance models from the image without prior information on the underlying segmentation. Our method uses local high order color statistics from the image as an input to tensor factorization-based estimator for latent variable models. This approach is able to estimate models in multiregion images and automatically output the regions proportions without prior user interaction.
  arXiv  Detail & Related papers  (2022-08-16T17:21:00Z)
• GradViT: Gradient Inversion of Vision Transformers [83.54779732309653]
  We demonstrate the vulnerability of vision transformers (ViTs) to gradient-based inversion attacks. We introduce a method, named GradViT, that optimize random noise into naturally looking images. We observe unprecedentedly high fidelity and closeness to the original (hidden) data.
  arXiv  Detail & Related papers  (2022-03-22T17:06:07Z)
• Generative Probabilistic Image Colorization [2.110198946293069]
  We propose a diffusion-based generative process that trains a sequence of probabilistic models to reverse each step of noise corruption. Given a line-drawing image as input, our method suggests multiple candidate colorized images. Our proposed approach performed well not only on color-conditional image generation tasks, but also on some practical image completion and inpainting tasks.
  arXiv  Detail & Related papers  (2021-09-29T16:10:12Z)
• SDEdit: Image Synthesis and Editing with Stochastic Differential Equations [113.35735935347465]
  We introduce Differential Editing (SDEdit), based on a recent generative model using differential equations (SDEs) Given an input image with user edits, we first add noise to the input according to an SDE, and subsequently denoise it by simulating the reverse SDE to gradually increase its likelihood under the prior. Our method does not require task-specific loss function designs, which are critical components for recent image editing methods based on GAN inversions.
  arXiv  Detail & Related papers  (2021-08-02T17:59:47Z)
• Underwater Image Color Correction by Complementary Adaptation [0.0]
  We propose a novel approach for underwater image color correction based on a Tikhonov type optimization model in the CIELAB color space. Understood as a long-term adaptive process, our method effectively removes the underwater color cast and yields a balanced color distribution.
  arXiv  Detail & Related papers  (2020-10-21T03:59:22Z)
• Gaussian MRF Covariance Modeling for Efficient Black-Box Adversarial Attacks [86.88061841975482]
  We study the problem of generating adversarial examples in a black-box setting, where we only have access to a zeroth order oracle. We use this setting to find fast one-step adversarial attacks, akin to a black-box version of the Fast Gradient Sign Method(FGSM) We show that the method uses fewer queries and achieves higher attack success rates than the current state of the art.
  arXiv  Detail & Related papers  (2020-10-08T18:36:51Z)
• Patch based Colour Transfer using SIFT Flow [2.8790548120668573]
  We propose a new colour transfer method with Optimal Transport (OT) to transfer the colour of a sourceimage to match the colour of a target image. Experiments show quantitative andqualitative improvements over previous state of the art colour transfer methods.
  arXiv  Detail & Related papers  (2020-05-18T18:22:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.