Elastica Models for Color Image Regularization

• URL: http://arxiv.org/abs/2203.09995v1
• Date: Fri, 18 Mar 2022 14:47:33 GMT
• Title: Elastica Models for Color Image Regularization
• Authors: Hao Liu, Xue-Cheng Tai, Ron Kimmel, Roland Glowinski
• Abstract summary: Minimizing the area of the image manifold leads to the Beltrami flow or mean curvature flow of the image surface in the 3D color space. We introduce two new models for color image regularization.
• Score: 14.430905433555248
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: One classical approach to regularize color is to tream them as two dimensional surfaces embedded in a five dimensional spatial-chromatic space. In this case, a natural regularization term arises as the image surface area. Choosing the chromatic coordinates as dominating over the spatial ones, the image spatial coordinates could be thought of as a paramterization of the image surface manifold in a three dimensional color space. Minimizing the area of the image manifold leads to the Beltrami flow or mean curvature flow of the image surface in the 3D color space, while minimizing the elastica of the image surface yields an additional interesting regularization. Recently, the authors proposed a color elastica model, which minimizes both the surface area and elastica of the image manifold. In this paper, we propose to modify the color elastica and introduce two new models for color image regularization. The revised measures are motivated by the relations between the color elastica model, Euler's elastica model and the total variation model for gray level images. Compared to our previous color elastica model, the new models are direct extensions of Euler's elastica model to color images. The proposed models are nonlinear and challenging to minimize. To overcome this difficulty, two operator-splitting methods are suggested. Specifically, nonlinearities are decoupled by introducing new vector- and matrix-valued variables. Then, the minimization problems are converted to solving initial value problems which are time-discretized by operator splitting. Each subproblem, after splitting either, has a closed-form solution or can be solved efficiently. The effectiveness and advantages of the proposed models are demonstrated by comprehensive experiments. The benefits of incorporating the elastica of the image surface as regularization terms compared to common alternatives are empirically validated.

Related papers

• Euler's Elastica Based Cartoon-Smooth-Texture Image Decomposition [4.829677240798159]
  We propose a novel model for decomposing grayscale images into three distinct components. The structural part represents strong boundaries and regions with strong light-to-dark transitions; the smooth part, capturing soft shadows and shadows; and the oscillatory, characterizing textures and noise.
  arXiv  Detail & Related papers  (2024-07-03T03:42:33Z)
• Interpreting the Weight Space of Customized Diffusion Models [79.14866339932199]
  We show that the weight space of fine-tuned diffusion models can behave as an interpretable meta-latent space producing new models. Our results indicate that the weight space of fine-tuned diffusion models can behave as an interpretable meta-latent space producing new models.
  arXiv  Detail & Related papers  (2024-06-13T17:59:56Z)
• Flexible Isosurface Extraction for Gradient-Based Mesh Optimization [65.76362454554754]
  This work considers gradient-based mesh optimization, where we iteratively optimize for a 3D surface mesh by representing it as the isosurface of a scalar field. We introduce FlexiCubes, an isosurface representation specifically designed for optimizing an unknown mesh with respect to geometric, visual, or even physical objectives.
  arXiv  Detail & Related papers  (2023-08-10T06:40:19Z)
• Geometric Neural Diffusion Processes [55.891428654434634]
  We extend the framework of diffusion models to incorporate a series of geometric priors in infinite-dimension modelling. We show that with these conditions, the generative functional model admits the same symmetry.
  arXiv  Detail & Related papers  (2023-07-11T16:51:38Z)
• Shuffled Autoregression For Motion Interpolation [53.61556200049156]
  This work aims to provide a deep-learning solution for the motion task. We propose a novel framework, referred to as emphShuffled AutoRegression, which expands the autoregression to generate in arbitrary (shuffled) order. We also propose an approach to constructing a particular kind of dependency graph, with three stages assembled into an end-to-end spatial-temporal motion Transformer.
  arXiv  Detail & Related papers  (2023-06-10T07:14:59Z)
• Multi-channel Nuclear Norm Minus Frobenius Norm Minimization for Color Image Denoising [9.20787253404652]
  One traditional strategy is to convert the RGB image to a less correlated color space and denoise each channel of the new space separately. This paper proposes a new multi-channel optimization model for color image denoising under the nuclear norm minus Frobenius norm minimization framework. Experimental results on both synthetic and real noise datasets demonstrate the proposed model outperforms state-of-the-art models.
  arXiv  Detail & Related papers  (2022-09-16T04:10:29Z)
• Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonization [59.19214040221055]
  We propose a novel spatial-separated curve rendering network (S$2$CRNet) for efficient and high-resolution image harmonization. The proposed method reduces more than 90% parameters compared with previous methods. Our method can work smoothly on higher resolution images in real-time which is more than 10$times$ faster than the existing methods.
  arXiv  Detail & Related papers  (2021-09-13T07:20:16Z)
• Topology-Preserving 3D Image Segmentation Based On Hyperelastic Regularization [1.52292571922932]
  We propose a novel 3D topology-preserving registration-based segmentation model with the hyperelastic regularization. Numerical experiments have been carried out on the synthetic and real images, which demonstrate the effectiveness of our proposed model.
  arXiv  Detail & Related papers  (2021-03-31T02:20:46Z)
• Joint Estimation of Image Representations and their Lie Invariants [57.3768308075675]
  Images encode both the state of the world and its content. The automatic extraction of this information is challenging because of the high-dimensionality and entangled encoding inherent to the image representation. This article introduces two theoretical approaches aimed at the resolution of these challenges.
  arXiv  Detail & Related papers  (2020-12-05T00:07:41Z)
• A Color Elastica Model for Vector-Valued Image Regularization [14.430905433555248]
  We introduce an addition to the Polyakov action for color images that minimizes the color manifold curvature. Finding a minimizer for the proposed nonlinear geometric model is a challenge we address in this paper.
  arXiv  Detail & Related papers  (2020-08-19T04:18:35Z)
• A Weighted Difference of Anisotropic and Isotropic Total Variation for Relaxed Mumford-Shah Color and Multiphase Image Segmentation [2.6381163133447836]
  We present a class of piecewise-constant image segmentation models that incorporate a difference of anisotropic and isotropic total variation. In addition, a generalization to color image segmentation is discussed.
  arXiv  Detail & Related papers  (2020-05-09T09:35:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.