VecFusion: Vector Font Generation with Diffusion

• URL: http://arxiv.org/abs/2312.10540v2
• Date: Tue, 21 May 2024 21:40:12 GMT
• Title: VecFusion: Vector Font Generation with Diffusion
• Abstract summary: We present VecFusion, a new neural architecture that can generate vector structures and precise control point positions. In contrast to previous generative models for vector graphics, our new cascaded vector diffusion model generates higher quality vector fonts, with complex structures and diverse styles.
• Score: 44.668828983881276
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present VecFusion, a new neural architecture that can generate vector fonts with varying topological structures and precise control point positions. Our approach is a cascaded diffusion model which consists of a raster diffusion model followed by a vector diffusion model. The raster model generates low-resolution, rasterized fonts with auxiliary control point information, capturing the global style and shape of the font, while the vector model synthesizes vector fonts conditioned on the low-resolution raster fonts from the first stage. To synthesize long and complex curves, our vector diffusion model uses a transformer architecture and a novel vector representation that enables the modeling of diverse vector geometry and the precise prediction of control points. Our experiments show that, in contrast to previous generative models for vector graphics, our new cascaded vector diffusion model generates higher quality vector fonts, with complex structures and diverse styles.

Related papers

• VecFontLLM: Anchor-Guided Direct Synthesis of Chinese Vector Fonts [27.152213483804072]
  VecFontLLM is an anchor-guided model for direct few-shot synthesis of Chinese vector fonts.<n>VecFontLLM predicts and refines an anchor scaffold that fixes the coarse layout of components.<n>It then completes Bézier control points to recover local curvature and style.
  arXiv  Detail & Related papers  (2026-07-19T13:41:38Z)
• VectorArk: Learning Practical Image Vectorization with Rounded Polygon Representation [16.74960700300166]
  We introduce VectorArk, a robust and practical model for image vectorization.<n>Our experiments show that VectorArk achieves superior geometric completeness and artifact suppression across multiple datasets.
  arXiv  Detail & Related papers  (2026-05-23T04:53:28Z)
• VecGlypher: Unified Vector Glyph Generation with Language Models [49.18215716168074]
  VecGlypher generates high-fidelity vector glyphs directly from text descriptions or image exemplars.<n>VecGlypher autoregressively emits SVG path tokens, avoiding intermediates and a target character.
  arXiv  Detail & Related papers  (2026-02-25T00:27:23Z)
• Stroke Modeling Enables Vectorized Character Generation with Large Vectorized Glyph Model [20.240367070645963]
  We propose a novel Large Vectorized Glyph Model (LVGM) designed to generate vectorized Chinese glyphs by predicting the next stroke.<n>With limited strokes given, it can generate complete characters, semantically elegant words, and even unseen verses in vectorized form.
  arXiv  Detail & Related papers  (2025-11-14T09:48:38Z)
• Segmentation-guided Layer-wise Image Vectorization with Gradient Fills [6.037332707968933]
  We propose a segmentation-guided vectorization framework to convert images into concise vector graphics with gradient fills. With the guidance of an embedded gradient-aware segmentation, our approach progressively appends gradient-filled B'ezier paths to the output.
  arXiv  Detail & Related papers  (2024-08-28T12:08:25Z)
• An Intrinsic Vector Heat Network [64.55434397799728]
  This paper introduces a novel neural network architecture for learning tangent vector fields embedded in 3D. We introduce a trainable vector heat diffusion module to spatially propagate vector-valued feature data across the surface. We also demonstrate the effectiveness of our method on the useful industrial application of quadrilateral mesh generation.
  arXiv  Detail & Related papers  (2024-06-14T00:40:31Z)
• VectorPainter: Advanced Stylized Vector Graphics Synthesis Using Stroke-Style Priors [18.477188153621125]
  We introduce VectorPainter, a novel framework designed for reference-guided text-to-vector-graphics synthesis. Our method first converts the pixels of the reference image into a series of vector strokes, and then generates a vector graphic based on the input text description. To preserve the style of the strokes throughout the generation process, we introduce a style-preserving loss function.
  arXiv  Detail & Related papers  (2024-05-05T15:01:29Z)
• DualVector: Unsupervised Vector Font Synthesis with Dual-Part Representation [43.64428946288288]
  Current font synthesis methods fail to represent the shape concisely or require vector supervision during training. We propose a novel dual-part representation for vector glyphs, where each glyph is modeled as a collection of closed "positive" and "negative" path pairs. Our method, named Dual-of-Font-art, outperforms state-of-the-art methods for practical use.
  arXiv  Detail & Related papers  (2023-05-17T08:18:06Z)
• DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Quality [38.32966391626858]
  This paper proposes an enhanced version of DeepVecFont for vector font synthesis. We adopt Transformers instead of RNNs to process sequential data and design a relaxation representation for vector outlines. We also propose to sample auxiliary points in addition to control points to precisely align the generated and target B'ezier curves or lines.
  arXiv  Detail & Related papers  (2023-03-25T23:28:19Z)
• VecFontSDF: Learning to Reconstruct and Synthesize High-quality Vector Fonts via Signed Distance Functions [15.47282857047361]
  This paper proposes an end-to-end trainable method, VecFontSDF, to reconstruct and synthesize high-quality vector fonts. Based on the proposed SDF-based implicit shape representation, VecFontSDF learns to model each glyph as shape primitives enclosed by several parabolic curves.
  arXiv  Detail & Related papers  (2023-03-22T16:14:39Z)
• Diff-Font: Diffusion Model for Robust One-Shot Font Generation [110.45944936952309]
  We propose a novel one-shot font generation method based on a diffusion model, named Diff-Font. The proposed model aims to generate the entire font library by giving only one sample as the reference. The well-trained Diff-Font is not only robust to font gap and font variation, but also achieved promising performance on difficult character generation.
  arXiv  Detail & Related papers  (2022-12-12T13:51:50Z)
• VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Models [82.93345261434943]
  We show that a text-conditioned diffusion model trained on pixel representations of images can be used to generate SVG-exportable vector graphics. Inspired by recent text-to-3D work, we learn an SVG consistent with a caption using Score Distillation Sampling. Experiments show greater quality than prior work, and demonstrate a range of styles including pixel art and sketches.
  arXiv  Detail & Related papers  (2022-11-21T10:04:27Z)
• DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning [21.123297001902177]
  We propose a novel method, DeepVecFont, to generate visually-pleasing vector glyphs. The highlights of this paper are threefold. First, we design a dual-modality learning strategy which utilizes both image-aspect and sequence-aspect features of fonts to synthesize vector glyphs. Second, we provide a new generative paradigm to handle unstructured data (e.g., vector glyphs) by randomly sampling plausible results to get the optimal one which is further refined under the guidance of generated structured data.
  arXiv  Detail & Related papers  (2021-10-13T12:57:19Z)
• Scalable Font Reconstruction with Dual Latent Manifolds [55.29525824849242]
  We propose a deep generative model that performs typography analysis and font reconstruction. Our approach enables us to massively scale up the number of character types we can effectively model. We evaluate on the task of font reconstruction over various datasets representing character types of many languages.
  arXiv  Detail & Related papers  (2021-09-10T20:37:43Z)
• A Differential Geometry Perspective on Orthogonal Recurrent Models [56.09491978954866]
  We employ tools and insights from differential geometry to offer a novel perspective on orthogonal RNNs. We show that orthogonal RNNs may be viewed as optimizing in the space of divergence-free vector fields. Motivated by this observation, we study a new recurrent model, which spans the entire space of vector fields.
  arXiv  Detail & Related papers  (2021-02-18T19:39:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.