Efficient and Scalable Chinese Vector Font Generation via Component Composition

• URL: http://arxiv.org/abs/2404.06779v1
• Date: Wed, 10 Apr 2024 06:39:18 GMT
• Title: Efficient and Scalable Chinese Vector Font Generation via Component Composition
• Authors: Jinyu Song, Weitao You, Shuhui Shi, Shuxuan Guo, Lingyun Sun, Wei Wang,
• Abstract summary: We introduce the first efficient and scalable Chinese vector font generation approach via component composition. We propose a framework based on spatial transformer networks (STN) and multiple losses tailored to font characteristics. Our experiments have demonstrated that our method significantly surpasses the state-of-the-art vector font generation methods.
• Score: 13.499566877003408
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Chinese vector font generation is challenging due to the complex structure and huge amount of Chinese characters. Recent advances remain limited to generating a small set of characters with simple structure. In this work, we first observe that most Chinese characters can be disassembled into frequently-reused components. Therefore, we introduce the first efficient and scalable Chinese vector font generation approach via component composition, allowing generating numerous vector characters from a small set of components. To achieve this, we collect a large-scale dataset that contains over \textit{90K} Chinese characters with their components and layout information. Upon the dataset, we propose a simple yet effective framework based on spatial transformer networks (STN) and multiple losses tailored to font characteristics to learn the affine transformation of the components, which can be directly applied to the B\'ezier curves, resulting in Chinese characters in vector format. Our qualitative and quantitative experiments have demonstrated that our method significantly surpasses the state-of-the-art vector font generation methods in generating large-scale complex Chinese characters in both font generation and zero-shot font extension.

Related papers

• VQ-Font: Few-Shot Font Generation with Structure-Aware Enhancement and Quantization [52.870638830417]
  We propose a VQGAN-based framework (i.e., VQ-Font) to enhance glyph fidelity through token prior refinement and structure-aware enhancement. Specifically, we pre-train a VQGAN to encapsulate font token prior within a codebook. Subsequently, VQ-Font refines the synthesized glyphs with the codebook to eliminate the domain gap between synthesized and real-world strokes.
  arXiv  Detail & Related papers  (2023-08-27T06:32:20Z)
• Learning Generative Structure Prior for Blind Text Image Super-resolution [153.05759524358467]
  We present a novel prior that focuses more on the character structure. To restrict the generative space of StyleGAN, we store the discrete features for each character in a codebook. The proposed structure prior exerts stronger character-specific guidance to restore faithful and precise strokes of a designated character.
  arXiv  Detail & Related papers  (2023-03-26T13:54:28Z)
• Diff-Font: Diffusion Model for Robust One-Shot Font Generation [110.45944936952309]
  We propose a novel one-shot font generation method based on a diffusion model, named Diff-Font. The proposed model aims to generate the entire font library by giving only one sample as the reference. The well-trained Diff-Font is not only robust to font gap and font variation, but also achieved promising performance on difficult character generation.
  arXiv  Detail & Related papers  (2022-12-12T13:51:50Z)
• SVG Vector Font Generation for Chinese Characters with Transformer [42.46279506573065]
  We propose a novel network architecture with Transformer and loss functions to capture structural features without differentiable rendering. Although the dataset range was still limited to the sans-serif family, we successfully generated the Chinese vector font for the first time.
  arXiv  Detail & Related papers  (2022-06-21T12:51:19Z)
• ZiGAN: Fine-grained Chinese Calligraphy Font Generation via a Few-shot Style Transfer Approach [7.318027179922774]
  ZiGAN is a powerful end-to-end Chinese calligraphy font generation framework. It does not require any manual operation or redundant preprocessing to generate fine-grained target-style characters. Our method has a state-of-the-art generalization ability in few-shot Chinese character style transfer.
  arXiv  Detail & Related papers  (2021-08-08T09:50:20Z)
• MECT: Multi-Metadata Embedding based Cross-Transformer for Chinese Named Entity Recognition [21.190288516462704]
  This paper presents a novel Multi-metadata Embedding based Cross-Transformer (MECT) to improve the performance of Chinese NER. Specifically, we use multi-metadata embedding in a two-stream Transformer to integrate Chinese character features with the radical-level embedding. With the structural characteristics of Chinese characters, MECT can better capture the semantic information of Chinese characters for NER.
  arXiv  Detail & Related papers  (2021-07-12T13:39:06Z)
• GlyphCRM: Bidirectional Encoder Representation for Chinese Character with its Glyph [31.723483415041347]
  Previous works indicate that the glyph of Chinese characters contains rich semantic information. We propose a Chinese pre-trained representation model named as Glyph CRM. It abandons the ID-based character embedding method yet solely based on sequential character images.
  arXiv  Detail & Related papers  (2021-07-01T12:14:05Z)
• A Multi-Implicit Neural Representation for Fonts [79.6123184198301]
  font-specific discontinuities like edges and corners are difficult to represent using neural networks. We introduce textitmulti-implicits to represent fonts as a permutation-in set of learned implict functions, without losing features.
  arXiv  Detail & Related papers  (2021-06-12T21:40:11Z)
• Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models [62.41139712595334]
  We propose a novel pre-training paradigm for Chinese -- Lattice-BERT. We construct a lattice graph from the characters and words in a sentence and feed all these text units into transformers. We show that our model can bring an average increase of 1.5% under the 12-layer setting.
  arXiv  Detail & Related papers  (2021-04-15T02:36:49Z)
• Few-shot Font Generation with Localized Style Representations and Factorization [23.781619323447003]
  We propose a novel font generation method by learning localized styles, namely component-wise style representations, instead of universal styles. Our method shows remarkably better few-shot font generation results (with only 8 reference glyph images) than other state-of-the-arts.
  arXiv  Detail & Related papers  (2020-09-23T10:33:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.