DiffCJK: Conditional Diffusion Model for High-Quality and Wide-coverage CJK Character Generation

• URL: http://arxiv.org/abs/2404.05212v2
• Date: Thu, 25 Apr 2024 06:53:06 GMT
• Title: DiffCJK: Conditional Diffusion Model for High-Quality and Wide-coverage CJK Character Generation
• Authors: Yingtao Tian,
• Abstract summary: We propose a novel diffusion method for generating glyphs in a targeted style from a single conditioned, standard glyph form. Our approach shows remarkable zero-shot generalization capabilities for non-CJK but Chinese-inspired scripts. In summary, our proposed method opens the door to high-quality, generative model-assisted font creation for CJK characters.
• Score: 1.0044057719679087
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Chinese, Japanese, and Korean (CJK), with a vast number of native speakers, have profound influence on society and culture. The typesetting of CJK languages carries a wide range of requirements due to the complexity of their scripts and unique literary traditions. A critical aspect of this typesetting process is that CJK fonts need to provide a set of consistent-looking glyphs for approximately one hundred thousand characters. However, creating such a font is inherently labor-intensive and expensive, which significantly hampers the development of new CJK fonts for typesetting, historical, aesthetic, or artistic purposes. To bridge this gap, we are motivated by recent advancements in diffusion-based generative models and propose a novel diffusion method for generating glyphs in a targeted style from a single conditioned, standard glyph form. Our experiments show that our method is capable of generating fonts of both printed and hand-written styles, the latter of which presents a greater challenge. Moreover, our approach shows remarkable zero-shot generalization capabilities for non-CJK but Chinese-inspired scripts. We also show our method facilitates smooth style interpolation and generates bitmap images suitable for vectorization, which is crucial in the font creation process. In summary, our proposed method opens the door to high-quality, generative model-assisted font creation for CJK characters, for both typesetting and artistic endeavors.

Related papers

• Decoupling Layout from Glyph in Online Chinese Handwriting Generation [6.566541829858544]
  We develop a text line layout generator and stylized font synthesizer. The layout generator performs in-context-like learning based on the text content and the provided style references to generate positions for each glyph autoregressively. The font synthesizer which consists of a character embedding dictionary, a multi-scale calligraphy style encoder, and a 1D U-Net based diffusion denoiser will generate each font on its position while imitating the calligraphy style extracted from the given style references.
  arXiv  Detail & Related papers  (2024-10-03T08:46:17Z)
• GRIF-DM: Generation of Rich Impression Fonts using Diffusion Models [18.15911470339845]
  We introduce a diffusion-based method, termed ourmethod, to generate fonts that vividly embody specific impressions. Our experimental results, conducted on the MyFonts dataset, affirm that this method is capable of producing realistic, vibrant, and high-fidelity fonts.
  arXiv  Detail & Related papers  (2024-08-14T02:26:46Z)
• VQ-Font: Few-Shot Font Generation with Structure-Aware Enhancement and Quantization [52.870638830417]
  We propose a VQGAN-based framework (i.e., VQ-Font) to enhance glyph fidelity through token prior refinement and structure-aware enhancement. Specifically, we pre-train a VQGAN to encapsulate font token prior within a codebook. Subsequently, VQ-Font refines the synthesized glyphs with the codebook to eliminate the domain gap between synthesized and real-world strokes.
  arXiv  Detail & Related papers  (2023-08-27T06:32:20Z)
• GlyphDiffusion: Text Generation as Image Generation [100.98428068214736]
  We propose GlyphDiffusion, a novel diffusion approach for text generation via text-guided image generation. Our key idea is to render the target text as a glyph image containing visual language content. Our model also makes significant improvements compared to the recent diffusion model.
  arXiv  Detail & Related papers  (2023-04-25T02:14:44Z)
• Few-shot Font Generation by Learning Style Difference and Similarity [84.76381937516356]
  We propose a novel font generation approach by learning the Difference between different styles and the Similarity of the same style (DS-Font) Specifically, we propose a multi-layer style projector for style encoding and realize a distinctive style representation via our proposed Cluster-level Contrastive Style (CCS) loss.
  arXiv  Detail & Related papers  (2023-01-24T13:57:25Z)
• Diff-Font: Diffusion Model for Robust One-Shot Font Generation [110.45944936952309]
  We propose a novel one-shot font generation method based on a diffusion model, named Diff-Font. The proposed model aims to generate the entire font library by giving only one sample as the reference. The well-trained Diff-Font is not only robust to font gap and font variation, but also achieved promising performance on difficult character generation.
  arXiv  Detail & Related papers  (2022-12-12T13:51:50Z)
• Few-Shot Font Generation by Learning Fine-Grained Local Styles [90.39288370855115]
  Few-shot font generation (FFG) aims to generate a new font with a few examples. We propose a new font generation approach by learning 1) the fine-grained local styles from references, and 2) the spatial correspondence between the content and reference glyphs.
  arXiv  Detail & Related papers  (2022-05-20T05:07:05Z)
• Scalable Font Reconstruction with Dual Latent Manifolds [55.29525824849242]
  We propose a deep generative model that performs typography analysis and font reconstruction. Our approach enables us to massively scale up the number of character types we can effectively model. We evaluate on the task of font reconstruction over various datasets representing character types of many languages.
  arXiv  Detail & Related papers  (2021-09-10T20:37:43Z)
• Few-Shot Font Generation with Deep Metric Learning [33.12829580813688]
  The proposed framework introduces deep metric learning to style encoders. We performed experiments using black-and-white and shape-distinctive font datasets.
  arXiv  Detail & Related papers  (2020-11-04T10:12:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.