Font Representation Learning via Paired-glyph Matching

• URL: http://arxiv.org/abs/2211.10967v1
• Date: Sun, 20 Nov 2022 12:27:27 GMT
• Title: Font Representation Learning via Paired-glyph Matching
• Authors: Junho Cho, Kyuewang Lee, Jin Young Choi
• Abstract summary: We propose a novel font representation learning scheme to embed font styles into the latent space. For the discriminative representation of a font from others, we propose a paired-glyph matching-based font representation learning model. We show our font representation learning scheme achieves better generalization performance than the existing font representation learning techniques.
• Score: 15.358456947574913
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Fonts can convey profound meanings of words in various forms of glyphs. Without typography knowledge, manually selecting an appropriate font or designing a new font is a tedious and painful task. To allow users to explore vast font styles and create new font styles, font retrieval and font style transfer methods have been proposed. These tasks increase the need for learning high-quality font representations. Therefore, we propose a novel font representation learning scheme to embed font styles into the latent space. For the discriminative representation of a font from others, we propose a paired-glyph matching-based font representation learning model that attracts the representations of glyphs in the same font to one another, but pushes away those of other fonts. Through evaluations on font retrieval with query glyphs on new fonts, we show our font representation learning scheme achieves better generalization performance than the existing font representation learning techniques. Finally on the downstream font style transfer and generation tasks, we confirm the benefits of transfer learning with the proposed method. The source code is available at https://github.com/junhocho/paired-glyph-matching.

Related papers

• VQ-Font: Few-Shot Font Generation with Structure-Aware Enhancement and Quantization [52.870638830417]
  We propose a VQGAN-based framework (i.e., VQ-Font) to enhance glyph fidelity through token prior refinement and structure-aware enhancement. Specifically, we pre-train a VQGAN to encapsulate font token prior within a codebook. Subsequently, VQ-Font refines the synthesized glyphs with the codebook to eliminate the domain gap between synthesized and real-world strokes.
  arXiv  Detail & Related papers  (2023-08-27T06:32:20Z)
• Diff-Font: Diffusion Model for Robust One-Shot Font Generation [110.45944936952309]
  We propose a novel one-shot font generation method based on a diffusion model, named Diff-Font. The proposed model aims to generate the entire font library by giving only one sample as the reference. The well-trained Diff-Font is not only robust to font gap and font variation, but also achieved promising performance on difficult character generation.
  arXiv  Detail & Related papers  (2022-12-12T13:51:50Z)
• Few-Shot Font Generation by Learning Fine-Grained Local Styles [90.39288370855115]
  Few-shot font generation (FFG) aims to generate a new font with a few examples. We propose a new font generation approach by learning 1) the fine-grained local styles from references, and 2) the spatial correspondence between the content and reference glyphs.
  arXiv  Detail & Related papers  (2022-05-20T05:07:05Z)
• FontNet: Closing the gap to font designer performance in font synthesis [3.991334489146843]
  We propose a model, called FontNet, that learns to separate font styles in the embedding space where distances directly correspond to a measure of font similarity. We design the network architecture and training procedure that can be adopted for any language system and can produce high-resolution font images.
  arXiv  Detail & Related papers  (2022-05-13T08:37:10Z)
• Scalable Font Reconstruction with Dual Latent Manifolds [55.29525824849242]
  We propose a deep generative model that performs typography analysis and font reconstruction. Our approach enables us to massively scale up the number of character types we can effectively model. We evaluate on the task of font reconstruction over various datasets representing character types of many languages.
  arXiv  Detail & Related papers  (2021-09-10T20:37:43Z)
• Font Completion and Manipulation by Cycling Between Multi-Modality Representations [113.26243126754704]
  We innovate to explore the generation of font glyphs as 2D graphic objects with the graph as an intermediate representation. We formulate a cross-modality cycled image-to-image structure with a graph between an image encoder and an image. Our model generates improved results than both image-to-image baseline and previous state-of-the-art methods for glyph completion.
  arXiv  Detail & Related papers  (2021-08-30T02:43:29Z)
• A Multi-Implicit Neural Representation for Fonts [79.6123184198301]
  font-specific discontinuities like edges and corners are difficult to represent using neural networks. We introduce textitmulti-implicits to represent fonts as a permutation-in set of learned implict functions, without losing features.
  arXiv  Detail & Related papers  (2021-06-12T21:40:11Z)
• Few-shot Compositional Font Generation with Dual Memory [16.967987801167514]
  We propose a novel font generation framework, named Dual Memory-augmented Font Generation Network (DM-Font) We employ memory components and global-context awareness in the generator to take advantage of the compositionality. In the experiments on Korean-handwriting fonts and Thai-printing fonts, we observe that our method generates a significantly better quality of samples with faithful stylization.
  arXiv  Detail & Related papers  (2020-05-21T08:13:40Z)
• Attribute2Font: Creating Fonts You Want From Attributes [32.82714291856353]
  Attribute2Font is trained to perform font style transfer between any two fonts conditioned on their attribute values. A novel unit named Attribute Attention Module is designed to make those generated glyph images better embody the prominent font attributes.
  arXiv  Detail & Related papers  (2020-05-16T04:06:53Z)
• Character-independent font identification [11.86456063377268]
  We propose a method of determining if any two characters are from the same font or not. We use a Convolutional Neural Network (CNN) trained with various font image pairs. We then evaluate the model on a different set of fonts that are unseen by the network.
  arXiv  Detail & Related papers  (2020-01-24T05:59:53Z)
• Neural Style Difference Transfer and Its Application to Font Generation [14.567067583556717]
  We will introduce a method to create fonts automatically. The difference of font styles between two different fonts is found and transferred to another font using neural style transfer.
  arXiv  Detail & Related papers  (2020-01-21T03:32:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.