Domain-Aware Universal Style Transfer

• URL: http://arxiv.org/abs/2108.04441v2
• Date: Wed, 11 Aug 2021 05:13:52 GMT
• Title: Domain-Aware Universal Style Transfer
• Abstract summary: Existing universal style transfer methods successfully deliver arbitrary styles to original images either in an artistic or a photo-realistic way. We propose a unified architecture, Domain-aware Style Transfer Networks (DSTN) that transfer not only the style but also the property of domain (i.e., domainness) from a given reference image. Our model produces better qualitative results and outperforms previous methods in terms of proxy metrics on both artistic and photo-realistic stylizations.
• Score: 34.89191913595395
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Style transfer aims to reproduce content images with the styles from reference images. Existing universal style transfer methods successfully deliver arbitrary styles to original images either in an artistic or a photo-realistic way. However, the range of 'arbitrary style' defined by existing works is bounded in the particular domain due to their structural limitation. Specifically, the degrees of content preservation and stylization are established according to a predefined target domain. As a result, both photo-realistic and artistic models have difficulty in performing the desired style transfer for the other domain. To overcome this limitation, we propose a unified architecture, Domain-aware Style Transfer Networks (DSTN) that transfer not only the style but also the property of domain (i.e., domainness) from a given reference image. To this end, we design a novel domainness indicator that captures the domainness value from the texture and structural features of reference images. Moreover, we introduce a unified framework with domain-aware skip connection to adaptively transfer the stroke and palette to the input contents guided by the domainness indicator. Our extensive experiments validate that our model produces better qualitative results and outperforms previous methods in terms of proxy metrics on both artistic and photo-realistic stylizations.

Related papers

• One-shot Embroidery Customization via Contrastive LoRA Modulation [20.463441212598273]
  We propose a novel contrastive learning framework that disentangles fine-grained style and content features with a single reference image.<n>To evaluate our method on fine-grained style transfer, we build a benchmark for embroidery customization.
  arXiv  Detail & Related papers  (2025-09-23T12:58:15Z)
• SIDA: Synthetic Image Driven Zero-shot Domain Adaptation [5.542712070598464]
  Zero-shot domain adaptation is a method for adapting a model to a target domain without utilizing target domain image data.<n>We propose SIDA, a novel and efficient zero-shot domain adaptation method leveraging synthetic images.<n>We demonstrate the effectiveness of our method by showing state-of-the-art performance in diverse zero-shot adaptation scenarios.
  arXiv  Detail & Related papers  (2025-07-24T17:59:36Z)
• Break Stylistic Sophon: Are We Really Meant to Confine the Imagination in Style Transfer? [12.2238770989173]
  StyleWallfacer is a groundbreaking unified training and inference framework.<n>It addresses various issues encountered in the style transfer process of traditional methods.<n>It delivers artist-level style transfer and text-driven stylization.
  arXiv  Detail & Related papers  (2025-06-18T00:24:29Z)
• Coarse-to-Fine Structure-Aware Artistic Style Transfer [3.5485551392251042]
  Artistic style transfer aims to use a style image and a content image to synthesize a target image that retains the same artistic expression as the style image. Many recently proposed style transfer methods have a common problem; that is, they simply transfer the texture and color of the style image to the global structure of the content image. We present an effective method that can be used to transfer style patterns while fusing the local style structure into the local content structure.
  arXiv  Detail & Related papers  (2025-02-08T00:04:12Z)
• AEANet: Affinity Enhanced Attentional Networks for Arbitrary Style Transfer [4.639424509503966]
  A research area that combines rational academic study with emotive artistic creation. It aims to create a new image from a content image according to a target artistic style, maintaining the content's textural structural information. Existing style transfer methods often significantly damage the texture lines of the content image during the style transformation. We propose affinity-enhanced attentional network, which include the content affinity-enhanced attention (CAEA) module, the style affinity-enhanced attention (SAEA) module, and the hybrid attention (HA) module.
  arXiv  Detail & Related papers  (2024-09-23T01:39:11Z)
• TSSAT: Two-Stage Statistics-Aware Transformation for Artistic Style Transfer [22.16475032434281]
  Artistic style transfer aims to create new artistic images by rendering a given photograph with the target artistic style. Existing methods learn styles simply based on global statistics or local patches, lacking careful consideration of the drawing process in practice. We propose a Two-Stage Statistics-Aware Transformation (TSSAT) module, which first builds the global style foundation by aligning the global statistics of content and style features. To further enhance both content and style representations, we introduce two novel losses: an attention-based content loss and a patch-based style loss.
  arXiv  Detail & Related papers  (2023-09-12T07:02:13Z)
• Any-to-Any Style Transfer: Making Picasso and Da Vinci Collaborate [58.83278629019384]
  Style transfer aims to render the style of a given image for style reference to another given image for content reference. Existing approaches either apply the holistic style of the style image in a global manner, or migrate local colors and textures of the style image to the content counterparts in a pre-defined way. We propose Any-to-Any Style Transfer, which enables users to interactively select styles of regions in the style image and apply them to the prescribed content regions.
  arXiv  Detail & Related papers  (2023-04-19T15:15:36Z)
• A Unified Arbitrary Style Transfer Framework via Adaptive Contrastive Learning [84.8813842101747]
  Unified Contrastive Arbitrary Style Transfer (UCAST) is a novel style representation learning and transfer framework. We present an adaptive contrastive learning scheme for style transfer by introducing an input-dependent temperature. Our framework consists of three key components, i.e., a parallel contrastive learning scheme for style representation and style transfer, a domain enhancement module for effective learning of style distribution, and a generative network for style transfer.
  arXiv  Detail & Related papers  (2023-03-09T04:35:00Z)
• Arbitrary Style Transfer with Structure Enhancement by Combining the Global and Local Loss [51.309905690367835]
  We introduce a novel arbitrary style transfer method with structure enhancement by combining the global and local loss. Experimental results demonstrate that our method can generate higher-quality images with impressive visual effects.
  arXiv  Detail & Related papers  (2022-07-23T07:02:57Z)
• Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer [103.54337984566877]
  Recent studies on StyleGAN show high performance on artistic portrait generation by transfer learning with limited data. We introduce a novel DualStyleGAN with flexible control of dual styles of the original face domain and the extended artistic portrait domain. Experiments demonstrate the superiority of DualStyleGAN over state-of-the-art methods in high-quality portrait style transfer and flexible style control.
  arXiv  Detail & Related papers  (2022-03-24T17:57:11Z)
• UMFA: A photorealistic style transfer method based on U-Net and multi-layer feature aggregation [0.0]
  We propose a photorealistic style transfer network to emphasize the natural effect of photorealistic image stylization. In particular, an encoder based on the dense block and a decoder form a symmetrical structure of U-Net are jointly staked to realize an effective feature extraction and image reconstruction.
  arXiv  Detail & Related papers  (2021-08-13T08:06:29Z)
• SAFIN: Arbitrary Style Transfer With Self-Attentive Factorized Instance Normalization [71.85169368997738]
  Artistic style transfer aims to transfer the style characteristics of one image onto another image while retaining its content. Self-Attention-based approaches have tackled this issue with partial success but suffer from unwanted artifacts. This paper aims to combine the best of both worlds: self-attention and normalization.
  arXiv  Detail & Related papers  (2021-05-13T08:01:01Z)
• DRANet: Disentangling Representation and Adaptation Networks for Unsupervised Cross-Domain Adaptation [23.588766224169493]
  DRANet is a network architecture that disentangles image representations and transfers the visual attributes in a latent space for unsupervised cross-domain adaptation. Our model encodes individual representations of content (scene structure) and style (artistic appearance) from both source and target images. It adapts the domain by incorporating the transferred style factor into the content factor along with learnable weights specified for each domain.
  arXiv  Detail & Related papers  (2021-03-24T18:54:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.