FreeStyle: Free Control of Style-Content Dual-Reference Generation from Community LoRA Mining

• URL: http://arxiv.org/abs/2606.20506v1
• Date: Thu, 18 Jun 2026 17:24:27 GMT
• Title: FreeStyle: Free Control of Style-Content Dual-Reference Generation from Community LoRA Mining
• Abstract summary: Style-content dual-reference generation aims to synthesize an image that preserves the structure and semantics of a content reference while adopting the style of a separate style reference.<n>Key bottleneck is the lack of large-scale triplet data with clean content-style separation and broad long-tail style coverage.<n>We propose FreeStyle, a scalable dual-reference generation framework based on community LoRA mining.
• Score: 42.06209840326987
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Style-content dual-reference generation aims to synthesize an image that preserves the structure and semantics of a content reference while adopting the style of a separate style reference.Despite recent progress, this setting remains challenging because models must balance content fidelity, style alignment, and instruction following avoiding semantic leakage from the style reference.A key bottleneck is the lack of large-scale triplet data with clean content-style separation and broad long-tail style coverage.In this work, we propose FreeStyle, a scalable dual-reference generation framework based on community LoRA mining.We treat community LoRAs as compositional anchors for style and content, and design a rigorous generation and filtering pipeline to construct large-scale Style-Reference and Content-Reference triplets across multiple base models.To address content leakage, we adopt a two-stage curriculum with stage-specific disentanglement mechanisms: an attention-level enrichment constraint that suppresses style-reference leakage in the style-transfer stage, and a frequency-aware RoPE modulation strategy that targets positional-correspondence-based leakage in the harder dual-reference stage.We also introduce a benchmark covering both style-reference and dual-reference generation, with evaluations on style similarity, content preservation, aesthetics, instruction following, and leakage rejection. The benchmark incorporates a style-invariant Content Alignment Score (CAS) and introduces a calibrated VLM-based Rejection Score for evaluating generation reliability and leakage suppression.Extensive experiments show that our model achieves a strong balance among style alignment, content preservation, and leakage suppression.

Related papers

• Style-CCL: Content-Preserving Style Transfer via Curriculum Continual Learning [52.33837657928263]
  Style transfer, given content and style references, remains challenging for Diffusion Transformers.<n>We propose Style-CCL, a Multi-Stage Curriculum Continual Learning framework that trains SC-DiT from semantic (easy) to texture (hard) styles.<n>Our framework achieves state-of-the-art performance in three core metrics: style similarity, content consistency, and aesthetic quality.
  arXiv  Detail & Related papers  (2026-06-04T13:02:04Z)
• Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation [79.94088803584262]
  Identity-preserving video generation (IPVG) aims to synthesize high-fidelity videos that follow text prompts while preserving a reference identity.<n>We propose ST-DRC, an effective Spatial-Temporal Decoupled Reference Conditioning framework for identity-preserving text-to-video generation.<n>We show that ST-DRC achieves strong identity preservation, prompt alignment, temporal consistency, and video quality with a lightweight design built on LTX-2.3.
  arXiv  Detail & Related papers  (2026-06-01T16:12:18Z)
• StyleVAR: Controllable Image Style Transfer via Visual Autoregressive Modeling [0.0]
  We formulate style transfer as conditional discrete sequence modeling in a learned latent space.<n>We introduce a blended cross-attention mechanism in which the evolving target representation attends to its own history.<n>Style VAR consistently outperforms an AdaIN baseline on Style Loss, Content Loss, LPIPS, SSIM, DreamSim, and CLIP similarity.
  arXiv  Detail & Related papers  (2026-04-22T19:52:35Z)
• UniCSG: Unified High-Fidelity Content-Constrained Style-Driven Generation via Staged Semantic and Frequency Disentanglement [13.265643008768825]
  DiT-based diffusion models often suffer from content-style entanglement, leading to reference-content leakage and unstable generation.<n>We present UniCSG, a unified framework for content-constrained, style-driven generation in both text-guided and reference-guided settings.
  arXiv  Detail & Related papers  (2026-04-20T05:59:20Z)
• Structure-Level Disentangled Diffusion for Few-Shot Chinese Font Generation [18.601789249339014]
  Few-shot Chinese font generation aims to synthesize new characters in a target style using only a handful of reference images.<n>Existing approaches achieve only feature-level disentanglement, allowing the generator to re-entangle these features.<n>We propose the Structure-Level Disentangled Diffusion Model (SLD-Font), which receives content and style information from two separate channels.
  arXiv  Detail & Related papers  (2026-02-21T15:41:06Z)
• USO: Unified Style and Subject-Driven Generation via Disentangled and Reward Learning [17.75580298339048]
  We present U.S.O, a Unified Style-Subject Optimized customization model.<n>First, we construct a large-scale triplet dataset consisting of content images, style images, and their corresponding stylized content images.<n>Second, we introduce a disentangled learning scheme that simultaneously aligns style features and disentangles content from style.<n>Third, we incorporate a style reward-learning paradigm denoted as SRL to further enhance the model's performance.
  arXiv  Detail & Related papers  (2025-08-26T12:10:24Z)
• Only-Style: Stylistic Consistency in Image Generation without Content Leakage [21.68241134664501]
  Only-Style is a method designed to mitigate content leakage in a semantically coherent manner while preserving stylistic consistency.<n>Only-Style works by localizing content leakage during inference, allowing the adaptive tuning of a parameter that controls the style alignment process.<n>Our approach demonstrates a significant improvement over state-of-the-art methods through extensive evaluation across diverse instances.
  arXiv  Detail & Related papers  (2025-06-11T16:33:09Z)
• ZePo: Zero-Shot Portrait Stylization with Faster Sampling [61.14140480095604]
  This paper presents an inversion-free portrait stylization framework based on diffusion models that accomplishes content and style feature fusion in merely four sampling steps. We propose a feature merging strategy to amalgamate redundant features in Consistency Features, thereby reducing the computational load of attention control.
  arXiv  Detail & Related papers  (2024-08-10T08:53:41Z)
• ArtWeaver: Advanced Dynamic Style Integration via Diffusion Model [73.95608242322949]
  Stylized Text-to-Image Generation (STIG) aims to generate images from text prompts and style reference images. We present ArtWeaver, a novel framework that leverages pretrained Stable Diffusion to address challenges such as misinterpreted styles and inconsistent semantics.
  arXiv  Detail & Related papers  (2024-05-24T07:19:40Z)
• StyleAdapter: A Unified Stylized Image Generation Model [97.24936247688824]
  StyleAdapter is a unified stylized image generation model capable of producing a variety of stylized images. It can be integrated with existing controllable synthesis methods, such as T2I-adapter and ControlNet.
  arXiv  Detail & Related papers  (2023-09-04T19:16:46Z)
• StyleMeUp: Towards Style-Agnostic Sketch-Based Image Retrieval [119.03470556503942]
  Crossmodal matching problem is typically solved by learning a joint embedding space where semantic content shared between photo and sketch modalities are preserved. An effective model needs to explicitly account for this style diversity, crucially, to unseen user styles. Our model can not only disentangle the cross-modal shared semantic content, but can adapt the disentanglement to any unseen user style as well, making the model truly agnostic.
  arXiv  Detail & Related papers  (2021-03-29T15:44:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.