Advancing Aesthetic Image Generation via Composition Transfer

• URL: http://arxiv.org/abs/2605.04609v1
• Date: Wed, 06 May 2026 07:56:16 GMT
• Title: Advancing Aesthetic Image Generation via Composition Transfer
• Abstract summary: Composer is a framework designed to model composition in a semantic-agnostic manner.<n>It supports composition transfer by extracting key composition-aware representations from a reference image.<n>It also supports theme-driven composition retrieval by leveraging the in-context learning capabilities of Large Vision-Language Models.
• Score: 57.624601729777986
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Composition is a cornerstone of visual aesthetics, influencing the appeal of an image. While its principles operate independently of specific content, in practice, composition is often coupled with semantics. As a result, existing methods often enhance composition either through implicit learning or by semantics-based layout control, rather than explicitly modeling composition itself. To address this gap, we introduce Composer, a framework rooted in aesthetic theory, designed to model composition in a semantic-agnostic manner. First, it supports composition transfer by extracting key composition-aware representations from a reference image and leveraging a tailored conditional guidance module to control composition based on pre-trained diffusion models. Second, when users specify only text themes without a composition reference, Composer supports theme-driven composition retrieval by leveraging the in-context learning capabilities of Large Vision-Language Models (LVLMs), achieving explicit composition planning. To enhance composition in a reference-free mode, we conduct text-to-composition fine-tuning on the trained control module to enable implicit composition planning. Furthermore, we curated a high-quality dataset comprising 2 million image-text pairs using state-of-the-art generative models to support model training. Experimental results demonstrate that Composer significantly enhances aesthetic quality in text-to-image tasks and facilitates personalized composition control and transfer, offering users precision and flexibility in the creative process.

Related papers

• Learning to Compose: Revisiting Proxy Task Design for Zero-Shot Composed Image Retrieval [31.201448685871558]
  Composed Image Retrieval (CIR) retrieves a target image from a reference image and a textual modification.<n>We propose FoCo, which models composition as two coordinated stages: focusing on modification-relevant visual content, and then completing the target semantics.<n>Experiments on four ZS-CIR benchmarks show FoCo's state-of-the-art performance and improved generalization.
  arXiv  Detail & Related papers  (2026-07-01T03:20:06Z)
• Cross-Modal Masked Compositional Concept Modeling for Enhancing Visio-Linguistic Compositionality [18.431462064948178]
  Contrastively trained vision-language models like CLIP, have made remarkable progress in learning joint image-text representations.<n>They often exhibit a "bag-of-words" behavior--struggling to capture the object relations, attribute-object bindings, and word order dependencies.<n>We propose MACCO, a framework that masks compositional concepts in one modality and reconstructs them conditioned on the full contextual information from the other.
  arXiv  Detail & Related papers  (2026-06-11T12:45:25Z)
• PhotoFramer: Multi-modal Image Composition Instruction [46.0750537074047]
  PhotoFramer is a multi-modal composition instruction framework.<n>It first describes how to improve the composition in natural language and then generates a well-composed example image.<n>PhotoFramer offers a practical step toward composition assistants that make expert photographic priors accessible to everyday users.
  arXiv  Detail & Related papers  (2025-11-30T17:26:47Z)
• Object-centric Binding in Contrastive Language-Image Pretraining [9.376583779399834]
  We propose a novel approach that diverges from commonly used strategies, which rely on the design of hard-negative augmentations.<n>Our work focuses on integrating inductive biases into pre-trained CLIP-like models to improve their compositional understanding without using any additional hard-negatives.<n>Our resulting model paves the way towards more accurate and sample-efficient image-text matching of complex scenes.
  arXiv  Detail & Related papers  (2025-02-19T21:30:51Z)
• ComAlign: Compositional Alignment in Vision-Language Models [2.3250871476216814]
  We introduce Compositional Alignment (ComAlign) to discover more exact correspondence of text and image components. Our methodology emphasizes that the compositional structure extracted from the text modality must also be retained in the image modality. We train a lightweight network lying on top of existing visual and language encoders using a small dataset.
  arXiv  Detail & Related papers  (2024-09-12T16:46:41Z)
• Cones 2: Customizable Image Synthesis with Multiple Subjects [50.54010141032032]
  We study how to efficiently represent a particular subject as well as how to appropriately compose different subjects. By rectifying the activations in the cross-attention map, the layout appoints and separates the location of different subjects in the image.
  arXiv  Detail & Related papers  (2023-05-30T18:00:06Z)
• Composer: Creative and Controllable Image Synthesis with Composable Conditions [57.78533372393828]
  Recent large-scale generative models learned on big data are capable of synthesizing incredible images yet suffer from limited controllability. This work offers a new generation paradigm that allows flexible control of the output image, such as spatial layout and palette, while maintaining the synthesis quality and model creativity.
  arXiv  Detail & Related papers  (2023-02-20T05:48:41Z)
• Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis [78.28620571530706]
  Large-scale diffusion models have achieved state-of-the-art results on text-to-image synthesis (T2I) tasks. We improve the compositional skills of T2I models, specifically more accurate attribute binding and better image compositions.
  arXiv  Detail & Related papers  (2022-12-09T18:30:24Z)
• StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesis [52.341186561026724]
  Lacking compositionality could have severe implications for robustness and fairness. We introduce a new framework, StyleT2I, to improve the compositionality of text-to-image synthesis. Results show that StyleT2I outperforms previous approaches in terms of consistency between the input text and synthesized images.
  arXiv  Detail & Related papers  (2022-03-29T17:59:50Z)
• Adversarial Image Composition with Auxiliary Illumination [53.89445873577062]
  We propose an Adversarial Image Composition Net (AIC-Net) that achieves realistic image composition. A novel branched generation mechanism is proposed, which disentangles the generation of shadows and the transfer of foreground styles. Experiments on pedestrian and car composition tasks show that the proposed AIC-Net achieves superior composition performance.
  arXiv  Detail & Related papers  (2020-09-17T12:58:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.