CalliMaster: Mastering Page-level Chinese Calligraphy via Layout-guided Spatial Planning
- URL: http://arxiv.org/abs/2603.12482v1
- Date: Thu, 12 Mar 2026 22:01:19 GMT
- Title: CalliMaster: Mastering Page-level Chinese Calligraphy via Layout-guided Spatial Planning
- Abstract summary: Page-level calligraphy synthesis requires balancing glyph precision with layout composition.<n>We present textbfCalliMaster, a unified framework for controllable generation and editing.
- Score: 37.872480365351485
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Page-level calligraphy synthesis requires balancing glyph precision with layout composition. Existing character models lack spatial context, while page-level methods often compromise brushwork detail. In this paper, we present \textbf{CalliMaster}, a unified framework for controllable generation and editing that resolves this conflict by decoupling spatial planning from content synthesis. Inspired by the human cognitive process of ``planning before writing'', we introduce a coarse-to-fine pipeline \textbf{(Text $\rightarrow$ Layout $\rightarrow$ Image)} to tackle the combinatorial complexity of page-scale synthesis. Operating within a single Multimodal Diffusion Transformer, a spatial planning stage first predicts character bounding boxes to establish the global spatial arrangement. This intermediate layout then serves as a geometric prompt for the content synthesis stage, where the same network utilizes flow-matching to render high-fidelity brushwork. Beyond achieving state-of-the-art generation quality, this disentanglement supports versatile downstream capabilities. By treating the layout as a modifiable constraint, CalliMaster enables controllable semantic re-planning: users can resize or reposition characters while the model automatically harmonizes the surrounding void space and brush momentum. Furthermore, we demonstrate the framework's extensibility to artifact restoration and forensic analysis, providing a comprehensive tool for digital cultural heritage.
Related papers
- Mise-en-Scène: Implicit Layout Emergence in Diffusion Transformers for Human-AI Design Co-Creation [15.30671862055459]
We present Mise-en-Scne, a two-stage framework for graphic design synthesis.<n>In the first stage, a diffusion transformer adapted with a small, knockout-selected LoRA drafts a complete design in which the arrangement of the elements emerges jointly with the rendered canvas.<n>In the second stage, a deterministic match-and-place step moves the original high-resolution assets to the drafted positions, which guarantees exact asset fidelity.
arXiv Detail & Related papers (2026-08-19T15:02:12Z) - Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Framework [52.477407591581176]
Mask-free video object insertion has emerged as a challenging task, requiring harmonious integration of reference objects into source videos.<n>We propose textittextbfSmart-Insertion-V, an end-to-end textbfDual-Stream framework that concurrently conducts video insertion and image style transfer.
arXiv Detail & Related papers (2026-05-22T17:54:54Z) - All-in-One Conditioning for Text-to-Image Synthesis [45.22434803596108]
We propose a novel approach that grounds text-to-image synthesis within the framework of scene graph structures.<n>We introduce a zero-shot, scene graph-based conditioning mechanism that generates soft visual guidance during inference.<n>This enables the model to maintain text-image alignment while supporting lightweight, coherent, and diverse image synthesis.
arXiv Detail & Related papers (2026-02-09T20:16:19Z) - BookNet: Book Image Rectification via Cross-Page Attention Network [61.60737484928661]
We introduce BookNet, the first end-to-end deep learning framework specifically designed for dual-page book image rectification.<n>BookNet adopts a dual-branch architecture with cross-page attention mechanisms, enabling it to estimate warping flows for both individual pages and the complete book spread.<n>To address the absence of specialized datasets, we present Book3D, a large-scale synthetic dataset for training, and Book100, a comprehensive real-world benchmark for evaluation.
arXiv Detail & Related papers (2026-01-29T16:26:25Z) - Text-Conditioned Background Generation for Editable Multi-Layer Documents [32.896370365677136]
We present a framework for document-centric background generation with multi-page editing and thematic continuity.<n>Our training-free framework produces visually coherent, text-preserving documents, bridging generative modeling with natural design.
arXiv Detail & Related papers (2025-12-19T01:10:24Z) - UniCalli: A Unified Diffusion Framework for Column-Level Generation and Recognition of Chinese Calligraphy [37.162115015010585]
We introduce textbfUniCalli, a unified diffusion framework for column-level recognition and generation.<n>We curated a dataset of over 8,000 digitized pieces, with 4,000 annotated pieces, trained on a mix of synthetic, labeled, and unlabeled data.<n>The model achieves state-of-the-art generative quality with superior ligature continuity and layout fidelity, alongside stronger recognition.
arXiv Detail & Related papers (2025-10-15T16:52:07Z) - MUSE: Multi-Subject Unified Synthesis via Explicit Layout Semantic Expansion [15.787883177836362]
We address the task of layout-controllable multi-subject synthesis (LMS), which requires both faithful reconstruction of reference subjects and their accurate placement in specified regions within a unified image.<n>We propose MUSE, a unified synthesis framework that seamlessly integrates layout specifications with textual guidance through explicit semantic expansion.
arXiv Detail & Related papers (2025-08-20T05:52:26Z) - Robust Image Stitching with Optimal Plane [39.80133570371559]
textitRopStitch is an unsupervised deep image stitching framework with both robustness and naturalness.<n>textitRopStitch significantly outperforms existing methods, particularly in scene robustness and content naturalness.
arXiv Detail & Related papers (2025-08-07T23:53:26Z) - LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image
Generation [121.45667242282721]
We propose a coarse-to-fine paradigm to achieve layout planning and image generation.
Our proposed method outperforms the state-of-the-art models in terms of photorealistic layout and image generation.
arXiv Detail & Related papers (2023-08-09T17:45:04Z) - Composer: Creative and Controllable Image Synthesis with Composable
Conditions [57.78533372393828]
Recent large-scale generative models learned on big data are capable of synthesizing incredible images yet suffer from limited controllability.
This work offers a new generation paradigm that allows flexible control of the output image, such as spatial layout and palette, while maintaining the synthesis quality and model creativity.
arXiv Detail & Related papers (2023-02-20T05:48:41Z) - Semantic Palette: Guiding Scene Generation with Class Proportions [34.746963256847145]
We introduce a conditional framework with novel architecture designs and learning objectives, which effectively accommodates class proportions to guide the scene generation process.
Thanks to the semantic control, we can produce layouts close to the real distribution, helping enhance the whole scene generation process.
We demonstrate the merit of our approach for data augmentation: semantic segmenters trained on real layout-image pairs outperform models only trained on real pairs.
arXiv Detail & Related papers (2021-06-03T07:04:00Z) - Person-in-Context Synthesiswith Compositional Structural Space [59.129960774988284]
We propose a new problem, textbfPersons in Context Synthesis, which aims to synthesize diverse person instance(s) in consistent contexts.
The context is specified by the bounding box object layout which lacks shape information, while pose of the person(s) by keypoints which are sparsely annotated.
To handle the stark difference in input structures, we proposed two separate neural branches to attentively composite the respective (context/person) inputs into shared compositional structural space''
This structural space is then decoded to the image space using multi-level feature modulation strategy, and learned in a self
arXiv Detail & Related papers (2020-08-28T14:33:28Z) - CoSE: Compositional Stroke Embeddings [52.529172734044664]
We present a generative model for complex free-form structures such as stroke-based drawing tasks.
Our approach is suitable for interactive use cases such as auto-completing diagrams.
arXiv Detail & Related papers (2020-06-17T15:22:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.