OcclusionFormer: Arranging Z-Order for Layout-Grounded Image Generation

• URL: http://arxiv.org/abs/2605.21343v1
• Date: Wed, 20 May 2026 16:10:44 GMT
• Title: OcclusionFormer: Arranging Z-Order for Layout-Grounded Image Generation
• Abstract summary: We introduce OcclusionFormer, a novel framework that explicitly models Z-order priority by decoupling instances.<n>We also introduce a queried alignment loss that explicitly supervises individual instances and enhances semantic consistency.<n>The proposed method effectively reduces ambiguity in overlapping regions, enforces correct occlusion dependencies, and preserves structural integrity, leading to substantial accuracy gains across diverse scenes.
• Score: 49.49933361280724
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent layout-to-image models have achieved remarkable progress in spatial controllability. However, they still struggle with inter-object occlusion. When bounding boxes overlap, most existing methods lack explicit occlusion information, which makes the generation in intersection regions inherently ambiguous and hinders the determination of complex occlusion relationships. As a result, they often produce entangled textures or physically inconsistent layering in the overlapped areas. To address this issue, we first construct SA-Z, a large-scale dataset enriched with explicit occlusion ordering and pixel-level annotations. Building upon our proposed dataset, we introduce OcclusionFormer, a novel occlusion-aware Diffusion Transformer framework that explicitly models Z-order priority by decoupling instances and compositing them via volume rendering. Furthermore, to ensure fine-grained spatial precision, we introduce a queried alignment loss that explicitly supervises individual instances and enhances semantic consistency. The proposed method effectively reduces ambiguity in overlapping regions, enforces correct occlusion dependencies, and preserves structural integrity, leading to substantial accuracy gains across diverse scenes.

Related papers

• OccluRank: Controllable Occlusion-Aware Layout-to-Image Generation by Adding Just an Ordinal Rank [57.48234285746084]
  OccluRank is a layout-to-image framework that augments each bounding box with only one ordinal rank.<n>Experiments show that OccluRank more reliably preserves target instances, follows specified layouts, and realizes desired attribute relationships.
  arXiv  Detail & Related papers  (2026-08-21T09:53:06Z)
• SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video [88.79625979053873]
  We propose a novel framework, SpaceEra, for pre-trained vision-language models (VLMs)<n>We extend the original framework into a comprehensive system, termed SpaceEra++, which spans data construction, model design, training optimization, and prompting inference.<n>In addition, to enhance spatial reasoning, we develop SpaceAlign, which enforces pairwise object constraints by jointly exploiting absolute coordinates and relative spatial relations.
  arXiv  Detail & Related papers  (2026-07-02T06:56:29Z)
• DepthArb: Training-Free Depth-Arbitrated Generation for Occlusion-Robust Image Synthesis [21.345962204165932]
  We propose DepthArb, a training-free framework that resolves occlusion ambiguities by arbitrating attention competition between interacting objects.<n>We show that DepthArb consistently outperforms state-of-the-art baselines in synthesizing both occlusion accuracy and visual fidelity.<n>As a plug-and-play method, DepthArb seamlessly enhances the compositional capabilities of diffusion backbones.
  arXiv  Detail & Related papers  (2026-03-25T04:28:17Z)
• CroBIM-U: Uncertainty-Driven Referring Remote Sensing Image Segmentation [8.834663340762562]
  Referring remote sensing image segmentation aims to localize specific targets described by natural language within complex overhead imagery.<n>Existing methods typically employ uniform fusion and refinement strategies across the entire image.<n>We propose an textbfuncertainty-guided framework that explicitly leverages a pixel-wise Referrbfreferring uncertainty map as a spatial prior to orchestrate adaptive inference.
  arXiv  Detail & Related papers  (2026-01-07T01:02:39Z)
• Multi-Agent Amodal Completion: Direct Synthesis with Fine-Grained Semantic Guidance [17.81116161163605]
  Amodal completion, generating invisible parts of occluded objects, is vital for applications like image editing and AR.<n>We propose a Collaborative Multi-Agent Reasoning Framework based on upfront collaborative reasoning to overcome these issues.
  arXiv  Detail & Related papers  (2025-09-22T13:20:06Z)
• Semantic Concentration for Self-Supervised Dense Representations Learning [103.10708947415092]
  Image-level self-supervised learning (SSL) has made significant progress, yet learning dense representations for patches remains challenging.<n>This work reveals that image-level SSL avoids over-dispersion by involving implicit semantic concentration.
  arXiv  Detail & Related papers  (2025-09-11T13:12:10Z)
• Geometry-Editable and Appearance-Preserving Object Compositon [67.98806888489385]
  General object composition (GOC) aims to seamlessly integrate a target object into a background scene with desired geometric properties.<n>Recent approaches derive semantic embeddings and integrate them into advanced diffusion models to enable geometry-editable generation.<n>We introduce a Disentangled Geometry-editable and Appearance-preserving Diffusion model that first leverages semantic embeddings to implicitly capture desired geometric transformations.
  arXiv  Detail & Related papers  (2025-05-27T09:05:28Z)
• From Missing Pieces to Masterpieces: Image Completion with Context-Adaptive Diffusion [98.31811240195324]
  ConFill is a novel framework that reduces discrepancies between generated and original images at each diffusion step.<n>It outperforms current methods, setting a new benchmark in image completion.
  arXiv  Detail & Related papers  (2025-04-19T13:40:46Z)
• Convex Hull-based Algebraic Constraint for Visual Quadric SLAM [9.855936120653995]
  Using quadrics as the object representation has the benefits of both generality closed-form projection between image and world spaces.<n>Although numerous have been proposed for dualc reconstruction, we found that many of them are imprecise and provide minimal improvements to localization.<n>We introduce a concise yet more precise convex hull-based constraint for object landmarks.<n>Experiments on public datasets demonstrate that our approach is applicable to both monocular and RGB-D SLAM.
  arXiv  Detail & Related papers  (2025-03-03T07:30:07Z)
• SA-MixNet: Structure-aware Mixup and Invariance Learning for Scribble-supervised Road Extraction in Remote Sensing Images [85.52629779976137]
  We propose a structure-aware Mixup scheme to paste road regions from one image onto another for creating an image scene with increased complexity. A discriminator-based regularization is designed for enhancing the connectivity meanwhile preserving the structure of roads. Our framework demonstrates superior performance on the DeepGlobe, Wuhan, and Massachusetts datasets.
  arXiv  Detail & Related papers  (2024-03-03T02:56:43Z)
• Harnessing the Spatial-Temporal Attention of Diffusion Models for High-Fidelity Text-to-Image Synthesis [59.10787643285506]
  Diffusion-based models have achieved state-of-the-art performance on text-to-image synthesis tasks. One critical limitation of these models is the low fidelity of generated images with respect to the text description. We propose a new text-to-image algorithm that adds explicit control over spatial-temporal cross-attention in diffusion models.
  arXiv  Detail & Related papers  (2023-04-07T23:49:34Z)
• Feature Completion Transformer for Occluded Person Re-identification [25.159974510754992]
  Occluded person re-identification (Re-ID) is a challenging problem due to the destruction of occluders. We propose a Feature Completion Transformer (FCFormer) to implicitly complement the semantic information of occluded parts in the feature space. FCFormer achieves superior performance and outperforms the state-of-the-art methods by significant margins on occluded datasets.
  arXiv  Detail & Related papers  (2023-03-03T01:12:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.