OccluRank: Controllable Occlusion-Aware Layout-to-Image Generation by Adding Just an Ordinal Rank

• URL: http://arxiv.org/abs/2608.20932v1
• Date: Fri, 21 Aug 2026 09:53:06 GMT
• Title: OccluRank: Controllable Occlusion-Aware Layout-to-Image Generation by Adding Just an Ordinal Rank
• Abstract summary: OccluRank is a layout-to-image framework that augments each bounding box with only one ordinal rank.<n>Experiments show that OccluRank more reliably preserves target instances, follows specified layouts, and realizes desired attribute relationships.
• Score: 57.48234285746084
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Layout-to-image generation enables explicit spatial control through bounding-box layouts, yet bounding boxes specify only instance locations and cannot represent their occlusion order. Existing methods may rely on additional geometric conditions, employ complex inference procedures, or aggregate independently constructed instance representations without explicitly modeling their occlusion-dependent interactions. We propose OccluRank, a simple and controllable occlusion-aware layout-to-image framework that augments each bounding box with only one ordinal rank. OccluRank encodes the user-specified occlusion order through lightweight rank-based conditioning and introduces an Order-aware Instance Interaction (OII) module to jointly update rank-conditioned instance representations before aggregation. This allows the specified order to guide information exchange among occluding instances without additional geometric inputs or specialized inference-time optimization. We further construct OccluLayout, a synthetic training dataset whose occlusion order and amodal annotations are derived directly from known scene geometry rather than estimated from partially occluded images using auxiliary prediction models. For comprehensive evaluation, we introduce OccluLayout-Bench, which uses multiple multimodal large language model evaluators to assess instance presence, spatial layout, attributes, and occlusion order, together with FID for overall image quality. Experiments show that OccluRank more reliably preserves target instances, follows specified layouts, and realizes desired occlusion relationships while maintaining comparable attribute consistency and overall image quality.

Related papers

• Rank-Consistent Set Reasoning for Co-Salient Object Detection [0.548014499873554]
  Co-salient object detection (Co-SOD) requires a model to find foreground regions that are salient in individual images and supported by the image group.<n>We present emphRank-Consistent Set Reasoning (RCSR), a supervised dense-prediction framework that models a group as an unordered set.
  arXiv  Detail & Related papers  (2026-09-12T04:34:48Z)
• MultiCompose: Multi-Concept Personalized Composition with Per-Subject Attribute Binding [9.605365111072745]
  MultiCompose is a composition framework that decouples per-concept personalization from multi-subject inference.<n>MSP-Bench is a benchmark that jointly evaluates identity fidelity (ID), attribute binding accuracy (BIND), and attribute misalignment (MIS)<n>Experiments show that MultiCompose outperforms existing methods on both conventional metrics and MSP-Bench.
  arXiv  Detail & Related papers  (2026-08-04T14:13:18Z)
• SPORT: Structure-Aware Prototype Disentanglement for Incomplete Multi-View Clustering [51.01038967474103]
  Prototype-based Incomplete Multi-view Clustering has attracted increasing attention by exploiting prototypes as semantic anchors for missing-view imputation.<n>We propose a novel framework termed Structure-aware PrOtotype disentanglement foR incomplete multi-view clusTering (SPORT)<n>SPORT explicitly disentangles shared and view-specific components of prototypes while preserving cluster-level relational structures.
  arXiv  Detail & Related papers  (2026-07-11T17:40:22Z)
• OcclusionFormer: Arranging Z-Order for Layout-Grounded Image Generation [49.49933361280724]
  We introduce OcclusionFormer, a novel framework that explicitly models Z-order priority by decoupling instances.<n>We also introduce a queried alignment loss that explicitly supervises individual instances and enhances semantic consistency.<n>The proposed method effectively reduces ambiguity in overlapping regions, enforces correct occlusion dependencies, and preserves structural integrity, leading to substantial accuracy gains across diverse scenes.
  arXiv  Detail & Related papers  (2026-05-20T16:10:44Z)
• UniCustom: Unified Visual Conditioning for Multi-Reference Image Generation [65.53694602893042]
  We propose a unified visual conditioning framework that fuses ViT and VAE features before VLM encoding.<n>Experiments on two multi-reference generation benchmarks demonstrate that UniCustom consistently improves subject consistency, instruction following, and compositional fidelity.
  arXiv  Detail & Related papers  (2026-05-12T13:10:05Z)
• Spanning Tree Autoregressive Visual Generation [51.7635842702602]
  We present Spanning Tree Autoregressive (STAR) modeling, which can incorporate prior knowledge of images, such as center bias and locality, to maintain sampling performance.
  arXiv  Detail & Related papers  (2025-11-21T09:45:17Z)
• A Two-Stage System for Layout-Controlled Image Generation using Large Language Models and Diffusion Models [0.0]
  Text-to-image diffusion models exhibit remarkable generative capabilities, but lack precise control over object counts and spatial arrangements.<n>This work introduces a two-stage system to address these compositional limitations.<n>The first stage employs a Large Language Model (LLM) to generate a structured layout from a list of objects.<n>The second stage uses a layout-conditioned diffusion model to synthesize a photorealistic image adhering to this layout.
  arXiv  Detail & Related papers  (2025-11-10T09:40:48Z)
• Spatial-Aware Latent Initialization for Controllable Image Generation [9.23227552726271]
  Text-to-image diffusion models have demonstrated impressive ability to generate high-quality images conditioned on the textual input. Previous research has primarily focused on aligning cross-attention maps with layout conditions. We propose leveraging a spatial-aware initialization noise during the denoising process to achieve better layout control.
  arXiv  Detail & Related papers  (2024-01-29T13:42:01Z)
• Multi-Granularity Denoising and Bidirectional Alignment for Weakly Supervised Semantic Segmentation [75.32213865436442]
  We propose an end-to-end multi-granularity denoising and bidirectional alignment (MDBA) model to alleviate the noisy label and multi-class generalization issues. The MDBA model can reach the mIoU of 69.5% and 70.2% on validation and test sets for the PASCAL VOC 2012 dataset.
  arXiv  Detail & Related papers  (2023-05-09T03:33:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.