PolyLayout: Hierarchical VLM-Guided Layout Generation Beyond Rectangular Rooms

• URL: http://arxiv.org/abs/2608.10838v1
• Date: Tue, 11 Aug 2026 12:04:14 GMT
• Title: PolyLayout: Hierarchical VLM-Guided Layout Generation Beyond Rectangular Rooms
• Abstract summary: We introduce a hybrid, hierarchical framework tailored for retail, specifically designed to support scalable spatial planning applications.<n>Our system decouples generation into three stages: (1) functional furniture clustering and fine-grained intra-zone placement; (2) macro-routing guided by a vision-language model (VLM) to anchor both these clustered zones and any remaining standalone furniture within diverse polygonal boundaries; and (3) rule-based optimization for collision-free micro-arrangements that respect architectural constraints.<n>Our results show that our approach attains the highest perceptual plausibility while maintaining good geometric compliance at relatively low latency, and extends to irregular boundaries that
• Score: 4.2118472123729775
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Generating physically plausible 3D room layouts is essential for home furnishing retail, enabling customers to visualize products in their own homes and confidently make purchasing decisions. However, a gap exists between academic research and real-world application: existing solutions primarily focus on algorithmic strategies for furniture placement, largely neglecting the non-rectangular geometries and strict door/window constraints prevalent in real homes. To bridge the gap, we introduce a hybrid, hierarchical framework tailored for retail, specifically designed to support scalable spatial planning applications. Our system decouples generation into three stages: (1) functional furniture clustering and fine-grained intra-zone placement; (2) macro-routing guided by a vision-language model (VLM) to anchor both these clustered zones and any remaining standalone furniture within diverse polygonal boundaries; and (3) rule-based optimization for collision-free micro-arrangements that respect architectural constraints. We evaluate our system on production-scale catalogs and a representative set of irregular real-world topologies. Our results show that our approach attains the highest perceptual plausibility while maintaining good geometric compliance at relatively low latency, and extends to irregular boundaries that existing methods do not natively support.

Related papers

• Architect-Ant: Editable Automatic Furnishing of Architectural Floor Plans [73.84806303977797]
  We present Architect-Ant, an automatic furnishing framework powered by a fine-tuned vision-tuned model.<n>Furniture layouts are represented using a compact, coordinate-based domain-specific language (language) that encodes object placements.<n>We show that Architect-Ant produces geometrically valid and functionally plausible layouts, and suggest a scalable path for furnishing larger structure-only floor-plan datasets.
  arXiv  Detail & Related papers  (2026-06-09T14:55:43Z)
• VLM-GLoc: Vision-Language Model Enhanced Monte Carlo Localization for Robust Semantic Global Localization in Cluttered Quasi-Static Environments [2.049702429898688]
  VLM-GLoc is a method for hierarchical semantic Monte Carlo localization.<n>We evaluate it in two real-world environments: a grocery store with a cellphone and a 3,700 sq. ft. lab space with a quadruped.<n>VLM-GLoc achieves 70% and 74% global localization success respectively, substantially outperforming traditional geometry-only and domain-specific baselines.
  arXiv  Detail & Related papers  (2026-05-28T19:43:32Z)
• Generative Floor Plan Design with LLMs via Reinforcement Learning with Verifiable Rewards [16.41930427892441]
  An AI system for professional floor plan design must precisely control room dimensions and areas while respecting the desired connectivity between rooms.<n>Existing generative approaches focus primarily on respecting the requested connectivity between rooms, but do not support generating floor plans that respect numerical constraints.<n>We introduce a text-based floor plan generation approach that fine-tunes a large language model (LLM) on real plans and then applies reinforcement learning with verifiable rewards.<n>Our results demonstrate that LLMs can effectively handle constraints in this setting, suggesting broader applications for text-based generative modeling.
  arXiv  Detail & Related papers  (2026-05-13T21:06:12Z)
• CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling [18.135856965440784]
  Existing approaches often overlook structural boundaries or rely on fully connected relation graphs that introduce redundant generation errors.<n>Inspired by human design cognition, we present Cas, a cascaded diffusion framework that decomposes the joint scene generation task into four conditional sub-stages.<n>Experiments demonstrate that Cas achieves state-of-the-art performance in fidelity and diversity while enabling improved controllability in practical applications.
  arXiv  Detail & Related papers  (2026-04-30T03:18:26Z)
• DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesis [76.7196710324494]
  3D indoor layout synthesis is crucial for creating virtual environments.<n>DisCo is a novel framework that disentangles and coordinates physical and semantic refinement.
  arXiv  Detail & Related papers  (2025-10-02T16:30:37Z)
• Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshes [60.92139345612904]
  We present Light-SQ, a novel superquadric-based optimization framework.<n>We propose a block-regrow-fill strategy guided by structure-aware volumetric decomposition.<n>Experiments demonstrate that Light-SQ enables efficient, high-fidelity, and editable shape abstraction with superquadrics.
  arXiv  Detail & Related papers  (2025-09-29T16:18:32Z)
• FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured Representations [78.65988445433844]
  FloorplanQA is a diagnostic benchmark for evaluating spatial reasoning in large-language models.<n>The benchmark covers core spatial tasks, including distance measurement, visibility, path finding, and object placement within constrained spaces.
  arXiv  Detail & Related papers  (2025-07-10T11:16:48Z)
• RoomCraft: Controllable and Complete 3D Indoor Scene Generation [51.19602078504066]
  RoomCraft is a multi-stage pipeline that converts real images, sketches, or text descriptions into coherent 3D indoor scenes.<n>Our approach combines a scene generation pipeline with a constraint-driven optimization framework.<n>RoomCraft significantly outperforms existing methods in generating realistic, semantically coherent, and visually appealing room layouts.
  arXiv  Detail & Related papers  (2025-06-27T15:03:17Z)
• HierRelTriple: Guiding Indoor Layout Generation with Hierarchical Relationship Triplet Losses [52.70183252341687]
  We present a hierarchical triplet-based indoor relationship learning method, coined HierRelTriple, with a focus on spatial relationship learning.<n>We introduce HierRelTriple, a hierarchical relational triplets modeling framework that first partitions functional regions and then automatically extracts three levels of spatial relationships.<n>Experiments on unconditional layout synthesis, floorplan-conditioned layout generation, and scene rearrangement demonstrate that HierRel improves spatial-relation metrics by over 15%.
  arXiv  Detail & Related papers  (2025-03-26T07:31:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.