PanoWorld: A Generative Spatial World Model for Consistent Whole-House Panorama Synthesis

• URL: http://arxiv.org/abs/2605.17916v2
• Date: Tue, 19 May 2026 02:30:02 GMT
• Title: PanoWorld: A Generative Spatial World Model for Consistent Whole-House Panorama Synthesis
• Abstract summary: PanoWorld is a generative spatial world model that treats whole-house synthesis as autoregressive generation of node-based panoramas.<n>It preserves high-frequency 2D synthesis quality while improving cross-node layout and material consistency.
• Score: 9.056861577664717
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Generating a consistent whole-house VR tour from a floorplan and style reference requires both photorealistic panoramas and cross-view spatial coherence. Pure 2D generators produce appealing single panoramas but re-imagine geometry and materials when the viewpoint changes, whereas monolithic 3D generation becomes expensive and loses fine texture at multi-room scale. We introduce PanoWorld, a generative spatial world model that treats whole-house synthesis as autoregressive generation of node-based 360-degree panoramas, matching the discrete navigation used by real VR tour products. PanoWorld uses a floorplan-derived 3D shell as a global geometric proxy and a dynamic 3D Gaussian Splatting cache as renderable spatial memory. A feed-forward panoramic LRM designed for metric-scale multi-room 360-degree inputs lifts generated panoramas into local 3DGS updates, while Room-aware Group Attention suppresses cross-room feature interference. A topology-aware progressive caching strategy fuses these local updates without repeatedly reconstructing the full history. By decoupling shell-based geometry guidance from cache-rendered visual memory, PanoWorld preserves high-frequency 2D synthesis quality while improving cross-node layout and material consistency. The project link is https://jjrcn.github.io/PanoWorld-project-home/

Related papers

• PanoWorld: Real-World Panoramic Generation [68.3569360188378]
  We propose PanoWorld, which simplifies camera trajectories into translations via fixed headings for both current-action modeling and long-range memory.<n>Extensive experiments on World360 demonstrate the effectiveness of PanoWorld, outperforming alternative methods by a large margin.
  arXiv  Detail & Related papers  (2026-07-10T17:59:32Z)
• Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences [9.89397063309918]
  We present Pano2World, which takes a single indoor panorama as input and directly outputs a persistent, explorable 3D Gaussian scene.<n> Experiments demonstrate that Pano2World significantly outperforms existing methods on the multi-position panoramic novel-view synthesis benchmark.
  arXiv  Detail & Related papers  (2026-07-01T11:54:02Z)
• PanoWorld: Geometry-Consistent Panoramic Video World Modeling [31.274777055274345]
  We present PanoWorld, a panoramic video world model that generates geometry-consistent 360$degree$ video from a single image and a caption.<n> Experiments show that PanoWorld improves geometric consistency over prior panoramic generation methods while maintaining competitive visual realism.
  arXiv  Detail & Related papers  (2026-05-14T20:24:23Z)
• WorldWarp: Propagating 3D Geometry with Asynchronous Video Diffusion [78.20778143251171]
  WorldWarp is a framework that couples a 3D structural anchor with a 2D generative refiner.<n>WorldWarp maintains consistency across video chunks by dynamically updating the 3D cache at every step.<n>It achieves state-of-the-art fidelity by ensuring that 3D logic guides structure while diffusion logic perfects texture.
  arXiv  Detail & Related papers  (2025-12-22T18:53:50Z)
• OmniX: From Unified Panoramic Generation and Perception to Graphics-Ready 3D Scenes [57.790894531046796]
  Panorama-based 2D lifting has emerged as a promising technique to produce immersive, realistic, and diverse 3D environments.<n>In this work, we advance this technique to generate graphics-ready 3D scenes suitable for physically based rendering (PBR), relighting, and simulation.<n>Our key insight is to repurpose 2D generative models for panoramic perception of geometry, textures, and PBR materials.<n>Based on a lightweight and efficient cross-modal adapter structure, OmniX reuses 2D generative priors for a broad range of panoramic vision tasks.
  arXiv  Detail & Related papers  (2025-10-30T17:59:51Z)
• TiP4GEN: Text to Immersive Panorama 4D Scene Generation [82.8444414014506]
  TiP4GEN is a text-to-dynamic panorama scene generation framework.<n>It enables fine-grained content control and synthesizes motion-rich, geometry-consistent panoramic 4D scenes.<n> TiP4GEN integrates panorama video generation and dynamic scene reconstruction to create 360-degree immersive virtual environments.
  arXiv  Detail & Related papers  (2025-08-17T16:02:24Z)
• Matrix-3D: Omnidirectional Explorable 3D World Generation [20.568791715708134]
  We propose Matrix-3D, a framework that utilize panoramic representation for wide-coverage omnidirectional 3D world generation.<n>We first train a trajectory-guided panoramic video diffusion model that employs scene mesh renders as condition.<n>To lift the panorama scene video to 3D world, we propose two separate methods: (1) a feed-forward large panorama reconstruction model for rapid 3D scene reconstruction and (2) an optimization-based pipeline for accurate and detailed 3D scene reconstruction.
  arXiv  Detail & Related papers  (2025-08-11T15:29:57Z)
• Top2Pano: Learning to Generate Indoor Panoramas from Top-Down View [1.182769785560032]
  Top2Pano is an end-to-end model for realistic indoor panoramas from top-down views.<n>Our method estimates volumetric occupancy to infer 3D structures, then uses volumetric rendering to generate coarse color and depth panoramas.
  arXiv  Detail & Related papers  (2025-07-28T22:32:41Z)
• LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generation [105.52153675890408]
  3D immersive scene generation is a challenging yet critical task in computer vision and graphics.<n>Layerpano3D is a novel framework for full-view, explorable panoramic 3D scene generation from a single text prompt.
  arXiv  Detail & Related papers  (2024-08-23T17:50:23Z)
• Pano2Room: Novel View Synthesis from a Single Indoor Panorama [20.262621556667852]
  Pano2Room is designed to automatically reconstruct high-quality 3D indoor scenes from a single panoramic image. The key idea is to initially construct a preliminary mesh from the input panorama, and iteratively refine this mesh using a panoramic RGBD inpainter. The refined mesh is converted into a 3D Gaussian Splatting field and trained with the collected pseudo novel views.
  arXiv  Detail & Related papers  (2024-08-21T08:19:12Z)
• DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting [56.101576795566324]
  We present a text-to-3D 360$circ$ scene generation pipeline. Our approach utilizes the generative power of a 2D diffusion model and prompt self-refinement. Our method offers a globally consistent 3D scene within a 360$circ$ perspective.
  arXiv  Detail & Related papers  (2024-04-10T10:46:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.