Panoramic Scene Analysis: A Survey from Distortion-Aware Engineering to Sphere-Native Foundation Modeling

• URL: http://arxiv.org/abs/2606.27745v1
• Date: Fri, 26 Jun 2026 05:54:38 GMT
• Title: Panoramic Scene Analysis: A Survey from Distortion-Aware Engineering to Sphere-Native Foundation Modeling
• Abstract summary: Panoramic images capture the complete visual sphere in a single frame, providing spatial context unattainable by conventional cameras.<n>Yet this completeness comes at a geometric cost: the 2-sphere cannot be faithfully mapped to the plane, and every planar representation introduces distortions that violate the assumptions underlying standard vision architectures.<n>This survey traces the evolution of panoramic scene analysis along a methodological trajectory, from projection-based adaptation, through distortion-aware engineering, to sphere-native modeling and geometry-aware tokenization for foundation models.
• Score: 1.8625021794520016
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Panoramic images capture the complete visual sphere in a single frame, providing spatial context unattainable by conventional cameras. Yet this completeness comes at a geometric cost: the 2-sphere cannot be faithfully mapped to the plane, and every planar representation introduces distortions that violate the assumptions underlying standard vision architectures. This survey traces the evolution of panoramic scene analysis along a methodological trajectory, from projection-based adaptation, through distortion-aware engineering, to sphere-native modeling and geometry-aware tokenization for foundation models, and argues that this evolution reflects a progressive deepening of geometric commitment rather than a simple accumulation of techniques. We organize the literature along two orthogonal dimensions: architectural design (how operators interact with spherical geometry) and training paradigm (how knowledge is transferred across domains). Covering dense prediction (semantic segmentation, depth estimation, and room layout estimation), unified multi-task understanding, open-world perception, vision-language reasoning, and dynamic video analysis, we identify a central unresolved tension: among the methods surveyed, none simultaneously delivers strict spherical equivariance and full reuse of perspective-pretrained foundation-model weights, and we argue that this is a structural rather than incidental gap. We further expose five systematic gaps in current evaluation protocols, namely the absence of spherical-area-weighted metrics, seam-consistency testing, polar-robustness stratification, cross-projection generalization, and open-world protocol standardization, and propose a six-point research roadmap toward general-purpose panoramic intelligence. The corresponding repository is publicly available at: https://github.com/zhuqinfeng1999/Awesome-Panoramic-Scene-Analysis.

Related papers

• SphereSOD: Geometry-Structure Coupled Learning for 360 Salient Object Detection [75.77856258186854]
  360 salient object detection aims to accurately segment salient regions across a full field of view.<n>Existing methods mainly focus on compensating projection distortion while overlooking the interaction between panoramic geometry and salient object structure.<n>We propose SphereSOD, an ERP-native framework that couples panoramic geometry with evolving salient structures.
  arXiv  Detail & Related papers  (2026-09-07T14:47:54Z)
• Capsule Lens: Locating and Tracking Concept Geometry in Model Representations [8.78662595138283]
  We introduce Capsule Lens, a framework that matches the region a concept occupies with a simple, trackable geometric form.<n>On static representations, we demonstrate how to locate concept geometry across various models, and how the span and norm curves uncover important geometric characteristics.<n>On dynamic representations, we present three case studies tracking representation drifts induced by distinct training settings.
  arXiv  Detail & Related papers  (2026-09-04T09:15:04Z)
• Geometric Distillation from Rectified Stereo: Leveraging Epipolar Cues for Monocular Depth [11.871264497562008]
  We propose a novel framework that transfers the scale-aware geometric priors of multi-view models into monocular depth foundation models.<n>Specifically, we introduce an Epipolar Distillation (EpiDistill), which enables the single-view prediction model to retain epipolar attention patterns and maintain geometric consistency without requiring multi-view inputs at inference.
  arXiv  Detail & Related papers  (2026-07-17T03:49:14Z)
• ARDepth: Auto-regressive Monocular Depth Estimation with Progressive Visual Conditioning [66.42476564611607]
  Diffusion models assume that depth can be recovered as a globally smooth field through iterative denoising.<n>We introduce ARDepth, which formulates depth estimation as structured auto-regressive generation.<n>We show that our approach achieves strong performance and produces structurally consistent depth predictions across scales.
  arXiv  Detail & Related papers  (2026-07-14T07:06:46Z)
• Z-FLoc: Zero-Shot Floorplan Localization via Geometric Primitives [72.63181031215858]
  We propose a zero-shot floorplan localization method that generalizes to novel environments without any retraining.<n>Our key insight is that dominant geometric primitives are ubiquitous in human-made environments.<n> Experiments on both simulated and real-world datasets show that our approach outperforms state-of-the-art learning-based methods on unseen environments.
  arXiv  Detail & Related papers  (2026-06-03T12:14:24Z)
• SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environments [75.60795462502949]
  SpatialEvo is a self-evolving framework for 3D spatial reasoning.<n>It formalizes 16 spatial reasoning task categories under explicit geometric validation rules.<n>It converts unannotated 3D scenes into zero-noise interactive oracles, replacing model consensus with objective physical feedback.
  arXiv  Detail & Related papers  (2026-04-15T17:59:12Z)
• Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective [91.23306722968509]
  Generalizable feed-forward 3D reconstruction has witnessed rapid development in recent years.<n>Existing feed-forward approaches share similar high-level architectural patterns.<n>We propose a novel taxonomy centered on model design strategies that are agnostic to the output format.
  arXiv  Detail & Related papers  (2026-04-15T16:07:18Z)
• Learning 3D Representations for Spatial Intelligence from Unposed Multi-View Images [81.94999489820974]
  UniSplat is a feed-forward framework for learning 3D representations from unposed multi-view images.<n>We introduce a dual-masking strategy that strengthens geometry induction in the encoder.<n>Second, we develop a coarse-to-fine Gaussian splatting strategy that reduces appearance-semantics inconsistencies.<n>Third, we introduce a pose-conditioned recalibration mechanism that interrelates predicted 3D point and semantic maps into the image plane.
  arXiv  Detail & Related papers  (2026-04-12T10:36:18Z)
• LatentGeo: Learnable Auxiliary Constructions in Latent Space for Multimodal Geometric Reasoning [32.39048489202347]
  We propose a framework that learns continuous latent visual representations to internalize auxiliary geometric constructions without pixel-level rendering or external executors.<n>LatentGeo achieves substantial gains on geometric reasoning tasks, particularly those requiring auxiliary constructions.
  arXiv  Detail & Related papers  (2026-03-12T17:01:23Z)
• GeoSurDepth: Spatial Geometry-Consistent Self-Supervised Depth Estimation for Surround-View Cameras [3.072321170197384]
  GeoSurDepth is a framework that leverages geometry consistency as the primary cue for surround-view depth estimation.<n>Our framework highlights the importance of exploiting geometry coherence and consistency for robust self-supervised multi-view depth estimation.
  arXiv  Detail & Related papers  (2026-01-09T15:13:28Z)
• GeoMoE: Divide-and-Conquer Motion Field Modeling with Mixture-of-Experts for Two-View Geometry [26.926348149152656]
  We re-architect motion field modeling in two-view geometry with GeoMoE, a streamlined framework.<n>We first devise a Probabilistic Prior-Guided Decomposition strategy that exploits inlier probability signals to perform a structure-aware decomposition of the motion field.<n>Next, we introduce an MoE-Enhanced Bi-Path Rectifier that enhances each sub-field along spatial-context and channel-semantic paths.
  arXiv  Detail & Related papers  (2025-08-01T12:45:47Z)
• Aligned Novel View Image and Geometry Synthesis via Cross-modal Attention Instillation [62.87088388345378]
  We introduce a diffusion-based framework that performs aligned novel view image and geometry generation via a warping-and-inpainting methodology.<n>Method leverages off-the-shelf geometry predictors to predict partial geometries viewed from reference images.<n>Cross-modal attention distillation is proposed to ensure accurate alignment between generated images and geometry.
  arXiv  Detail & Related papers  (2025-06-13T16:19:00Z)
• Self-training Room Layout Estimation via Geometry-aware Ray-casting [27.906107629563852]
  We introduce a geometry-aware self-training framework for room layout estimation models on unseen scenes with unlabeled data. Our approach utilizes a ray-casting formulation to aggregate multiple estimates from different viewing positions.
  arXiv  Detail & Related papers  (2024-07-21T03:25:55Z)
• Towards Self-Supervised Category-Level Object Pose and Size Estimation [121.28537953301951]
  This work presents a self-supervised framework for category-level object pose and size estimation from a single depth image. We leverage the geometric consistency residing in point clouds of the same shape for self-supervision.
  arXiv  Detail & Related papers  (2022-03-06T06:02:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.