A Multi-Layer System for Ultra-High-Resolution Static 360-Degree Telepresence

• URL: http://arxiv.org/abs/2608.05570v1
• Date: Thu, 06 Aug 2026 03:42:50 GMT
• Title: A Multi-Layer System for Ultra-High-Resolution Static 360-Degree Telepresence
• Abstract summary: We present a multilayer, ultra-high-resolution system for static 360-degree telepresence that combines an 8K panoramic camera with a 4K pantilttable (PTZ) camera.<n>Our approach builds a three-layer representation: (1) a tile-based ultra-high-resolution panoramic background, generated by offline stitching, and represented as a set spatial tiles.<n>We evaluate the proposed system through comparisons with representative video super-resolution approaches and a user study assessing perceived detail and immersive experience.
• Score: 3.0980312108768513
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: 360-degree video telepresence offers strong immersive potential but remains constrained by the limited resolution of current capture and display hardware. Many telepresence installations feature fixed viewpoints and largely static scenes, yet optimization strategies tailored to such setups have received limited attention. We present a multi-layer, ultra-high-resolution system for static 360-degree telepresence that combines an 8K panoramic camera with a rotatable 4K pan-tilt-zoom (PTZ) camera. Our approach builds a three-layer representation: (1) a tile-based ultra-high-resolution panoramic background, generated by offline stitching high-detail 4K PTZ scans onto the base 8K panorama to achieve effective resolution beyond native capture, and represented as a set of spatial tiles; (2) a dynamic update layer that composites foreground motions from the 8K stream via real-time high-resolution background matting; and (3) a region-of-interest 4K layer that streams a real-time PTZ view of the selected region and additionally updates the corresponding background tiles over time. We evaluate the proposed system through comparisons with representative video super-resolution approaches and a user study assessing perceived detail and immersive experience. Our results indicate that tile-based background refinement, together with user-guided updates, provides a practical way to balance panoramic fidelity and interactivity in static 360-degree telepresence.

Related papers

• SAP: Segment Any 4K Panorama [64.69300263307441]
  We introduce Segment Any 4K Panorama (SAP), a foundation model for 4K high-resolution panoramic instance-level segmentation.<n>We reformulate panoramic segmentation as fixed-trajectory perspective video segmentation, decomposing a panorama into overlapping perspective patches sampled along a continuous spherical.<n>This memory-aligned reformulation preserves native 4K resolution while restoring the smooth viewpoint transitions required for stable cross-view propagation.
  arXiv  Detail & Related papers  (2026-03-13T08:02:38Z)
• YOLO11-4K: An Efficient Architecture for Real-Time Small Object Detection in 4K Panoramic Images [7.5117172634019775]
  We introduce YOLO11-4K, an efficient real-time detection framework tailored for 4K panoramic images.<n>The architecture incorporates a novel multi-scale detection head with a P2 layer to improve sensitivity to small objects.<n>YOLO11-4K achieves 0.95 mAP at 0.50 IoU with 28.3 milliseconds inference per frame, representing a 75 percent latency reduction compared to YOLO11.
  arXiv  Detail & Related papers  (2025-12-18T13:00:05Z)
• TiP4GEN: Text to Immersive Panorama 4D Scene Generation [82.8444414014506]
  TiP4GEN is a text-to-dynamic panorama scene generation framework.<n>It enables fine-grained content control and synthesizes motion-rich, geometry-consistent panoramic 4D scenes.<n> TiP4GEN integrates panorama video generation and dynamic scene reconstruction to create 360-degree immersive virtual environments.
  arXiv  Detail & Related papers  (2025-08-17T16:02:24Z)
• HoloTime: Taming Video Diffusion Models for Panoramic 4D Scene Generation [29.579493980120173]
  HoloTime is a framework that integrates video diffusion models to generate panoramic videos from a single prompt or reference image.<n>360World dataset is the first comprehensive collection of panoramic videos suitable for downstream 4D scene reconstruction tasks.<n>Panoramic Animator is a two-stage image-to-video diffusion model that can convert panoramic images into high-quality panoramic videos.<n>Panoramic Space-Time Reconstruction uses a space-time depth estimation method to transform the generated panoramic videos into 4D point clouds.
  arXiv  Detail & Related papers  (2025-04-30T13:55:28Z)
• Scaling Vision Pre-Training to 4K Resolution [120.32767371797578]
  We introduce PS3 that scales vision pre-training to 4K resolution with a near-constant cost.<n>Instead of contrastive learning on global representation, PS3 is pre-trained by selectively processing local regions.<n>PS3 is able to both encode the global image at low resolution and selectively process local high-resolution regions.
  arXiv  Detail & Related papers  (2025-03-25T17:58:37Z)
• Neural Light Spheres for Implicit Image Stitching and View Synthesis [32.396278546192995]
  Spherical neural light field model for implicit panoramic image stitching and re-rendering.<n>We show improved reconstruction quality over traditional image stitching and radiance field methods.
  arXiv  Detail & Related papers  (2024-09-26T15:05:29Z)
• 4K4DGen: Panoramic 4D Generation at 4K Resolution [67.98105958108503]
  We tackle the challenging task of elevating a single panorama to an immersive 4D experience. For the first time, we demonstrate the capability to generate omnidirectional dynamic scenes with 360$circ$ views at 4K resolution. We achieve high-quality Panorama-to-4D generation at a resolution of 4K for the first time.
  arXiv  Detail & Related papers  (2024-06-19T13:11:02Z)
• Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using Sparse RGB Cameras [34.520964056321105]
  We present a low-budget and high-authenticity bidirectional telepresence system, Tele-Aloha, targeting peer-to-peer communication scenarios. Tele-Aloha utilizes only four sparse RGB cameras, one consumer-grade GPU, and one autostereoscopic screen to achieve high-resolution (2048x2048), real-time (30 fps), low-latency (less than 150ms) and robust distant communication.
  arXiv  Detail & Related papers  (2024-05-23T17:59:45Z)
• VR-NeRF: High-Fidelity Virtualized Walkable Spaces [55.51127858816994]
  We present an end-to-end system for the high-fidelity capture, model reconstruction, and real-time rendering of walkable spaces in virtual reality using neural radiance fields.
  arXiv  Detail & Related papers  (2023-11-05T02:03:14Z)
• Event-guided Multi-patch Network with Self-supervision for Non-uniform Motion Deblurring [113.96237446327795]
  We present a novel self-supervised event-guided deep hierarchical Multi-patch Network to deal with blurry images and videos. We also propose an event-guided architecture to exploit motion cues contained in videos to tackle complex blur in videos. Our MPN achieves the state of the art on the GoPro and VideoDeblurring datasets with a 40x faster runtime compared to current multi-scale methods.
  arXiv  Detail & Related papers  (2023-02-14T15:58:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.