Creating Virtual Environments with 3D Gaussian Splatting: A Comparative Study

• URL: http://arxiv.org/abs/2501.09302v1
• Date: Thu, 16 Jan 2025 05:37:29 GMT
• Title: Creating Virtual Environments with 3D Gaussian Splatting: A Comparative Study
• Authors: Shi Qiu, Binzhu Xie, Qixuan Liu, Pheng-Ann Heng,
• Abstract summary: 3D Gaussian Splatting (3DGS) has emerged as an innovative and efficient 3D representation technique. We examine three distinct 3DGS-based approaches for virtual environment (VE) creation, leveraging their unique strengths for efficient and visually compelling scene representation. We evaluate the feasibility of 3DGS in creating immersive VEs, identify its limitations in XR applications, and discuss future research and development opportunities.
• Score: 47.11223113086051
• License:
• Abstract: 3D Gaussian Splatting (3DGS) has recently emerged as an innovative and efficient 3D representation technique. While its potential for extended reality (XR) applications is frequently highlighted, its practical effectiveness remains underexplored. In this work, we examine three distinct 3DGS-based approaches for virtual environment (VE) creation, leveraging their unique strengths for efficient and visually compelling scene representation. By conducting a comparable study, we evaluate the feasibility of 3DGS in creating immersive VEs, identify its limitations in XR applications, and discuss future research and development opportunities.

Related papers

• 3D Gaussian Splatting aided Localization for Large and Complex Indoor-Environments [3.255320158480672]
  We present an approach to significantly improve the accuracy and reliability of established visual localization methods by adding rendered images. We demonstrate that enriching reference data with images rendered from 3DGS at randomly sampled poses significantly improves the performance of both geometry-based visual localization and Scene Coordinate Regression methods.
  arXiv  Detail & Related papers  (2025-02-19T15:12:43Z)
• CLIP-GS: Unifying Vision-Language Representation with 3D Gaussian Splatting [88.24743308058441]
  We present CLIP-GS, a novel multimodal representation learning framework grounded in 3DGS. We develop an efficient way to generate triplets of 3DGS, images, and text, facilitating CLIP-GS in learning unified multimodal representations.
  arXiv  Detail & Related papers  (2024-12-26T09:54:25Z)
• Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospects [47.11223113086051]
  3D Gaussian Splatting (3DGS) has attracted significant attention for its potential to revolutionize 3D representation, rendering, and interaction. Despite the rapid growth of 3DGS research, its direct application to Extended Reality (XR) remains underexplored. In this paper, we aim to synthesize innovations in 3DGS that show specific potential for advancing XR research and development.
  arXiv  Detail & Related papers  (2024-12-09T07:14:58Z)
• L3DG: Latent 3D Gaussian Diffusion [74.36431175937285]
  L3DG is the first approach for generative 3D modeling of 3D Gaussians through a latent 3D Gaussian diffusion formulation. We employ a sparse convolutional architecture to efficiently operate on room-scale scenes. By leveraging the 3D Gaussian representation, the generated scenes can be rendered from arbitrary viewpoints in real-time.
  arXiv  Detail & Related papers  (2024-10-17T13:19:32Z)
• 3D Representation Methods: A Survey [0.0]
  3D representation has experienced significant advancements, driven by the increasing demand for high-fidelity 3D models in various applications. This review examines the development and current state of 3D representation methods, highlighting their research trajectories, innovations, strength and weakness.
  arXiv  Detail & Related papers  (2024-10-09T02:01:05Z)
• Optimizing 3D Gaussian Splatting for Sparse Viewpoint Scene Reconstruction [11.840097269724792]
  3D Gaussian Splatting (3DGS) has emerged as a promising approach for 3D scene representation, offering a reduction in computational overhead compared to Neural Radiance Fields (NeRF) We introduce SVS-GS, a novel framework for Sparse Viewpoint Scene reconstruction that integrates a 3D Gaussian smoothing filter to suppress artifacts.
  arXiv  Detail & Related papers  (2024-09-05T03:18:04Z)
• OV-Uni3DETR: Towards Unified Open-Vocabulary 3D Object Detection via Cycle-Modality Propagation [67.56268991234371]
  OV-Uni3DETR achieves the state-of-the-art performance on various scenarios, surpassing existing methods by more than 6% on average. Code and pre-trained models will be released later.
  arXiv  Detail & Related papers  (2024-03-28T17:05:04Z)
• A Survey on 3D Gaussian Splatting [51.96747208581275]
  3D Gaussian splatting (GS) has emerged as a transformative technique in the realm of explicit radiance field and computer graphics. We provide the first systematic overview of the recent developments and critical contributions in the domain of 3D GS. By enabling unprecedented rendering speed, 3D GS opens up a plethora of applications, ranging from virtual reality to interactive media and beyond.
  arXiv  Detail & Related papers  (2024-01-08T13:42:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.