OMeGa: Joint Optimization of Explicit Meshes and Gaussian Splats for Robust Scene-Level Surface Reconstruction

• URL: http://arxiv.org/abs/2509.24308v1
• Date: Mon, 29 Sep 2025 05:43:40 GMT
• Title: OMeGa: Joint Optimization of Explicit Meshes and Gaussian Splats for Robust Scene-Level Surface Reconstruction
• Abstract summary: OMeGa is an end-to-end framework that jointly optimize an explicit triangle mesh and 2D Gaussian splats.<n>OMeGa achieves state-of-the-art performance on challenging indoor reconstruction benchmarks.
• Score: 10.746979229164815
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Neural rendering with Gaussian splatting has advanced novel view synthesis, and most methods reconstruct surfaces via post-hoc mesh extraction. However, existing methods suffer from two limitations: (i) inaccurate geometry in texture-less indoor regions, and (ii) the decoupling of mesh extraction from optimization, thereby missing the opportunity to leverage mesh geometry to guide splat optimization. In this paper, we present OMeGa, an end-to-end framework that jointly optimizes an explicit triangle mesh and 2D Gaussian splats via a flexible binding strategy, where spatial attributes of Gaussian Splats are expressed in the mesh frame and texture attributes are retained on splats. To further improve reconstruction accuracy, we integrate mesh constraints and monocular normal supervision into the optimization, thereby regularizing geometry learning. In addition, we propose a heuristic, iterative mesh-refinement strategy that splits high-error faces and prunes unreliable ones to further improve the detail and accuracy of the reconstructed mesh. OMeGa achieves state-of-the-art performance on challenging indoor reconstruction benchmarks, reducing Chamfer-$L_1$ by 47.3\% over the 2DGS baseline while maintaining competitive novel-view rendering quality. The experimental results demonstrate that OMeGa effectively addresses prior limitations in indoor texture-less reconstruction.

Related papers

• ADELE - Adaptive Delaunay Grids for High-Fidelity Mesh-Native Reconstruction [10.718334749514694]
  Meshes remain the most practical representation for geometry reasoning and integration into graphics pipelines.<n>Existing mesh-native optimization methods alleviate some of these issues but suffer from fixed-resolution discretizations and unstable optimization behavior.<n>We introduce an adaptive mesh-based optimization framework and a practical mesh rendering technique to address these challenges.
  arXiv  Detail & Related papers  (2026-09-06T16:55:21Z)
• CoMVS-GS: Collaborative Multi-View Stereo and 3D Gaussian Splatting for Surface Reconstruction [4.2932025928748425]
  CoMVS-GS is a general surface reconstruction framework that combines Multi-View Stereo with Gaussian splatting.<n>It initializes primitives from dense multi-view stereo points with pre-flattened scales and normal-aligned orientations.<n>For surface extraction, CoMVS-GS replaces truncated signed distance field voxel fusion with a Delaunay graph-cut meshing pipeline.
  arXiv  Detail & Related papers  (2026-08-19T00:46:19Z)
• Gaussian Sculpting: End-to-End Controllable Surface Reconstruction via Field Optimization [22.001328928240053]
  3D Gaussian Splatting has recently enabled real-time novel view synthesis with impressive quality.<n>It struggles to recover accurate surfaces under limited viewpoints and due to the inherent irregularity of Gaussian primitives.<n>We propose a fully differentiable end-to-end framework for high-quality surface reconstruction.
  arXiv  Detail & Related papers  (2026-08-11T07:42:24Z)
• Incremental Online Scene Reconstruction by 3D Gaussian Triangulation [22.398131643187384]
  We propose a novel online framework that incrementally reconstructs and updates high-fidelity explicit meshes.<n>We also present a direct meshing algorithm that efficiently extracts and updates the mesh from the Gaussian set.<n>Our framework significantly reduces memory and computational overhead during long-sequence processing.
  arXiv  Detail & Related papers  (2026-07-12T10:22:18Z)
• SparseSurf: Sparse-View 3D Gaussian Splatting for Surface Reconstruction [26.59203606048875]
  We propose net, a method that reconstructs more accurate and detailed surfaces while preserving high-quality novel view rendering.<n>Our key insight is to introduce Stereo Geometry-Texture Alignment, which bridges rendering quality and geometry estimation.<n>In addition, we present a Pseudo-Feature Enhanced Geometry Consistency that enforces multi-view geometric consistency.
  arXiv  Detail & Related papers  (2025-11-18T16:24:37Z)
• QuickSplat: Fast 3D Surface Reconstruction via Learned Gaussian Initialization [69.50126552763157]
  Surface reconstruction is fundamental to computer vision and graphics, enabling applications in 3D modeling, mixed reality, robotics, and more.<n>Existing approaches based on rendering obtain promising results, but optimize on a per-scene basis, resulting in a slow optimization that can struggle to model textureless regions.<n>We introduce QuickSplat, which learns data-driven priors to generate dense initializations for 2D gaussian splatting optimization of large-scale indoor scenes.
  arXiv  Detail & Related papers  (2025-05-08T18:43:26Z)
• TetWeave: Isosurface Extraction using On-The-Fly Delaunay Tetrahedral Grids for Gradient-Based Mesh Optimization [59.318328774645835]
  We introduce TetWeave, a novel isosurface representation for gradient-based mesh optimization.<n>TetWeave constructs tetrahedral grids on-the-fly via Delaunay triangulation.<n>We demonstrate the applicability of TetWeave to a broad range of challenging tasks in computer graphics and vision.
  arXiv  Detail & Related papers  (2025-05-07T17:32:49Z)
• SolidGS: Consolidating Gaussian Surfel Splatting for Sparse-View Surface Reconstruction [48.228533595941556]
  We propose a novel method called SolidGS to address this problem.<n>We observed that the reconstructed geometry can be severely inconsistent across multi-views.<n>With the additional help of geometrical regularization and monocular normal estimation, our method achieves superior performance on the sparse view surface reconstruction.
  arXiv  Detail & Related papers  (2024-12-19T21:04:43Z)
• 2DGS-Room: Seed-Guided 2D Gaussian Splatting with Geometric Constrains for High-Fidelity Indoor Scene Reconstruction [3.8879997968084137]
  We introduce 2DGS-Room, a novel method leveraging 2D Gaussian Splatting for high-fidelity indoor scene reconstruction.<n>We employ a seed-guided mechanism to control the distribution of 2D Gaussians, with the density of seed points dynamically optimized through adaptive growth and pruning mechanisms.<n>To further improve geometric accuracy, we incorporate monocular depth and normal priors to provide constraints for details and textureless regions respectively.
  arXiv  Detail & Related papers  (2024-12-04T16:17:47Z)
• GausSurf: Geometry-Guided 3D Gaussian Splatting for Surface Reconstruction [79.42244344704154]
  GausSurf employs geometry guidance from multi-view consistency in texture-rich areas and normal priors in texture-less areas of a scene.<n>Our method surpasses state-of-the-art methods in terms of reconstruction quality and computation time.
  arXiv  Detail & Related papers  (2024-11-29T03:54:54Z)
• GaussianRoom: Improving 3D Gaussian Splatting with SDF Guidance and Monocular Cues for Indoor Scene Reconstruction [5.112375652774415]
  We propose a unified optimization framework that integrates neural signed distance fields (SDFs) with 3DGS for accurate geometry reconstruction and real-time rendering.<n>Our method achieves state-of-the-art performance in both surface reconstruction and novel view synthesis.
  arXiv  Detail & Related papers  (2024-05-30T03:46:59Z)
• GeoGaussian: Geometry-aware Gaussian Splatting for Scene Rendering [83.19049705653072]
  During the Gaussian Splatting optimization process, the scene's geometry can gradually deteriorate if its structure is not deliberately preserved. We propose a novel approach called GeoGaussian to mitigate this issue. Our proposed pipeline achieves state-of-the-art performance in novel view synthesis and geometric reconstruction.
  arXiv  Detail & Related papers  (2024-03-17T20:06:41Z)
• Flexible Isosurface Extraction for Gradient-Based Mesh Optimization [65.76362454554754]
  This work considers gradient-based mesh optimization, where we iteratively optimize for a 3D surface mesh by representing it as the isosurface of a scalar field. We introduce FlexiCubes, an isosurface representation specifically designed for optimizing an unknown mesh with respect to geometric, visual, or even physical objectives.
  arXiv  Detail & Related papers  (2023-08-10T06:40:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.