Spatiotemporal Degradation-Aware 3D Gaussian Splatting for Realistic Underwater Scene Reconstruction
- URL: http://arxiv.org/abs/2604.23551v1
- Date: Sun, 26 Apr 2026 06:22:16 GMT
- Title: Spatiotemporal Degradation-Aware 3D Gaussian Splatting for Realistic Underwater Scene Reconstruction
- Abstract summary: MarineSTD-GS is a novel 3D Splatting-based framework that explicitly models both temporal and spatial degradations for realistic underwater scene reconstruction.<n>We show that MarineSTD-GS robustly handlestemporals degradation and outperforms existing methods in novel view synthesis with realistic, water-free scene appearances.
- Score: 15.149648789370547
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Reconstructing realistic underwater scenes from underwater video remains a meaningful yet challenging task in the multimedia domain. The inherent spatiotemporal degradations in underwater imaging, including caustics, flickering, attenuation, and backscattering, frequently result in inaccurate geometry and appearance in existing 3D reconstruction methods. While a few recent works have explored underwater degradation-aware reconstruction, they often address either spatial or temporal degradation alone, falling short in more real-world underwater scenarios where both types of degradation occur. We propose MarineSTD-GS, a novel 3D Gaussian Splatting-based framework that explicitly models both temporal and spatial degradations for realistic underwater scene reconstruction. Specifically, we introduce two paired Gaussian primitives: Intrinsic Gaussians represent the true scene, while Degraded Gaussians render the degraded observations. The color of each Degraded Gaussian is physically derived from its paired Intrinsic Gaussian via a Spatiotemporal Degradation Modeling (SDM) module, enabling self-supervised disentanglement of realistic appearance from degraded images. To ensure stable training and accurate geometry, we further propose a Depth-Guided Geometry Loss and a Multi-Stage Optimization strategy. We also construct a simulated benchmark with diverse spatial and temporal degradations and ground-truth appearances for comprehensive evaluation. Experiments on both simulated and real-world datasets show that MarineSTD-GS robustly handles spatiotemporal degradations and outperforms existing methods in novel view synthesis with realistic, water-free scene appearances.
Related papers
- 3D-USE: From Image-Level to Scene-Level Underwater Enhancement [54.11922584483346]
Underwater Scene-level Enhancement (USE)<n>Uses a reliable scene representation for enhancement and a consistent enhancement target without paired enhanced 3D data.<n> Experiments on real underwater scenes show improved visibility and cross-view consistency while preserving reconstruction quality.
arXiv Detail & Related papers (2026-08-28T07:34:13Z) - Wat3R: Underwater 3D Geometry Learning without Annotations [58.91163632674025]
Estimating 3D geometry in underwater environments presents unique challenges due to light attenuation, scattering, and the absence of large-scale, high-quality 3D annotations.<n>We propose Wat3R, a cross-domain semi-supervised learning framework designed to adapt feed-forward 3D reconstruction models from air to underwater scenes.
arXiv Detail & Related papers (2026-07-09T17:59:58Z) - Rethinking Conditional Generation for Underwater Salient Object Detection [69.38806804258452]
A Conditional Generation Network (DCGNet) is designed to construct reliable conditional features for underwater saliency generation.<n>DCGNet significantly outperforms existing state-of-the-art methods, verifying its potential for complex underwater visual applications.
arXiv Detail & Related papers (2026-07-02T07:48:06Z) - BALTIC: A Benchmark and Cross-Domain Strategy for 3D Reconstruction Across Air and Underwater Domains Under Varying Illumination [6.8920172327690175]
We introduce BALTIC, a benchmark designed to evaluate modern 3D reconstruction methods under variations in medium and lighting.<n>The benchmark comprises 13 datasets spanning two media (air and water) and three lighting conditions (ambient, artificial, and mixed)<n>We investigate cross-domain reconstruction by augmenting underwater image sequences with a small number of in-air views captured under similar lighting conditions.
arXiv Detail & Related papers (2026-04-21T06:32:07Z) - NimbusGS: Unified 3D Scene Reconstruction under Hybrid Weather [83.14198482357388]
We present NimbusGS, a unified framework for reconstructing high-quality 3D scenes from degraded multi-view inputs.<n>Unlike existing methods that target specific weather types, NimbusGS addresses the broader challenge of generalization.
arXiv Detail & Related papers (2026-03-28T10:46:29Z) - OceanSplat: Object-aware Gaussian Splatting with Trinocular View Consistency for Underwater Scene Reconstruction [4.325717217536016]
OceanSplat is a novel 3D Gaussian Splatting-based approach for representing 3D geometry in underwater scenes.<n>We show that OceanSplat substantially outperforms existing methods for both scene reconstruction and restoration in scattering media.
arXiv Detail & Related papers (2026-01-08T14:38:39Z) - InpaintHuman: Reconstructing Occluded Humans with Multi-Scale UV Mapping and Identity-Preserving Diffusion Inpainting [64.42884719282323]
InpaintHuman is a novel method for generating high-fidelity, complete, and animatable avatars from occluded monocular videos.<n>Our approach employs direct pixel-level supervision to ensure identity fidelity.
arXiv Detail & Related papers (2026-01-05T13:26:02Z) - OracleGS: Grounding Generative Priors for Sparse-View Gaussian Splatting [78.70702961852119]
OracleGS reconciles generative completeness with regressive fidelity for sparse view Gaussian Splatting.<n>Our approach conditions the powerful generative prior on multi-view geometric evidence, filtering hallucinatory artifacts while preserving plausible completions in under-constrained regions.
arXiv Detail & Related papers (2025-09-27T11:19:32Z) - Single-Step Latent Diffusion for Underwater Image Restoration [25.229678050715496]
Underwater image restoration algorithms seek to restore the color, contrast, and appearance of a scene that is imaged underwater.<n>They are a critical tool in applications ranging from marine ecology and aquaculture to underwater construction and archaeology.<n>Slurpp is over 200X faster than existing diffusion-based methods while offering 3 dB improvement in PSNR on synthetic benchmarks.
arXiv Detail & Related papers (2025-07-10T16:02:07Z) - 3D-UIR: 3D Gaussian for Underwater 3D Scene Reconstruction via Physics Based Appearance-Medium Decoupling [30.985414238960466]
3D Gaussian Splatting (3DGS) offers real-time rendering capabilities, but struggles with underwater inhomogeneous environments.<n>We propose a physics-based framework that disentangles object appearance from water medium effects.<n>Our approach achieves both high-quality novel view synthesis and physically accurate scene restoration.
arXiv Detail & Related papers (2025-05-27T14:19:30Z) - AquaGS: Fast Underwater Scene Reconstruction with SfM-Free Gaussian Splatting [4.0317256978754505]
We introduce AquaGS, an SfM-free underwater scene reconstruction model based on the SeaThru algorithm.<n>Our model can complete high-precision reconstruction in 30 seconds with only 3 image inputs.
arXiv Detail & Related papers (2025-05-03T12:05:57Z) - Ghost on the Shell: An Expressive Representation of General 3D Shapes [97.76840585617907]
Meshes are appealing since they enable fast physics-based rendering with realistic material and lighting.
Recent work on reconstructing and statistically modeling 3D shapes has critiqued meshes as being topologically inflexible.
We parameterize open surfaces by defining a manifold signed distance field on watertight surfaces.
G-Shell achieves state-of-the-art performance on non-watertight mesh reconstruction and generation tasks.
arXiv Detail & Related papers (2023-10-23T17:59:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.