MSGS: Multispectral 3D Gaussian Splatting

• URL: http://arxiv.org/abs/2604.13340v1
• Date: Tue, 14 Apr 2026 23:03:38 GMT
• Title: MSGS: Multispectral 3D Gaussian Splatting
• Abstract summary: We present a multispectral extension to 3D Gaussian Splatting (3DGS) for wavelength-aware view synthesis.<n>Each Gaussian is augmented with spectral radiance, represented via per-band spherical harmonics, and optimized under a dual-loss supervision scheme combining RGB and multispectral signals.<n>Our method is evaluated on both public and self-captured real-world datasets, demonstrating consistent improvements over the RGB-only 3DGS baseline in terms of image quality and spectral consistency.
• Score: 46.61006851229471
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a multispectral extension to 3D Gaussian Splatting (3DGS) for wavelength-aware view synthesis. Each Gaussian is augmented with spectral radiance, represented via per-band spherical harmonics, and optimized under a dual-loss supervision scheme combining RGB and multispectral signals. To improve rendering fidelity, we perform spectral-to-RGB conversion at the pixel level, allowing richer spectral cues to be retained during optimization. Our method is evaluated on both public and self-captured real-world datasets, demonstrating consistent improvements over the RGB-only 3DGS baseline in terms of image quality and spectral consistency. Notably, it excels in challenging scenes involving translucent materials and anisotropic reflections. The proposed approach maintains the compactness and real-time efficiency of 3DGS while laying the foundation for future integration with physically based shading models.

Related papers

• Phy-CoSF: Physics-Guided Continuous Spectral Fields Reconstruction and Super-Resolution for Snapshot Compressive Imaging [79.35520607451187]
  We propose Phy-CoSF, which synergizes deep unfolding networks with implicit neural representations.<n>Specifically, we propose a two-phase architecture that bridges discrete-wavelength training with continuous spectral rendering.
  arXiv  Detail & Related papers  (2026-05-13T14:17:02Z)
• Residual Gaussian Splatting for Ultra Sparse-View CBCT Reconstruction [14.00351191217297]
  This work integrates wavelet multi-resolution analysis with 3DGS to enhance sparse reconstruction.<n>We introduce a spectrally-decoupled Gaussian representation that stratifies the volumetric field into a geometric base component and a residual detail component.<n>Experiments on clinical datasets demonstrate that RGS enables the reconstructed images to capture highly refined geometric textures.
  arXiv  Detail & Related papers  (2026-04-30T07:59:18Z)
• Towards Integrating Multi-Spectral Imaging with Gaussian Splatting [8.908394706712395]
  We present a study of how to integrate color (RGB) and multi-spectral imagery into the 3D Gaussian Splatting framework.<n>We suggest integrating multi-spectral data directly into the spherical harmonics color components to compactly model each Gaussian's multi-spectral reflectance.
  arXiv  Detail & Related papers  (2025-08-31T20:53:35Z)
• 3DGabSplat: 3D Gabor Splatting for Frequency-adaptive Radiance Field Rendering [50.04967868036964]
  3D Gaussian Splatting (3DGS) has enabled real-time rendering while maintaining high-fidelity novel view synthesis.<n>We propose 3D Gabor Splatting (3DGabSplat) that incorporates a novel 3D Gabor-based primitive with multiple directional 3D frequency responses.<n>We achieve 1.35 dBR gain over 3D with simultaneously reduced number of primitive memory consumption.
  arXiv  Detail & Related papers  (2025-08-07T12:49:44Z)
• Complex-Valued Holographic Radiance Fields [9.050557698554696]
  We reformulate 3D Gaussian splatting with complex-valued Gaussian primitives, expanding support for rendering with light waves.<n>Compared with state-of-the-art methods, our method achieves 30x-10,000x speed improvements while maintaining on-par image quality.
  arXiv  Detail & Related papers  (2025-06-10T02:09:04Z)
• Multi-Spectral Gaussian Splatting with Neural Color Representation [8.200719250787651]
  We present MS-Splatting -- a multi-spectral 3D Gaussian Splatting framework.<n>Our method does not require cross-modal camera calibration.<n>It is versatile enough to model a variety of different spectra, including thermal and near-infra red.
  arXiv  Detail & Related papers  (2025-06-03T21:36:50Z)
• Diffusion Denoised Hyperspectral Gaussian Splatting [11.486860334986394]
  3D reconstruction methods have been used to create implicit neural representations of hyperspectral scenes.<n>We propose Diffusion-Denoised Hyperspectral Gaussian Splatting (DD-HGS) to enable 3D explicit reconstruction of hyperspectral scenes.
  arXiv  Detail & Related papers  (2025-05-28T02:07:52Z)
• 3iGS: Factorised Tensorial Illumination for 3D Gaussian Splatting [15.059156311856087]
  3D Gaussian Splatting, or 3iGS, improves upon 3D Gaussian Splatting (3DGS) rendering quality. Use of 3D Gaussians as representation of radiance fields has enabled high quality novel view synthesis at real-time rendering speed.
  arXiv  Detail & Related papers  (2024-08-07T13:06:29Z)
• 2D Gaussian Splatting for Geometrically Accurate Radiance Fields [50.056790168812114]
  3D Gaussian Splatting (3DGS) has recently revolutionized radiance field reconstruction, achieving high quality novel view synthesis and fast rendering speed without baking.<n>We present 2D Gaussian Splatting (2DGS), a novel approach to model and reconstruct geometrically accurate radiance fields from multi-view images.<n>We demonstrate that our differentiable terms allows for noise-free and detailed geometry reconstruction while maintaining competitive appearance quality, fast training speed, and real-time rendering.
  arXiv  Detail & Related papers  (2024-03-26T17:21:24Z)
• GS-IR: 3D Gaussian Splatting for Inverse Rendering [71.14234327414086]
  We propose GS-IR, a novel inverse rendering approach based on 3D Gaussian Splatting (GS) We extend GS, a top-performance representation for novel view synthesis, to estimate scene geometry, surface material, and environment illumination from multi-view images captured under unknown lighting conditions. The flexible and expressive GS representation allows us to achieve fast and compact geometry reconstruction, photorealistic novel view synthesis, and effective physically-based rendering.
  arXiv  Detail & Related papers  (2023-11-26T02:35:09Z)
• SpectralGPT: Spectral Remote Sensing Foundation Model [60.023956954916414]
  A universal RS foundation model, named SpectralGPT, is purpose-built to handle spectral RS images using a novel 3D generative pretrained transformer (GPT) Compared to existing foundation models, SpectralGPT accommodates input images with varying sizes, resolutions, time series, and regions in a progressive training fashion, enabling full utilization of extensive RS big data. Our evaluation highlights significant performance improvements with pretrained SpectralGPT models, signifying substantial potential in advancing spectral RS big data applications within the field of geoscience.
  arXiv  Detail & Related papers  (2023-11-13T07:09:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.