SmokeSeer: 3D Gaussian Splatting for Smoke Removal and Scene Reconstruction

• URL: http://arxiv.org/abs/2509.17329v1
• Date: Mon, 22 Sep 2025 03:05:22 GMT
• Title: SmokeSeer: 3D Gaussian Splatting for Smoke Removal and Scene Reconstruction
• Authors: Neham Jain, Andrew Jong, Sebastian Scherer, Ioannis Gkioulekas,
• Abstract summary: Smoke in real-world scenes can severely degrade the quality of images and hamper visibility.<n>We introduce SmokeSeer, a method for simultaneous 3D scene reconstruction and smoke removal from a video.<n>Our method uses thermal and RGB images, leveraging the fact that the reduced scattering in thermal images enables us to see through the smoke.
• Score: 14.475461616365346
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Smoke in real-world scenes can severely degrade the quality of images and hamper visibility. Recent methods for image restoration either rely on data-driven priors that are susceptible to hallucinations, or are limited to static low-density smoke. We introduce SmokeSeer, a method for simultaneous 3D scene reconstruction and smoke removal from a video capturing multiple views of a scene. Our method uses thermal and RGB images, leveraging the fact that the reduced scattering in thermal images enables us to see through the smoke. We build upon 3D Gaussian splatting to fuse information from the two image modalities, and decompose the scene explicitly into smoke and non-smoke components. Unlike prior approaches, SmokeSeer handles a broad range of smoke densities and can adapt to temporally varying smoke. We validate our approach on synthetic data and introduce a real-world multi-view smoke dataset with RGB and thermal images. We provide open-source code and data at the project website.

Related papers

• SmokeBench: A Real-World Dataset for Surveillance Image Desmoking in Early-Stage Fire Scenes [8.183561852240851]
  Smoke produced by combustion significantly reduces the visibility of surveillance systems.<n>There is an urgent need to remove smoke from images to obtain clear scene information.<n>We present a real-world surveillance image desmoking benchmark dataset named SmokeBench.
  arXiv  Detail & Related papers  (2025-09-16T05:51:11Z)
• WildSmoke: Ready-to-Use Dynamic 3D Smoke Assets from a Single Video in the Wild [15.941164647083696]
  We propose a pipeline to extract and reconstruct dynamic 3D smoke assets from a single in-the-wild video.<n>Our method outperforms previous reconstruction and generation methods with high-quality smoke reconstructions.
  arXiv  Detail & Related papers  (2025-09-14T06:06:42Z)
• MFGDiffusion: Mask-Guided Smoke Synthesis for Enhanced Forest Fire Detection [6.307649189539342]
  Smoke is the first visible indicator of a wildfire.<n>Current inpainting models exhibit limitations in generating high-quality smoke representations.<n>We propose a comprehensive framework for generating forest fire smoke images.
  arXiv  Detail & Related papers  (2025-07-15T12:25:35Z)
• DehazeGS: Seeing Through Fog with 3D Gaussian Splatting [17.119969983512533]
  We introduce DehazeGS, a method capable of decomposing and rendering a fog-free background from participating media.<n>Experiments on both synthetic and real-world foggy datasets demonstrate that DehazeGS achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-01-07T09:47:46Z)
• SCube: Instant Large-Scale Scene Reconstruction using VoxSplats [55.383993296042526]
  We present SCube, a novel method for reconstructing large-scale 3D scenes (geometry, appearance, and semantics) from a sparse set of posed images. Our method encodes reconstructed scenes using a novel representation VoxSplat, which is a set of 3D Gaussians supported on a high-resolution sparse-voxel scaffold.
  arXiv  Detail & Related papers  (2024-10-26T00:52:46Z)
• Self-Supervised Video Desmoking for Laparoscopic Surgery [48.83900673665993]
  We introduce self-supervised surgery video desmoking (SelfSVD) We observe that the frame captured before the activation of high-energy devices is generally clear (named pre-smoke frame, PS frame) We further feed the valuable information from PS frame into models, where a masking strategy and a regularization term are presented to avoid trivial solutions.
  arXiv  Detail & Related papers  (2024-03-17T12:38:58Z)
• TriVol: Point Cloud Rendering via Triple Volumes [57.305748806545026]
  We present a dense while lightweight 3D representation, named TriVol, that can be combined with NeRF to render photo-realistic images from point clouds. Our framework has excellent generalization ability to render a category of scenes/objects without fine-tuning.
  arXiv  Detail & Related papers  (2023-03-29T06:34:12Z)
• Refer-it-in-RGBD: A Bottom-up Approach for 3D Visual Grounding in RGBD Images [69.5662419067878]
  Grounding referring expressions in RGBD image has been an emerging field. We present a novel task of 3D visual grounding in single-view RGBD image where the referred objects are often only partially scanned due to occlusion. Our approach first fuses the language and the visual features at the bottom level to generate a heatmap that localizes the relevant regions in the RGBD image. Then our approach conducts an adaptive feature learning based on the heatmap and performs the object-level matching with another visio-linguistic fusion to finally ground the referred object.
  arXiv  Detail & Related papers  (2021-03-14T11:18:50Z)
• STCNet: Spatio-Temporal Cross Network for Industrial Smoke Detection [52.648906951532155]
  We propose a novel Spatio-Temporal Cross Network (STCNet) to recognize industrial smoke emissions. The proposed STCNet involves a spatial to extract texture features and a temporal pathway to capture smoke motion information. We show that our STCNet achieves clear improvements on the challenging RISE industrial smoke detection dataset against the best competitors by 6.2%.
  arXiv  Detail & Related papers  (2020-11-10T02:28:47Z)
• Nighttime Dehazing with a Synthetic Benchmark [147.21955799938115]
  We propose a novel synthetic method called 3R to simulate nighttime hazy images from daytime clear images. We generate realistic nighttime hazy images by sampling real-world light colors from a prior empirical distribution. Experiment results demonstrate their superiority over state-of-the-art methods in terms of both image quality and runtime.
  arXiv  Detail & Related papers  (2020-08-10T02:16:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.