NTR-Gaussian: Nighttime Dynamic Thermal Reconstruction with 4D Gaussian Splatting Based on Thermodynamics

• URL: http://arxiv.org/abs/2503.03115v1
• Date: Wed, 05 Mar 2025 02:24:13 GMT
• Title: NTR-Gaussian: Nighttime Dynamic Thermal Reconstruction with 4D Gaussian Splatting Based on Thermodynamics
• Authors: Kun Yang, Yuxiang Liu, Zeyu Cui, Yu Liu, Maojun Zhang, Shen Yan, Qing Wang,
• Abstract summary: NTR-Gaussian method treats temperature as a form of thermal radiation, incorporating elements like convective heat transfer and radiative heat dissipation.<n>NTR-Gaussian significantly outperforms comparison methods in thermal reconstruction, achieving a predicted temperature error within 1 degree Celsius.
• Score: 22.777703129471004
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Thermal infrared imaging offers the advantage of all-weather capability, enabling non-intrusive measurement of an object's surface temperature. Consequently, thermal infrared images are employed to reconstruct 3D models that accurately reflect the temperature distribution of a scene, aiding in applications such as building monitoring and energy management. However, existing approaches predominantly focus on static 3D reconstruction for a single time period, overlooking the impact of environmental factors on thermal radiation and failing to predict or analyze temperature variations over time. To address these challenges, we propose the NTR-Gaussian method, which treats temperature as a form of thermal radiation, incorporating elements like convective heat transfer and radiative heat dissipation. Our approach utilizes neural networks to predict thermodynamic parameters such as emissivity, convective heat transfer coefficient, and heat capacity. By integrating these predictions, we can accurately forecast thermal temperatures at various times throughout a nighttime scene. Furthermore, we introduce a dynamic dataset specifically for nighttime thermal imagery. Extensive experiments and evaluations demonstrate that NTR-Gaussian significantly outperforms comparison methods in thermal reconstruction, achieving a predicted temperature error within 1 degree Celsius.

Related papers

• Thermoxels: a voxel-based method to generate simulation-ready 3D thermal models [5.66229031510643]
  Thermoxels is a novel voxel-based method able to generate FEA-compatible models from sparse images. We demonstrate Thermoxels' capability to generate RGB+Thermal meshes of 3D scenes, surpassing other state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-04-06T11:37:16Z)
• Thermal3D-GS: Physics-induced 3D Gaussians for Thermal Infrared Novel-view Synthesis [11.793425521298488]
  This paper introduces a physics-induced 3D Gaussian splatting method named Thermal3D-GS. The first large-scale benchmark dataset for this field named Thermal Infrared Novel-view Synthesis dataset (TI-NSD) is created. The results indicate that our method outperforms the baseline method with a 3.03 dB improvement in PSNR.
  arXiv  Detail & Related papers  (2024-09-12T13:46:53Z)
• Chemical Reaction Neural Networks for Fitting Accelerating Rate Calorimetry Data [37.69303106863453]
  Chemical Reaction Neural Networks (CRNNs) are trained to fit the kinetic parameters of N-equation Arrhenius ODEs to ARC data obtained from a Molicel 21700 P45B. The flexibility of the method is demonstrated by experimenting with two-equation and four-equation models.
  arXiv  Detail & Related papers  (2024-08-21T20:39:41Z)
• Does Thermal Really Always Matter for RGB-T Salient Object Detection? [153.17156598262656]
  This paper proposes a network named TNet to solve the RGB-T salient object detection (SOD) task. In this paper, we introduce a global illumination estimation module to predict the global illuminance score of the image. On the other hand, we introduce a two-stage localization and complementation module in the decoding phase to transfer object localization cue and internal integrity cue in thermal features to the RGB modality.
  arXiv  Detail & Related papers  (2022-10-09T13:50:12Z)
• Physics-based Learning of Parameterized Thermodynamics from Real-time Thermography [0.0]
  We present a novel physics-based approach to learning a thermal process's dynamics from real-time thermographic data. We show that our approach is robust against noise, and can be used to further refine parameter estimates.
  arXiv  Detail & Related papers  (2022-03-24T16:06:31Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)
• Physics-Informed Deep Reversible Regression Model for Temperature Field Reconstruction of Heat-Source Systems [10.151316399254718]
  This work develops a novel physics-informed deep reversible regression models for temperature field reconstruction of heat-source systems. First, we define the temperature field reconstruction task of heat-source systems mathematically, numerically model the problem, and further transform the problem as an image-to-image regression problem. Based on the law of forward and backward propagation of deep models, this work develops the deep reversible regression model which can better learn the physical information near the boundary.
  arXiv  Detail & Related papers  (2021-06-22T17:01:53Z)
• Near-Field Radiative Heat Transfer Eigenmodes [55.41644538483948]
  Near-field electromagnetic interaction between nanoscale objects produces enhanced radiative heat transfer. We present a theoretical framework to describe the temporal dynamics of the radiative heat transfer in ensembles of nanostructures.
  arXiv  Detail & Related papers  (2021-02-10T23:14:30Z)
• A Large-Scale, Time-Synchronized Visible and Thermal Face Dataset [62.193924313292875]
  We present the DEVCOM Army Research Laboratory Visible-Thermal Face dataset (ARL-VTF) With over 500,000 images from 395 subjects, the ARL-VTF dataset represents to the best of our knowledge, the largest collection of paired visible and thermal face images to date. This paper presents benchmark results and analysis on thermal face landmark detection and thermal-to-visible face verification by evaluating state-of-the-art models on the ARL-VTF dataset.
  arXiv  Detail & Related papers  (2021-01-07T17:17:12Z)
• Adiabatic Sensing Technique for Optimal Temperature Estimation using Trapped Ions [64.31011847952006]
  We propose an adiabatic method for optimal phonon temperature estimation using trapped ions. The relevant information of the phonon thermal distributions can be transferred to the collective spin-degree of freedom. We show that each of the thermal state probabilities is adiabatically mapped onto the respective collective spin-excitation configuration.
  arXiv  Detail & Related papers  (2020-12-16T12:58:08Z)
• Real-time estimation of the optically detected magnetic resonance shift in diamond quantum thermometry [47.50219326456544]
  We investigate the real-time estimation protocols for the frequency shift of optically detected magnetic resonance (ODMR) of nitrogen-vacancy centers in nanodiamonds (NDs) Efficiently integrating multipoint ODMR measurements and ND particle tracking into fluorescence microscopy has recently demonstrated stable monitoring of the temperature inside living animals.
  arXiv  Detail & Related papers  (2020-06-12T01:44:35Z)
• Exploring Thermal Images for Object Detection in Underexposure Regions for Autonomous Driving [67.69430435482127]
  Underexposure regions are vital to construct a complete perception of the surroundings for safe autonomous driving. The availability of thermal cameras has provided an essential alternate to explore regions where other optical sensors lack in capturing interpretable signals. This work proposes a domain adaptation framework which employs a style transfer technique for transfer learning from visible spectrum images to thermal images.
  arXiv  Detail & Related papers  (2020-06-01T09:59:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.