Absorption-Based, Passive Range Imaging from Hyperspectral Thermal Measurements

• URL: http://arxiv.org/abs/2308.05818v1
• Date: Thu, 10 Aug 2023 18:35:22 GMT
• Title: Absorption-Based, Passive Range Imaging from Hyperspectral Thermal Measurements
• Authors: Unay Dorken Gallastegi, Hoover Rueda-Chacon, Martin J. Stevens, and Vivek K Goyal
• Abstract summary: We introduce a novel passive range imaging method based on atmospheric absorption of ambient thermal radiance. Range features from 15m to 150m are recovered, with good qualitative match to unaligned lidar data.
• Score: 6.719751155411075
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Passive hyperspectral long-wave infrared measurements are remarkably informative about the surroundings, such as remote object material composition, temperature, and range; and air temperature and gas concentrations. Remote object material and temperature determine the spectrum of thermal radiance, and range, air temperature, and gas concentrations determine how this spectrum is modified by propagation to the sensor. We computationally separate these phenomena, introducing a novel passive range imaging method based on atmospheric absorption of ambient thermal radiance. Previously demonstrated passive absorption-based ranging methods assume hot and highly emitting objects. However, the temperature variation in natural scenes is usually low, making range imaging challenging. Our method benefits from explicit consideration of air emission and parametric modeling of atmospheric absorption. To mitigate noise in low-contrast scenarios, we jointly estimate range and intrinsic object properties by exploiting a variety of absorption lines spread over the infrared spectrum. Along with Monte Carlo simulations that demonstrate the importance of regularization, temperature differentials, and availability of many spectral bands, we apply this method to long-wave infrared (8--13 $\mu$m) hyperspectral image data acquired from natural scenes with no active illumination. Range features from 15m to 150m are recovered, with good qualitative match to unaligned lidar data.

Related papers

• Adaptive Stereo Depth Estimation with Multi-Spectral Images Across All Lighting Conditions [58.88917836512819]
  We propose a novel framework incorporating stereo depth estimation to enforce accurate geometric constraints. To mitigate the effects of poor lighting on stereo matching, we introduce Degradation Masking. Our method achieves state-of-the-art (SOTA) performance on the Multi-Spectral Stereo (MS2) dataset.
  arXiv  Detail & Related papers  (2024-11-06T03:30:46Z)
• Beyond Night Visibility: Adaptive Multi-Scale Fusion of Infrared and Visible Images [49.75771095302775]
  We propose an Adaptive Multi-scale Fusion network (AMFusion) with infrared and visible images. First, we separately fuse spatial and semantic features from infrared and visible images, where the former are used for the adjustment of light distribution. Second, we utilize detection features extracted by a pre-trained backbone that guide the fusion of semantic features. Third, we propose a new illumination loss to constrain fusion image with normal light intensity.
  arXiv  Detail & Related papers  (2024-03-02T03:52:07Z)
• Thermal Spread Functions (TSF): Physics-guided Material Classification [21.120014488056032]
  We propose a physics-guided material classification framework that relies on thermal properties of the object. The rate of heating and cooling of an object depends on the unique intrinsic properties of the material, namely the emissivity and diffusivity. Our approach is extremely simple requiring only a small light source (low power laser) and a thermal camera, and produces robust classification results with 86% accuracy over 16 classes.
  arXiv  Detail & Related papers  (2023-04-03T03:07:26Z)
• Does Thermal Really Always Matter for RGB-T Salient Object Detection? [153.17156598262656]
  This paper proposes a network named TNet to solve the RGB-T salient object detection (SOD) task. In this paper, we introduce a global illumination estimation module to predict the global illuminance score of the image. On the other hand, we introduce a two-stage localization and complementation module in the decoding phase to transfer object localization cue and internal integrity cue in thermal features to the RGB modality.
  arXiv  Detail & Related papers  (2022-10-09T13:50:12Z)
• Deep Learning of Radiative Atmospheric Transfer with an Autoencoder [0.0]
  We create an autoencoder similar to denoising autoencoders treating the atmospheric affects as 'noise' and ground reflectance as truth per spectrum. This process ideally could create an autoencoder that would separate atmospheric effects and ground reflectance in hyperspectral imagery.
  arXiv  Detail & Related papers  (2022-07-21T17:50:57Z)
• Augmentation of Atmospheric Turbulence Effects on Thermal Adapted Object Detection Models [0.0]
  Atmospheric turbulence has a degrading effect on the image quality of long-range observation systems. We use a geometric turbulence model to simulate turbulence effects on a medium-scale thermal image set. We propose a data augmentation strategy to increase the performance of object detectors.
  arXiv  Detail & Related papers  (2022-04-19T08:40:00Z)
• Thermal to Visible Image Synthesis under Atmospheric Turbulence [67.99407460140263]
  In biometrics and surveillance, thermal imagining modalities are often used to capture images in low-light and nighttime conditions. Such imaging systems often suffer from atmospheric turbulence, which introduces severe blur and deformation artifacts to the captured images. An end-to-end reconstruction method is proposed which can directly transform thermal images into visible-spectrum images.
  arXiv  Detail & Related papers  (2022-04-06T19:47:41Z)
• A Cloud-Edge-Terminal Collaborative System for Temperature Measurement in COVID-19 Prevention [13.593364699001693]
  To prevent the spread of coronavirus disease 2019 (COVID-19), preliminary temperature measurement and mask detection in public areas are conducted. We propose a cloud-edge-terminal collaborative system with a lightweight infrared temperature measurement model. Experiments show that the detection model is only 6.1M and the average detection speed is 257ms.
  arXiv  Detail & Related papers  (2021-07-11T16:15:15Z)
• A Large-Scale, Time-Synchronized Visible and Thermal Face Dataset [62.193924313292875]
  We present the DEVCOM Army Research Laboratory Visible-Thermal Face dataset (ARL-VTF) With over 500,000 images from 395 subjects, the ARL-VTF dataset represents to the best of our knowledge, the largest collection of paired visible and thermal face images to date. This paper presents benchmark results and analysis on thermal face landmark detection and thermal-to-visible face verification by evaluating state-of-the-art models on the ARL-VTF dataset.
  arXiv  Detail & Related papers  (2021-01-07T17:17:12Z)
• Exploring Thermal Images for Object Detection in Underexposure Regions for Autonomous Driving [67.69430435482127]
  Underexposure regions are vital to construct a complete perception of the surroundings for safe autonomous driving. The availability of thermal cameras has provided an essential alternate to explore regions where other optical sensors lack in capturing interpretable signals. This work proposes a domain adaptation framework which employs a style transfer technique for transfer learning from visible spectrum images to thermal images.
  arXiv  Detail & Related papers  (2020-06-01T09:59:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.