Visible to Thermal image Translation for improving visual task in low light conditions

• URL: http://arxiv.org/abs/2310.20190v2
• Date: Thu, 9 Nov 2023 02:42:20 GMT
• Title: Visible to Thermal image Translation for improving visual task in low light conditions
• Authors: Md Azim Khan
• Abstract summary: We have collected images from two different locations using the Parrot Anafi Thermal drone. We created a two-stream network, preprocessed, augmented, the image data, and trained the generator and discriminator models from scratch. The findings demonstrate that it is feasible to translate RGB training data to thermal data using GAN.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Several visual tasks, such as pedestrian detection and image-to-image translation, are challenging to accomplish in low light using RGB images. Heat variation of objects in thermal images can be used to overcome this. In this work, an end-to-end framework, which consists of a generative network and a detector network, is proposed to translate RGB image into Thermal ones and compare generated thermal images with real data. We have collected images from two different locations using the Parrot Anafi Thermal drone. After that, we created a two-stream network, preprocessed, augmented, the image data, and trained the generator and discriminator models from scratch. The findings demonstrate that it is feasible to translate RGB training data to thermal data using GAN. As a result, thermal data can now be produced more quickly and affordably, which is useful for security and surveillance applications.

Related papers

• T-FAKE: Synthesizing Thermal Images for Facial Landmarking [8.20594611891252]
  We introduce the T-FAKE dataset, a new large-scale synthetic thermal dataset with sparse and dense landmarks. Our models show excellent performance with both sparse 70-point landmarks and dense 478-point landmark annotations.
  arXiv  Detail & Related papers  (2024-08-27T15:07:58Z)
• ThermoNeRF: Multimodal Neural Radiance Fields for Thermal Novel View Synthesis [5.66229031510643]
  We propose ThermoNeRF, a novel approach to rendering new RGB and thermal views of a scene jointly. To overcome the lack of texture in thermal images, we use paired RGB and thermal images to learn scene density. We also introduce ThermoScenes, a new dataset to palliate the lack of available RGB+thermal datasets for scene reconstruction.
  arXiv  Detail & Related papers  (2024-03-18T18:10:34Z)
• You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement [50.37253008333166]
  Low-Light Image Enhancement (LLIE) task tends to restore the details and visual information from corrupted low-light images. We propose a novel trainable color space, named Horizontal/Vertical-Intensity (HVI) It not only decouples brightness and color from RGB channels to mitigate the instability during enhancement but also adapts to low-light images in different illumination ranges due to the trainable parameters.
  arXiv  Detail & Related papers  (2024-02-08T16:47:43Z)
• Multimodal Crowd Counting with Pix2Pix GANs [2.462045767312954]
  We propose the use of generative adversarial networks (GANs) to automatically generate thermal infrared (TIR) images from color (RGB) images. Our experiments on several state-of-the-art crowd counting models and benchmark crowd datasets report significant improvement in accuracy.
  arXiv  Detail & Related papers  (2024-01-15T10:54:35Z)
• Does Thermal Really Always Matter for RGB-T Salient Object Detection? [153.17156598262656]
  This paper proposes a network named TNet to solve the RGB-T salient object detection (SOD) task. In this paper, we introduce a global illumination estimation module to predict the global illuminance score of the image. On the other hand, we introduce a two-stage localization and complementation module in the decoding phase to transfer object localization cue and internal integrity cue in thermal features to the RGB modality.
  arXiv  Detail & Related papers  (2022-10-09T13:50:12Z)
• T2V-DDPM: Thermal to Visible Face Translation using Denoising Diffusion Probabilistic Models [71.94264837503135]
  We propose a Denoising Diffusion Probabilistic Model (DDPM) based solution for Thermal-to-Visible (T2V) image translation. During training, the model learns the conditional distribution of visible facial images given their corresponding thermal image. We achieve the state-of-the-art results on multiple datasets.
  arXiv  Detail & Related papers  (2022-09-19T07:59:32Z)
• Glass Segmentation with RGB-Thermal Image Pairs [16.925196782387857]
  We propose a new glass segmentation method utilizing paired RGB and thermal images. Glass regions of a scene are made more distinguishable with a pair of RGB and thermal images than solely with an RGB image.
  arXiv  Detail & Related papers  (2022-04-12T00:20:22Z)
• Meta-UDA: Unsupervised Domain Adaptive Thermal Object Detection using Meta-Learning [64.92447072894055]
  Infrared (IR) cameras are robust under adverse illumination and lighting conditions. We propose an algorithm meta-learning framework to improve existing UDA methods. We produce a state-of-the-art thermal detector for the KAIST and DSIAC datasets.
  arXiv  Detail & Related papers  (2021-10-07T02:28:18Z)
• Refer-it-in-RGBD: A Bottom-up Approach for 3D Visual Grounding in RGBD Images [69.5662419067878]
  Grounding referring expressions in RGBD image has been an emerging field. We present a novel task of 3D visual grounding in single-view RGBD image where the referred objects are often only partially scanned due to occlusion. Our approach first fuses the language and the visual features at the bottom level to generate a heatmap that localizes the relevant regions in the RGBD image. Then our approach conducts an adaptive feature learning based on the heatmap and performs the object-level matching with another visio-linguistic fusion to finally ground the referred object.
  arXiv  Detail & Related papers  (2021-03-14T11:18:50Z)
• Robust pedestrian detection in thermal imagery using synthesized images [39.33977680993236]
  We propose a method for improving pedestrian detection in the thermal domain using two stages. First, a generative data augmentation approach is used, then a domain adaptation method using generated data adapts an RGB pedestrian detector. Our detector achieves the best single-modality detection results on KAIST with respect to the state-of-the-art.
  arXiv  Detail & Related papers  (2021-02-03T11:08:31Z)
• Exploring Thermal Images for Object Detection in Underexposure Regions for Autonomous Driving [67.69430435482127]
  Underexposure regions are vital to construct a complete perception of the surroundings for safe autonomous driving. The availability of thermal cameras has provided an essential alternate to explore regions where other optical sensors lack in capturing interpretable signals. This work proposes a domain adaptation framework which employs a style transfer technique for transfer learning from visible spectrum images to thermal images.
  arXiv  Detail & Related papers  (2020-06-01T09:59:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.