Augmentation techniques for video surveillance in the visible and thermal spectral range

• URL: http://arxiv.org/abs/2606.13042v1
• Date: Thu, 11 Jun 2026 08:25:14 GMT
• Title: Augmentation techniques for video surveillance in the visible and thermal spectral range
• Abstract summary: In intelligent video surveillance, cameras record image sequences during day and night. Commonly, this demands different sensors.<n>We focus on the case that a long-wave infrared camera records continuously and in addition to this, another camera records in the visible spectral range during daytime.<n>More accurate, our task is multispectral CNN-based object detection.
• Score: 2.893226191913102
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In intelligent video surveillance, cameras record image sequences during day and night. Commonly, this demands different sensors. To achieve a better performance it is not unusual to combine them. We focus on the case that a long-wave infrared camera records continuously and in addition to this, another camera records in the visible spectral range during daytime and an intelligent algorithm supervises the picked up imagery. More accurate, our task is multispectral CNN-based object detection. At first glance, images originating from the visible spectral range differ between thermal infrared ones in the presence of color and distinct texture information on the one hand and in not containing information about thermal radiation that emits from objects on the other hand. Although color can provide valuable information for classification tasks, effects such as varying illumination and specialties of different sensors still represent significant problems. Anyway, obtaining sufficient and practical thermal infrared datasets for training a deep neural network poses still a challenge. That is the reason why training with the help of data from the visible spectral range could be advantageous, particularly if the data, which has to be evaluated contains both visible and infrared data. However, there is no clear evidence of how strongly variations in thermal radiation, shape, or color information influence classification accuracy. To gain deeper insight into how Convolutional Neural Networks make decisions and what they learn from different sensor input data, we investigate the suitability and robustness of different augmentation techniques...

Related papers

• Knowledge-Guided Adversarial Training for Infrared Object Detection via Thermal Radiation Modeling [49.887347082863194]
  We show that relative thermal radiation relations between different classes can be regarded as a reliable knowledge source under the complex scenarios of adversarial examples and common corruptions.<n>We propose Knowledge-Guided Adversarial Training (KGAT) for infrared object detection, in which infrared physical knowledge is embedded into the adversarial training process.
  arXiv  Detail & Related papers  (2026-03-26T08:43:43Z)
• Optimizing the image correction pipeline for pedestrian detection in the thermal-infrared domain [15.97485485068461]
  Infrared imagery can help in low-visibility situations such as fog and low-light scenarios. It is prone to thermal noise and requires further processing and correction. This work studies the effect of different infrared processing pipelines on the performance of a pedestrian detection in an urban environment.
  arXiv  Detail & Related papers  (2024-07-05T13:07:40Z)
• Spatial-Temporal Frequency Forgery Clue for Video Forgery Detection in VIS and NIR Scenario [87.72258480670627]
  Existing face forgery detection methods based on frequency domain find that the GAN forged images have obvious grid-like visual artifacts in the frequency spectrum compared to the real images. This paper proposes a Cosine Transform-based Forgery Clue Augmentation Network (FCAN-DCT) to achieve a more comprehensive spatial-temporal feature representation.
  arXiv  Detail & Related papers  (2022-07-05T09:27:53Z)
• Semantic Segmentation for Thermal Images: A Comparative Survey [0.0]
  Using infrared spectrum in semantic segmentation has many real-world use cases, such as autonomous driving, medical imaging, agriculture, defense industry, etc. One approach is to use both visible and infrared spectrum images as inputs. Another approach is to use only thermal images, enabling less hardware cost for smaller use cases.
  arXiv  Detail & Related papers  (2022-05-26T11:32:15Z)
• Performance Evaluation of Infrared Image Enhancement Techniques [0.0]
  Infrared (IR) images are widely used in many fields such as medical imaging, object tracking, astronomy and military purposes for securing borders. There are several types of IR radiation based on the range of wavelength and corresponding frequency. Due to noising and other artifacts, IR images are not clearly visible.
  arXiv  Detail & Related papers  (2022-02-07T00:05:01Z)
• A Comparison of Deep Saliency Map Generators on Multispectral Data in Object Detection [9.264502124445348]
  This work investigates three saliency map generator methods on how their maps differ across the different spectra. As a practical problem, we chose object detection in the infrared and visual spectrum for autonomous driving. The results show that there are differences between the infrared and visual activation maps. Further, an advanced training with both, the infrared and visual data not only improves the network's output, it also leads to more focused spots in the saliency maps.
  arXiv  Detail & Related papers  (2021-08-26T12:56:49Z)
• Multispectral Object Detection with Deep Learning [7.592218846348004]
  In this work, we have taken images with both the Thermal and NIR spectrum for the object detection task. We train the YOLO v3 network from scratch to detect an object from multi-spectral images.
  arXiv  Detail & Related papers  (2021-02-05T11:39:14Z)
• Towards Online Monitoring and Data-driven Control: A Study of Segmentation Algorithms for Laser Powder Bed Fusion Processes [83.97264034062673]
  An increasing number of laser powder bed fusion machines use off-axis infrared cameras to improve online monitoring and data-driven control capabilities. We study over 30 segmentation algorithms that segment each infrared image into a foreground and background. The identified algorithms can be readily applied to the laser powder bed fusion machines to address each of the above limitations and thus, significantly improve process control.
  arXiv  Detail & Related papers  (2020-11-18T03:30:16Z)
• Real-Time Drone Detection and Tracking With Visible, Thermal and Acoustic Sensors [66.4525391417921]
  A thermal infrared camera is shown to be a feasible solution to the drone detection task. The detector performance as a function of the sensor-to-target distance is also investigated. A novel video dataset containing 650 annotated infrared and visible videos of drones, birds, airplanes and helicopters is also presented.
  arXiv  Detail & Related papers  (2020-07-14T23:06:42Z)
• Exploring Thermal Images for Object Detection in Underexposure Regions for Autonomous Driving [67.69430435482127]
  Underexposure regions are vital to construct a complete perception of the surroundings for safe autonomous driving. The availability of thermal cameras has provided an essential alternate to explore regions where other optical sensors lack in capturing interpretable signals. This work proposes a domain adaptation framework which employs a style transfer technique for transfer learning from visible spectrum images to thermal images.
  arXiv  Detail & Related papers  (2020-06-01T09:59:09Z)
• Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learning [59.19469551774703]
  Drone-based vehicle detection aims at finding the vehicle locations and categories in an aerial image. We construct a large-scale drone-based RGB-Infrared vehicle detection dataset, termed DroneVehicle. Our DroneVehicle collects 28, 439 RGB-Infrared image pairs, covering urban roads, residential areas, parking lots, and other scenarios from day to night.
  arXiv  Detail & Related papers  (2020-03-05T05:29:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.