Optimizing the image correction pipeline for pedestrian detection in the thermal-infrared domain

• URL: http://arxiv.org/abs/2407.04484v1
• Date: Fri, 5 Jul 2024 13:07:40 GMT
• Title: Optimizing the image correction pipeline for pedestrian detection in the thermal-infrared domain
• Abstract summary: Infrared imagery can help in low-visibility situations such as fog and low-light scenarios. It is prone to thermal noise and requires further processing and correction. This work studies the effect of different infrared processing pipelines on the performance of a pedestrian detection in an urban environment.
• Score: 15.97485485068461
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Infrared imagery can help in low-visibility situations such as fog and low-light scenarios, but it is prone to thermal noise and requires further processing and correction. This work studies the effect of different infrared processing pipelines on the performance of a pedestrian detection in an urban environment, similar to autonomous driving scenarios. Detection on infrared images is shown to outperform that on visible images, but the infrared correction pipeline is crucial since the models cannot extract information from raw infrared images. Two thermal correction pipelines are studied, the shutter and the shutterless pipes. Experiments show that some correction algorithms like spatial denoising are detrimental to performance even if they increase visual quality for a human observer. Other algorithms like destriping and, to a lesser extent, temporal denoising, increase computational time, but have some role to play in increasing detection accuracy. As it stands, the optimal trade-off for speed and accuracy is simply to use the shutterless pipe with a tonemapping algorithm only, for autonomous driving applications within varied environments.

Related papers

• Augmentation techniques for video surveillance in the visible and thermal spectral range [2.893226191913102]
  In intelligent video surveillance, cameras record image sequences during day and night. Commonly, this demands different sensors.<n>We focus on the case that a long-wave infrared camera records continuously and in addition to this, another camera records in the visible spectral range during daytime.<n>More accurate, our task is multispectral CNN-based object detection.
  arXiv  Detail & Related papers  (2026-06-11T08:25:14Z)
• DifIISR: A Diffusion Model with Gradient Guidance for Infrared Image Super-Resolution [32.53713932204663]
  DifIISR is an infrared image super-resolution diffusion model optimized for visual quality and perceptual performance. We introduce an infrared thermal spectrum distribution regulation to preserve visual fidelity. We incorporate various visual foundational models as the perceptual guidance for downstream visual tasks.
  arXiv  Detail & Related papers  (2025-03-03T05:20:57Z)
• Make Explicit Calibration Implicit: Calibrate Denoiser Instead of the Noise Model [83.9497193551511]
  We introduce Lighting Every Darkness (LED), which is effective regardless of the digital gain or the camera sensor. LED eliminates the need for explicit noise model calibration, instead utilizing an implicit fine-tuning process that allows quick deployment and requires minimal data. LED also allows researchers to focus more on deep learning advancements while still utilizing sensor engineering benefits.
  arXiv  Detail & Related papers  (2023-08-07T10:09:11Z)
• Enhancing Low-Light Images Using Infrared-Encoded Images [81.8710581927427]
  Previous arts mainly focus on the low-light images captured in the visible spectrum using pixel-wise loss. We propose a novel approach to increase the visibility of images captured under low-light environments by removing the in-camera infrared (IR) cut-off filter.
  arXiv  Detail & Related papers  (2023-07-09T08:29:19Z)
• Factorized Inverse Path Tracing for Efficient and Accurate Material-Lighting Estimation [97.0195314255101]
  Inverse path tracing is expensive to compute, and ambiguities exist between reflection and emission. Our Factorized Inverse Path Tracing (FIPT) addresses these challenges by using a factored light transport formulation. Our algorithm enables accurate material and lighting optimization faster than previous work, and is more effective at resolving ambiguities.
  arXiv  Detail & Related papers  (2023-04-12T07:46:05Z)
• Breaking Modality Disparity: Harmonized Representation for Infrared and Visible Image Registration [66.33746403815283]
  We propose a scene-adaptive infrared and visible image registration. We employ homography to simulate the deformation between different planes. We propose the first ground truth available misaligned infrared and visible image dataset.
  arXiv  Detail & Related papers  (2023-04-12T06:49:56Z)
• Deep Unfolding for Iterative Stripe Noise Removal [4.756256077972335]
  Non-uniform photoelectric response of infrared imaging systems results in fixed-pattern stripe noise being superimposed on infrared images. Existing image destriping methods struggle to concurrently remove all stripe noise artifacts, preserve image details and structures, and balance real-time performance. We propose a novel algorithm for destriping degraded images, which takes advantage of neighbouring column signal correlation to remove independent column stripe noise.
  arXiv  Detail & Related papers  (2022-09-27T02:53:03Z)
• Semantic Segmentation for Thermal Images: A Comparative Survey [0.0]
  Using infrared spectrum in semantic segmentation has many real-world use cases, such as autonomous driving, medical imaging, agriculture, defense industry, etc. One approach is to use both visible and infrared spectrum images as inputs. Another approach is to use only thermal images, enabling less hardware cost for smaller use cases.
  arXiv  Detail & Related papers  (2022-05-26T11:32:15Z)
• Convolutional Deep Denoising Autoencoders for Radio Astronomical Images [0.0]
  We apply a Machine Learning technique known as Convolutional Denoising Autoencoder to denoise synthetic images of state-of-the-art radio telescopes. Our autoencoder can effectively denoise complex images identifying and extracting faint objects at the limits of the instrumental sensitivity.
  arXiv  Detail & Related papers  (2021-10-16T17:08:30Z)
• Comparison of Object Detection Algorithms Using Video and Thermal Images Collected from a UAS Platform: An Application of Drones in Traffic Management [2.9932638148627104]
  This study explores real-time vehicle detection algorithms on both visual and infrared cameras. Red Green Blue (RGB) videos and thermal images were collected from a UAS platform along highways in the Tampa, Florida, area.
  arXiv  Detail & Related papers  (2021-09-27T16:57:09Z)
• Thermal Image Processing via Physics-Inspired Deep Networks [21.094006629684376]
  DeepIR combines physically accurate sensor modeling with deep network-based image representation. DeepIR requires neither training data nor periodic ground-truth calibration with a known black body target. Simulated and real data experiments demonstrate that DeepIR can perform high-quality non-uniformity correction with as few as three images.
  arXiv  Detail & Related papers  (2021-08-18T04:57:48Z)
• Towards Online Monitoring and Data-driven Control: A Study of Segmentation Algorithms for Laser Powder Bed Fusion Processes [83.97264034062673]
  An increasing number of laser powder bed fusion machines use off-axis infrared cameras to improve online monitoring and data-driven control capabilities. We study over 30 segmentation algorithms that segment each infrared image into a foreground and background. The identified algorithms can be readily applied to the laser powder bed fusion machines to address each of the above limitations and thus, significantly improve process control.
  arXiv  Detail & Related papers  (2020-11-18T03:30:16Z)
• Exploring Thermal Images for Object Detection in Underexposure Regions for Autonomous Driving [67.69430435482127]
  Underexposure regions are vital to construct a complete perception of the surroundings for safe autonomous driving. The availability of thermal cameras has provided an essential alternate to explore regions where other optical sensors lack in capturing interpretable signals. This work proposes a domain adaptation framework which employs a style transfer technique for transfer learning from visible spectrum images to thermal images.
  arXiv  Detail & Related papers  (2020-06-01T09:59:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.