Object Detection in Thermal Spectrum for Advanced Driver-Assistance Systems (ADAS)

• URL: http://arxiv.org/abs/2109.09854v1
• Date: Mon, 20 Sep 2021 21:38:55 GMT
• Title: Object Detection in Thermal Spectrum for Advanced Driver-Assistance Systems (ADAS)
• Authors: Muhammad Ali Farooq, Peter Corcoran, Cosmin Rotariu
• Abstract summary: Object detection in thermal infrared spectrum provides more reliable data source in low-lighting conditions and different weather conditions. This paper is about exploring and adapting state-of-the-art object and vision framework on thermal vision with seven distinct classes for advanced driver-assistance systems (ADAS) The trained network variants on public datasets are validated on test data with three different test approaches. The efficacy of trained networks is tested on locally gathered novel test-data captured with an uncooled LWIR prototype thermal camera.
• Score: 0.5156484100374058
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Object detection in thermal infrared spectrum provides more reliable data source in low-lighting conditions and different weather conditions, as it is useful both in-cabin and outside for pedestrian, animal, and vehicular detection as well as for detecting street-signs & lighting poles. This paper is about exploring and adapting state-of-the-art object detection and classifier framework on thermal vision with seven distinct classes for advanced driver-assistance systems (ADAS). The trained network variants on public datasets are validated on test data with three different test approaches which include test-time with no augmentation, test-time augmentation, and test-time with model ensembling. Additionally, the efficacy of trained networks is tested on locally gathered novel test-data captured with an uncooled LWIR prototype thermal camera in challenging weather and environmental scenarios. The performance analysis of trained models is investigated by computing precision, recall, and mean average precision scores (mAP). Furthermore, the trained model architecture is optimized using TensorRT inference accelerator and deployed on resource-constrained edge hardware Nvidia Jetson Nano to explicitly reduce the inference time on GPU as well as edge devices for further real-time onboard installations.

Related papers

• Rapid Wildfire Hotspot Detection Using Self-Supervised Learning on Temporal Remote Sensing Data [0.12289361708127873]
  Leveraging remote sensed data from satellite networks and advanced AI models to automatically detect hotspots is an effective way to build wildfire monitoring systems. We propose a novel dataset containing time series of remotely sensed data related to European fire events and a Self-Supervised Learning (SSL)-based model able to analyse multi-temporal data and identify hotspots in potentially near real time. We train and evaluate the performance of our model using our dataset and Thraws, a dataset of thermal anomalies including several fire events, obtaining an F1 score of 63.58.
  arXiv  Detail & Related papers  (2024-05-30T14:31:46Z)
• Hardware Acceleration for Real-Time Wildfire Detection Onboard Drone Networks [6.313148708539912]
  wildfire detection in remote and forest areas is crucial for minimizing devastation and preserving ecosystems. Drones offer agile access to remote, challenging terrains, equipped with advanced imaging technology. limited computation and battery resources pose challenges in implementing and efficient image classification models. This paper aims to develop a real-time image classification and fire segmentation model.
  arXiv  Detail & Related papers  (2024-01-16T04:16:46Z)
• WEDGE: A multi-weather autonomous driving dataset built from generative vision-language models [51.61662672912017]
  We introduce WEDGE: a synthetic dataset generated with a vision-language generative model via prompting. WEDGE consists of 3360 images in 16 extreme weather conditions manually annotated with 16513 bounding boxes. We establish baseline performance for classification and detection with 53.87% test accuracy and 45.41 mAP.
  arXiv  Detail & Related papers  (2023-05-12T14:42:47Z)
• Evaluation of Thermal Imaging on Embedded GPU Platforms for Application in Vehicular Assistance Systems [0.5156484100374058]
  This study is focused on evaluating the real-time performance of thermal object detection for smart and safe vehicular systems. A novel large-scale thermal dataset comprising of > 35,000 distinct frames is acquired. The effectiveness of trained networks is validated on extensive test data using various quantitative metrics.
  arXiv  Detail & Related papers  (2022-01-05T15:36:25Z)
• Meta-UDA: Unsupervised Domain Adaptive Thermal Object Detection using Meta-Learning [64.92447072894055]
  Infrared (IR) cameras are robust under adverse illumination and lighting conditions. We propose an algorithm meta-learning framework to improve existing UDA methods. We produce a state-of-the-art thermal detector for the KAIST and DSIAC datasets.
  arXiv  Detail & Related papers  (2021-10-07T02:28:18Z)
• DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly detection in air transportation [68.8204255655161]
  We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE) It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase. Results show that the DAE achieves better results in both accuracy and speed of detection.
  arXiv  Detail & Related papers  (2021-09-08T14:07:55Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)
• Cycle and Semantic Consistent Adversarial Domain Adaptation for Reducing Simulation-to-Real Domain Shift in LiDAR Bird's Eye View [110.83289076967895]
  We present a BEV domain adaptation method based on CycleGAN that uses prior semantic classification in order to preserve the information of small objects of interest during the domain adaptation process. The quality of the generated BEVs has been evaluated using a state-of-the-art 3D object detection framework at KITTI 3D Object Detection Benchmark.
  arXiv  Detail & Related papers  (2021-04-22T12:47:37Z)
• Exploring Thermal Images for Object Detection in Underexposure Regions for Autonomous Driving [67.69430435482127]
  Underexposure regions are vital to construct a complete perception of the surroundings for safe autonomous driving. The availability of thermal cameras has provided an essential alternate to explore regions where other optical sensors lack in capturing interpretable signals. This work proposes a domain adaptation framework which employs a style transfer technique for transfer learning from visible spectrum images to thermal images.
  arXiv  Detail & Related papers  (2020-06-01T09:59:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.