Challenges in Hyperspectral Imaging for Autonomous Driving: The HSI-Drive Case

• URL: http://arxiv.org/abs/2603.25510v1
• Date: Thu, 26 Mar 2026 14:45:57 GMT
• Title: Challenges in Hyperspectral Imaging for Autonomous Driving: The HSI-Drive Case
• Abstract summary: Hyperspectral imaging (HSI) in autonomous driving (AD) faces many challenges related to the specifics and requirements of this application domain.<n>On the one hand, non-controlled and variable lighting conditions, the wide depth-of-field ranges, and dynamic scenes with fast-moving objects.<n>The combination of these factors determines both the criteria for selecting appropriate HSI technologies and the development of custom vision algorithms.
• Score: 0.8258451067861933
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The use of hyperspectral imaging (HSI) in autonomous driving (AD), while promising, faces many challenges related to the specifics and requirements of this application domain. On the one hand, non-controlled and variable lighting conditions, the wide depth-of-field ranges, and dynamic scenes with fast-moving objects. On the other hand, the requirements for real-time operation and the limited computational resources of embedded platforms. The combination of these factors determines both the criteria for selecting appropriate HSI technologies and the development of custom vision algorithms that leverage the spectral and spatial information obtained from the sensors. In this article, we analyse several techniques explored in the research of HSI-based vision systems with application to AD, using as an example results obtained from experiments using data from the most recent version of the HSI-Drive dataset.

Related papers

• Hyperspectral Sensors and Autonomous Driving: Technologies, Limitations, and Opportunities [3.1254189095228497]
  Hyperspectral imaging (HSI) offers a transformative sensing modality for Advanced Driver Assistance Systems (ADAS) and autonomous driving (AD) applications.<n>This paper presents the first comprehensive review of HSI for automotive applications, examining the strengths, limitations, and suitability of current HSI technologies.
  arXiv  Detail & Related papers  (2025-08-27T14:09:53Z)
• Hyperspectral Imaging [49.45523645429475]
  Hyperspectral imaging (HSI) is an advanced sensing modality that simultaneously captures spatial and spectral information.<n>This Primer presents a comprehensive overview of HSI, from the underlying physical principles and sensor architectures to key steps in data acquisition, calibration, and correction.
  arXiv  Detail & Related papers  (2025-08-11T15:47:24Z)
• AI-Driven HSI: Multimodality, Fusion, Challenges, and the Deep Learning Revolution [1.2647816797166165]
  Hyperspectral imaging (HSI) captures spatial and spectral data, enabling analysis of features invisible to conventional systems.<n>This study provides an overview of the HSI, its applications, challenges in data fusion and the role of deep learning models in processing HSI data.<n>Deep learning enhances HSI analysis in areas like feature extraction, change detection, denoising unmixing, dimensionality reduction, landcover mapping, data augmentation, spectral construction and super resolution.
  arXiv  Detail & Related papers  (2025-02-09T12:44:16Z)
• Multi-Modality Driven LoRA for Adverse Condition Depth Estimation [61.525312117638116]
  We propose Multi-Modality Driven LoRA (MMD-LoRA) for Adverse Condition Depth Estimation.<n>It consists of two core components: Prompt Driven Domain Alignment (PDDA) and Visual-Text Consistent Contrastive Learning (VTCCL)<n>It achieves state-of-the-art performance on the nuScenes and Oxford RobotCar datasets.
  arXiv  Detail & Related papers  (2024-12-28T14:23:58Z)
• Exploring Fully Convolutional Networks for the Segmentation of Hyperspectral Imaging Applied to Advanced Driver Assistance Systems [1.8874331450711404]
  We explore the use of hyperspectral imaging (HSI) in Advanced Driver Assistance Systems (ADAS)<n>This paper describes some experimental results of the application of fully convolutional networks (FCN) to the image segmentation of HSI for ADAS applications.<n>We use the HSI-Drive v1.1 dataset, which provides a set of labelled images recorded in real driving conditions with a small-size snapshot NIR-HSI camera.
  arXiv  Detail & Related papers  (2024-12-05T08:58:25Z)
• On-chip Hyperspectral Image Segmentation with Fully Convolutional Networks for Scene Understanding in Autonomous Driving [1.696186398088554]
  spectral reflectance of different objects in a driving scene beyond the visible spectrum can offer additional information.<n>In this work we explore the use of snapshot, video-rate hyperspectral imaging (HSI) cameras in advanced driver assistance systems (ADAS)<n>We analyze to what extent the spatial features codified by standard, tiny fully convolutional network (FCN) models can improve the performance of HSI segmentation systems.
  arXiv  Detail & Related papers  (2024-11-28T17:10:50Z)
• Efficient High-Resolution Visual Representation Learning with State Space Model for Human Pose Estimation [60.80423207808076]
  Capturing long-range dependencies while preserving high-resolution visual representations is crucial for dense prediction tasks such as human pose estimation.<n>We propose the Dynamic Visual State Space (DVSS) block, which augments visual state space models with multi-scale convolutional operations.<n>We build HRVMamba, a novel model for efficient high-resolution representation learning.
  arXiv  Detail & Related papers  (2024-10-04T06:19:29Z)
• HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model [88.13261547704444]
  Hyper SIGMA is a vision transformer-based foundation model that unifies HSI interpretation across tasks and scenes.<n>In addition, we construct a large-scale hyperspectral dataset, HyperGlobal-450K, for pre-training, which contains about 450K hyperspectral images.
  arXiv  Detail & Related papers  (2024-06-17T13:22:58Z)
• BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation [57.40024206484446]
  We introduce the BEHAVIOR Vision Suite (BVS), a set of tools and assets to generate fully customized synthetic data for systematic evaluation of computer vision models. BVS supports a large number of adjustable parameters at the scene level. We showcase three example application scenarios.
  arXiv  Detail & Related papers  (2024-05-15T17:57:56Z)
• Interpretable Hyperspectral AI: When Non-Convex Modeling meets Hyperspectral Remote Sensing [57.52865154829273]
  Hyperspectral imaging, also known as image spectrometry, is a landmark technique in geoscience remote sensing (RS) In the past decade efforts have been made to process analyze these hyperspectral (HS) products mainly by means of seasoned experts. For this reason, it is urgent to develop more intelligent and automatic approaches for various HS RS applications.
  arXiv  Detail & Related papers  (2021-03-02T03:32:10Z)
• Hyperspectral Image Classification -- Traditional to Deep Models: A Survey for Future Prospects [0.6091702876917281]
  Hyperspectral Imaging (HSI) has been extensively utilized in many real-life applications. In the last few years, deep learning (DL) has been substantiated as a powerful feature extractor. This survey enlists a systematic overview of DL for HSIC and compared state-of-the-art strategies of the said topic.
  arXiv  Detail & Related papers  (2021-01-15T13:59:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.