HSLiNets: Evaluating Band Ordering Strategies in Hyperspectral and LiDAR Fusion

• URL: http://arxiv.org/abs/2503.21072v1
• Date: Thu, 27 Mar 2025 01:11:31 GMT
• Title: HSLiNets: Evaluating Band Ordering Strategies in Hyperspectral and LiDAR Fusion
• Authors: Judy X Yang, Jing Wang, Zhuanfeng, Li, Chenhong Sui Zekun Long, Jun Zhou,
• Abstract summary: We investigate the influence of band order on HSI-LiDAR fusion performance.<n>We propose a novel fusion architecture that learns from multiple band order configurations.<n>Our approach outperforms state-of-the-art fusion models.
• Score: 6.395336865759017
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The integration of hyperspectral imaging (HSI) and Light Detection and Ranging (LiDAR) data provides complementary spectral and spatial information for remote sensing applications. While previous studies have explored the role of band selection and grouping in HSI classification, little attention has been given to how the spectral sequence or band order affects classification outcomes when fused with LiDAR. In this work, we systematically investigate the influence of band order on HSI-LiDAR fusion performance. Through extensive experiments, we demonstrate that band order significantly impacts classification accuracy, revealing a previously overlooked factor in fusion-based models. Motivated by this observation, we propose a novel fusion architecture that not only integrates HSI and LiDAR data but also learns from multiple band order configurations. The proposed method enhances feature representation by adaptively fusing different spectral sequences, leading to improved classification accuracy. Experimental results on the Houston 2013 and Trento datasets show that our approach outperforms state-of-the-art fusion models. Data and code are available at https://github.com/Judyxyang/HSLiNets.

Related papers

• Band Prompting Aided SAR and Multi-Spectral Data Fusion Framework for Local Climate Zone Classification [20.71392764471532]
  Local climate zone (LCZ) classification is of great value for understanding the complex interactions between urban development and local climate.<n>Recent studies have increasingly focused on the fusion of synthetic aperture radar (SAR) and multi-spectral data to improve LCZ classification performance.<n>In this paper, a novel band prompting aided data fusion framework is proposed for LCZ classification, namely BP-LCZ.<n>The experimental results demonstrate the effectiveness and superiority of the proposed data fusion framework.
  arXiv  Detail & Related papers  (2024-12-24T07:40:07Z)
• LiDAR-GS:Real-time LiDAR Re-Simulation using Gaussian Splatting [50.808933338389686]
  We present LiDAR-GS, a real-time, high-fidelity re-simulation of LiDAR scans in public urban road scenes.<n>The method achieves state-of-the-art results in both rendering frame rate and quality on publically available large scene datasets.
  arXiv  Detail & Related papers  (2024-10-07T15:07:56Z)
• Test-time Training for Hyperspectral Image Super-resolution [95.38382633281398]
  Hyperspectral image (HSI) super-resolution (SR) is still lagging behind the research of RGB image SR. In this work, we propose a new test-time training method to tackle this problem. Specifically, a novel self-training framework is developed, where more accurate pseudo-labels and more accurate LR-HR relationships are generated.
  arXiv  Detail & Related papers  (2024-09-13T09:30:19Z)
• Unsupervised Band Selection Using Fused HSI and LiDAR Attention Integrating With Autoencoder [16.742768644585684]
  Band selection in hyperspectral imaging (HSI) is critical for optimising data processing and enhancing analytical accuracy. Traditional approaches have predominantly concentrated on analysing spectral and pixel characteristics within individual bands independently. This paper introduces a novel unsupervised band selection framework that incorporates attention mechanisms and an Autoencoder for reconstruction-based band selection.
  arXiv  Detail & Related papers  (2024-04-08T07:47:28Z)
• LiDAR-Guided Cross-Attention Fusion for Hyperspectral Band Selection and Image Classification [16.742768644585684]
  This paper introduces a cross-attention mechanism for the selection of HSI bands guided by LiDAR data. The method ensures that the selected HSI bands drastically reduce redundancy and computational requirements. Experiments have been undertaken on three paired HSI and LiDAR data sets: Houston 2013, Trento and MUUFL.
  arXiv  Detail & Related papers  (2024-04-05T04:11:31Z)
• DiffSpectralNet : Unveiling the Potential of Diffusion Models for Hyperspectral Image Classification [6.521187080027966]
  We propose a new network called DiffSpectralNet, which combines diffusion and transformer techniques. First, we use an unsupervised learning framework based on the diffusion model to extract both high-level and low-level spectral-spatial features. The diffusion method is capable of extracting diverse and meaningful spectral-spatial features, leading to improvement in HSI classification.
  arXiv  Detail & Related papers  (2023-10-29T15:26:37Z)
• SpectralDiff: A Generative Framework for Hyperspectral Image Classification with Diffusion Models [18.391049303136715]
  We propose a generative framework for HSI classification with diffusion models (SpectralDiff) SpectralDiff effectively mines the distribution information of high-dimensional and highly redundant data. Experiments on three public HSI datasets demonstrate that the proposed method can achieve better performance than state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-04-12T16:32:34Z)
• Benchmarking the Robustness of LiDAR Semantic Segmentation Models [78.6597530416523]
  In this paper, we aim to comprehensively analyze the robustness of LiDAR semantic segmentation models under various corruptions. We propose a new benchmark called SemanticKITTI-C, which features 16 out-of-domain LiDAR corruptions in three groups, namely adverse weather, measurement noise and cross-device discrepancy. We design a robust LiDAR segmentation model (RLSeg) which greatly boosts the robustness with simple but effective modifications.
  arXiv  Detail & Related papers  (2023-01-03T06:47:31Z)
• The Manifold Hypothesis for Gradient-Based Explanations [55.01671263121624]
  gradient-based explanation algorithms provide perceptually-aligned explanations. We show that the more a feature attribution is aligned with the tangent space of the data, the more perceptually-aligned it tends to be. We suggest that explanation algorithms should actively strive to align their explanations with the data manifold.
  arXiv  Detail & Related papers  (2022-06-15T08:49:24Z)
• Unsupervised Machine Learning for Exploratory Data Analysis of Exoplanet Transmission Spectra [68.8204255655161]
  We focus on unsupervised techniques for analyzing spectral data from transiting exoplanets. We show that there is a high degree of correlation in the spectral data, which calls for appropriate low-dimensional representations. We uncover interesting structures in the principal component basis, namely, well-defined branches corresponding to different chemical regimes.
  arXiv  Detail & Related papers  (2022-01-07T22:26:33Z)
• Hyperspectral Image Super-Resolution with Spectral Mixup and Heterogeneous Datasets [99.92564298432387]
  This work studies Hyperspectral image (HSI) super-resolution (SR) HSI SR is characterized by high-dimensional data and a limited amount of training examples. This exacerbates the undesirable behaviors of neural networks such as memorization and sensitivity to out-of-distribution samples.
  arXiv  Detail & Related papers  (2021-01-19T12:19:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.