MSP-Net: Manifold-Guided Spectral Prompt Network for Hyperspectral Object Tracking

• URL: http://arxiv.org/abs/2608.09575v1
• Date: Mon, 10 Aug 2026 13:09:25 GMT
• Title: MSP-Net: Manifold-Guided Spectral Prompt Network for Hyperspectral Object Tracking
• Abstract summary: Hyperspectral object tracking offers unique advantages for target discrimination in complex scenes.<n>Existing methods treat hyperspectral images as multi-channel extensions of RGB images, performing feature fusion in fixed band order.<n>We propose the Manifold-Guided Spectral Prompt Network (MSP-Net)<n> Experiments on HOT2020 and HOT2023 demonstrate MSP-Net achieves AUC and Precision exceeding 0.80 and 0.96, respectively.
• Score: 11.03462046191901
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Hyperspectral object tracking leverages abundant spectral information to provide unique advantages for target discrimination in complex scenes. However, existing methods typically treat hyperspectral images as multi-channel extensions of RGB images, performing feature fusion in fixed band order. This approach leads to models dependent on specific sensor configurations while neglecting manifold relationships between bands, making generalization to heterogeneous sensors difficult. Moreover, the discriminative contribution of bands dynamically changes with target attributes and scene variations, further limiting the representational capacity of static fusion strategies. To address this, we propose the Manifold-Guided Spectral Prompt Network (MSP-Net). This network first reconstructs band relationships and forms adaptive spectral grouping through graph-driven manifold routing, then jointly integrates grouped spectral statistics with template appearance to construct target-related dynamic conditional prompts, enhancing target features while suppressing background interference. Furthermore, as tracking progresses, spectral conditions continuously evolve based on intermediate target representations, enabling target prompts to adapt in real-time to appearance and scene changes. Meanwhile, reliable historical states are used to constrain target localization and scale fluctuations, significantly improving temporal stability in cross-sensor tracking. Experiments on HOT2020 and HOT2023 demonstrate that MSP-Net achieves AUC and Precision exceeding 0.80 and 0.96, respectively, exhibiting exceptional robustness under heterogeneous sensors, target deformation, and complex background conditions. The code will be released at https://github.com/GGML668897/MSP-Net.

Related papers

• Spectral-Spatial Synergistic Guided Network for Hyperspectral Salient Object Detection [29.979358462284623]
  We propose a lightweight and efficient Spectral-Spatial Synergistic Guided Network (S3GNet) for object detection.<n>S3GNet builds a closed-loop information flow around spectrum robust modeling, cross-stream co-perception and multi-scale refinement decoding.<n> Experimental results show that S3GNet achieves superior performance in both computational efficiency and detection accuracy compared to existing methods.
  arXiv  Detail & Related papers  (2026-07-23T08:14:32Z)
• Weaving Light and Time: Unified Harmonic-Geometric Representation Learning for Dense RGB-Event Parsing [55.13802890769086]
  We present Evita, the first unified backbone specifically engineered for dedicated dense RGB-Event parsing.<n>To achieve profound modal synergy, Evita embeds a suite of intrinsic co-learning modules directly into every encoder layer.<n>Evita establishes new state-of-the-art metrics while delivering a superior accuracy-latency trade-off for real-time multimodal perception.
  arXiv  Detail & Related papers  (2026-07-10T06:52:09Z)
• Liquid Fusion of Heterogeneous Representations Towards General Salient Object Detection [17.9670241907852]
  General Salient Object Detection (SOD) aims to identify and segment visually interesting objects from uni-modality or multi-modality scenes.<n>We introduce a liquid fusion to dynamically integrate features from two backbones, including VMamba and ConvNeXt, referred to Liquid Fusion Network (LFNet)<n>LFNet achieves state-of-the-art performance, offering a superior trade-off between detection accuracy and model efficiency.
  arXiv  Detail & Related papers  (2026-06-25T10:35:42Z)
• Active Adversarial Perturbation-driven Associative Memory Retrieval for RGB-Event Visual Object Tracking [58.338848435042536]
  RGB-Event tracking improves localization by fusing RGB appearance textures and dense temporal motion cues from event sensors.<n>Real-world scenes suffer diverse structured signal degradations that hinder traditional multi-modal fusion.<n>We present a hierarchical perturbation and retrieval framework tailored for RGB-Event tracking with robustness against partial target missing and modal degradation.
  arXiv  Detail & Related papers  (2026-06-24T23:34:06Z)
• Dynamic Spectral Denoising with Global-Context Attention for Multi-Behavior Recommendation [58.33732779555114]
  We argue that the key bottleneck is a representation-level failure caused by two coupled heterogeneities.<n>We propose Dynamic Spectral Denoising with Global-Context Attention for Multi-Behavior Recommendation (SpectraMB)<n>SpectraMB achieves the best results in most evaluation settings and exhibits improved robustness under noisy interactions.
  arXiv  Detail & Related papers  (2026-06-01T15:58:13Z)
• LESSViT: Robust Hyperspectral Representation Learning under Spectral Configuration Shift [29.791943499456426]
  Low-rank Efficient Spatial-Spectral ViT (LESSViT) is a sensor-flexible architecture for cross-spectral generalization.<n>We introduce a hyperspectral masked autoencoder (HyperMAE) with decoupled spatial-spectral masking and hierarchical channel sampling.
  arXiv  Detail & Related papers  (2026-05-18T15:22:26Z)
• Physics-Aligned Spectral Mamba: Decoupling Semantics and Dynamics for Few-Shot Hyperspectral Target Detection [14.607792636586067]
  SpecMamba is a framework that decouples stable semantic representation from agile spectral adaptation.<n>It consistently outperforms state-of-the-art methods in detection accuracy and cross-domain generalization.
  arXiv  Detail & Related papers  (2026-04-07T08:04:18Z)
• Hyperspectral Mamba for Hyperspectral Object Tracking [56.365517163296936]
  A new hyperspectral object tracking network equipped with Mamba (HyMamba) is proposed.<n>It unifies spectral, cross-depth, and temporal modeling through state space modules (SSMs)<n>HyMamba achieves state-of-the-art performance on seven benchmark datasets.
  arXiv  Detail & Related papers  (2025-09-10T03:47:43Z)
• AuxDet: Auxiliary Metadata Matters for Omni-Domain Infrared Small Target Detection [49.81255045696323]
  We present the Auxiliary Metadata Driven Infrared Small Target Detector (AuxDet)<n>AuxDet integrates metadata semantics with visual features, guiding adaptive representation learning for each sample.<n>Experiments on the challenging WideIRSTD-Full benchmark demonstrate that AuxDet consistently outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-05-21T07:02:05Z)
• Unleashing Correlation and Continuity for Hyperspectral Reconstruction from RGB Images [64.80875911446937]
  We propose a Correlation and Continuity Network (CCNet) for HSI reconstruction from RGB images.<n>For the correlation of local spectrum, we introduce the Group-wise Spectral Correlation Modeling (GrSCM) module.<n>For the continuity of global spectrum, we design the Neighborhood-wise Spectral Continuity Modeling (NeSCM) module.
  arXiv  Detail & Related papers  (2025-01-02T15:14:40Z)
• SSF-Net: Spatial-Spectral Fusion Network with Spectral Angle Awareness for Hyperspectral Object Tracking [21.664141982246598]
  Hyperspectral video (HSV) offers valuable spatial, spectral, and temporal information simultaneously.<n>Existing methods primarily focus on band regrouping and rely on RGB trackers for feature extraction.<n>In this paper, a spatial-spectral fusion network with spectral angle awareness (SST-Net) is proposed for hyperspectral (HS) object tracking.
  arXiv  Detail & Related papers  (2024-03-09T09:37:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.