HyperFM: An Efficient Hyperspectral Foundation Model with Spectral Grouping

• URL: http://arxiv.org/abs/2604.21127v1
• Date: Wed, 22 Apr 2026 22:33:15 GMT
• Title: HyperFM: An Efficient Hyperspectral Foundation Model with Spectral Grouping
• Abstract summary: PACE mission provides unprecedented hyperspectral observations of ocean color, aerosols, and clouds.<n>Current hyperspectral foundation models struggle to interpret the continuous spectral signatures captured by PACE.<n>We introduce HyperFM, a parameter-efficient hyperspectral foundation model that leverages intra-group and inter-group spectral attention.<n>We additionally release HyperFM250K, a large-scale hyperspectral dataset from the PACE mission that includes both clear and cloudy scenes.
• Score: 8.058012251047336
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The NASA PACE mission provides unprecedented hyperspectral observations of ocean color, aerosols, and clouds, offering new insights into how these components interact and influence Earth's climate and air quality. Its Ocean Color Instrument measures light across hundreds of finely spaced wavelength bands, enabling detailed characterization of features such as phytoplankton composition, aerosol properties, and cloud microphysics. However, hyperspectral data of this scale is large, complex, and difficult to label, requiring specialized processing and analysis techniques. Existing foundation models, which have transformed computer vision and natural language processing, are generally trained on standard RGB imagery and therefore struggle to interpret the continuous spectral signatures captured by PACE. While recent advances have introduced hyperspectral foundation models, they are typically trained on cloud-free observations and often remain limited to single-sensor datasets due to spectral inconsistencies across instruments. Moreover, existing models tend to be parameter-heavy and computationally expensive, limiting scalability and adoption in operational settings. To address these challenges, we introduce HyperFM, a parameter-efficient hyperspectral foundation model that leverages intra-group and inter-group spectral attention along with hybrid parameter decomposition to better capture spectral spatial relationships while reducing computational cost. HyperFM demonstrates consistent performance improvements over existing hyperspectral foundation models and task-specific state-of-the-art methods across four benchmark downstream atmospheric cloud property retrieval tasks. To support further research, we additionally release HyperFM250K, a large-scale hyperspectral dataset from the PACE mission that includes both clear and cloudy scenes.

Related papers

• Hybrid Quantum CNN for Cross-Sensor Spaceborne Volcanic Thermal Activity Recognition Worldwide [63.84017474733142]
  This work proposes a Hybrid Quantum AlexNet architecture for cross-sensor recognition of volcanic thermal activity at the global scale.<n>The proposed model combines a classical convolutional backbone for high-level spatial features extraction with a parameterized quantum circuit (PQC) acting as a variational layer.<n> Experimental results demonstrate that the proposed hybrid quantum model learns more discriminative feature representations, leading to improved cross-sensor transferability and robustness across heterogeneous volcanic environments.
  arXiv  Detail & Related papers  (2026-07-29T08:34:44Z)
• LESSViT: Robust Hyperspectral Representation Learning under Spectral Configuration Shift [29.791943499456426]
  Low-rank Efficient Spatial-Spectral ViT (LESSViT) is a sensor-flexible architecture for cross-spectral generalization.<n>We introduce a hyperspectral masked autoencoder (HyperMAE) with decoupled spatial-spectral masking and hierarchical channel sampling.
  arXiv  Detail & Related papers  (2026-05-18T15:22:26Z)
• Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting [52.53742727060265]
  Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets.<n>Here, we introduce Earth System Foundation Model (ESFM), a fully open model building on the 3Dwin UNet backbone of the pioneering model.<n>We present findings using dense gridded data (ERA5, CMIP6), regionally masked dense data, sparse gridded MODIS satellite data, and station data.<n>Results demonstrate competitive or superior performance relative to state-of-the-art benchmarks.
  arXiv  Detail & Related papers  (2026-04-20T11:40:39Z)
• SSFT: A Lightweight Spectral-Spatial Fusion Transformer for Generic Hyperspectral Classification [42.09644109233563]
  We propose the lightweight Spectral-Spatial Fusion Transformer (SSFT), which factorizes representation learning into spectral and spatial pathways.<n>We evaluate our SSFT on the challenging HSI-Benchmark, a heterogeneous multi-dataset benchmark covering earth observation, fruit condition assessment, and fine-grained material recognition.
  arXiv  Detail & Related papers  (2026-04-17T08:31:25Z)
• Generative Modeling of Aerosol State Representations [5.772617906251992]
  Aerosol-cloud-radiation interactions remain among the most uncertain components of the Earth's climate system.<n>We present a framework for learning deep variational autoencoder models of speciated mass and number concentration distributions.<n>By compressing hundreds of original dimensions into ten latent variables, the approach enables efficient storage and processing.
  arXiv  Detail & Related papers  (2025-10-11T22:38:30Z)
• Hyperspectral Adapter for Semantic Segmentation with Vision Foundation Models [18.24287471339871]
  Hyperspectral imaging (HSI) captures spatial information along with dense spectral measurements across numerous narrow wavelength bands.<n>Our architecture incorporates a spectral transformer and a spectrum-aware spatial prior module to extract rich spatial-spectral features.<n>Our architecture achieves state-of-the-art semantic segmentation performance while directly using HSI inputs, outperforming both vision-based and hyperspectral segmentation methods.
  arXiv  Detail & Related papers  (2025-09-24T13:32:07Z)
• Hyperspectral Mamba for Hyperspectral Object Tracking [56.365517163296936]
  A new hyperspectral object tracking network equipped with Mamba (HyMamba) is proposed.<n>It unifies spectral, cross-depth, and temporal modeling through state space modules (SSMs)<n>HyMamba achieves state-of-the-art performance on seven benchmark datasets.
  arXiv  Detail & Related papers  (2025-09-10T03:47:43Z)
• CARL: Camera-Agnostic Representation Learning for Spectral Image Analysis [69.02751635551724]
  Spectral imaging offers promising applications across diverse domains, including medicine and urban scene understanding.<n> variability in channel dimensionality and captured wavelengths among spectral cameras impede the development of AI-driven methodologies.<n>We introduce CARL, a model for Camera-Agnostic Representation Learning across RGB, multispectral, and hyperspectral imaging modalities.
  arXiv  Detail & Related papers  (2025-04-27T13:06:40Z)
• Multispectral to Hyperspectral using Pretrained Foundational model [1.3516162688685323]
  Hyperspectral imaging provides detailed spectral information, offering significant potential for monitoring greenhouse gases like CH4 and NO2.<n>Its application is constrained by limited coverage and infrequent revisit times.<n>In contrast, multispectral imaging delivers spatial and temporal coverage but lacks the spectral granularity required for precise detection.
  arXiv  Detail & Related papers  (2025-02-26T06:18:40Z)
• PolSAM: Polarimetric Scattering Mechanism Informed Segment Anything Model [83.35198885088093]
  PolSAR data presents unique challenges due to its rich and complex characteristics.<n>Existing data representations, such as complex-valued data, polarimetric features, and amplitude images, are widely used.<n>Most feature extraction networks for PolSAR are small, limiting their ability to capture features effectively.<n>We propose the Polarimetric Scattering Mechanism-Informed SAM (PolSAM), an enhanced Segment Anything Model (SAM) that integrates domain-specific scattering characteristics and a novel prompt generation strategy.
  arXiv  Detail & Related papers  (2024-12-17T09:59:53Z)
• HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model [88.13261547704444]
  Hyper SIGMA is a vision transformer-based foundation model that unifies HSI interpretation across tasks and scenes.<n>In addition, we construct a large-scale hyperspectral dataset, HyperGlobal-450K, for pre-training, which contains about 450K hyperspectral images.
  arXiv  Detail & Related papers  (2024-06-17T13:22:58Z)
• Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery [79.69449412334188]
  In this paper, we investigate how to adapt state-of-the-art residual learning based single gray/RGB image super-resolution approaches. We introduce a spatial-spectral prior network (SSPN) to fully exploit the spatial information and the correlation between the spectra of the hyperspectral data. Experimental results on some hyperspectral images demonstrate that the proposed SSPSR method enhances the details of the recovered high-resolution hyperspectral images.
  arXiv  Detail & Related papers  (2020-05-18T14:25:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.