USP-Mamba: Unmixing-Derived Spectral and Structural Prompting for Hyperspectral Image Super-Resolution
- URL: http://arxiv.org/abs/2608.02401v1
- Date: Mon, 03 Aug 2026 15:47:20 GMT
- Title: USP-Mamba: Unmixing-Derived Spectral and Structural Prompting for Hyperspectral Image Super-Resolution
- Abstract summary: We propose an Unmixing-derived Spectral and Structural Prompting Mamba framework, termed USP-Mamba.<n> USP-Mamba adapts Mamba state evolution through composition-aware spectral priors and image-dependent structural prompts.<n>Experiments on different datasets demonstrate that the proposed method consistently outperforms representative approaches.
- Score: 43.685895242899704
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Hyperspectral image super-resolution aims to reconstruct high-resolution imagery while preserving dense spectral information. Recently, Mamba-based models have shown promising potential for this task by capturing long-range dependencies with linear computational complexity. Nevertheless, their causal sequence modeling requires two-dimensional hyperspectral features to be unfolded along predefined scanning orders, which disrupts spatial adjacency and restricts the effective propagation of contextual information. Moreover, state-space parameterization of existing models is predominantly derived from generic learned representations, without explicit alignment with the intrinsic characteristics of the hyperspectral image. To address this issue, we propose an Unmixing-derived Spectral and Structural Prompting Mamba framework, termed USP-Mamba, which adapts Mamba state evolution through composition-aware spectral priors and image-dependent structural prompts. Specifically, an unmixing-informed spectral prompt captures the global material composition of the input image and provides persistent conditioning throughout reconstruction. Injected into the Mamba sequence and progressively adapted across layers, it steers state evolution toward composition-consistent reconstruction. We introduce feature-level structural prompts comprising spatial and frequency components to provide image-dependent local guidance. The spatial prompt promotes structure-sensitive state encoding for local detail preservation, while the frequency prompt enables region-adaptive transitions between homogeneous regions and high-frequency details. Finally, complementary Hilbert and Semantic-Guided Neighboring scans preserve spatial continuity and strengthen non-local semantic dependency modeling. Extensive experiments on different datasets demonstrate that the proposed method consistently outperforms representative approaches.
Related papers
- Dual-Domain Manifold Modeling for Hyperspectral Image Fusion [27.323225283223817]
We propose a dual-domain manifold modeling framework for hyperspectral image fusion.<n>We show that DDMM achieves superior overall performance over SoTA methods in terms of spatial structure preservation and spectral reconstruction.
arXiv Detail & Related papers (2026-07-28T06:40:36Z) - CLUIE: Clustering-Aware Recurrent Propagation with Local Structural Compensation for Underwater Image Enhancement [92.78545064386485]
Underwater image enhancement remains challenging due to wavelength-dependent light absorption, scattering, and backscattering.<n>We propose a Clustering-aware RWKV framework, which reformulates the fixed recurrent propagation path of conventional RWKV into a content-adaptive token trajectory.<n>Experiments on multiple underwater image enhancement benchmarks demonstrate that CRWKV achieves state-of-the-art quantitative performance and superior visual quality.
arXiv Detail & Related papers (2026-07-23T16:09:36Z) - SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolution [99.56535031145211]
State space models (SSMs) have emerged as a powerful paradigm for efficient single-image super-resolution (SR)<n>We propose textbfSP-MoMamba, a superpixel-driven mixture of state space experts for content-aware SR.<n>Our core idea is to transform the traditional rigid scanning into a textbfsemantic-level interaction by treating superpixels as fundamental units.
arXiv Detail & Related papers (2026-05-25T14:19:59Z) - Layout-Guided Controllable Pathology Image Generation with In-Context Diffusion Transformers [57.54843029965778]
Controllable pathology image synthesis requires reliable regulation of spatial layout, tissue morphology, and semantic detail.<n>We propose In-Context Diffusion Transformer (IC-DiT), a layout-aware generative model that incorporates spatial layouts, textual descriptions, and visual embeddings into a unified diffusion transformer.<n>IC-DiT achieves higher fidelity, stronger spatial controllability, and better diagnostic consistency than existing methods.
arXiv Detail & Related papers (2026-03-11T06:14:11Z) - Universal Pansharpening Foundation Model [67.10467574892282]
Pansharpening generates the high-resolution multi-spectral (MS) image by integrating spatial details from a texture-rich panchromatic (PAN) image and spectral attributes from a low-resolution MS image.<n>We present FoundPS, a universal pansharpening foundation model for satellite-agnostic and scene-robust fusion.
arXiv Detail & Related papers (2026-03-04T08:30:15Z) - SpectralMamba-UNet: Frequency-Disentangled State Space Modeling for Texture-Structure Consistent Medical Image Segmentation [14.42559964239819]
We propose SpectralMamba-UNet to decouple the learning of structural and textural information in the spectral domain.<n> Experiments on five public benchmarks demonstrate consistent improvements across diverse modalities and segmentation targets.
arXiv Detail & Related papers (2026-02-26T15:17:42Z) - Mixed-granularity Implicit Representation for Continuous Hyperspectral Compressive Reconstruction [16.975538181162616]
This study introduces a novel method using implicit neural representation for continuous hyperspectral image reconstruction.<n>By leveraging implicit neural representations, the MGIR framework enables reconstruction at any desired spatial-spectral resolution.
arXiv Detail & Related papers (2025-03-17T03:37:42Z) - HSRMamba: Contextual Spatial-Spectral State Space Model for Single Image Hyperspectral Super-Resolution [41.93421212397078]
Mamba has demonstrated exceptional performance in visual tasks due to its powerful global modeling capabilities and linear computational complexity.<n>HSRMamba is a contextual spatial-spectral modeling state space model for hyperspectral image super-resolution (HSISR)
arXiv Detail & Related papers (2025-01-30T17:10:53Z) - Unleashing Correlation and Continuity for Hyperspectral Reconstruction from RGB Images [64.80875911446937]
We propose a Correlation and Continuity Network (CCNet) for HSI reconstruction from RGB images.<n>For the correlation of local spectrum, we introduce the Group-wise Spectral Correlation Modeling (GrSCM) module.<n>For the continuity of global spectrum, we design the Neighborhood-wise Spectral Continuity Modeling (NeSCM) module.
arXiv Detail & Related papers (2025-01-02T15:14:40Z) - OSMamba: Omnidirectional Spectral Mamba with Dual-Domain Prior Generator for Exposure Correction [15.884868711123993]
We propose Omnidirectional Spectral Mamba (OSMamba), a novel exposure correction network.<n>OSMamba introduces an omnidirectional spectral scanning mechanism that adapts Mamba to the frequency domain.<n>We develop a dual-domain prior generator that learns from well-exposed images to generate a degradation-free diffusion prior.
arXiv Detail & Related papers (2024-11-22T08:54:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.