Learning Spectral Diffusion Prior for Hyperspectral Image Reconstruction

• URL: http://arxiv.org/abs/2507.13769v1
• Date: Fri, 18 Jul 2025 09:27:11 GMT
• Title: Learning Spectral Diffusion Prior for Hyperspectral Image Reconstruction
• Authors: Mingyang Yu, Zhijian Wu, Dingjiang Huang,
• Abstract summary: Hyperspectral image (HSI) aims to recover 3D HSI from its degraded 2D measurements.<n>Deep learning-based methods often struggle to accurately capture high-frequency details of the HSI.<n>This paper proposes a Spectral Diffusion Prior (SDP) that is implicitly learned from hyperspectral images using a diffusion model.
• Score: 1.8043904095267116
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Hyperspectral image (HSI) reconstruction aims to recover 3D HSI from its degraded 2D measurements. Recently great progress has been made in deep learning-based methods, however, these methods often struggle to accurately capture high-frequency details of the HSI. To address this issue, this paper proposes a Spectral Diffusion Prior (SDP) that is implicitly learned from hyperspectral images using a diffusion model. Leveraging the powerful ability of the diffusion model to reconstruct details, this learned prior can significantly improve the performance when injected into the HSI model. To further improve the effectiveness of the learned prior, we also propose the Spectral Prior Injector Module (SPIM) to dynamically guide the model to recover the HSI details. We evaluate our method on two representative HSI methods: MST and BISRNet. Experimental results show that our method outperforms existing networks by about 0.5 dB, effectively improving the performance of HSI reconstruction.

Related papers

• One-Step Diffusion-based Real-World Image Super-Resolution with Visual Perception Distillation [53.24542646616045]
  We propose VPD-SR, a novel visual perception diffusion distillation framework specifically designed for image super-resolution (SR) generation.<n>VPD-SR consists of two components: Explicit Semantic-aware Supervision (ESS) and High-frequency Perception (HFP) loss.<n>The proposed VPD-SR achieves superior performance compared to both previous state-of-the-art methods and the teacher model with just one-step sampling.
  arXiv  Detail & Related papers  (2025-06-03T08:28:13Z)
• Rethinking the Upsampling Layer in Hyperspectral Image Super Resolution [51.98465973507002]
  We propose a novel lightweight SHSR network, i.e., LKCA-Net, that incorporates channel attention to calibrate multi-scale channel features of hyperspectral images.<n>We demonstrate, for the first time, that the low-rank property of the learnable upsampling layer is a key bottleneck in lightweight SHSR methods.
  arXiv  Detail & Related papers  (2025-01-30T15:43:34Z)
• HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models [38.74983301496911]
  Hyperspectral image (HSI) restoration aims at recovering clean images from degraded observations. Existing model-based methods have limitations in accurately modeling the complex image characteristics. This paper proposes an unsupervised HSI restoration framework with pre-trained diffusion model (HIR-Diff)
  arXiv  Detail & Related papers  (2024-02-24T17:15:05Z)
• DiffSCI: Zero-Shot Snapshot Compressive Imaging via Iterative Spectral Diffusion Model [18.25548360119976]
  This paper endeavors to advance the precision of snapshot compressive imaging (SCI) reconstruction for multispectral image (MSI) We propose a novel structured zero-shot diffusion model, dubbed DiffSCI. We present extensive testing to show that DiffSCI exhibits discernible performance enhancements over prevailing self-supervised and zero-shot approaches.
  arXiv  Detail & Related papers  (2023-11-19T20:27:14Z)
• DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restoration [103.79030498369319]
  Self-supervised diffusion model for hyperspectral image restoration is proposed. textttDDS2M enjoys stronger ability to generalization compared to existing diffusion-based methods. Experiments on HSI denoising, noisy HSI completion and super-resolution on a variety of HSIs demonstrate textttDDS2M's superiority over the existing task-specific state-of-the-arts.
  arXiv  Detail & Related papers  (2023-03-12T14:57:04Z)
• HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging [138.04956118993934]
  We propose a high-resolution dual-domain learning network (HDNet) for HSI reconstruction. On the one hand, the proposed HR spatial-spectral attention module with its efficient feature fusion provides continuous and fine pixel-level features. On the other hand, frequency domain learning (FDL) is introduced for HSI reconstruction to narrow the frequency domain discrepancy.
  arXiv  Detail & Related papers  (2022-03-04T06:37:45Z)
• Hyperspectral Pansharpening Based on Improved Deep Image Prior and Residual Reconstruction [64.10636296274168]
  Hyperspectral pansharpening aims to synthesize a low-resolution hyperspectral image (LR-HSI) with a registered panchromatic image (PAN) to generate an enhanced HSI with high spectral and spatial resolution. Recently proposed HS pansharpening methods have obtained remarkable results using deep convolutional networks (ConvNets) We propose a novel over-complete network, called HyperKite, which focuses on learning high-level features by constraining the receptive from increasing in the deep layers.
  arXiv  Detail & Related papers  (2021-07-06T14:11:03Z)
• Deep Gaussian Scale Mixture Prior for Spectral Compressive Imaging [48.34565372026196]
  We propose a novel HSI reconstruction method based on the a Posterior (MAP) estimation framework. We also propose to estimate the local means of the GSM models by the deep convolutional neural network (DCNN)
  arXiv  Detail & Related papers  (2021-03-12T08:57:06Z)
• Snapshot Hyperspectral Imaging Based on Weighted High-order Singular Value Regularization [22.5033027930853]
  Snapshot hyperspectral imaging can capture the 3D hyperspectral image (HSI) with a single 2D measurement. Existing reconstruction methods cannot fully exploit the structurally spectral-spatial nature in 3D HSI. We propose an effective high-order tensor optimization based method to boost the reconstruction fidelity for snapshot hyperspectral imaging.
  arXiv  Detail & Related papers  (2021-01-22T02:54:55Z)
• Unsupervised Alternating Optimization for Blind Hyperspectral Imagery Super-resolution [40.350308926790255]
  This paper proposes an unsupervised blind HSI SR method to handle blind HSI fusion problem. We first propose an alternating optimization based deep framework to estimate the degeneration models and reconstruct the latent image. Then, a meta-learning based mechanism is further proposed to pre-train the network, which can effectively improve the speed and generalization ability.
  arXiv  Detail & Related papers  (2020-12-03T07:52:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.