Dual-Stage Approach Toward Hyperspectral Image Super-Resolution
- URL: http://arxiv.org/abs/2204.04387v1
- Date: Sat, 9 Apr 2022 04:36:44 GMT
- Title: Dual-Stage Approach Toward Hyperspectral Image Super-Resolution
- Authors: Qiang Li, Yuan Yuan, Xiuping Jia, and Qi Wang
- Abstract summary: We propose a new structure for hyperspectral image super-resolution (DualSR)
In coarse stage, five bands with high similarity in a certain spectral range are divided into three groups, and the current band is guided to study the potential knowledge.
In fine stage, an enhanced back-projection method via spectral angle constraint is developed to learn the content of spatial-spectral consistency.
- Score: 21.68598210467761
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Hyperspectral image produces high spectral resolution at the sacrifice of
spatial resolution. Without reducing the spectral resolution, improving the
resolution in the spatial domain is a very challenging problem. Motivated by
the discovery that hyperspectral image exhibits high similarity between
adjacent bands in a large spectral range, in this paper, we explore a new
structure for hyperspectral image super-resolution (DualSR), leading to a
dual-stage design, i.e., coarse stage and fine stage. In coarse stage, five
bands with high similarity in a certain spectral range are divided into three
groups, and the current band is guided to study the potential knowledge. Under
the action of alternative spectral fusion mechanism, the coarse SR image is
super-resolved in band-by-band. In order to build model from a global
perspective, an enhanced back-projection method via spectral angle constraint
is developed in fine stage to learn the content of spatial-spectral
consistency, dramatically improving the performance gain. Extensive experiments
demonstrate the effectiveness of the proposed coarse stage and fine stage.
Besides, our network produces state-of-the-art results against existing works
in terms of spatial reconstruction and spectral fidelity.
Related papers
- Correlation Hyperspectral Imaging [0.0]
Hyperspectral imaging aims at providing information on both the spatial and the spectral distribution of light, with high resolution.
We address this limitation by exploiting light intensity correlations, which are shown to enable overcoming the typical downsides of traditional hyperspectral imaging techniques.
The enabled combination of high spatial and spectral resolution, high speed, and insensitivity to undesired spectral features shall lead to a paradigm change in hyperspectral imaging devices.
arXiv Detail & Related papers (2024-07-18T19:54:44Z) - Physics-Inspired Degradation Models for Hyperspectral Image Fusion [61.743696362028246]
Most fusion methods solely focus on the fusion algorithm itself and overlook the degradation models.
We propose physics-inspired degradation models (PIDM) to model the degradation of LR-HSI and HR-MSI.
Our proposed PIDM can boost the fusion performance of existing fusion methods in practical scenarios.
arXiv Detail & Related papers (2024-02-04T09:07:28Z) - Cross-Scope Spatial-Spectral Information Aggregation for Hyperspectral
Image Super-Resolution [47.12985199570964]
We propose a novel cross-scope spatial-spectral Transformer (CST) to investigate long-range spatial and spectral similarities for single hyperspectral image super-resolution.
Specifically, we devise cross-attention mechanisms in spatial and spectral dimensions to comprehensively model the long-range spatial-spectral characteristics.
Experiments over three hyperspectral datasets demonstrate that the proposed CST is superior to other state-of-the-art methods both quantitatively and visually.
arXiv Detail & Related papers (2023-11-29T03:38:56Z) - SSIF: Learning Continuous Image Representation for Spatial-Spectral
Super-Resolution [73.46167948298041]
We propose a neural implicit model that represents an image as a function of both continuous pixel coordinates in the spatial domain and continuous wavelengths in the spectral domain.
We show that SSIF generalizes well to both unseen spatial resolutions and spectral resolutions.
It can generate high-resolution images that improve the performance of downstream tasks by 1.7%-7%.
arXiv Detail & Related papers (2023-09-30T15:23:30Z) - ESSAformer: Efficient Transformer for Hyperspectral Image
Super-resolution [76.7408734079706]
Single hyperspectral image super-resolution (single-HSI-SR) aims to restore a high-resolution hyperspectral image from a low-resolution observation.
We propose ESSAformer, an ESSA attention-embedded Transformer network for single-HSI-SR with an iterative refining structure.
arXiv Detail & Related papers (2023-07-26T07:45:14Z) - High Spectral Spatial Resolution Synthetic HyperSpectral Dataset form
multi-source fusion [7.249349307341409]
This research paper introduces a synthetic hyperspectral dataset that combines high spectral and spatial resolution imaging.
The proposed dataset addresses this limitation by leveraging three modalities: RGB, push-broom visible hyperspectral camera, and snapshot infrared hyperspectral camera.
arXiv Detail & Related papers (2023-06-25T11:17:12Z) - A Latent Encoder Coupled Generative Adversarial Network (LE-GAN) for
Efficient Hyperspectral Image Super-resolution [3.1023808510465627]
generative adversarial network (GAN) has proven to be an effective deep learning framework for image super-resolution.
To alleviate the problem of mode collapse, this work has proposed a novel GAN model coupled with a latent encoder (LE-GAN)
LE-GAN can map the generated spectral-spatial features from the image space to the latent space and produce a coupling component to regularise the generated samples.
arXiv Detail & Related papers (2021-11-16T18:40:19Z) - Spectral Splitting and Aggregation Network for Hyperspectral Face
Super-Resolution [82.59267937569213]
High-resolution (HR) hyperspectral face image plays an important role in face related computer vision tasks under uncontrolled conditions.
In this paper, we investigate how to adapt the deep learning techniques to hyperspectral face image super-resolution.
We present a spectral splitting and aggregation network (SSANet) for HFSR with limited training samples.
arXiv Detail & Related papers (2021-08-31T02:13:00Z) - Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral
Imagery [79.69449412334188]
In this paper, we investigate how to adapt state-of-the-art residual learning based single gray/RGB image super-resolution approaches.
We introduce a spatial-spectral prior network (SSPN) to fully exploit the spatial information and the correlation between the spectra of the hyperspectral data.
Experimental results on some hyperspectral images demonstrate that the proposed SSPSR method enhances the details of the recovered high-resolution hyperspectral images.
arXiv Detail & Related papers (2020-05-18T14:25:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.