Unsupervised Alternating Optimization for Blind Hyperspectral Imagery
Super-resolution
- URL: http://arxiv.org/abs/2012.01745v1
- Date: Thu, 3 Dec 2020 07:52:32 GMT
- Title: Unsupervised Alternating Optimization for Blind Hyperspectral Imagery
Super-resolution
- Authors: Jiangtao Nie, Lei Zhang, Wei Wei, Zhiqiang Lang, Yanning Zhang
- Abstract summary: This paper proposes an unsupervised blind HSI SR method to handle blind HSI fusion problem.
We first propose an alternating optimization based deep framework to estimate the degeneration models and reconstruct the latent image.
Then, a meta-learning based mechanism is further proposed to pre-train the network, which can effectively improve the speed and generalization ability.
- Score: 40.350308926790255
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Despite the great success of deep model on Hyperspectral imagery (HSI)
super-resolution(SR) for simulated data, most of them function unsatisfactory
when applied to the real data, especially for unsupervised HSI SR methods. One
of the main reason comes from the fact that the predefined degeneration models
(e.g. blur in spatial domain) utilized by most HSI SR methods often exist great
discrepancy with the real one, which results in these deep models overfit and
ultimately degrade their performance on real data. To well mitigate such a
problem, we explore the unsupervised blind HSI SR method. Specifically, we
investigate how to effectively obtain the degeneration models in spatial and
spectral domain, respectively, and makes them can well compatible with the
fusion based SR reconstruction model. To this end, we first propose an
alternating optimization based deep framework to estimate the degeneration
models and reconstruct the latent image, with which the degeneration models
estimation and HSI reconstruction can mutually promotes each other. Then, a
meta-learning based mechanism is further proposed to pre-train the network,
which can effectively improve the speed and generalization ability adapting to
different complex degeneration. Experiments on three benchmark HSI SR datasets
report an excellent superiority of the proposed method on handling blind HSI
fusion problem over other competing methods.
Related papers
- Degradation-Guided One-Step Image Super-Resolution with Diffusion Priors [75.24313405671433]
Diffusion-based image super-resolution (SR) methods have achieved remarkable success by leveraging large pre-trained text-to-image diffusion models as priors.
We introduce a novel one-step SR model, which significantly addresses the efficiency issue of diffusion-based SR methods.
Unlike existing fine-tuning strategies, we designed a degradation-guided Low-Rank Adaptation (LoRA) module specifically for SR.
arXiv Detail & Related papers (2024-09-25T16:15:21Z) - Test-time Training for Hyperspectral Image Super-resolution [95.38382633281398]
Hyperspectral image (HSI) super-resolution (SR) is still lagging behind the research of RGB image SR.
In this work, we propose a new test-time training method to tackle this problem.
Specifically, a novel self-training framework is developed, where more accurate pseudo-labels and more accurate LR-HR relationships are generated.
arXiv Detail & Related papers (2024-09-13T09:30:19Z) - DifAugGAN: A Practical Diffusion-style Data Augmentation for GAN-based
Single Image Super-resolution [88.13972071356422]
We propose a diffusion-style data augmentation scheme for GAN-based image super-resolution (SR) methods, known as DifAugGAN.
It involves adapting the diffusion process in generative diffusion models for improving the calibration of the discriminator during training.
Our DifAugGAN can be a Plug-and-Play strategy for current GAN-based SISR methods to improve the calibration of the discriminator and thus improve SR performance.
arXiv Detail & Related papers (2023-11-30T12:37:53Z) - Efficient Test-Time Adaptation for Super-Resolution with Second-Order
Degradation and Reconstruction [62.955327005837475]
Image super-resolution (SR) aims to learn a mapping from low-resolution (LR) to high-resolution (HR) using paired HR-LR training images.
We present an efficient test-time adaptation framework for SR, named SRTTA, which is able to quickly adapt SR models to test domains with different/unknown degradation types.
arXiv Detail & Related papers (2023-10-29T13:58:57Z) - Hyperspectral Benchmark: Bridging the Gap between HSI Applications
through Comprehensive Dataset and Pretraining [11.935879491267634]
Hyperspectral Imaging (HSI) serves as a non-destructive spatial spectroscopy technique with a multitude of potential applications.
A recurring challenge lies in the limited size of the target datasets, impeding exhaustive architecture search.
This study introduces an innovative benchmark dataset encompassing three markedly distinct HSI applications.
arXiv Detail & Related papers (2023-09-20T08:08:34Z) - A comparative analysis of SRGAN models [0.0]
We evaluate the performance of SRGAN (Super Resolution Generative Adversarial Network) models, ESRGAN, Real-ESRGAN and EDSR, on a benchmark dataset of real-world images.
Some models seem to significantly increase the resolution of the input images while preserving their visual quality, this is assessed using Tesseract OCR engine.
arXiv Detail & Related papers (2023-07-18T17:35:45Z) - HDNet: High-resolution Dual-domain Learning for Spectral Compressive
Imaging [138.04956118993934]
We propose a high-resolution dual-domain learning network (HDNet) for HSI reconstruction.
On the one hand, the proposed HR spatial-spectral attention module with its efficient feature fusion provides continuous and fine pixel-level features.
On the other hand, frequency domain learning (FDL) is introduced for HSI reconstruction to narrow the frequency domain discrepancy.
arXiv Detail & Related papers (2022-03-04T06:37:45Z) - Hyperspectral Image Super-resolution with Deep Priors and Degradation
Model Inversion [6.0622962428871885]
Fusion-based hyperspectral image (HSI) super-resolution is attracting increasing attention.
Deep learning architectures have been used to address the HSI super-resolution problem.
We propose a method that makes use of the linear degradation model in the data-fidelity term of the objective function.
arXiv Detail & Related papers (2022-01-24T18:17:40Z) - A Latent Encoder Coupled Generative Adversarial Network (LE-GAN) for
Efficient Hyperspectral Image Super-resolution [3.1023808510465627]
generative adversarial network (GAN) has proven to be an effective deep learning framework for image super-resolution.
To alleviate the problem of mode collapse, this work has proposed a novel GAN model coupled with a latent encoder (LE-GAN)
LE-GAN can map the generated spectral-spatial features from the image space to the latent space and produce a coupling component to regularise the generated samples.
arXiv Detail & Related papers (2021-11-16T18:40:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.