HIDFlowNet: A Flow-Based Deep Network for Hyperspectral Image Denoising
- URL: http://arxiv.org/abs/2306.17797v1
- Date: Tue, 20 Jun 2023 08:20:28 GMT
- Title: HIDFlowNet: A Flow-Based Deep Network for Hyperspectral Image Denoising
- Authors: Li Pang, Weizhen Gu, Xiangyong Cao, Xiangyu Rui, Jiangjun Peng, Shuang
Xu, Gang Yang, Deyu Meng
- Abstract summary: Hyperspectral image (HSI) denoising is essentially ill-posed since a noisy HSI can be degraded from multiple clean HSIs.
This paper proposes a flow-based HSI denoising network (HIDFlowNet) to learn the conditional distribution of the clean HSI.
- Score: 44.13660701641694
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Hyperspectral image (HSI) denoising is essentially ill-posed since a noisy
HSI can be degraded from multiple clean HSIs. However, current deep
learning-based approaches ignore this fact and restore the clean image with
deterministic mapping (i.e., the network receives a noisy HSI and outputs a
clean HSI). To alleviate this issue, this paper proposes a flow-based HSI
denoising network (HIDFlowNet) to directly learn the conditional distribution
of the clean HSI given the noisy HSI and thus diverse clean HSIs can be sampled
from the conditional distribution. Overall, our HIDFlowNet is induced from the
flow methodology and contains an invertible decoder and a conditional encoder,
which can fully decouple the learning of low-frequency and high-frequency
information of HSI. Specifically, the invertible decoder is built by staking a
succession of invertible conditional blocks (ICBs) to capture the local
high-frequency details since the invertible network is information-lossless.
The conditional encoder utilizes down-sampling operations to obtain
low-resolution images and uses transformers to capture correlations over a long
distance so that global low-frequency information can be effectively extracted.
Extensive experimental results on simulated and real HSI datasets verify the
superiority of our proposed HIDFlowNet compared with other state-of-the-art
methods both quantitatively and visually.
Related papers
- Diffusion-Aided Joint Source Channel Coding For High Realism Wireless Image Transmission [24.372996233209854]
DiffJSCC is a novel framework that produces high-realism images via the conditional diffusion denoising process.
It can achieve highly realistic reconstructions for 768x512 pixel Kodak images with only 3072 symbols.
arXiv Detail & Related papers (2024-04-27T00:12:13Z) - Hybrid Convolutional and Attention Network for Hyperspectral Image Denoising [54.110544509099526]
Hyperspectral image (HSI) denoising is critical for the effective analysis and interpretation of hyperspectral data.
We propose a hybrid convolution and attention network (HCANet) to enhance HSI denoising.
Experimental results on mainstream HSI datasets demonstrate the rationality and effectiveness of the proposed HCANet.
arXiv Detail & Related papers (2024-03-15T07:18:43Z) - HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved
Diffusion Models [38.74983301496911]
Hyperspectral image (HSI) restoration aims at recovering clean images from degraded observations.
Existing model-based methods have limitations in accurately modeling the complex image characteristics.
This paper proposes an unsupervised HSI restoration framework with pre-trained diffusion model (HIR-Diff)
arXiv Detail & Related papers (2024-02-24T17:15:05Z) - Hyperspectral Image Denoising via Self-Modulating Convolutional Neural
Networks [15.700048595212051]
We introduce a self-modulating convolutional neural network which utilizes correlated spectral and spatial information.
At the core of the model lies a novel block, which allows the network to transform the features in an adaptive manner based on the adjacent spectral data.
Experimental analysis on both synthetic and real data shows that the proposed SM-CNN outperforms other state-of-the-art HSI denoising methods.
arXiv Detail & Related papers (2023-09-15T06:57:43Z) - Degradation-Noise-Aware Deep Unfolding Transformer for Hyperspectral
Image Denoising [9.119226249676501]
Hyperspectral images (HSIs) are often quite noisy because of narrow band spectral filtering.
To reduce the noise in HSI data cubes, both model-driven and learning-based denoising algorithms have been proposed.
This paper proposes a Degradation-Noise-Aware Unfolding Network (DNA-Net) that addresses these issues.
arXiv Detail & Related papers (2023-05-06T13:28:20Z) - Multi-stage image denoising with the wavelet transform [125.2251438120701]
Deep convolutional neural networks (CNNs) are used for image denoising via automatically mining accurate structure information.
We propose a multi-stage image denoising CNN with the wavelet transform (MWDCNN) via three stages, i.e., a dynamic convolutional block (DCB), two cascaded wavelet transform and enhancement blocks (WEBs) and residual block (RB)
arXiv Detail & Related papers (2022-09-26T03:28:23Z) - Low-Light Hyperspectral Image Enhancement [90.84144276935464]
This work focuses on the low-light HSI enhancement task, which aims to reveal the spatial-spectral information hidden in darkened areas.
Based on Laplacian pyramid decomposition and reconstruction, we developed an end-to-end data-driven low-light HSI enhancement (HSIE) approach.
The effectiveness and efficiency of HSIE both in quantitative assessment measures and visual effects are demonstrated.
arXiv Detail & Related papers (2022-08-05T08:45:52Z) - CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image
Denoising by Disentangling Noise from Image [53.76319163746699]
We propose a novel and powerful self-supervised denoising method called CVF-SID.
CVF-SID can disentangle a clean image and noise maps from the input by leveraging various self-supervised loss terms.
It achieves state-of-the-art self-supervised image denoising performance and is comparable to other existing approaches.
arXiv Detail & Related papers (2022-03-24T11:59:28Z) - ADRN: Attention-based Deep Residual Network for Hyperspectral Image
Denoising [52.01041506447195]
We propose an attention-based deep residual network to learn a mapping from noisy HSI to the clean one.
Experimental results demonstrate that our proposed ADRN scheme outperforms the state-of-the-art methods both in quantitative and visual evaluations.
arXiv Detail & Related papers (2020-03-04T08:36:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.