Self-supervised Deep Hyperspectral Inpainting with the Sparsity and Low-Rank Considerations

• URL: http://arxiv.org/abs/2306.08128v1
• Date: Tue, 13 Jun 2023 20:49:02 GMT
• Title: Self-supervised Deep Hyperspectral Inpainting with the Sparsity and Low-Rank Considerations
• Authors: Shuo Li, Mehrdad Yaghoobi
• Abstract summary: Hyperspectral images can be affected by various sources of noise, distortions, or data losses. We introduce two novel self-supervised Images (HSI) in Hyperpainting algorithms. We conduct the stability analysis under some mild assumptions which guarantees the algorithm to converge.
• Score: 7.777433987363129
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Hyperspectral images are typically composed of hundreds of narrow and contiguous spectral bands, each containing information about the material composition of the imaged scene. However, these images can be affected by various sources of noise, distortions, or data losses, which can significantly degrade their quality and usefulness. To address these problems, we introduce two novel self-supervised Hyperspectral Images (HSI) inpainting algorithms: Low Rank and Sparsity Constraint Plug-and-Play (LRS-PnP), and its extension LRS-PnP-DIP, which features the strong learning capability, but is still free of external training data. We conduct the stability analysis under some mild assumptions which guarantees the algorithm to converge. It is specifically very helpful for the practical applications. Extensive experiments demonstrate that the proposed solution is able to produce visually and qualitatively superior inpainting results, achieving state-of-the-art performance. The code for reproducing the results is available at \url{https://github.com/shuoli0708/LRS-PnP-DIP}.

Related papers

• Self-supervised Deep Hyperspectral Inpainting with the Plug and Play and Deep Image Prior Models [6.8557067473167415]
  Hyperspectral images are typically composed of hundreds of narrow and contiguous spectral bands, each containing information regarding the composition of the imaged scene. These images can be affected by various sources of noise, distortions data, or material loss, which can significantly degrade their quality and usefulness. This paper introduces a converge a guaranteed algorithm, LRS-nt-DIP, which successfully addresses the instability issue of DHP.
  arXiv  Detail & Related papers  (2025-01-14T15:18:28Z)
• Hipandas: Hyperspectral Image Joint Denoising and Super-Resolution by Image Fusion with the Panchromatic Image [51.333064033152304]
  Recently launched satellites can concurrently acquire HSIs and panchromatic (PAN) images. Hipandas is a novel learning paradigm that reconstructs HRHS images from noisy low-resolution HSIs and high-resolution PAN images.
  arXiv  Detail & Related papers  (2024-12-05T14:39:29Z)
• Multi-Scale Texture Loss for CT denoising with GANs [0.9349653765341301]
  We present a novel approach to capture and embed multi-scale texture information into the loss function. Our method introduces a differentiable multi-scale texture representation of the images dynamically aggregated by a self-attention layer. We validate our approach by carrying out extensive experiments in the context of low-dose CT denoising.
  arXiv  Detail & Related papers  (2024-03-25T11:28:52Z)
• Self-Supervised Hyperspectral Inpainting with the Optimisation inspired Deep Neural Network Prior [7.777433987363129]
  We introduce a novel HSI missing pixel prediction algorithm, called Low Rank Spars Constraint Plug-and-Play (LRS-DIP) LRS-DIP is able to predict missing pixels and even when spectral bands are missing.
  arXiv  Detail & Related papers  (2023-06-12T13:48:37Z)
• Combining Attention Module and Pixel Shuffle for License Plate Super-Resolution [3.8831062015253055]
  This work focuses on license plate (LP) reconstruction in low-resolution and low-quality images. We present a Single-Image Super-Resolution (SISR) approach that extends the attention/transformer module concept. In our experiments, the proposed method outperformed the baselines both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2022-10-30T13:05:07Z)
• Blind Super-Resolution for Remote Sensing Images via Conditional Stochastic Normalizing Flows [14.882417028542855]
  We propose a novel blind SR framework based on the normalizing flow (BlindSRSNF) to address the above problems. BlindSRSNF learns the conditional probability distribution over the high-resolution image space given a low-resolution (LR) image by explicitly optimizing the variational bound on the likelihood. We show that the proposed algorithm can obtain SR results with excellent visual perception quality on both simulated LR and real-world RSIs.
  arXiv  Detail & Related papers  (2022-10-14T12:37:32Z)
• Rank-Enhanced Low-Dimensional Convolution Set for Hyperspectral Image Denoising [50.039949798156826]
  This paper tackles the challenging problem of hyperspectral (HS) image denoising. We propose rank-enhanced low-dimensional convolution set (Re-ConvSet) We then incorporate Re-ConvSet into the widely-used U-Net architecture to construct an HS image denoising method.
  arXiv  Detail & Related papers  (2022-07-09T13:35:12Z)
• Hierarchical Similarity Learning for Aliasing Suppression Image Super-Resolution [64.15915577164894]
  A hierarchical image super-resolution network (HSRNet) is proposed to suppress the influence of aliasing. HSRNet achieves better quantitative and visual performance than other works, and remits the aliasing more effectively.
  arXiv  Detail & Related papers  (2022-06-07T14:55:32Z)
• Real-World Image Super-Resolution by Exclusionary Dual-Learning [98.36096041099906]
  Real-world image super-resolution is a practical image restoration problem that aims to obtain high-quality images from in-the-wild input. Deep learning-based methods have achieved promising restoration quality on real-world image super-resolution datasets. We propose Real-World image Super-Resolution by Exclusionary Dual-Learning (RWSR-EDL) to address the feature diversity in perceptual- and L1-based cooperative learning.
  arXiv  Detail & Related papers  (2022-06-06T13:28:15Z)
• Hyperspectral Image Super-resolution via Deep Progressive Zero-centric Residual Learning [62.52242684874278]
  Cross-modality distribution of spatial and spectral information makes the problem challenging. We propose a novel textitlightweight deep neural network-based framework, namely PZRes-Net. Our framework learns a high resolution and textitzero-centric residual image, which contains high-frequency spatial details of the scene.
  arXiv  Detail & Related papers  (2020-06-18T06:32:11Z)
• The Power of Triply Complementary Priors for Image Compressive Sensing [89.14144796591685]
  We propose a joint low-rank deep (LRD) image model, which contains a pair of complementaryly trip priors. We then propose a novel hybrid plug-and-play framework based on the LRD model for image CS. To make the optimization tractable, a simple yet effective algorithm is proposed to solve the proposed H-based image CS problem.
  arXiv  Detail & Related papers  (2020-05-16T08:17:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.