Blind deblurring of hyperspectral document images

• URL: http://arxiv.org/abs/2303.05130v1
• Date: Thu, 9 Mar 2023 09:31:13 GMT
• Title: Blind deblurring of hyperspectral document images
• Authors: M. Ljubenovic, P. Guzzonato, G. Franceschin, A. Traviglia
• Abstract summary: Multispectral (MS) and hyperspectral (HS) images contain much richer spectral information than RGB images. We propose novel blind HS image deblurring methods tailored to document images.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Most computer vision and machine learning-based approaches for historical document analysis are tailored to grayscale or RGB images and thus, mostly exploit their spatial information. Multispectral (MS) and hyperspectral (HS) images contain, next to the spatial information, much richer spectral information than RGB images (usually spreading beyond the visible spectral range) that can facilitate more effective feature extraction, more accurate classification and recognition, and thus, improved analysis. Although utilization of rich spectral information can improve historical document analysis tremendously, there are still some potential limitations of HS imagery such as camera-induced noise and blur that require a carefully designed preprocessing step. Here, we propose novel blind HS image deblurring methods tailored to document images. We exploit a low-rank property of HS images (i.e., by projecting an HS image to a lower dimensional subspace) and utilize a text tailor image prior to performing a PSF estimation and deblurring of subspace components. The preliminary results show that the proposed approach gives good results over all spectral bands, removing successfully image artefacts introduced by blur and noise and significantly increasing the number of bands that can be used in further analysis.

Related papers

• HyperColorization: Propagating spatially sparse noisy spectral clues for reconstructing hyperspectral images [2.7214317850962106]
  We present a colorization to reconstruct hyperspectral images from a grayscale guide image and spatially sparse spectral clues. Our algorithm generalizes to varying spectral dimensions for hyperspectral images, and show that colorizing in a low-rank space reduces compute time and the impact of shot noise.
  arXiv  Detail & Related papers  (2024-03-18T16:33:43Z)
• A Survey of Graph and Attention Based Hyperspectral Image Classification Methods for Remote Sensing Data [5.1901440366375855]
  The use of Deep Learning techniques for classification in Hyperspectral Imaging (HSI) is rapidly growing. Recent methods have also explored the usage of Graph Convolution Networks and their unique ability to use node features in prediction.
  arXiv  Detail & Related papers  (2023-10-16T00:42:25Z)
• Object Detection in Hyperspectral Image via Unified Spectral-Spatial Feature Aggregation [55.9217962930169]
  We present S2ADet, an object detector that harnesses the rich spectral and spatial complementary information inherent in hyperspectral images. S2ADet surpasses existing state-of-the-art methods, achieving robust and reliable results.
  arXiv  Detail & Related papers  (2023-06-14T09:01:50Z)
• Rank-Enhanced Low-Dimensional Convolution Set for Hyperspectral Image Denoising [50.039949798156826]
  This paper tackles the challenging problem of hyperspectral (HS) image denoising. We propose rank-enhanced low-dimensional convolution set (Re-ConvSet) We then incorporate Re-ConvSet into the widely-used U-Net architecture to construct an HS image denoising method.
  arXiv  Detail & Related papers  (2022-07-09T13:35:12Z)
• Multiscale Analysis for Improving Texture Classification [62.226224120400026]
  This paper employs the Gaussian-Laplacian pyramid to treat different spatial frequency bands of a texture separately. We aggregate features extracted from gray and color texture images using bio-inspired texture descriptors, information-theoretic measures, gray-level co-occurrence matrix features, and Haralick statistical features into a single feature vector.
  arXiv  Detail & Related papers  (2022-04-21T01:32:22Z)
• Semantic-embedded Unsupervised Spectral Reconstruction from Single RGB Images in the Wild [48.44194221801609]
  We propose a new lightweight and end-to-end learning-based framework to tackle this challenge. We progressively spread the differences between input RGB images and re-projected RGB images from recovered HS images via effective camera spectral response function estimation. Our method significantly outperforms state-of-the-art unsupervised methods and even exceeds the latest supervised method under some settings.
  arXiv  Detail & Related papers  (2021-08-15T05:19:44Z)
• Hyperspectral Pansharpening Based on Improved Deep Image Prior and Residual Reconstruction [64.10636296274168]
  Hyperspectral pansharpening aims to synthesize a low-resolution hyperspectral image (LR-HSI) with a registered panchromatic image (PAN) to generate an enhanced HSI with high spectral and spatial resolution. Recently proposed HS pansharpening methods have obtained remarkable results using deep convolutional networks (ConvNets) We propose a novel over-complete network, called HyperKite, which focuses on learning high-level features by constraining the receptive from increasing in the deep layers.
  arXiv  Detail & Related papers  (2021-07-06T14:11:03Z)
• Learnable Reconstruction Methods from RGB Images to Hyperspectral Imaging: A Survey [27.235897806207706]
  Many alternative spectral imaging methods have been proposed by directly reconstructing the hyperspectral information from lower-cost, more available RGB images. We present a thorough investigation of these state-of-the-art spectral reconstruction methods from the widespread RGB images. Most of the data-driven deep learning methods are superior to prior-based methods in terms of reconstruction accuracy and quality despite lower speeds.
  arXiv  Detail & Related papers  (2021-06-30T09:52:41Z)
• Learning to Enhance Visual Quality via Hyperspectral Domain Mapping [8.365634649800658]
  SpecNet computes spectral profile to estimate pixel-wise dynamic range adjustment of a given image. We incorporate a self-supervision and a spectral profile regularization network to infer a plausible HSI from an RGB image.
  arXiv  Detail & Related papers  (2021-02-10T13:27:34Z)
• Spectral Superresolution of Multispectral Imagery with Joint Sparse and Low-Rank Learning [29.834065415830764]
  spectral superresolution (SSR) of MS imagery is challenging and less investigated due to its high ill-posedness in inverse imaging. We develop a simple but effective method, called joint sparse and low-rank learning (J-SLoL), to spectrally enhance MS images by jointly learning low-rank HS-MS dictionary pairs from overlapped regions.
  arXiv  Detail & Related papers  (2020-07-28T06:08:44Z)
• Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery [79.69449412334188]
  In this paper, we investigate how to adapt state-of-the-art residual learning based single gray/RGB image super-resolution approaches. We introduce a spatial-spectral prior network (SSPN) to fully exploit the spatial information and the correlation between the spectra of the hyperspectral data. Experimental results on some hyperspectral images demonstrate that the proposed SSPSR method enhances the details of the recovered high-resolution hyperspectral images.
  arXiv  Detail & Related papers  (2020-05-18T14:25:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.