Equivariant Imaging for Self-supervised Hyperspectral Image Inpainting

• URL: http://arxiv.org/abs/2404.13159v1
• Date: Fri, 19 Apr 2024 19:55:15 GMT
• Title: Equivariant Imaging for Self-supervised Hyperspectral Image Inpainting
• Authors: Shuo Li, Mike Davies, Mehrdad Yaghoobi,
• Abstract summary: We introduce a novel HSI inpainting algorithm called Hyperspectral Equivariant Imaging (Hyper-EI) Results show that the proposed method achieves state-of-the-art inpainting performance compared to the existing methods.
• Score: 6.099927091387616
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Hyperspectral imaging (HSI) is a key technology for earth observation, surveillance, medical imaging and diagnostics, astronomy and space exploration. The conventional technology for HSI in remote sensing applications is based on the push-broom scanning approach in which the camera records the spectral image of a stripe of the scene at a time, while the image is generated by the aggregation of measurements through time. In real-world airborne and spaceborne HSI instruments, some empty stripes would appear at certain locations, because platforms do not always maintain a constant programmed attitude, or have access to accurate digital elevation maps (DEM), and the travelling track is not necessarily aligned with the hyperspectral cameras at all times. This makes the enhancement of the acquired HS images from incomplete or corrupted observations an essential task. We introduce a novel HSI inpainting algorithm here, called Hyperspectral Equivariant Imaging (Hyper-EI). Hyper-EI is a self-supervised learning-based method which does not require training on extensive datasets or access to a pre-trained model. Experimental results show that the proposed method achieves state-of-the-art inpainting performance compared to the existing methods.

Related papers

• GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning [50.7702397913573]
  The rapid advancement of photorealistic generators has reached a critical juncture where the discrepancy between authentic and manipulated images is increasingly indistinguishable. Although there have been a number of publicly available face forgery datasets, the forgery faces are mostly generated using GAN-based synthesis technology. We propose a large-scale, diverse, and fine-grained high-fidelity dataset, namely GenFace, to facilitate the advancement of deepfake detection.
  arXiv  Detail & Related papers  (2024-02-03T03:13:50Z)
• A Survey of Graph and Attention Based Hyperspectral Image Classification Methods for Remote Sensing Data [5.1901440366375855]
  The use of Deep Learning techniques for classification in Hyperspectral Imaging (HSI) is rapidly growing. Recent methods have also explored the usage of Graph Convolution Networks and their unique ability to use node features in prediction.
  arXiv  Detail & Related papers  (2023-10-16T00:42:25Z)
• Object Detection in Hyperspectral Image via Unified Spectral-Spatial Feature Aggregation [55.9217962930169]
  We present S2ADet, an object detector that harnesses the rich spectral and spatial complementary information inherent in hyperspectral images. S2ADet surpasses existing state-of-the-art methods, achieving robust and reliable results.
  arXiv  Detail & Related papers  (2023-06-14T09:01:50Z)
• A Vision Transformer Approach for Efficient Near-Field Irregular SAR Super-Resolution [0.0]
  We introduce a mobile-friend vision transformer (ViT) architecture to address position estimation error and perform SAR image super-resolution (SR) under irregular sampling geometries. The proposed algorithm, Mobile-SRViT, is the first to employ a ViT approach for SAR image enhancement and is validated in simulation and via empirical studies.
  arXiv  Detail & Related papers  (2023-05-03T12:25:01Z)
• Hyperspectral Image Segmentation: A Preliminary Study on the Oral and Dental Spectral Image Database (ODSI-DB) [3.1993890965689666]
  Hyperspectral imaging (HSI) is a promising technology providing rich spectral information. Recent development of snapshot HSI cameras has made real-time clinical HSI a distinct possibility. Our work highlights the relative importance of spectral resolution, spectral range, and spatial information to both guide the development of HSI cameras and inform future clinical HSI applications.
  arXiv  Detail & Related papers  (2023-03-14T21:57:11Z)
• Blind deblurring of hyperspectral document images [0.0]
  Multispectral (MS) and hyperspectral (HS) images contain much richer spectral information than RGB images. We propose novel blind HS image deblurring methods tailored to document images.
  arXiv  Detail & Related papers  (2023-03-09T09:31:13Z)
• Real-time Hyperspectral Imaging in Hardware via Trained Metasurface Encoders [55.16861072631285]
  Hyperspectral imaging has attracted significant attention to identify spectral signatures for image classification and automated pattern recognition in computer vision. This work introduces Hyplex, a new integrated architecture addressing the limitations discussed above. Hyplex is a CMOS-compatible, fast hyperspectral camera that replaces bulk optics with nanoscale metasurfaces inversely designed through artificial intelligence.
  arXiv  Detail & Related papers  (2022-04-05T09:52:51Z)
• Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction [127.20208645280438]
  Hyperspectral image (HSI) reconstruction aims to recover the 3D spatial-spectral signal from a 2D measurement. Modeling the inter-spectra interactions is beneficial for HSI reconstruction. Mask-guided Spectral-wise Transformer (MST) proposes a novel framework for HSI reconstruction.
  arXiv  Detail & Related papers  (2021-11-15T16:59:48Z)
• End to end hyperspectral imaging system with coded compression imaging process [13.00211539170695]
  We present a physics-informed self-supervising CNN method based on a coded aperture spectral imaging system. Our method effectively exploits the spatial-spectral relativization from the coded spectral information and forms a self-supervising system based on the camera quantum effect model.
  arXiv  Detail & Related papers  (2021-09-06T13:39:54Z)
• Hyperspectral Pansharpening Based on Improved Deep Image Prior and Residual Reconstruction [64.10636296274168]
  Hyperspectral pansharpening aims to synthesize a low-resolution hyperspectral image (LR-HSI) with a registered panchromatic image (PAN) to generate an enhanced HSI with high spectral and spatial resolution. Recently proposed HS pansharpening methods have obtained remarkable results using deep convolutional networks (ConvNets) We propose a novel over-complete network, called HyperKite, which focuses on learning high-level features by constraining the receptive from increasing in the deep layers.
  arXiv  Detail & Related papers  (2021-07-06T14:11:03Z)
• Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery [79.69449412334188]
  In this paper, we investigate how to adapt state-of-the-art residual learning based single gray/RGB image super-resolution approaches. We introduce a spatial-spectral prior network (SSPN) to fully exploit the spatial information and the correlation between the spectra of the hyperspectral data. Experimental results on some hyperspectral images demonstrate that the proposed SSPSR method enhances the details of the recovered high-resolution hyperspectral images.
  arXiv  Detail & Related papers  (2020-05-18T14:25:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.