S2A: Wasserstein GAN with Spatio-Spectral Laplacian Attention for Multi-Spectral Band Synthesis

• URL: http://arxiv.org/abs/2004.03867v1
• Date: Wed, 8 Apr 2020 08:07:00 GMT
• Title: S2A: Wasserstein GAN with Spatio-Spectral Laplacian Attention for Multi-Spectral Band Synthesis
• Authors: Litu Rout, Indranil Misra, S Manthira Moorthi, Debajyoti Dhar
• Abstract summary: We introduce a new cost function for the discriminator based on spatial attention and domain adaptation loss. We synthesize over 4000 high resolution scenes covering various terrains to analyze scientific fidelity.
• Score: 13.96995818103425
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Intersection of adversarial learning and satellite image processing is an emerging field in remote sensing. In this study, we intend to address synthesis of high resolution multi-spectral satellite imagery using adversarial learning. Guided by the discovery of attention mechanism, we regulate the process of band synthesis through spatio-spectral Laplacian attention. Further, we use Wasserstein GAN with gradient penalty norm to improve training and stability of adversarial learning. In this regard, we introduce a new cost function for the discriminator based on spatial attention and domain adaptation loss. We critically analyze the qualitative and quantitative results compared with state-of-the-art methods using widely adopted evaluation metrics. Our experiments on datasets of three different sensors, namely LISS-3, LISS-4, and WorldView-2 show that attention learning performs favorably against state-of-the-art methods. Using the proposed method we provide an additional data product in consistent with existing high resolution bands. Furthermore, we synthesize over 4000 high resolution scenes covering various terrains to analyze scientific fidelity. At the end, we demonstrate plausible large scale real world applications of the synthesized band.

Related papers

• Enhancing Active Learning for Sentinel 2 Imagery through Contrastive Learning and Uncertainty Estimation [0.0]
  We introduce a novel method designed to enhance label efficiency in satellite imagery analysis. Our approach utilizes contrastive learning together with uncertainty estimations via Monte Carlo Dropout. Our results show that the proposed method performs better than several other popular methods in this field.
  arXiv  Detail & Related papers  (2024-05-22T01:54:51Z)
• SIRAN: Sinkhorn Distance Regularized Adversarial Network for DEM Super-resolution using Discriminative Spatial Self-attention [5.178465447325005]
  Digital Elevation Model (DEM) is an essential aspect in the remote sensing domain to analyze and explore different applications related to surface elevation information. In this study, we intend to address the generation of high-resolution DEMs using high-resolution multi-spectral (MX) satellite imagery. We present an objective function related to optimizing Sinkhorn distance with traditional GAN to improve the stability of adversarial learning.
  arXiv  Detail & Related papers  (2023-11-27T12:03:22Z)
• Searching for Novel Chemistry in Exoplanetary Atmospheres using Machine Learning for Anomaly Detection [1.8434042562191815]
  We advocate the application of machine learning (ML) techniques for anomaly (novelty) detection to exoplanet transit spectra. We demonstrate the feasibility of two popular anomaly detection methods on a large public database of synthetic spectra.
  arXiv  Detail & Related papers  (2023-08-15T07:19:54Z)
• Land Use Prediction using Electro-Optical to SAR Few-Shot Transfer Learning [16.71560262537924]
  Deep learning methods can facilitate the analysis of different satellite modalities, such as electro-optical (EO) and synthetic aperture radar (SAR) imagery. We show how distributional alignment of neural network embeddings can produce powerful transfer learning models by employing a sliced Wasserstein distance (SWD) loss. In an application to few-shot Local Climate Zone (LCZ) prediction, we show that these networks outperform multiple common baselines on datasets with a large number of classes.
  arXiv  Detail & Related papers  (2022-12-04T22:41:25Z)
• Hyperspectral Images Classification and Dimensionality Reduction using spectral interaction and SVM classifier [0.0]
  The high dimensionality of the hyperspectral images (HSI) is one of the main challenges for the analysis of the collected data. The existence of noisy, redundant and irrelevant bands increases the computational complexity. We propose a novel filter approach based on the spectral interaction measure and the support vector machines for dimensionality reduction.
  arXiv  Detail & Related papers  (2022-10-27T15:37:57Z)
• Tensor Decompositions for Hyperspectral Data Processing in Remote Sensing: A Comprehensive Review [85.36368666877412]
  hyperspectral (HS) remote sensing (RS) imaging has provided a significant amount of spatial and spectral information for the observation and analysis of the Earth's surface. The recent advancement and even revolution of the HS RS technique offer opportunities to realize the full potential of various applications. Due to the maintenance of the 3-D HS inherent structure, tensor decomposition has aroused widespread concern and research in HS data processing tasks.
  arXiv  Detail & Related papers  (2022-05-13T00:39:23Z)
• The KFIoU Loss for Rotated Object Detection [115.334070064346]
  In this paper, we argue that one effective alternative is to devise an approximate loss who can achieve trend-level alignment with SkewIoU loss. Specifically, we model the objects as Gaussian distribution and adopt Kalman filter to inherently mimic the mechanism of SkewIoU. The resulting new loss called KFIoU is easier to implement and works better compared with exact SkewIoU.
  arXiv  Detail & Related papers  (2022-01-29T10:54:57Z)
• Unsupervised Machine Learning for Exploratory Data Analysis of Exoplanet Transmission Spectra [68.8204255655161]
  We focus on unsupervised techniques for analyzing spectral data from transiting exoplanets. We show that there is a high degree of correlation in the spectral data, which calls for appropriate low-dimensional representations. We uncover interesting structures in the principal component basis, namely, well-defined branches corresponding to different chemical regimes.
  arXiv  Detail & Related papers  (2022-01-07T22:26:33Z)
• Estimating Crop Primary Productivity with Sentinel-2 and Landsat 8 using Machine Learning Methods Trained with Radiative Transfer Simulations [58.17039841385472]
  We take advantage of all parallel developments in mechanistic modeling and satellite data availability for advanced monitoring of crop productivity. Our model successfully estimates gross primary productivity across a variety of C3 crop types and environmental conditions even though it does not use any local information from the corresponding sites. This highlights its potential to map crop productivity from new satellite sensors at a global scale with the help of current Earth observation cloud computing platforms.
  arXiv  Detail & Related papers  (2020-12-07T16:23:13Z)
• Semi-Supervised StyleGAN for Disentanglement Learning [79.01988132442064]
  Current disentanglement methods face several inherent limitations. We design new architectures and loss functions based on StyleGAN for semi-supervised high-resolution disentanglement learning.
  arXiv  Detail & Related papers  (2020-03-06T22:54:46Z)
• Towards High Performance Human Keypoint Detection [87.1034745775229]
  We find that context information plays an important role in reasoning human body configuration and invisible keypoints. Inspired by this, we propose a cascaded context mixer ( CCM) which efficiently integrates spatial and channel context information. To maximize CCM's representation capability, we develop a hard-negative person detection mining strategy and a joint-training strategy. We present several sub-pixel refinement techniques for postprocessing keypoint predictions to improve detection accuracy.
  arXiv  Detail & Related papers  (2020-02-03T02:24:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.