Can Location Embeddings Enhance Super-Resolution of Satellite Imagery?

• URL: http://arxiv.org/abs/2501.15847v2
• Date: Thu, 30 Jan 2025 11:14:09 GMT
• Title: Can Location Embeddings Enhance Super-Resolution of Satellite Imagery?
• Authors: Daniel Panangian, Ksenia Bittner,
• Abstract summary: Publicly available satellite imagery, such as Sentinel- 2, often lacks the spatial resolution required for accurate analysis of remote sensing tasks. We propose a novel super-resolution framework that enhances generalization by incorporating geographic context through location embeddings. We demonstrate the effectiveness of our method on the building segmentation task, showing significant improvements over state-of-the-art methods.
• Score: 2.3020018305241337
• License:
• Abstract: Publicly available satellite imagery, such as Sentinel- 2, often lacks the spatial resolution required for accurate analysis of remote sensing tasks including urban planning and disaster response. Current super-resolution techniques are typically trained on limited datasets, leading to poor generalization across diverse geographic regions. In this work, we propose a novel super-resolution framework that enhances generalization by incorporating geographic context through location embeddings. Our framework employs Generative Adversarial Networks (GANs) and incorporates techniques from diffusion models to enhance image quality. Furthermore, we address tiling artifacts by integrating information from neighboring images, enabling the generation of seamless, high-resolution outputs. We demonstrate the effectiveness of our method on the building segmentation task, showing significant improvements over state-of-the-art methods and highlighting its potential for real-world applications.

Related papers

• Cross Pseudo Supervision Framework for Sparsely Labelled Geospatial Images [0.0]
  Land Use Land Cover (LULC) mapping is a vital tool for urban and resource planning. This study introduces a semi-supervised segmentation model for LULC prediction using high-resolution satellite images. We propose a modified Cross Pseudo Supervision framework to train image segmentation models on sparsely labelled data.
  arXiv  Detail & Related papers  (2024-08-05T11:14:23Z)
• SatDiffMoE: A Mixture of Estimation Method for Satellite Image Super-resolution with Latent Diffusion Models [3.839322642354617]
  We propose a novel diffusion-based fusion algorithm called textbfSatDiffMoE. Our algorithm is highly flexible and allows training and inference on arbitrary number of low-resolution images. Experimental results show that our proposed SatDiffMoE method achieves superior performance for the satellite image super-resolution tasks.
  arXiv  Detail & Related papers  (2024-06-14T17:58:28Z)
• Region-aware Distribution Contrast: A Novel Approach to Multi-Task Partially Supervised Learning [50.88504784466931]
  Multi-task dense prediction involves semantic segmentation, depth estimation, and surface normal estimation. Existing solutions typically rely on learning global image representations for global cross-task image matching. Our proposal involves modeling region-wise representations using Gaussian Distributions.
  arXiv  Detail & Related papers  (2024-03-15T12:41:30Z)
• Feature Aggregation Network for Building Extraction from High-resolution Remote Sensing Images [1.7623838912231695]
  High-resolution satellite remote sensing data acquisition has uncovered the potential for detailed extraction of surface architectural features. Current methods focus exclusively on localized information of surface features. We propose the Feature Aggregation Network (FANet), concentrating on extracting both global and local features.
  arXiv  Detail & Related papers  (2023-09-12T07:31:51Z)
• HRFNet: High-Resolution Forgery Network for Localizing Satellite Image Manipulation [16.668334854459143]
  Existing high-resolution satellite image forgery localization methods rely on patch-based or downsampling-based training. We propose a novel model called HRFNet to enable satellite image forgery localization effectively.
  arXiv  Detail & Related papers  (2023-07-20T17:33:57Z)
• Super-Resolving Face Image by Facial Parsing Information [52.1267613768555]
  Face super-resolution is a technology that transforms a low-resolution face image into the corresponding high-resolution one. We build a novel parsing map guided face super-resolution network which extracts the face prior from low-resolution face image. High-resolution features contain more precise spatial information while low-resolution features provide strong contextual information.
  arXiv  Detail & Related papers  (2023-04-06T08:19:03Z)
• Activation Regression for Continuous Domain Generalization with Applications to Crop Classification [48.795866501365694]
  Geographic variance in satellite imagery impacts the ability of machine learning models to generalise to new regions. We model geographic generalisation in medium resolution Landsat-8 satellite imagery as a continuous domain adaptation problem. We develop a dataset spatially distributed across the entire continental United States.
  arXiv  Detail & Related papers  (2022-04-14T15:41:39Z)
• Tracking Urbanization in Developing Regions with Remote Sensing Spatial-Temporal Super-Resolution [82.50301442891602]
  We propose a pipeline that leverages a single high-resolution image and a time series of publicly available low-resolution images. Our method achieves significant improvement in comparison to baselines using single image super-resolution.
  arXiv  Detail & Related papers  (2022-04-04T17:21:20Z)
• Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional Pixel Synthesis [66.50914391487747]
  We propose a new conditional pixel synthesis model that uses abundant, low-cost, low-resolution imagery to generate accurate high-resolution imagery. We show that our model attains photo-realistic sample quality and outperforms competing baselines on a key downstream task -- object counting.
  arXiv  Detail & Related papers  (2021-06-22T02:16:24Z)
• Fusion of Deep and Non-Deep Methods for Fast Super-Resolution of Satellite Images [54.44842669325082]
  This work proposes to bridge the gap between image quality and the price by improving the image quality via super-resolution (SR) We design an SR framework that analyzes the regional information content on each patch of the low-resolution image. We show substantial decrease in inference time while achieving similar performance to that of existing deep SR methods.
  arXiv  Detail & Related papers  (2020-08-03T13:55:39Z)
• Weakly Supervised Domain Adaptation for Built-up Region Segmentation in Aerial and Satellite Imagery [3.8508264614798517]
  Built-up area estimation is an important component in understanding the human impact on the environment, the effect of public policy, and general urban population analysis. The diverse nature of aerial and satellite imagery and lack of labeled data covering this diversity makes machine learning algorithms difficult to generalize. This paper proposes a novel domain adaptation algorithm to handle the challenges posed by the satellite and aerial imagery.
  arXiv  Detail & Related papers  (2020-07-05T10:05:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.