SatDiffMoE: A Mixture of Estimation Method for Satellite Image Super-resolution with Latent Diffusion Models
- URL: http://arxiv.org/abs/2406.10225v1
- Date: Fri, 14 Jun 2024 17:58:28 GMT
- Title: SatDiffMoE: A Mixture of Estimation Method for Satellite Image Super-resolution with Latent Diffusion Models
- Authors: Zhaoxu Luo, Bowen Song, Liyue Shen,
- Abstract summary: We propose a novel diffusion-based fusion algorithm called textbfSatDiffMoE.
Our algorithm is highly flexible and allows training and inference on arbitrary number of low-resolution images.
Experimental results show that our proposed SatDiffMoE method achieves superior performance for the satellite image super-resolution tasks.
- Score: 3.839322642354617
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: During the acquisition of satellite images, there is generally a trade-off between spatial resolution and temporal resolution (acquisition frequency) due to the onboard sensors of satellite imaging systems. High-resolution satellite images are very important for land crop monitoring, urban planning, wildfire management and a variety of applications. It is a significant yet challenging task to achieve high spatial-temporal resolution in satellite imaging. With the advent of diffusion models, we can now learn strong generative priors to generate realistic satellite images with high resolution, which can be utilized to promote the super-resolution task as well. In this work, we propose a novel diffusion-based fusion algorithm called \textbf{SatDiffMoE} that can take an arbitrary number of sequential low-resolution satellite images at the same location as inputs, and fuse them into one high-resolution reconstructed image with more fine details, by leveraging and fusing the complementary information from different time points. Our algorithm is highly flexible and allows training and inference on arbitrary number of low-resolution images. Experimental results show that our proposed SatDiffMoE method not only achieves superior performance for the satellite image super-resolution tasks on a variety of datasets, but also gets an improved computational efficiency with reduced model parameters, compared with previous methods.
Related papers
- A Distance Similarity-based Genetic Optimization Algorithm for Satellite Ground Network Planning Considering Feeding Mode [53.71516191515285]
The low transmission efficiency of the satellite data relay back mission has become a problem that is currently constraining the construction of the system.
We propose a distance similarity-based genetic optimization algorithm (DSGA), which considers the state characteristics between the tasks.
The results of simulation experiments show that the DSGA can effectively solve the SGNPFM problem.
arXiv Detail & Related papers (2024-08-29T06:57:45Z) - DiffusionSat: A Generative Foundation Model for Satellite Imagery [63.2807119794691]
We present DiffusionSat, to date the largest generative foundation model trained on a collection of publicly available large, high-resolution remote sensing datasets.
Our method produces realistic samples and can be used to solve multiple generative tasks including temporal generation, superresolution given multi-spectral inputs and in-painting.
arXiv Detail & Related papers (2023-12-06T16:53:17Z) - Fast Satellite Tensorial Radiance Field for Multi-date Satellite Imagery
of Large Size [0.76146285961466]
Existing NeRF models for satellite images suffer from slow speeds, mandatory solar information as input, and limitations in handling large satellite images.
We present SatensoRF, which significantly accelerates the entire process while employing fewer parameters for satellite imagery of large size.
arXiv Detail & Related papers (2023-09-21T04:00:38Z) - RSDiff: Remote Sensing Image Generation from Text Using Diffusion Model [0.8747606955991705]
This research introduces a two-stage diffusion model methodology for synthesizing high-resolution satellite images from textual prompts.
The pipeline comprises a Low-Resolution Diffusion Model (LRDM) that generates initial images based on text inputs and a Super-Resolution Diffusion Model (SRDM) that refines these images into high-resolution outputs.
arXiv Detail & Related papers (2023-09-03T09:34:49Z) - Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization
Using Satellite Image [91.29546868637911]
This paper addresses the problem of vehicle-mounted camera localization by matching a ground-level image with an overhead-view satellite map.
The key idea is to formulate the task as pose estimation and solve it by neural-net based optimization.
Experiments on standard autonomous vehicle localization datasets have confirmed the superiority of the proposed method.
arXiv Detail & Related papers (2022-04-10T19:16:58Z) - Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional
Pixel Synthesis [66.50914391487747]
We propose a new conditional pixel synthesis model that uses abundant, low-cost, low-resolution imagery to generate accurate high-resolution imagery.
We show that our model attains photo-realistic sample quality and outperforms competing baselines on a key downstream task -- object counting.
arXiv Detail & Related papers (2021-06-22T02:16:24Z) - Unsupervised Remote Sensing Super-Resolution via Migration Image Prior [12.728430583409997]
We propose a new unsupervised learning framework, called "MIP", which achieves super-resolution tasks without low/high resolution image pairs.
In this paper, we show that MIP achieves significant improvements over state-of-the-art methods both quantitatively and qualitatively.
arXiv Detail & Related papers (2021-05-08T03:29:35Z) - Fusion of Deep and Non-Deep Methods for Fast Super-Resolution of
Satellite Images [54.44842669325082]
This work proposes to bridge the gap between image quality and the price by improving the image quality via super-resolution (SR)
We design an SR framework that analyzes the regional information content on each patch of the low-resolution image.
We show substantial decrease in inference time while achieving similar performance to that of existing deep SR methods.
arXiv Detail & Related papers (2020-08-03T13:55:39Z) - HighRes-net: Recursive Fusion for Multi-Frame Super-Resolution of
Satellite Imagery [55.253395881190436]
Multi-frame Super-Resolution (MFSR) offers a more grounded approach to the ill-posed problem.
This is important for satellite monitoring of human impact on the planet.
We present HighRes-net, the first deep learning approach to MFSR that learns its sub-tasks in an end-to-end fashion.
arXiv Detail & Related papers (2020-02-15T22:17:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.