Deep Learning for Satellite Image Time Series Analysis: A Review
- URL: http://arxiv.org/abs/2404.03936v2
- Date: Thu, 11 Apr 2024 13:02:58 GMT
- Title: Deep Learning for Satellite Image Time Series Analysis: A Review
- Authors: Lynn Miller, Charlotte Pelletier, Geoffrey I. Webb,
- Abstract summary: This review presents a summary of the state-of-the-art methods of modelling environmental, agricultural, and other Earth observation variables from SITS data using deep learning methods.
- Score: 5.882962965835289
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Earth observation (EO) satellite missions have been providing detailed images about the state of the Earth and its land cover for over 50 years. Long term missions, such as NASA's Landsat, Terra, and Aqua satellites, and more recently, the ESA's Sentinel missions, record images of the entire world every few days. Although single images provide point-in-time data, repeated images of the same area, or satellite image time series (SITS) provide information about the changing state of vegetation and land use. These SITS are useful for modeling dynamic processes and seasonal changes such as plant phenology. They have potential benefits for many aspects of land and natural resource management, including applications in agricultural, forest, water, and disaster management, urban planning, and mining. However, the resulting satellite image time series (SITS) are complex, incorporating information from the temporal, spatial, and spectral dimensions. Therefore, deep learning methods are often deployed as they can analyze these complex relationships. This review presents a summary of the state-of-the-art methods of modelling environmental, agricultural, and other Earth observation variables from SITS data using deep learning methods. We aim to provide a resource for remote sensing experts interested in using deep learning techniques to enhance Earth observation models with temporal information.
Related papers
- DiffusionSat: A Generative Foundation Model for Satellite Imagery [63.2807119794691]
We present DiffusionSat, to date the largest generative foundation model trained on a collection of publicly available large, high-resolution remote sensing datasets.
Our method produces realistic samples and can be used to solve multiple generative tasks including temporal generation, superresolution given multi-spectral inputs and in-painting.
arXiv Detail & Related papers (2023-12-06T16:53:17Z) - An Aligned Multi-Temporal Multi-Resolution Satellite Image Dataset for
Change Detection Research [0.0]
This paper presents an aligned multi-temporal and multi-resolution satellite image dataset for research in change detection.
The dataset was created by augmenting the SpaceNet-7 dataset with temporally parallel stacks of Landsat and Sentinel images.
arXiv Detail & Related papers (2023-02-23T19:43:20Z) - A General Purpose Neural Architecture for Geospatial Systems [142.43454584836812]
We present a roadmap towards the construction of a general-purpose neural architecture (GPNA) with a geospatial inductive bias.
We envision how such a model may facilitate cooperation between members of the community.
arXiv Detail & Related papers (2022-11-04T09:58:57Z) - Semantic Segmentation of Vegetation in Remote Sensing Imagery Using Deep
Learning [77.34726150561087]
We propose an approach for creating a multi-modal and large-temporal dataset comprised of publicly available Remote Sensing data.
We use Convolutional Neural Networks (CNN) models that are capable of separating different classes of vegetation.
arXiv Detail & Related papers (2022-09-28T18:51:59Z) - Towards Space-to-Ground Data Availability for Agriculture Monitoring [0.0]
We present a space-to-ground dataset that contains Sentinel-1 radar and Sentinel-2 optical image time-series, as well as street-level images from the crowdsourcing platform Mapillary.
We train machine and deep learning algorithms on these different data domains and highlight the potential of fusion techniques towards increasing the reliability of decisions.
arXiv Detail & Related papers (2022-05-16T14:35:48Z) - Satellite Image Time Series Analysis for Big Earth Observation Data [50.591267188664666]
This paper describes sits, an open-source R package for satellite image time series analysis using machine learning.
We show that this approach produces high accuracy for land use and land cover maps through a case study in the Cerrado biome.
arXiv Detail & Related papers (2022-04-24T15:23:25Z) - Activation Regression for Continuous Domain Generalization with
Applications to Crop Classification [48.795866501365694]
Geographic variance in satellite imagery impacts the ability of machine learning models to generalise to new regions.
We model geographic generalisation in medium resolution Landsat-8 satellite imagery as a continuous domain adaptation problem.
We develop a dataset spatially distributed across the entire continental United States.
arXiv Detail & Related papers (2022-04-14T15:41:39Z) - Multimodal learning-based inversion models for the space-time
reconstruction of satellite-derived geophysical fields [40.33123267556167]
A variety of satellite sensors deliver observation data with different sampling patterns due satellite orbits and/or their sensitivity to atmospheric conditions.
Here, we investigate how end-to-end learning schemes provide new means to address multimodal inversion problems.
We show how this scheme can successfully extract relevant information from satellite-derived sea surface temperature images and enhance the reconstruction of sea surface currents issued from satellite altimetry data.
arXiv Detail & Related papers (2022-03-20T20:37:03Z) - Embedding Earth: Self-supervised contrastive pre-training for dense land
cover classification [61.44538721707377]
We present Embedding Earth a self-supervised contrastive pre-training method for leveraging the large availability of satellite imagery.
We observe significant improvements up to 25% absolute mIoU when pre-trained with our proposed method.
We find that learnt features can generalize between disparate regions opening up the possibility of using the proposed pre-training scheme.
arXiv Detail & Related papers (2022-03-11T16:14:14Z) - Deep Neural Networks for automatic extraction of features in time series
satellite images [3.3598755777055374]
We exploit both temporal and spatial information provided by Landsat Sentinel, SPOT, and other time series images to generate land cover maps.
Experimental results show that the Pleiades temporal information allows increasing the accuracy of land cover classification, thus producing up-to-date maps that can help in identifying changes on earth.
arXiv Detail & Related papers (2020-08-17T09:26:52Z) - Attentive Weakly Supervised land cover mapping for object-based
satellite image time series data with spatial interpretation [4.549831511476249]
We propose a new deep learning framework, named TASSEL, that is able to intelligently exploit the weak supervision provided by the coarse granularity labels.
Our framework also produces an additional side-information that supports the model interpretability with the aim to make the black box gray.
arXiv Detail & Related papers (2020-04-30T10:23:12Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.