Satellite Image Time Series Semantic Change Detection: Novel Architecture and Analysis of Domain Shift

• URL: http://arxiv.org/abs/2407.07616v1
• Date: Wed, 10 Jul 2024 12:54:51 GMT
• Title: Satellite Image Time Series Semantic Change Detection: Novel Architecture and Analysis of Domain Shift
• Authors: Elliot Vincent, Jean Ponce, Mathieu Aubry,
• Abstract summary: We tackle semantic change detection with satellite image time series (SITS-SCD) We propose a new architecture that improves over the state of the art, scales better with the number of parameters, and leverages long-term temporal information. For practical use cases, models need to adapt to spatial and temporal shifts, which remains a challenge.
• Score: 38.96950437566293
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Satellite imagery plays a crucial role in monitoring changes happening on Earth's surface and aiding in climate analysis, ecosystem assessment, and disaster response. In this paper, we tackle semantic change detection with satellite image time series (SITS-SCD) which encompasses both change detection and semantic segmentation tasks. We propose a new architecture that improves over the state of the art, scales better with the number of parameters, and leverages long-term temporal information. However, for practical use cases, models need to adapt to spatial and temporal shifts, which remains a challenge. We investigate the impact of temporal and spatial shifts separately on global, multi-year SITS datasets using DynamicEarthNet and MUDS. We show that the spatial domain shift represents the most complex setting and that the impact of temporal shift on performance is more pronounced on change detection than on semantic segmentation, highlighting that it is a specific issue deserving further attention.

Related papers

• On the use of Graphs for Satellite Image Time Series [3.2623791881739033]
  This paper is an effort to examine the integration of graph-based methods in remote-sensing analysis.<n>It aims to present a versatile graph-based pipeline to tackle SITS analysis.<n>The paper includes a review and two case studies, which highlight the potential of graph-based approaches for land cover mapping and water forecasting datasets.
  arXiv  Detail & Related papers  (2025-05-22T13:53:36Z)
• CEBSNet: Change-Excited and Background-Suppressed Network with Temporal Dependency Modeling for Bitemporal Change Detection [5.667475728935794]
  Change detection is a critical task in remote sensing and computer vision.<n>Current methods overlook temporal dependencies and overemphasize prominent changes.<n>We introduce textbfCEBSNet, a novel change-excited and background-suppressed network for change detection.
  arXiv  Detail & Related papers  (2025-05-21T09:57:30Z)
• TiMo: Spatiotemporal Foundation Model for Satellite Image Time Series [39.22426645737932]
  TiMo is a novel hierarchical vision transformer foundation model tailored for SITS analysis.<n>At its core, we introduce atemporal attention mechanism that dynamically captures multiscale patterns across both time and space.<n>Extensive experiments across multipletemporal tasks-including deforestation monitoring-demonstrate TiMo's superiority over state-of-theart methods.
  arXiv  Detail & Related papers  (2025-05-13T16:35:11Z)
• Paving the way toward foundation models for irregular and unaligned Satellite Image Time Series [0.0]
  We propose an ALIgned Sits (ALISE) to take into account the spatial, spectral, and temporal dimensions of satellite imagery. Unlike SSL models currently available for SITS, ALISE incorporates a flexible query mechanism to project the SITS into a common and learned temporal projection space. The quality of the produced representation is assessed through three downstream tasks: crop segmentation (PASTIS), land cover segmentation (MultiSenGE) and a novel crop change detection dataset.
  arXiv  Detail & Related papers  (2024-07-11T12:42:10Z)
• A Late-Stage Bitemporal Feature Fusion Network for Semantic Change Detection [32.112311027857636]
  We propose a novel late-stage bitemporal feature fusion network to address the issue of semantic change detection. Specifically, we propose local global attentional aggregation module to strengthen feature fusion, and propose local global context enhancement module to highlight pivotal semantics. Our proposed model achieves new state-of-the-art performance on both datasets.
  arXiv  Detail & Related papers  (2024-06-15T16:02:10Z)
• ChangeBind: A Hybrid Change Encoder for Remote Sensing Change Detection [16.62779899494721]
  Change detection (CD) is a fundamental task in remote sensing (RS) which aims to detect the semantic changes between the same geographical regions at different time stamps. We propose an effective Siamese-based framework to encode the semantic changes occurring in the bi-temporal RS images.
  arXiv  Detail & Related papers  (2024-04-26T17:47:14Z)
• GlobalMind: Global Multi-head Interactive Self-attention Network for Hyperspectral Change Detection [22.22495802857453]
  High spectral resolution imagery of the Earth's surface enables users to monitor changes over time in fine-grained scale. Most current algorithms are still confined to describing local features and fail to incorporate a global perspective. We propose a Global Multi-head INteractive self-attention change Detection network (GlobalMind) to explore the implicit correlation between different surface objects and variant land cover transformations.
  arXiv  Detail & Related papers  (2023-04-18T01:43:17Z)
• Local-Global Temporal Difference Learning for Satellite Video Super-Resolution [55.69322525367221]
  We propose to exploit the well-defined temporal difference for efficient and effective temporal compensation. To fully utilize the local and global temporal information within frames, we systematically modeled the short-term and long-term temporal discrepancies. Rigorous objective and subjective evaluations conducted across five mainstream video satellites demonstrate that our method performs favorably against state-of-the-art approaches.
  arXiv  Detail & Related papers  (2023-04-10T07:04:40Z)
• SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery [74.82821342249039]
  We present SatMAE, a pre-training framework for temporal or multi-spectral satellite imagery based on Masked Autoencoder (MAE) To leverage temporal information, we include a temporal embedding along with independently masking image patches across time.
  arXiv  Detail & Related papers  (2022-07-17T01:35:29Z)
• Activation Regression for Continuous Domain Generalization with Applications to Crop Classification [48.795866501365694]
  Geographic variance in satellite imagery impacts the ability of machine learning models to generalise to new regions. We model geographic generalisation in medium resolution Landsat-8 satellite imagery as a continuous domain adaptation problem. We develop a dataset spatially distributed across the entire continental United States.
  arXiv  Detail & Related papers  (2022-04-14T15:41:39Z)
• Attentive Weakly Supervised land cover mapping for object-based satellite image time series data with spatial interpretation [4.549831511476249]
  We propose a new deep learning framework, named TASSEL, that is able to intelligently exploit the weak supervision provided by the coarse granularity labels. Our framework also produces an additional side-information that supports the model interpretability with the aim to make the black box gray.
  arXiv  Detail & Related papers  (2020-04-30T10:23:12Z)
• Spatial Attention Pyramid Network for Unsupervised Domain Adaptation [66.75008386980869]
  Unsupervised domain adaptation is critical in various computer vision tasks. We design a new spatial attention pyramid network for unsupervised domain adaptation. Our method performs favorably against the state-of-the-art methods by a large margin.
  arXiv  Detail & Related papers  (2020-03-29T09:03:23Z)
• A Spatial-Temporal Attentive Network with Spatial Continuity for Trajectory Prediction [74.00750936752418]
  We propose a novel model named spatial-temporal attentive network with spatial continuity (STAN-SC) First, spatial-temporal attention mechanism is presented to explore the most useful and important information. Second, we conduct a joint feature sequence based on the sequence and instant state information to make the generative trajectories keep spatial continuity.
  arXiv  Detail & Related papers  (2020-03-13T04:35:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.