Pixel-wise Agricultural Image Time Series Classification: Comparisons and a Deformable Prototype-based Approach

• URL: http://arxiv.org/abs/2303.12533v2
• Date: Fri, 12 Jul 2024 13:04:31 GMT
• Title: Pixel-wise Agricultural Image Time Series Classification: Comparisons and a Deformable Prototype-based Approach
• Authors: Elliot Vincent, Jean Ponce, Mathieu Aubry,
• Abstract summary: Current methods for crop segmentation using temporal data either rely on data or are heavily engineered to compensate the lack of supervision. We present and compare datasets and methods for both supervised and unsupervised pixelwise segmentation of satellite image time (SITS) We show this simple and highly interpretable method achieves the best performance in the low data regime.
• Score: 38.96950437566293
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Improvements in Earth observation by satellites allow for imagery of ever higher temporal and spatial resolution. Leveraging this data for agricultural monitoring is key for addressing environmental and economic challenges. Current methods for crop segmentation using temporal data either rely on annotated data or are heavily engineered to compensate the lack of supervision. In this paper, we present and compare datasets and methods for both supervised and unsupervised pixel-wise segmentation of satellite image time series (SITS). We also introduce an approach to add invariance to spectral deformations and temporal shifts to classical prototype-based methods such as K-means and Nearest Centroid Classifier (NCC). We study different levels of supervision and show this simple and highly interpretable method achieves the best performance in the low data regime and significantly improves the state of the art for unsupervised classification of agricultural time series on four recent SITS datasets.

Related papers

• Hybrid Ensemble Deep Graph Temporal Clustering for Spatiotemporal Data [0.37083047471478225]
  We propose a hybrid ensemble graph clustering (HEDGTC) method for multivariate temporal data analysis. HEDGTC adopts a dual consensus approach to address noise and misclassification from traditional clustering. When evaluated on three real-world datasets, HEDGTC outperforms state-of-the-art ensemble clustering models.
  arXiv  Detail & Related papers  (2024-09-19T09:14:10Z)
• SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation [69.42764583465508]
  We explore the potential of generative image diffusion to address the scarcity of annotated data in earth observation tasks. To the best of our knowledge, we are the first to generate both images and corresponding masks for satellite segmentation.
  arXiv  Detail & Related papers  (2024-03-25T10:30:22Z)
• Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method [66.80344502790231]
  We extend meteorological downscaling to arbitrary scattered station scales and establish a new benchmark and dataset. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Our proposed method outperforms other specially designed baseline models on multiple surface variables.
  arXiv  Detail & Related papers  (2024-01-22T14:02:56Z)
• View Consistent Purification for Accurate Cross-View Localization [59.48131378244399]
  This paper proposes a fine-grained self-localization method for outdoor robotics. The proposed method addresses limitations in existing cross-view localization methods. It is the first sparse visual-only method that enhances perception in dynamic environments.
  arXiv  Detail & Related papers  (2023-08-16T02:51:52Z)
• SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery [74.82821342249039]
  We present SatMAE, a pre-training framework for temporal or multi-spectral satellite imagery based on Masked Autoencoder (MAE) To leverage temporal information, we include a temporal embedding along with independently masking image patches across time.
  arXiv  Detail & Related papers  (2022-07-17T01:35:29Z)
• Explicitly incorporating spatial information to recurrent networks for agriculture [4.583080280213959]
  We propose novel approaches to improve the classification of deep convolutional neural networks. We leverage available RGB-D images and robot odometry to perform inter-frame feature map spatial registration. This information is then fused within recurrent deep learnt models, to improve their accuracy and robustness.
  arXiv  Detail & Related papers  (2022-06-27T15:57:42Z)
• Investigating Temporal Convolutional Neural Networks for Satellite Image Time Series Classification: A survey [0.0]
  Temporal CNNs have been employed for SITS classification tasks with encouraging results. This paper seeks to survey this method against a plethora of other contemporary methods for SITS classification to validate the existing findings in recent literature. Experiments are carried out on two benchmark SITS datasets with the results demonstrating that Temporal CNNs display a superior performance to the comparative benchmark algorithms.
  arXiv  Detail & Related papers  (2022-04-13T14:08:14Z)
• A Contrastive Learning Approach to Auroral Identification and Classification [0.8399688944263843]
  We present a novel application of unsupervised learning to the task of auroral image classification. We modify and adapt the Simple framework for Contrastive Learning of Representations (SimCLR) algorithm to learn representations of auroral images. Our approach exceeds an established threshold for operational purposes, demonstrating readiness for deployment and utilization.
  arXiv  Detail & Related papers  (2021-09-28T17:51:25Z)
• Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation [93.83369981759996]
  We propose a self-supervised equivariant attention mechanism (SEAM) to discover additional supervision and narrow the gap. Our method is based on the observation that equivariance is an implicit constraint in fully supervised semantic segmentation. We propose consistency regularization on predicted CAMs from various transformed images to provide self-supervision for network learning.
  arXiv  Detail & Related papers  (2020-04-09T14:57:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.