Meta-Learning for Few-Shot Land Cover Classification

• URL: http://arxiv.org/abs/2004.13390v1
• Date: Tue, 28 Apr 2020 09:42:41 GMT
• Title: Meta-Learning for Few-Shot Land Cover Classification
• Authors: Marc Ru{\ss}wurm, Sherrie Wang, Marco K\"orner, David Lobell
• Abstract summary: We evaluate the model-agnostic meta-learning (MAML) algorithm on classification and segmentation tasks. We find that few-shot model adaptation outperforms pre-training with regular gradient descent. This indicates that model optimization with meta-learning may benefit tasks in the Earth sciences.
• Score: 3.8529010979482123
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The representations of the Earth's surface vary from one geographic region to another. For instance, the appearance of urban areas differs between continents, and seasonality influences the appearance of vegetation. To capture the diversity within a single category, like as urban or vegetation, requires a large model capacity and, consequently, large datasets. In this work, we propose a different perspective and view this diversity as an inductive transfer learning problem where few data samples from one region allow a model to adapt to an unseen region. We evaluate the model-agnostic meta-learning (MAML) algorithm on classification and segmentation tasks using globally and regionally distributed datasets. We find that few-shot model adaptation outperforms pre-training with regular gradient descent and fine-tuning on (1) the Sen12MS dataset and (2) DeepGlobe data when the source domain and target domain differ. This indicates that model optimization with meta-learning may benefit tasks in the Earth sciences whose data show a high degree of diversity from region to region, while traditional gradient-based supervised learning remains suitable in the absence of a feature or label shift.

Related papers

• SALUDA: Surface-based Automotive Lidar Unsupervised Domain Adaptation [62.889835139583965]
  We introduce an unsupervised auxiliary task of learning an implicit underlying surface representation simultaneously on source and target data. As both domains share the same latent representation, the model is forced to accommodate discrepancies between the two sources of data. Our experiments demonstrate that our method achieves a better performance than the current state of the art, both in real-to-real and synthetic-to-real scenarios.
  arXiv  Detail & Related papers  (2023-04-06T17:36:23Z)
• GeoNet: Benchmarking Unsupervised Adaptation across Geographies [71.23141626803287]
  We study the problem of geographic robustness and make three main contributions. First, we introduce a large-scale dataset GeoNet for geographic adaptation. Second, we hypothesize that the major source of domain shifts arise from significant variations in scene context. Third, we conduct an extensive evaluation of several state-of-the-art unsupervised domain adaptation algorithms and architectures.
  arXiv  Detail & Related papers  (2023-03-27T17:59:34Z)
• GIVL: Improving Geographical Inclusivity of Vision-Language Models with Pre-Training Methods [62.076647211744564]
  We propose GIVL, a Geographically Inclusive Vision-and-Language Pre-trained model. There are two attributes of geo-diverse visual concepts which can help to learn geo-diverse knowledge: 1) concepts under similar categories have unique knowledge and visual characteristics, 2) concepts with similar visual features may fall in completely different categories. Compared with similar-size models pre-trained with similar scale of data, GIVL achieves state-of-the-art (SOTA) and more balanced performance on geo-diverse V&L tasks.
  arXiv  Detail & Related papers  (2023-01-05T03:43:45Z)
• Task-Adaptive Meta-Learning Framework for Advancing Spatial Generalizability [5.448577641039577]
  We propose a model-agnostic meta-learning framework that ensembles regionally heterogeneous data into location-sensitive meta tasks. One major advantage of our proposed method is that it improves the model adaptation to a large number of heterogeneous tasks. It also enhances the model generalization by automatically adapting the meta model of the corresponding difficulty level to any new tasks.
  arXiv  Detail & Related papers  (2022-12-10T01:50:35Z)
• Domain Adaptation and Active Learning for Fine-Grained Recognition in the Field of Biodiversity [7.24935792316121]
  unsupervised domain adaptation can be used for fine-grained recognition in a biodiversity context. Using domain adaptation and Transferable Normalization, the accuracy of the classifier could be increased by up to 12.35 %. Surprisingly, we found that more sophisticated strategies provide better results than the random selection baseline for only one of the two datasets.
  arXiv  Detail & Related papers  (2021-10-22T13:34:13Z)
• Domain Adaptation for Learning Generator from Paired Few-Shot Data [72.04430033118426]
  We propose a Paired Few-shot GAN (PFS-GAN) model for learning generators with sufficient source data and a few target data. Our method has better quantitative and qualitative results on the generated target-domain data with higher diversity in comparison to several baselines.
  arXiv  Detail & Related papers  (2021-02-25T10:11:44Z)
• The data synergy effects of time-series deep learning models in hydrology [9.282656246381102]
  We argue that unification can significantly outperform regionalization in the era of big data and deep learning (DL) We highlight an effect we call data synergy, where the results of the DL models improved when data were pooled together from characteristically different regions.
  arXiv  Detail & Related papers  (2021-01-06T05:24:45Z)
• PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image Segmentation [87.50205728818601]
  We propose a PriorGuided Local (PGL) self-supervised model that learns the region-wise local consistency in the latent feature space. Our PGL model learns the distinctive representations of local regions, and hence is able to retain structural information.
  arXiv  Detail & Related papers  (2020-11-25T11:03:11Z)
• Semantic Change Detection with Asymmetric Siamese Networks [71.28665116793138]
  Given two aerial images, semantic change detection aims to locate the land-cover variations and identify their change types with pixel-wise boundaries. This problem is vital in many earth vision related tasks, such as precise urban planning and natural resource management. We present an asymmetric siamese network (ASN) to locate and identify semantic changes through feature pairs obtained from modules of widely different structures.
  arXiv  Detail & Related papers  (2020-10-12T13:26:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.