Self-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Coding

• URL: http://arxiv.org/abs/2104.07070v1
• Date: Wed, 14 Apr 2021 18:25:43 GMT
• Title: Self-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Coding
• Authors: Vladan Stojni\'c (1), Vladimir Risojevi\'c (1) ((1) Faculty of Electrical Engineering, University of Banja Luka, Bosnia and Herzegovina)
• Abstract summary: We conduct an analysis of the applicability of self-supervised learning in remote sensing image classification. We show that, for the downstream task of remote sensing image classification, using self-supervised pre-training can give better results than using supervised pre-training on images of natural scenes.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes. However, its applicability is especially interesting in specific areas, like remote sensing and medicine, where it is hard to obtain huge amounts of labeled data. In this work, we conduct an extensive analysis of the applicability of self-supervised learning in remote sensing image classification. We analyze the influence of the number and domain of images used for self-supervised pre-training on the performance on downstream tasks. We show that, for the downstream task of remote sensing image classification, using self-supervised pre-training on remote sensing images can give better results than using supervised pre-training on images of natural scenes. Besides, we also show that self-supervised pre-training can be easily extended to multispectral images producing even better results on our downstream tasks.

Related papers

• Extending global-local view alignment for self-supervised learning with remote sensing imagery [1.5192294544599656]
  Self-supervised models acquire general feature representations by formulating a pretext task that generates pseudo-labels for massive unlabeled data. Inspired by DINO, we formulate two pretext tasks for self-supervised learning on remote sensing imagery (SSLRS) We extend DINO and propose DINO-MC which uses local views of various sized crops instead of a single fixed size.
  arXiv  Detail & Related papers  (2023-03-12T14:24:10Z)
• Saliency Guided Contrastive Learning on Scene Images [71.07412958621052]
  We leverage the saliency map derived from the model's output during learning to highlight discriminative regions and guide the whole contrastive learning. Our method significantly improves the performance of self-supervised learning on scene images by +1.1, +4.3, +2.2 Top1 accuracy in ImageNet linear evaluation, Semi-supervised learning with 1% and 10% ImageNet labels, respectively.
  arXiv  Detail & Related papers  (2023-02-22T15:54:07Z)
• Self-Supervised In-Domain Representation Learning for Remote Sensing Image Scene Classification [1.0152838128195465]
  Transferring the ImageNet pre-trained weights to the various remote sensing tasks has produced acceptable results. Recent research has demonstrated that self-supervised learning methods capture visual features that are more discriminative and transferable. We are motivated by these facts to pre-train the in-domain representations of remote sensing imagery using contrastive self-supervised learning.
  arXiv  Detail & Related papers  (2023-02-03T15:03:07Z)
• Focus on the Positives: Self-Supervised Learning for Biodiversity Monitoring [9.086207853136054]
  We address the problem of learning self-supervised representations from unlabeled image collections. We exploit readily available context data that encodes information such as the spatial and temporal relationships between the input images. For the critical task of global biodiversity monitoring, this results in image features that can be adapted to challenging visual species classification tasks with limited human supervision.
  arXiv  Detail & Related papers  (2021-08-14T01:12:41Z)
• Unsupervised Object-Level Representation Learning from Scene Images [97.07686358706397]
  Object-level Representation Learning (ORL) is a new self-supervised learning framework towards scene images. Our key insight is to leverage image-level self-supervised pre-training as the prior to discover object-level semantic correspondence. ORL significantly improves the performance of self-supervised learning on scene images, even surpassing supervised ImageNet pre-training on several downstream tasks.
  arXiv  Detail & Related papers  (2021-06-22T17:51:24Z)
• When Does Contrastive Visual Representation Learning Work? [13.247759411409936]
  We study contrastive self-supervised learning on four diverse large-scale datasets. Our key findings include: (i) the benefit of additional pretraining data beyond 500k images is modest, (ii) adding pretraining images from another domain does not lead to more general representations, and (iii) corrupted pretraining images have a disparate impact on supervised and self-supervised pretraining.
  arXiv  Detail & Related papers  (2021-05-12T17:52:42Z)
• Factors of Influence for Transfer Learning across Diverse Appearance Domains and Task Types [50.1843146606122]
  A simple form of transfer learning is common in current state-of-the-art computer vision models. Previous systematic studies of transfer learning have been limited and the circumstances in which it is expected to work are not fully understood. In this paper we carry out an extensive experimental exploration of transfer learning across vastly different image domains.
  arXiv  Detail & Related papers  (2021-03-24T16:24:20Z)
• Self-Supervised Representation Learning from Flow Equivariance [97.13056332559526]
  We present a new self-supervised learning representation framework that can be directly deployed on a video stream of complex scenes. Our representations, learned from high-resolution raw video, can be readily used for downstream tasks on static images.
  arXiv  Detail & Related papers  (2021-01-16T23:44:09Z)
• Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities [81.29441139530844]
  This paper provides a systematic survey of deep learning methods for remote sensing image scene classification by covering more than 160 papers. We discuss the main challenges of remote sensing image scene classification and survey. We introduce the benchmarks used for remote sensing image scene classification and summarize the performance of more than two dozen representative algorithms.
  arXiv  Detail & Related papers  (2020-05-03T14:18:00Z)
• Learning Representations by Predicting Bags of Visual Words [55.332200948110895]
  Self-supervised representation learning targets to learn convnet-based image representations from unlabeled data. Inspired by the success of NLP methods in this area, in this work we propose a self-supervised approach based on spatially dense image descriptions.
  arXiv  Detail & Related papers  (2020-02-27T16:45:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.