Domain-Adversarial Training of Self-Attention Based Networks for Land
Cover Classification using Multi-temporal Sentinel-2 Satellite Imagery
- URL: http://arxiv.org/abs/2104.00564v1
- Date: Thu, 1 Apr 2021 15:45:17 GMT
- Title: Domain-Adversarial Training of Self-Attention Based Networks for Land
Cover Classification using Multi-temporal Sentinel-2 Satellite Imagery
- Authors: Martini Mauro, Vittorio Mazzia, Aleem Khaliq, Marcello Chiaberge
- Abstract summary: Most practical applications cannot rely on labeled data, and in the field, surveys are a time consuming solution.
In this paper, we investigate adversarial training of deep neural networks to bridge the domain discrepancy between distinct geographical zones.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: The increasing availability of large-scale remote sensing labeled data has
prompted researchers to develop increasingly precise and accurate data-driven
models for land cover and crop classification (LC&CC). Moreover, with the
introduction of self-attention and introspection mechanisms, deep learning
approaches have shown promising results in processing long temporal sequences
in the multi-spectral domain with a contained computational request.
Nevertheless, most practical applications cannot rely on labeled data, and in
the field, surveys are a time consuming solution that poses strict limitations
to the number of collected samples. Moreover, atmospheric conditions and
specific geographical region characteristics constitute a relevant domain gap
that does not allow direct applicability of a trained model on the available
dataset to the area of interest. In this paper, we investigate adversarial
training of deep neural networks to bridge the domain discrepancy between
distinct geographical zones. In particular, we perform a thorough analysis of
domain adaptation applied to challenging multi-spectral, multi-temporal data,
accurately highlighting the advantages of adapting state-of-the-art
self-attention based models for LC&CC to different target zones where labeled
data are not available. Extensive experimentation demonstrated significant
performance and generalization gain in applying domain-adversarial training to
source and target regions with marked dissimilarities between the distribution
of extracted features.
Related papers
- Cross Domain Early Crop Mapping using CropSTGAN [12.271756709807898]
This paper introduces the Crop Mapping Spectral-temporal Generative Adrial Neural Network (CropSTGAN)
CropSTGAN learns to transform the target domain's spectral features to those of the source domain, effectively bridging large dissimilarities.
In experiments, CropSTGAN is benchmarked against various state-of-the-art (SOTA) methods.
arXiv Detail & Related papers (2024-01-15T00:27:41Z) - Evaluating the Label Efficiency of Contrastive Self-Supervised Learning
for Multi-Resolution Satellite Imagery [0.0]
Self-supervised learning has been applied in the remote sensing domain to exploit readily-available unlabeled data.
In this paper, we study self-supervised visual representation learning through the lens of label efficiency.
arXiv Detail & Related papers (2022-10-13T06:54:13Z) - Deep Unsupervised Domain Adaptation: A Review of Recent Advances and
Perspectives [16.68091981866261]
Unsupervised domain adaptation (UDA) is proposed to counter the performance drop on data in a target domain.
UDA has yielded promising results on natural image processing, video analysis, natural language processing, time-series data analysis, medical image analysis, etc.
arXiv Detail & Related papers (2022-08-15T20:05:07Z) - CHALLENGER: Training with Attribution Maps [63.736435657236505]
We show that utilizing attribution maps for training neural networks can improve regularization of models and thus increase performance.
In particular, we show that our generic domain-independent approach yields state-of-the-art results in vision, natural language processing and on time series tasks.
arXiv Detail & Related papers (2022-05-30T13:34:46Z) - Deep face recognition with clustering based domain adaptation [57.29464116557734]
We propose a new clustering-based domain adaptation method designed for face recognition task in which the source and target domain do not share any classes.
Our method effectively learns the discriminative target feature by aligning the feature domain globally, and, at the meantime, distinguishing the target clusters locally.
arXiv Detail & Related papers (2022-05-27T12:29:11Z) - Coarse to Fine: Domain Adaptive Crowd Counting via Adversarial Scoring
Network [58.05473757538834]
This paper proposes a novel adversarial scoring network (ASNet) to bridge the gap across domains from coarse to fine granularity.
Three sets of migration experiments show that the proposed methods achieve state-of-the-art counting performance.
arXiv Detail & Related papers (2021-07-27T14:47:24Z) - A Review of Single-Source Deep Unsupervised Visual Domain Adaptation [81.07994783143533]
Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks.
In many applications, it is prohibitively expensive and time-consuming to obtain large quantities of labeled data.
To cope with limited labeled training data, many have attempted to directly apply models trained on a large-scale labeled source domain to another sparsely labeled or unlabeled target domain.
arXiv Detail & Related papers (2020-09-01T00:06:50Z) - Physically-Constrained Transfer Learning through Shared Abundance Space
for Hyperspectral Image Classification [14.840925517957258]
We propose a new transfer learning scheme to bridge the gap between the source and target domains.
The proposed method is referred to as physically-constrained transfer learning through shared abundance space.
arXiv Detail & Related papers (2020-08-19T17:41:37Z) - Domain Conditioned Adaptation Network [90.63261870610211]
We propose a Domain Conditioned Adaptation Network (DCAN) to excite distinct convolutional channels with a domain conditioned channel attention mechanism.
This is the first work to explore the domain-wise convolutional channel activation for deep DA networks.
arXiv Detail & Related papers (2020-05-14T04:23:24Z) - Cross-domain Object Detection through Coarse-to-Fine Feature Adaptation [62.29076080124199]
This paper proposes a novel coarse-to-fine feature adaptation approach to cross-domain object detection.
At the coarse-grained stage, foreground regions are extracted by adopting the attention mechanism, and aligned according to their marginal distributions.
At the fine-grained stage, we conduct conditional distribution alignment of foregrounds by minimizing the distance of global prototypes with the same category but from different domains.
arXiv Detail & Related papers (2020-03-23T13:40:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.