Weakly Supervised Domain Adaptation for Built-up Region Segmentation in
Aerial and Satellite Imagery
- URL: http://arxiv.org/abs/2007.02277v1
- Date: Sun, 5 Jul 2020 10:05:01 GMT
- Title: Weakly Supervised Domain Adaptation for Built-up Region Segmentation in
Aerial and Satellite Imagery
- Authors: Javed Iqbal and Mohsen Ali
- Abstract summary: Built-up area estimation is an important component in understanding the human impact on the environment, the effect of public policy, and general urban population analysis.
The diverse nature of aerial and satellite imagery and lack of labeled data covering this diversity makes machine learning algorithms difficult to generalize.
This paper proposes a novel domain adaptation algorithm to handle the challenges posed by the satellite and aerial imagery.
- Score: 3.8508264614798517
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This paper proposes a novel domain adaptation algorithm to handle the
challenges posed by the satellite and aerial imagery, and demonstrates its
effectiveness on the built-up region segmentation problem. Built-up area
estimation is an important component in understanding the human impact on the
environment, the effect of public policy, and general urban population
analysis. The diverse nature of aerial and satellite imagery and lack of
labeled data covering this diversity makes machine learning algorithms
difficult to generalize for such tasks, especially across multiple domains. On
the other hand, due to the lack of strong spatial context and structure, in
comparison to the ground imagery, the application of existing unsupervised
domain adaptation methods results in the sub-optimal adaptation. We thoroughly
study the limitations of existing domain adaptation methods and propose a
weakly-supervised adaptation strategy where we assume image-level labels are
available for the target domain. More specifically, we design a built-up area
segmentation network (as encoder-decoder), with an image classification head
added to guide the adaptation. The devised system is able to address the
problem of visual differences in multiple satellite and aerial imagery
datasets, ranging from high resolution (HR) to very high resolution (VHR). A
realistic and challenging HR dataset is created by hand-tagging the 73.4 sq-km
of Rwanda, capturing a variety of build-up structures over different terrain.
The developed dataset is spatially rich compared to existing datasets and
covers diverse built-up scenarios including built-up areas in forests and
deserts, mud houses, tin, and colored rooftops. Extensive experiments are
performed by adapting from the single-source domain, to segment out the target
domain. We achieve high gains ranging 11.6%-52% in IoU over the existing
state-of-the-art methods.
Related papers
- UrbanCross: Enhancing Satellite Image-Text Retrieval with Cross-Domain Adaptation [44.14603461930746]
UrbanCross is a new framework for cross-domain satellite image-text retrieval.
It exploits a high-quality, cross-domain dataset enriched with extensive geo-tags from three countries.
Experiments confirm UrbanCross's superior efficiency in retrieval and adaptation to new urban environments.
arXiv Detail & Related papers (2024-04-22T14:53:27Z) - Region-aware Distribution Contrast: A Novel Approach to Multi-Task Partially Supervised Learning [50.88504784466931]
Multi-task dense prediction involves semantic segmentation, depth estimation, and surface normal estimation.
Existing solutions typically rely on learning global image representations for global cross-task image matching.
Our proposal involves modeling region-wise representations using Gaussian Distributions.
arXiv Detail & Related papers (2024-03-15T12:41:30Z) - Cross Domain Early Crop Mapping using CropSTGAN [12.271756709807898]
This paper introduces the Crop Mapping Spectral-temporal Generative Adrial Neural Network (CropSTGAN)
CropSTGAN learns to transform the target domain's spectral features to those of the source domain, effectively bridging large dissimilarities.
In experiments, CropSTGAN is benchmarked against various state-of-the-art (SOTA) methods.
arXiv Detail & Related papers (2024-01-15T00:27:41Z) - Self-supervised Domain-agnostic Domain Adaptation for Satellite Images [18.151134198549574]
We propose an self-supervised domain-agnostic domain adaptation (SS(DA)2) method to perform domain adaptation without such a domain definition.
We first design a contrastive generative adversarial loss to train a generative network to perform image-to-image translation between any two satellite image patches.
Then, we improve the generalizability of the downstream models by augmenting the training data with different testing spectral characteristics.
arXiv Detail & Related papers (2023-09-20T07:37:23Z) - GeoNet: Benchmarking Unsupervised Adaptation across Geographies [71.23141626803287]
We study the problem of geographic robustness and make three main contributions.
First, we introduce a large-scale dataset GeoNet for geographic adaptation.
Second, we hypothesize that the major source of domain shifts arise from significant variations in scene context.
Third, we conduct an extensive evaluation of several state-of-the-art unsupervised domain adaptation algorithms and architectures.
arXiv Detail & Related papers (2023-03-27T17:59:34Z) - Progressive Domain Adaptation with Contrastive Learning for Object
Detection in the Satellite Imagery [0.0]
State-of-the-art object detection methods largely fail to identify small and dense objects.
We propose a small object detection pipeline that improves the feature extraction process.
We show we can alleviate the degradation of object identification in previously unseen datasets.
arXiv Detail & Related papers (2022-09-06T15:16:35Z) - Deep face recognition with clustering based domain adaptation [57.29464116557734]
We propose a new clustering-based domain adaptation method designed for face recognition task in which the source and target domain do not share any classes.
Our method effectively learns the discriminative target feature by aligning the feature domain globally, and, at the meantime, distinguishing the target clusters locally.
arXiv Detail & Related papers (2022-05-27T12:29:11Z) - Cross-Region Building Counting in Satellite Imagery using Counting
Consistency [8.732274235941974]
Estimating the number of buildings in any geographical region is a vital component of urban analysis, disaster management, and public policy decision.
Deep learning methods for building localization and counting in satellite imagery, can serve as a viable and cheap alternative.
However, these algorithms suffer performance degradation when applied to the regions on which they have not been trained.
arXiv Detail & Related papers (2021-10-26T10:36:56Z) - AFAN: Augmented Feature Alignment Network for Cross-Domain Object
Detection [90.18752912204778]
Unsupervised domain adaptation for object detection is a challenging problem with many real-world applications.
We propose a novel augmented feature alignment network (AFAN) which integrates intermediate domain image generation and domain-adversarial training.
Our approach significantly outperforms the state-of-the-art methods on standard benchmarks for both similar and dissimilar domain adaptations.
arXiv Detail & Related papers (2021-06-10T05:01:20Z) - Domain Conditioned Adaptation Network [90.63261870610211]
We propose a Domain Conditioned Adaptation Network (DCAN) to excite distinct convolutional channels with a domain conditioned channel attention mechanism.
This is the first work to explore the domain-wise convolutional channel activation for deep DA networks.
arXiv Detail & Related papers (2020-05-14T04:23:24Z) - Spatial Attention Pyramid Network for Unsupervised Domain Adaptation [66.75008386980869]
Unsupervised domain adaptation is critical in various computer vision tasks.
We design a new spatial attention pyramid network for unsupervised domain adaptation.
Our method performs favorably against the state-of-the-art methods by a large margin.
arXiv Detail & Related papers (2020-03-29T09:03:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.