Domain Adaptation on Semantic Segmentation for Aerial Images
- URL: http://arxiv.org/abs/2012.02264v2
- Date: Fri, 11 Dec 2020 16:09:12 GMT
- Title: Domain Adaptation on Semantic Segmentation for Aerial Images
- Authors: Ying Chen, Xu Ouyang, Kaiyue Zhu, Gady Agam
- Abstract summary: We propose a novel unsupervised domain adaptation framework to address domain shift in semantic image segmentation.
We also apply entropy minimization on the target domain to produce high-confident prediction.
We show improvement over state-of-the-art methods in terms of various metrics.
- Score: 3.946367634483361
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Semantic segmentation has achieved significant advances in recent years.
While deep neural networks perform semantic segmentation well, their success
rely on pixel level supervision which is expensive and time-consuming. Further,
training using data from one domain may not generalize well to data from a new
domain due to a domain gap between data distributions in the different domains.
This domain gap is particularly evident in aerial images where visual
appearance depends on the type of environment imaged, season, weather, and time
of day when the environment is imaged. Subsequently, this distribution gap
leads to severe accuracy loss when using a pretrained segmentation model to
analyze new data with different characteristics. In this paper, we propose a
novel unsupervised domain adaptation framework to address domain shift in the
context of aerial semantic image segmentation. To this end, we solve the
problem of domain shift by learn the soft label distribution difference between
the source and target domains. Further, we also apply entropy minimization on
the target domain to produce high-confident prediction rather than using
high-confident prediction by pseudo-labeling. We demonstrate the effectiveness
of our domain adaptation framework using the challenge image segmentation
dataset of ISPRS, and show improvement over state-of-the-art methods in terms
of various metrics.
Related papers
- Unsupervised Domain Adaptation for Semantic Segmentation using One-shot
Image-to-Image Translation via Latent Representation Mixing [9.118706387430883]
We propose a new unsupervised domain adaptation method for the semantic segmentation of very high resolution images.
An image-to-image translation paradigm is proposed, based on an encoder-decoder principle where latent content representations are mixed across domains.
Cross-city comparative experiments have shown that the proposed method outperforms state-of-the-art domain adaptation methods.
arXiv Detail & Related papers (2022-12-07T18:16:17Z) - Edge-preserving Domain Adaptation for semantic segmentation of Medical
Images [0.0]
Domain adaptation is a technique to address the lack of massive amounts of labeled data in unseen environments.
We propose a model that adapts between domains using cycle-consistent loss while maintaining edge details of the original images.
We demonstrate the effectiveness of our algorithm by comparing it to other approaches on two eye fundus vessels segmentation datasets.
arXiv Detail & Related papers (2021-11-18T18:14:33Z) - AFAN: Augmented Feature Alignment Network for Cross-Domain Object
Detection [90.18752912204778]
Unsupervised domain adaptation for object detection is a challenging problem with many real-world applications.
We propose a novel augmented feature alignment network (AFAN) which integrates intermediate domain image generation and domain-adversarial training.
Our approach significantly outperforms the state-of-the-art methods on standard benchmarks for both similar and dissimilar domain adaptations.
arXiv Detail & Related papers (2021-06-10T05:01:20Z) - Multi-Source Domain Adaptation with Collaborative Learning for Semantic
Segmentation [32.95273803359897]
Multi-source unsupervised domain adaptation(MSDA) aims at adapting models trained on multiple labeled source domains to an unlabeled target domain.
We propose a novel multi-source domain adaptation framework based on collaborative learning for semantic segmentation.
arXiv Detail & Related papers (2021-03-08T12:51:42Z) - Pixel-Level Cycle Association: A New Perspective for Domain Adaptive
Semantic Segmentation [169.82760468633236]
We propose to build the pixel-level cycle association between source and target pixel pairs.
Our method can be trained end-to-end in one stage and introduces no additional parameters.
arXiv Detail & Related papers (2020-10-31T00:11:36Z) - Discriminative Cross-Domain Feature Learning for Partial Domain
Adaptation [70.45936509510528]
Partial domain adaptation aims to adapt knowledge from a larger and more diverse source domain to a smaller target domain with less number of classes.
Recent practice on domain adaptation manages to extract effective features by incorporating the pseudo labels for the target domain.
It is essential to align target data with only a small set of source data.
arXiv Detail & Related papers (2020-08-26T03:18:53Z) - Domain Adaptation for Semantic Parsing [68.81787666086554]
We propose a novel semantic for domain adaptation, where we have much fewer annotated data in the target domain compared to the source domain.
Our semantic benefits from a two-stage coarse-to-fine framework, thus can provide different and accurate treatments for the two stages.
Experiments on a benchmark dataset show that our method consistently outperforms several popular domain adaptation strategies.
arXiv Detail & Related papers (2020-06-23T14:47:41Z) - Spatial Attention Pyramid Network for Unsupervised Domain Adaptation [66.75008386980869]
Unsupervised domain adaptation is critical in various computer vision tasks.
We design a new spatial attention pyramid network for unsupervised domain adaptation.
Our method performs favorably against the state-of-the-art methods by a large margin.
arXiv Detail & Related papers (2020-03-29T09:03:23Z) - Domain Adaptive Medical Image Segmentation via Adversarial Learning of
Disease-Specific Spatial Patterns [6.298270929323396]
We propose an unsupervised domain adaptation framework for boosting image segmentation performance across multiple domains.
We enforce architectures to be adaptive to new data by rejecting improbable segmentation patterns and implicitly learning through semantic and boundary information.
We demonstrate that recalibrating the deep networks on a few unlabeled images from the target domain improves the segmentation accuracy significantly.
arXiv Detail & Related papers (2020-01-25T13:48:02Z) - CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistency [119.45667331836583]
Unsupervised domain adaptation algorithms aim to transfer the knowledge learned from one domain to another.
We present a novel pixel-wise adversarial domain adaptation algorithm.
arXiv Detail & Related papers (2020-01-09T19:00:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.