Unsupervised Domain Adaptation for Semantic Segmentation by Content
Transfer
- URL: http://arxiv.org/abs/2012.12545v1
- Date: Wed, 23 Dec 2020 09:01:00 GMT
- Title: Unsupervised Domain Adaptation for Semantic Segmentation by Content
Transfer
- Authors: Suhyeon Lee, Junhyuk Hyun, Hongje Seong, Euntai Kim
- Abstract summary: We tackle the unsupervised domain adaptation (UDA) for semantic segmentation.
Main problem of UDA for semantic segmentation relies on reducing the domain gap between the real image and synthetic image.
We propose a zero-style loss method to make the best of this effect.
- Score: 13.004192914150646
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we tackle the unsupervised domain adaptation (UDA) for
semantic segmentation, which aims to segment the unlabeled real data using
labeled synthetic data. The main problem of UDA for semantic segmentation
relies on reducing the domain gap between the real image and synthetic image.
To solve this problem, we focused on separating information in an image into
content and style. Here, only the content has cues for semantic segmentation,
and the style makes the domain gap. Thus, precise separation of content and
style in an image leads to effect as supervision of real data even when
learning with synthetic data. To make the best of this effect, we propose a
zero-style loss. Even though we perfectly extract content for semantic
segmentation in the real domain, another main challenge, the class imbalance
problem, still exists in UDA for semantic segmentation. We address this problem
by transferring the contents of tail classes from synthetic to real domain.
Experimental results show that the proposed method achieves the
state-of-the-art performance in semantic segmentation on the major two UDA
settings.
Related papers
- AdaptDiff: Cross-Modality Domain Adaptation via Weak Conditional Semantic Diffusion for Retinal Vessel Segmentation [10.958821619282748]
We present an unsupervised domain adaptation (UDA) method named AdaptDiff.
It enables a retinal vessel segmentation network trained on fundus photography (FP) to produce satisfactory results on unseen modalities.
Our results demonstrate a significant improvement in segmentation performance across all unseen datasets.
arXiv Detail & Related papers (2024-10-06T23:04:29Z) - Advancing Incremental Few-shot Semantic Segmentation via Semantic-guided
Relation Alignment and Adaptation [98.51938442785179]
Incremental few-shot semantic segmentation aims to incrementally extend a semantic segmentation model to novel classes.
This task faces a severe semantic-aliasing issue between base and novel classes due to data imbalance.
We propose the Semantic-guided Relation Alignment and Adaptation (SRAA) method that fully considers the guidance of prior semantic information.
arXiv Detail & Related papers (2023-05-18T10:40:52Z) - Semi-supervised domain adaptation with CycleGAN guided by a downstream
task loss [4.941630596191806]
Domain adaptation is of huge interest as labeling is an expensive and error-prone task.
Image-to-image approaches can be used to mitigate the shift in the input.
We propose a "task aware" version of a GAN in an image-to-image domain adaptation approach.
arXiv Detail & Related papers (2022-08-18T13:13:30Z) - Improving Semi-Supervised and Domain-Adaptive Semantic Segmentation with
Self-Supervised Depth Estimation [94.16816278191477]
We present a framework for semi-adaptive and domain-supervised semantic segmentation.
It is enhanced by self-supervised monocular depth estimation trained only on unlabeled image sequences.
We validate the proposed model on the Cityscapes dataset.
arXiv Detail & Related papers (2021-08-28T01:33:38Z) - Adversarial Semantic Hallucination for Domain Generalized Semantic
Segmentation [50.14933487082085]
We propose an adversarial hallucination approach, which combines a class-wise hallucination module and a semantic segmentation module.
Experiments on state of the art domain adaptation work demonstrate the efficacy of our proposed method when no target domain data are available for training.
arXiv Detail & Related papers (2021-06-08T07:07:45Z) - Get away from Style: Category-Guided Domain Adaptation for Semantic
Segmentation [15.002381934551359]
Unsupervised domain adaptation (UDA) becomes more and more popular in tackling real-world problems without ground truth of the target domain.
In this paper, we focus on UDA for semantic segmentation task.
We propose a style-independent content feature extraction mechanism to keep the style information of extracted features in the similar space.
Secondly, to keep the balance of pseudo labels on each category, we propose a category-guided threshold mechanism to choose category-wise pseudo labels for self-supervised learning.
arXiv Detail & Related papers (2021-03-29T10:00:50Z) - Affinity Space Adaptation for Semantic Segmentation Across Domains [57.31113934195595]
In this paper, we address the problem of unsupervised domain adaptation (UDA) in semantic segmentation.
Motivated by the fact that source and target domain have invariant semantic structures, we propose to exploit such invariance across domains.
We develop two affinity space adaptation strategies: affinity space cleaning and adversarial affinity space alignment.
arXiv Detail & Related papers (2020-09-26T10:28:11Z) - Semantically Adaptive Image-to-image Translation for Domain Adaptation
of Semantic Segmentation [1.8275108630751844]
We address the problem of domain adaptation for semantic segmentation of street scenes.
Many state-of-the-art approaches focus on translating the source image while imposing that the result should be semantically consistent with the input.
We advocate that the image semantics can also be exploited to guide the translation algorithm.
arXiv Detail & Related papers (2020-09-02T16:16:50Z) - Phase Consistent Ecological Domain Adaptation [76.75730500201536]
We focus on the task of semantic segmentation, where annotated synthetic data are aplenty, but annotating real data is laborious.
The first criterion, inspired by visual psychophysics, is that the map between the two image domains be phase-preserving.
The second criterion aims to leverage ecological statistics, or regularities in the scene which are manifest in any image of it, regardless of the characteristics of the illuminant or the imaging sensor.
arXiv Detail & Related papers (2020-04-10T06:58:03Z) - Differential Treatment for Stuff and Things: A Simple Unsupervised
Domain Adaptation Method for Semantic Segmentation [105.96860932833759]
State-of-the-art approaches prove that performing semantic-level alignment is helpful in tackling the domain shift issue.
We propose to improve the semantic-level alignment with different strategies for stuff regions and for things.
In addition to our proposed method, we show that our method can help ease this issue by minimizing the most similar stuff and instance features between the source and the target domains.
arXiv Detail & Related papers (2020-03-18T04:43:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.