T-UDA: Temporal Unsupervised Domain Adaptation in Sequential Point
Clouds
- URL: http://arxiv.org/abs/2309.08302v1
- Date: Fri, 15 Sep 2023 10:47:12 GMT
- Title: T-UDA: Temporal Unsupervised Domain Adaptation in Sequential Point
Clouds
- Authors: Awet Haileslassie Gebrehiwot, David Hurych, Karel Zimmermann, Patrick
P\'erez, Tom\'a\v{s} Svoboda
- Abstract summary: unsupervised domain adaptation (UDA) methods adapt models trained on one (source) domain with annotations available to another (target) domain for which only unannotated data are available.
We introduce a novel domain adaptation method that leverages the best of both trends. Dubbed T-UDA for "temporal UDA", such a combination yields massive performance gains for the task of 3D semantic segmentation of driving scenes.
- Score: 2.5291108878852864
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep perception models have to reliably cope with an open-world setting of
domain shifts induced by different geographic regions, sensor properties,
mounting positions, and several other reasons. Since covering all domains with
annotated data is technically intractable due to the endless possible
variations, researchers focus on unsupervised domain adaptation (UDA) methods
that adapt models trained on one (source) domain with annotations available to
another (target) domain for which only unannotated data are available. Current
predominant methods either leverage semi-supervised approaches, e.g.,
teacher-student setup, or exploit privileged data, such as other sensor
modalities or temporal data consistency. We introduce a novel domain adaptation
method that leverages the best of both trends. Our approach combines input
data's temporal and cross-sensor geometric consistency with the mean teacher
method. Dubbed T-UDA for "temporal UDA", such a combination yields massive
performance gains for the task of 3D semantic segmentation of driving scenes.
Experiments are conducted on Waymo Open Dataset, nuScenes and SemanticKITTI,
for two popular 3D point cloud architectures, Cylinder3D and MinkowskiNet. Our
codes are publicly available at https://github.com/ctu-vras/T-UDA.
Related papers
- Syn-to-Real Unsupervised Domain Adaptation for Indoor 3D Object Detection [50.448520056844885]
We propose a novel framework for syn-to-real unsupervised domain adaptation in indoor 3D object detection.
Our adaptation results from synthetic dataset 3D-FRONT to real-world datasets ScanNetV2 and SUN RGB-D demonstrate remarkable mAP25 improvements of 9.7% and 9.1% over Source-Only baselines.
arXiv Detail & Related papers (2024-06-17T08:18:41Z) - Compositional Semantic Mix for Domain Adaptation in Point Cloud
Segmentation [65.78246406460305]
compositional semantic mixing represents the first unsupervised domain adaptation technique for point cloud segmentation.
We present a two-branch symmetric network architecture capable of concurrently processing point clouds from a source domain (e.g. synthetic) and point clouds from a target domain (e.g. real-world)
arXiv Detail & Related papers (2023-08-28T14:43:36Z) - SSDA3D: Semi-supervised Domain Adaptation for 3D Object Detection from
Point Cloud [125.9472454212909]
We present a novel Semi-Supervised Domain Adaptation method for 3D object detection (SSDA3D)
SSDA3D includes an Inter-domain Adaptation stage and an Intra-domain Generalization stage.
Experiments show that, with only 10% labeled target data, our SSDA3D can surpass the fully-supervised oracle model with 100% target label.
arXiv Detail & Related papers (2022-12-06T09:32:44Z) - Viewer-Centred Surface Completion for Unsupervised Domain Adaptation in
3D Object Detection [7.489722641968593]
3D detectors tend to overfit datasets they are trained on. This causes a drastic decrease in accuracy when the detectors are trained on one dataset and tested on another.
We address this in our approach, SEE-VCN, by designing a novel viewer-centred surface completion network (VCN)
With SEE-VCN, we obtain a unified representation of objects across datasets, allowing the network to focus on learning geometry, rather than overfitting on scan patterns.
arXiv Detail & Related papers (2022-09-14T04:22:20Z) - Seeking Similarities over Differences: Similarity-based Domain Alignment
for Adaptive Object Detection [86.98573522894961]
We propose a framework that generalizes the components commonly used by Unsupervised Domain Adaptation (UDA) algorithms for detection.
Specifically, we propose a novel UDA algorithm, ViSGA, that leverages the best design choices and introduces a simple but effective method to aggregate features at instance-level.
We show that both similarity-based grouping and adversarial training allows our model to focus on coarsely aligning feature groups, without being forced to match all instances across loosely aligned domains.
arXiv Detail & Related papers (2021-10-04T13:09:56Z) - Stagewise Unsupervised Domain Adaptation with Adversarial Self-Training
for Road Segmentation of Remote Sensing Images [93.50240389540252]
Road segmentation from remote sensing images is a challenging task with wide ranges of application potentials.
We propose a novel stagewise domain adaptation model called RoadDA to address the domain shift (DS) issue in this field.
Experiment results on two benchmarks demonstrate that RoadDA can efficiently reduce the domain gap and outperforms state-of-the-art methods.
arXiv Detail & Related papers (2021-08-28T09:29:14Z) - Inferring Latent Domains for Unsupervised Deep Domain Adaptation [54.963823285456925]
Unsupervised Domain Adaptation (UDA) refers to the problem of learning a model in a target domain where labeled data are not available.
This paper introduces a novel deep architecture which addresses the problem of UDA by automatically discovering latent domains in visual datasets.
We evaluate our approach on publicly available benchmarks, showing that it outperforms state-of-the-art domain adaptation methods.
arXiv Detail & Related papers (2021-03-25T14:33:33Z) - Generation for adaption: a Gan-based approach for 3D Domain Adaption
inPoint Cloud [10.614067060304919]
Unsupervised domain adaptation (UDA) seeks to overcome such a problem without target domain labels.
We propose a method that use a Generative adversarial network to generate synthetic data from the source domain.
Experiments show that our approach performs better than other state-of-the-art UDA methods in three popular 3D object/scene datasets.
arXiv Detail & Related papers (2021-02-15T07:24:10Z) - Multi-Source Deep Domain Adaptation with Weak Supervision for
Time-Series Sensor Data [31.43183992755392]
We propose a novel Convolutional deep Domain Adaptation model for Time Series data (CoDATS)
Second, we propose a novel Domain Adaptation with Weak Supervision (DA-WS) method by utilizing weak supervision in the form of target-domain label distributions.
Third, we perform comprehensive experiments on diverse real-world datasets to evaluate the effectiveness of our domain adaptation and weak supervision methods.
arXiv Detail & Related papers (2020-05-22T04:16:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.