Spectral Transfer Guided Active Domain Adaptation For Thermal Imagery
- URL: http://arxiv.org/abs/2304.07031v1
- Date: Fri, 14 Apr 2023 10:04:42 GMT
- Title: Spectral Transfer Guided Active Domain Adaptation For Thermal Imagery
- Authors: Berkcan Ustun, Ahmet Kagan Kaya, Ezgi Cakir Ayerden, Fazil Altinel
- Abstract summary: We propose an active domain adaptation method to examine the efficiency of combining the visible spectrum and thermal imagery modalities.
We used the large-scale visible spectrum dataset MS-COCO as the source domain and the thermal dataset FLIR ADAS as the target domain.
Our proposed method outperforms the state-of-the-art active domain adaptation methods.
- Score: 1.911678487931003
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The exploitation of visible spectrum datasets has led deep networks to show
remarkable success. However, real-world tasks include low-lighting conditions
which arise performance bottlenecks for models trained on large-scale RGB image
datasets. Thermal IR cameras are more robust against such conditions.
Therefore, the usage of thermal imagery in real-world applications can be
useful. Unsupervised domain adaptation (UDA) allows transferring information
from a source domain to a fully unlabeled target domain. Despite substantial
improvements in UDA, the performance gap between UDA and its supervised
learning counterpart remains significant. By picking a small number of target
samples to annotate and using them in training, active domain adaptation tries
to mitigate this gap with minimum annotation expense. We propose an active
domain adaptation method in order to examine the efficiency of combining the
visible spectrum and thermal imagery modalities. When the domain gap is
considerably large as in the visible-to-thermal task, we may conclude that the
methods without explicit domain alignment cannot achieve their full potential.
To this end, we propose a spectral transfer guided active domain adaptation
method to select the most informative unlabeled target samples while aligning
source and target domains. We used the large-scale visible spectrum dataset
MS-COCO as the source domain and the thermal dataset FLIR ADAS as the target
domain to present the results of our method. Extensive experimental evaluation
demonstrates that our proposed method outperforms the state-of-the-art active
domain adaptation methods. The code and models are publicly available.
Related papers
- Spectral Adversarial MixUp for Few-Shot Unsupervised Domain Adaptation [72.70876977882882]
Domain shift is a common problem in clinical applications, where the training images (source domain) and the test images (target domain) are under different distributions.
We propose a novel method for Few-Shot Unsupervised Domain Adaptation (FSUDA), where only a limited number of unlabeled target domain samples are available for training.
arXiv Detail & Related papers (2023-09-03T16:02:01Z) - Enhancing Visual Domain Adaptation with Source Preparation [5.287588907230967]
Domain Adaptation techniques fail to consider the characteristics of the source domain itself.
We propose Source Preparation (SP), a method to mitigate source domain biases.
We show that SP enhances UDA across a range of visual domains, with improvements up to 40.64% in mIoU over baseline.
arXiv Detail & Related papers (2023-06-16T18:56:44Z) - Exploring Few-Shot Adaptation for Activity Recognition on Diverse Domains [46.26074225989355]
Domain adaptation is essential for activity recognition to ensure accurate and robust performance across diverse environments.
In this work, we focus on FewShot Domain Adaptation for Activity Recognition (FSDA-AR), which leverages a very small amount of labeled target videos.
We propose a new FSDA-AR using five established datasets considering the adaptation on more diverse and challenging domains.
arXiv Detail & Related papers (2023-05-15T08:01:05Z) - MADAv2: Advanced Multi-Anchor Based Active Domain Adaptation
Segmentation [98.09845149258972]
We introduce active sample selection to assist domain adaptation regarding the semantic segmentation task.
With only a little workload to manually annotate these samples, the distortion of the target-domain distribution can be effectively alleviated.
A powerful semi-supervised domain adaptation strategy is proposed to alleviate the long-tail distribution problem.
arXiv Detail & Related papers (2023-01-18T07:55:22Z) - An Unsupervised Domain Adaptive Approach for Multimodal 2D Object
Detection in Adverse Weather Conditions [5.217255784808035]
We propose an unsupervised domain adaptation framework to bridge the domain gap between source and target domains.
We use a data augmentation scheme that simulates weather distortions to add domain confusion and prevent overfitting on the source data.
Experiments performed on the DENSE dataset show that our method can substantially alleviate the domain gap.
arXiv Detail & Related papers (2022-03-07T18:10:40Z) - Frequency Spectrum Augmentation Consistency for Domain Adaptive Object
Detection [107.52026281057343]
We introduce a Frequency Spectrum Augmentation Consistency (FSAC) framework with four different low-frequency filter operations.
In the first stage, we utilize all the original and augmented source data to train an object detector.
In the second stage, augmented source and target data with pseudo labels are adopted to perform the self-training for prediction consistency.
arXiv Detail & Related papers (2021-12-16T04:07:01Z) - Meta-UDA: Unsupervised Domain Adaptive Thermal Object Detection using
Meta-Learning [64.92447072894055]
Infrared (IR) cameras are robust under adverse illumination and lighting conditions.
We propose an algorithm meta-learning framework to improve existing UDA methods.
We produce a state-of-the-art thermal detector for the KAIST and DSIAC datasets.
arXiv Detail & Related papers (2021-10-07T02:28:18Z) - Self-training Guided Adversarial Domain Adaptation For Thermal Imagery [0.12891210250935145]
We propose an unsupervised domain adaptation method which does not require RGB-to-thermal image pairs.
We employ large-scale RGB dataset MS-COCO as source domain and thermal dataset FLIR ADAS as target domain.
To perform self-training, pseudo labels are assigned to the samples on the target thermal domain to learn more generalized representations for the target domain.
arXiv Detail & Related papers (2021-06-14T05:17:21Z) - Effective Label Propagation for Discriminative Semi-Supervised Domain
Adaptation [76.41664929948607]
Semi-supervised domain adaptation (SSDA) methods have demonstrated great potential in large-scale image classification tasks.
We present a novel and effective method to tackle this problem by using effective inter-domain and intra-domain semantic information propagation.
Our source code and pre-trained models will be released soon.
arXiv Detail & Related papers (2020-12-04T14:28:19Z) - Exploring Thermal Images for Object Detection in Underexposure Regions
for Autonomous Driving [67.69430435482127]
Underexposure regions are vital to construct a complete perception of the surroundings for safe autonomous driving.
The availability of thermal cameras has provided an essential alternate to explore regions where other optical sensors lack in capturing interpretable signals.
This work proposes a domain adaptation framework which employs a style transfer technique for transfer learning from visible spectrum images to thermal images.
arXiv Detail & Related papers (2020-06-01T09:59:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.