Domain Adaptor Networks for Hyperspectral Image Recognition

• URL: http://arxiv.org/abs/2108.01555v1
• Date: Tue, 3 Aug 2021 15:06:39 GMT
• Title: Domain Adaptor Networks for Hyperspectral Image Recognition
• Authors: Gustavo Perez and Subhransu Maji
• Abstract summary: We consider the problem of adapting a network trained on three-channel color images to a hyperspectral domain with a large number of channels. We propose domain adaptor networks that map the input to be compatible with a network trained on large-scale color image datasets such as ImageNet.
• Score: 35.95313368586933
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We consider the problem of adapting a network trained on three-channel color images to a hyperspectral domain with a large number of channels. To this end, we propose domain adaptor networks that map the input to be compatible with a network trained on large-scale color image datasets such as ImageNet. Adaptors enable learning on small hyperspectral datasets where training a network from scratch may not be effective. We investigate architectures and strategies for training adaptors and evaluate them on a benchmark consisting of multiple hyperspectral datasets. We find that simple schemes such as linear projection or subset selection are often the most effective, but can lead to a loss in performance in some cases. We also propose a novel multi-view adaptor where of the inputs are combined in an intermediate layer of the network in an order invariant manner that provides further improvements. We present extensive experiments by varying the number of training examples in the benchmark to characterize the accuracy and computational trade-offs offered by these adaptors.

Related papers

Err

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.