Code-Aligned Autoencoders for Unsupervised Change Detection in
Multimodal Remote Sensing Images
- URL: http://arxiv.org/abs/2004.07011v1
- Date: Wed, 15 Apr 2020 11:24:51 GMT
- Title: Code-Aligned Autoencoders for Unsupervised Change Detection in
Multimodal Remote Sensing Images
- Authors: Luigi T.Luppino, Mads A. Hansen, Michael Kampffmeyer, Filippo M.
Bianchi, Gabriele Moser, Robert Jenssen, Stian N. Anfinsen
- Abstract summary: Image translation with convolutional autoencoders has recently been used as an approach to multimodal change detection in bitemporal satellite images.
A main challenge is the alignment of the code spaces by reducing the contribution of change pixels to the learning of the translation function.
We propose to extract relational pixel information captured by domain-specific affinity matrices at the input and use this to enforce alignment of the code spaces.
- Score: 18.133760118780128
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Image translation with convolutional autoencoders has recently been used as
an approach to multimodal change detection in bitemporal satellite images. A
main challenge is the alignment of the code spaces by reducing the contribution
of change pixels to the learning of the translation function. Many existing
approaches train the networks by exploiting supervised information of the
change areas, which, however, is not always available. We propose to extract
relational pixel information captured by domain-specific affinity matrices at
the input and use this to enforce alignment of the code spaces and reduce the
impact of change pixels on the learning objective. A change prior is derived in
an unsupervised fashion from pixel pair affinities that are comparable across
domains. To achieve code space alignment we enforce that pixel with similar
affinity relations in the input domains should be correlated also in code
space. We demonstrate the utility of this procedure in combination with cycle
consistency. The proposed approach are compared with state-of-the-art deep
learning algorithms. Experiments conducted on four real datasets show the
effectiveness of our methodology.
Related papers
- Unsupervised Domain Adaptation for Semantic Segmentation using One-shot
Image-to-Image Translation via Latent Representation Mixing [9.118706387430883]
We propose a new unsupervised domain adaptation method for the semantic segmentation of very high resolution images.
An image-to-image translation paradigm is proposed, based on an encoder-decoder principle where latent content representations are mixed across domains.
Cross-city comparative experiments have shown that the proposed method outperforms state-of-the-art domain adaptation methods.
arXiv Detail & Related papers (2022-12-07T18:16:17Z) - PiPa: Pixel- and Patch-wise Self-supervised Learning for Domain
Adaptative Semantic Segmentation [100.6343963798169]
Unsupervised Domain Adaptation (UDA) aims to enhance the generalization of the learned model to other domains.
We propose a unified pixel- and patch-wise self-supervised learning framework, called PiPa, for domain adaptive semantic segmentation.
arXiv Detail & Related papers (2022-11-14T18:31:24Z) - dual unet:a novel siamese network for change detection with cascade
differential fusion [4.651756476458979]
We propose a novel Siamese neural network for change detection task, namely Dual-UNet.
In contrast to previous individually encoded the bitemporal images, we design an encoder differential-attention module to focus on the spatial difference relationships of pixels.
Experiments demonstrate that the proposed approach consistently outperforms the most advanced methods on popular seasonal change detection datasets.
arXiv Detail & Related papers (2022-08-12T14:24:09Z) - Global and Local Alignment Networks for Unpaired Image-to-Image
Translation [170.08142745705575]
The goal of unpaired image-to-image translation is to produce an output image reflecting the target domain's style.
Due to the lack of attention to the content change in existing methods, semantic information from source images suffers from degradation during translation.
We introduce a novel approach, Global and Local Alignment Networks (GLA-Net)
Our method effectively generates sharper and more realistic images than existing approaches.
arXiv Detail & Related papers (2021-11-19T18:01:54Z) - LocalTrans: A Multiscale Local Transformer Network for Cross-Resolution
Homography Estimation [52.63874513999119]
Cross-resolution image alignment is a key problem in multiscale giga photography.
Existing deep homography methods neglecting the explicit formulation of correspondences between them, which leads to degraded accuracy in cross-resolution challenges.
We propose a local transformer network embedded within a multiscale structure to explicitly learn correspondences between the multimodal inputs.
arXiv Detail & Related papers (2021-06-08T02:51:45Z) - AINet: Association Implantation for Superpixel Segmentation [82.21559299694555]
We propose a novel textbfAssociation textbfImplantation (AI) module to enable the network to explicitly capture the relations between the pixel and its surrounding grids.
Our method could not only achieve state-of-the-art performance but maintain satisfactory inference efficiency.
arXiv Detail & Related papers (2021-01-26T10:40:13Z) - Image Fine-grained Inpainting [89.17316318927621]
We present a one-stage model that utilizes dense combinations of dilated convolutions to obtain larger and more effective receptive fields.
To better train this efficient generator, except for frequently-used VGG feature matching loss, we design a novel self-guided regression loss.
We also employ a discriminator with local and global branches to ensure local-global contents consistency.
arXiv Detail & Related papers (2020-02-07T03:45:25Z) - Deep Image Translation with an Affinity-Based Change Prior for
Unsupervised Multimodal Change Detection [20.485370285874613]
We propose two new network architectures trained with loss functions weighted by priors that reduce the impact of change pixels on the learning objective.
The proposed neural networks are compared with state-of-the-art algorithms.
arXiv Detail & Related papers (2020-01-13T14:23:24Z) - CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistency [119.45667331836583]
Unsupervised domain adaptation algorithms aim to transfer the knowledge learned from one domain to another.
We present a novel pixel-wise adversarial domain adaptation algorithm.
arXiv Detail & Related papers (2020-01-09T19:00:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.