Dsfer-Net: A Deep Supervision and Feature Retrieval Network for Bitemporal Change Detection Using Modern Hopfield Networks

• URL: http://arxiv.org/abs/2304.01101v2
• Date: Tue, 4 Jun 2024 17:55:02 GMT
• Title: Dsfer-Net: A Deep Supervision and Feature Retrieval Network for Bitemporal Change Detection Using Modern Hopfield Networks
• Authors: Shizhen Chang, Michael Kopp, Pedram Ghamisi, Bo Du,
• Abstract summary: We propose a Deep Supervision and FEature Retrieval network (Dsfer-Net) for bitemporal change detection. Specifically, the highly representative deep features of bitemporal images are jointly extracted through a fully convolutional Siamese network. Our end-to-end network establishes a novel framework by aggregating retrieved features and feature pairs from different layers.
• Score: 35.415260892693745
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Change detection, an essential application for high-resolution remote sensing images, aims to monitor and analyze changes in the land surface over time. Due to the rapid increase in the quantity of high-resolution remote sensing data and the complexity of texture features, several quantitative deep learning-based methods have been proposed. These methods outperform traditional change detection methods by extracting deep features and combining spatial-temporal information. However, reasonable explanations for how deep features improve detection performance are still lacking. In our investigations, we found that modern Hopfield network layers significantly enhance semantic understanding. In this paper, we propose a Deep Supervision and FEature Retrieval network (Dsfer-Net) for bitemporal change detection. Specifically, the highly representative deep features of bitemporal images are jointly extracted through a fully convolutional Siamese network. Based on the sequential geographical information of the bitemporal images, we designed a feature retrieval module to extract difference features and leverage discriminative information in a deeply supervised manner. Additionally, we observed that the deeply supervised feature retrieval module provides explainable evidence of the semantic understanding of the proposed network in its deep layers. Finally, our end-to-end network establishes a novel framework by aggregating retrieved features and feature pairs from different layers. Experiments conducted on three public datasets (LEVIR-CD, WHU-CD, and CDD) confirm the superiority of the proposed Dsfer-Net over other state-of-the-art methods.

Related papers

• Relating CNN-Transformer Fusion Network for Change Detection [23.025190360146635]
  RCTNet introduces an early fusion backbone to exploit both spatial and temporal features. Experiments demonstrate RCTNet's clear superiority over traditional RS image CD methods.
  arXiv  Detail & Related papers  (2024-07-03T14:58:40Z)
• AMANet: Advancing SAR Ship Detection with Adaptive Multi-Hierarchical Attention Network [0.5437298646956507]
  A novel adaptive multi-hierarchical attention module (AMAM) is proposed to learn multi-scale features and adaptively aggregate salient features from various feature layers. We first fuse information from adjacent feature layers to enhance the detection of smaller targets, thereby achieving multi-scale feature enhancement. Thirdly, we present a novel adaptive multi-hierarchical attention network (AMANet) by embedding the AMAM between the backbone network and the feature pyramid network.
  arXiv  Detail & Related papers  (2024-01-24T03:56:33Z)
• Frequency Perception Network for Camouflaged Object Detection [51.26386921922031]
  We propose a novel learnable and separable frequency perception mechanism driven by the semantic hierarchy in the frequency domain. Our entire network adopts a two-stage model, including a frequency-guided coarse localization stage and a detail-preserving fine localization stage. Compared with the currently existing models, our proposed method achieves competitive performance in three popular benchmark datasets.
  arXiv  Detail & Related papers  (2023-08-17T11:30:46Z)
• AGO-Net: Association-Guided 3D Point Cloud Object Detection Network [86.10213302724085]
  We propose a novel 3D detection framework that associates intact features for objects via domain adaptation. We achieve new state-of-the-art performance on the KITTI 3D detection benchmark in both accuracy and speed.
  arXiv  Detail & Related papers  (2022-08-24T16:54:38Z)
• Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepth [24.897377434844266]
  We propose a novel structure and training strategy for monocular depth estimation. We deploy a hierarchical transformer encoder to capture and convey the global context, and design a lightweight yet powerful decoder. Our network achieves state-of-the-art performance over the challenging depth dataset NYU Depth V2.
  arXiv  Detail & Related papers  (2022-01-19T06:37:21Z)
• Towards Interpretable Deep Networks for Monocular Depth Estimation [78.84690613778739]
  We quantify the interpretability of a deep MDE network by the depth selectivity of its hidden units. We propose a method to train interpretable MDE deep networks without changing their original architectures. Experimental results demonstrate that our method is able to enhance the interpretability of deep MDE networks.
  arXiv  Detail & Related papers  (2021-08-11T16:43:45Z)
• Multi-view Depth Estimation using Epipolar Spatio-Temporal Networks [87.50632573601283]
  We present a novel method for multi-view depth estimation from a single video. Our method achieves temporally coherent depth estimation results by using a novel Epipolar Spatio-Temporal (EST) transformer. To reduce the computational cost, inspired by recent Mixture-of-Experts models, we design a compact hybrid network.
  arXiv  Detail & Related papers  (2020-11-26T04:04:21Z)
• Ventral-Dorsal Neural Networks: Object Detection via Selective Attention [51.79577908317031]
  We propose a new framework called Ventral-Dorsal Networks (VDNets) Inspired by the structure of the human visual system, we propose the integration of a "Ventral Network" and a "Dorsal Network" Our experimental results reveal that the proposed method outperforms state-of-the-art object detection approaches.
  arXiv  Detail & Related papers  (2020-05-15T23:57:36Z)
• Deep Siamese Domain Adaptation Convolutional Neural Network for Cross-domain Change Detection in Multispectral Images [28.683734356006262]
  We propose a novel deep siamese domain adaptation convolutional neural network (DSDANet) architecture for cross-domain change detection. To the best of our knowledge, it is the first time that such a domain adaptation-based deep network is proposed for change detection.
  arXiv  Detail & Related papers  (2020-04-13T02:15:04Z)
• From W-Net to CDGAN: Bi-temporal Change Detection via Deep Learning Techniques [43.58400031452662]
  We propose an end-to-end dual-branch architecture termed as the W-Net, with each branch taking as input one of the two bi-temporal images. We also apply the recently popular Generative Adversarial Network (GAN) in which our W-Net serves as the Generator. To train our networks and also facilitate future research, we construct a large scale dataset by collecting images from Google Earth.
  arXiv  Detail & Related papers  (2020-03-14T09:24:08Z)
• Cross-layer Feature Pyramid Network for Salient Object Detection [102.20031050972429]
  We propose a novel Cross-layer Feature Pyramid Network to improve the progressive fusion in salient object detection. The distributed features per layer own both semantics and salient details from all other layers simultaneously, and suffer reduced loss of important information.
  arXiv  Detail & Related papers  (2020-02-25T14:06:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.