Looking for change? Roll the Dice and demand Attention

• URL: http://arxiv.org/abs/2009.02062v2
• Date: Tue, 23 Mar 2021 08:15:48 GMT
• Title: Looking for change? Roll the Dice and demand Attention
• Authors: Foivos I. Diakogiannis, Fran\c{c}ois Waldner, Peter Caccetta
• Abstract summary: We propose a reliable deep learning framework for the task of semantic change detection in high-resolution aerial images. Our framework consists of a new loss function, new attention modules, new feature extraction building blocks, and a new backbone architecture. We validate our approach by showing excellent performance and achieving state of the art score (F1 and Intersection over Union-hereafter IoU) on two building change detection datasets.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Change detection, i.e. identification per pixel of changes for some classes of interest from a set of bi-temporal co-registered images, is a fundamental task in the field of remote sensing. It remains challenging due to unrelated forms of change that appear at different times in input images. Here, we propose a reliable deep learning framework for the task of semantic change detection in very high-resolution aerial images. Our framework consists of a new loss function, new attention modules, new feature extraction building blocks, and a new backbone architecture that is tailored for the task of semantic change detection. Specifically, we define a new form of set similarity, that is based on an iterative evaluation of a variant of the Dice coefficient. We use this similarity metric to define a new loss function as well as a new spatial and channel convolution Attention layer (the FracTAL). The new attention layer, designed specifically for vision tasks, is memory efficient, thus suitable for use in all levels of deep convolutional networks. Based on these, we introduce two new efficient self-contained feature extraction convolution units. We validate the performance of these feature extraction building blocks on the CIFAR10 reference data and compare the results with standard ResNet modules. Further, we introduce a new encoder/decoder scheme, a network macro-topology, that is tailored for the task of change detection. Our network moves away from any notion of subtraction of feature layers for identifying change. We validate our approach by showing excellent performance and achieving state of the art score (F1 and Intersection over Union-hereafter IoU) on two building change detection datasets, namely, the LEVIRCD (F1: 0.918, IoU: 0.848) and the WHU (F1: 0.938, IoU: 0.882) datasets.

Related papers

• ELGC-Net: Efficient Local-Global Context Aggregation for Remote Sensing Change Detection [65.59969454655996]
  We propose an efficient change detection framework, ELGC-Net, which leverages rich contextual information to precisely estimate change regions. Our proposed ELGC-Net sets a new state-of-the-art performance in remote sensing change detection benchmarks. We also introduce ELGC-Net-LW, a lighter variant with significantly reduced computational complexity, suitable for resource-constrained settings.
  arXiv  Detail & Related papers  (2024-03-26T17:46:25Z)
• Explicit Change Relation Learning for Change Detection in VHR Remote Sensing Images [12.228675703851733]
  We propose a network architecture NAME for the explicit mining of change relation features. The change features of change detection should be divided into pre-changed image features, post-changed image features and change relation features. Our network performs better, in terms of F1, IoU, and OA, than those of the existing advanced networks for change detection.
  arXiv  Detail & Related papers  (2023-11-14T08:47:38Z)
• Unsupervised convolutional neural network fusion approach for change detection in remote sensing images [1.892026266421264]
  We introduce a completely unsupervised shallow convolutional neural network (USCNN) fusion approach for change detection. Our model has three features: the entire training process is conducted in an unsupervised manner, the network architecture is shallow, and the objective function is sparse. Experimental results on four real remote sensing datasets indicate the feasibility and effectiveness of the proposed approach.
  arXiv  Detail & Related papers  (2023-11-07T03:10:17Z)
• TINYCD: A (Not So) Deep Learning Model For Change Detection [68.8204255655161]
  The aim of change detection (CD) is to detect changes occurred in the same area by comparing two images of that place taken at different times. Recent developments in the field of deep learning enabled researchers to achieve outstanding performance in this area. We propose a novel model, called TinyCD, demonstrating to be both lightweight and effective.
  arXiv  Detail & Related papers  (2022-07-26T19:28:48Z)
• Augmenting Convolutional networks with attention-based aggregation [55.97184767391253]
  We show how to augment any convolutional network with an attention-based global map to achieve non-local reasoning. We plug this learned aggregation layer with a simplistic patch-based convolutional network parametrized by 2 parameters (width and depth) It yields surprisingly competitive trade-offs between accuracy and complexity, in particular in terms of memory consumption.
  arXiv  Detail & Related papers  (2021-12-27T14:05:41Z)
• FCCDN: Feature Constraint Network for VHR Image Change Detection [12.670734830806591]
  We propose a feature constraint change detection network (FCCDN) for change detection. We constrain features both on bi-temporal feature extraction and feature fusion. We achieve state-of-the-art performance on two building change detection datasets.
  arXiv  Detail & Related papers  (2021-05-23T06:13:47Z)
• Decoupled and Memory-Reinforced Networks: Towards Effective Feature Learning for One-Step Person Search [65.51181219410763]
  One-step methods have been developed to handle pedestrian detection and identification sub-tasks using a single network. There are two major challenges in the current one-step approaches. We propose a decoupled and memory-reinforced network (DMRNet) to overcome these problems.
  arXiv  Detail & Related papers  (2021-02-22T06:19:45Z)
• Decoupled Self Attention for Accurate One Stage Object Detection [4.791635488070342]
  A decoupled self attention(DSA) module is proposed for one stage object detection models in this paper. Although the network of DSA module is simple, but it can effectively improve the performance of object detection, also it can be easily embedded in many detection models.
  arXiv  Detail & Related papers  (2020-12-14T15:19:30Z)
• Rethinking Bottleneck Structure for Efficient Mobile Network Design [154.47657111869552]
  The inverted residual block is dominating architecture design for mobile networks recently. We propose to flip the structure and present a novel bottleneck design, called the sandglass block, that performs identity mapping and spatial transformation at higher dimensions. In ImageNet classification, by simply replacing the inverted residual block with our sandglass block without increasing parameters and computation, the classification accuracy can be improved by more than 1.7% over MobileNetV2.
  arXiv  Detail & Related papers  (2020-07-05T08:55:26Z)
• When Residual Learning Meets Dense Aggregation: Rethinking the Aggregation of Deep Neural Networks [57.0502745301132]
  We propose Micro-Dense Nets, a novel architecture with global residual learning and local micro-dense aggregations. Our micro-dense block can be integrated with neural architecture search based models to boost their performance.
  arXiv  Detail & Related papers  (2020-04-19T08:34:52Z)
• DASNet: Dual attentive fully convolutional siamese networks for change detection of high resolution satellite images [17.839181739760676]
  The research objective is to identity the change information of interest and filter out the irrelevant change information as interference factors. Recently, the rise of deep learning has provided new tools for change detection, which have yielded impressive results. We propose a new method, namely, dual attentive fully convolutional Siamese networks (DASNet) for change detection in high-resolution images.
  arXiv  Detail & Related papers  (2020-03-07T16:57:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.