An Iterative Classification and Semantic Segmentation Network for Old
Landslide Detection Using High-Resolution Remote Sensing Images
- URL: http://arxiv.org/abs/2302.12420v2
- Date: Mon, 24 Apr 2023 08:29:55 GMT
- Title: An Iterative Classification and Semantic Segmentation Network for Old
Landslide Detection Using High-Resolution Remote Sensing Images
- Authors: Zili Lu, Yuexing Peng, Wei Li, Junchuan Yu, Daqing Ge, Wei Xiang
- Abstract summary: An iterative classification and semantic segmentation network (ICSSN) is developed, which can greatly enhance both object-level and pixel-level classification performance.
An iterative training strategy is elaborated to fuse features in semantic space such that both object-level and pixel-level classification performance are improved.
The experimental results show that ICSSN can greatly improve the classification and segmentation accuracy of old landslide detection.
- Score: 6.584865979714256
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Huge challenges exist for old landslide detection because their morphology
features have been partially or strongly transformed over a long time and have
little difference from their surrounding. Besides, small-sample problem also
restrict in-depth learning.
In this paper, an iterative classification and semantic segmentation network
(ICSSN) is developed, which can greatly enhance both object-level and
pixel-level classification performance by iteratively upgrading the feature
extractor shared by two network. An object-level contrastive learning (OCL)
strategy is employed in the object classification sub-network featuring a
siamese network to realize the global features extraction, and a
sub-object-level contrastive learning (SOCL) paradigm is designed in the
semantic segmentation sub-network to efficiently extract salient features from
boundaries of landslides. Moreover, an iterative training strategy is
elaborated to fuse features in semantic space such that both object-level and
pixel-level classification performance are improved.
The proposed ICSSN is evaluated on the real landslide data set, and the
experimental results show that ICSSN can greatly improve the classification and
segmentation accuracy of old landslide detection. For the semantic segmentation
task, compared to the baseline, the F1 score increases from 0.5054 to 0.5448,
the mIoU improves from 0.6405 to 0.6610, the landslide IoU improved from 0.3381
to 0.3743, and the object-level detection accuracy of old landslides is
enhanced from 0.55 to 0.9. For the object classification task, the F1 score
increases from 0.8846 to 0.9230, and the accuracy score is up from 0.8375 to
0.8875.
Related papers
- MRIFE: A Mask-Recovering and Interactive-Feature-Enhancing Semantic Segmentation Network For Relic Landslide Detection [7.6822321138894765]
Relic landslide, formed over a long period, possess the potential for reactivation, making them a hazardous geological phenomenon.
High-resolution remote sensing images for relic landslides face many challenges, including the object visual blur problem.
A semantic segmentation model, termed mask-recovering and interactive-feature-enhancing (MRIFE), is proposed for more efficient feature extraction and separation.
The proposed MRIFE is evaluated on a real relic landslide dataset, and experimental results show that it greatly improves the performance of relic landslide detection.
arXiv Detail & Related papers (2024-11-26T07:15:50Z) - The object detection model uses combined extraction with KNN and RF classification [0.0]
This study contributes to the field of object detection with a new approach combining GLCM and LBP as feature vectors as well as VE for classification.
System testing used a dataset of 4,437 2D images, the results for KNN accuracy were 92.7% and F1-score 92.5%, while RF performance was lower.
arXiv Detail & Related papers (2024-05-09T05:21:42Z) - Hyper-pixel-wise Contrastive Learning Augmented Segmentation Network for
Old Landslide Detection through Fusing High-Resolution Remote Sensing Images
and Digital Elevation Model Data [8.90916893521958]
The proposed HPCL-Net is evaluated on the Loess Plateau old landslide dataset.
The proposed HPCL-Net greatly outperforms existing models, where the mIoU is increased from 0.620 to 0.651, the Landslide IoU is improved from 0.334 to 0.394 and the F1score is enhanced from 0.501 to 0.565.
arXiv Detail & Related papers (2023-08-02T16:11:51Z) - In-N-Out Generative Learning for Dense Unsupervised Video Segmentation [89.21483504654282]
In this paper, we focus on the unsupervised Video Object (VOS) task which learns visual correspondence from unlabeled videos.
We propose the In-aNd-Out (INO) generative learning from a purely generative perspective, which captures both high-level and fine-grained semantics.
Our INO outperforms previous state-of-the-art methods by significant margins.
arXiv Detail & Related papers (2022-03-29T07:56:21Z) - Do We Really Need a Learnable Classifier at the End of Deep Neural
Network? [118.18554882199676]
We study the potential of learning a neural network for classification with the classifier randomly as an ETF and fixed during training.
Our experimental results show that our method is able to achieve similar performances on image classification for balanced datasets.
arXiv Detail & Related papers (2022-03-17T04:34:28Z) - Denoised Non-Local Neural Network for Semantic Segmentation [18.84185406522064]
We propose a Denoised Non-Local Network (Denoised NL) to eliminate the inter-class and intra-class noises respectively.
Our proposed NL can achieve the state-of-the-art performance of 83.5% and 46.69% mIoU on Cityscapes and ADE20K, respectively.
arXiv Detail & Related papers (2021-10-27T06:16:31Z) - Adversarial Feature Augmentation and Normalization for Visual
Recognition [109.6834687220478]
Recent advances in computer vision take advantage of adversarial data augmentation to ameliorate the generalization ability of classification models.
Here, we present an effective and efficient alternative that advocates adversarial augmentation on intermediate feature embeddings.
We validate the proposed approach across diverse visual recognition tasks with representative backbone networks.
arXiv Detail & Related papers (2021-03-22T20:36:34Z) - Dense Contrastive Learning for Self-Supervised Visual Pre-Training [102.15325936477362]
We present dense contrastive learning, which implements self-supervised learning by optimizing a pairwise contrastive (dis)similarity loss at the pixel level between two views of input images.
Compared to the baseline method MoCo-v2, our method introduces negligible computation overhead (only 1% slower)
arXiv Detail & Related papers (2020-11-18T08:42:32Z) - A New Mask R-CNN Based Method for Improved Landslide Detection [54.7905160534631]
This paper presents a novel method of landslide detection by exploiting the Mask R-CNN capability of identifying an object layout.
A data set of 160 elements is created containing landslide and non-landslide images.
The proposed algorithm can be potentially useful for land use planners and policy makers of hilly areas.
arXiv Detail & Related papers (2020-10-04T07:46:37Z) - Looking for change? Roll the Dice and demand Attention [0.0]
We propose a reliable deep learning framework for the task of semantic change detection in high-resolution aerial images.
Our framework consists of a new loss function, new attention modules, new feature extraction building blocks, and a new backbone architecture.
We validate our approach by showing excellent performance and achieving state of the art score (F1 and Intersection over Union-hereafter IoU) on two building change detection datasets.
arXiv Detail & Related papers (2020-09-04T08:30:25Z) - Multi-scale Interactive Network for Salient Object Detection [91.43066633305662]
We propose the aggregate interaction modules to integrate the features from adjacent levels.
To obtain more efficient multi-scale features, the self-interaction modules are embedded in each decoder unit.
Experimental results on five benchmark datasets demonstrate that the proposed method without any post-processing performs favorably against 23 state-of-the-art approaches.
arXiv Detail & Related papers (2020-07-17T15:41:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.