AMD-HookNet for Glacier Front Segmentation
- URL: http://arxiv.org/abs/2302.02744v1
- Date: Mon, 6 Feb 2023 12:39:40 GMT
- Title: AMD-HookNet for Glacier Front Segmentation
- Authors: Fei Wu, Nora Gourmelon, Thorsten Seehaus, Jianlin Zhang, Matthias
Braun, Andreas Maier, and Vincent Christlein
- Abstract summary: knowledge on changes in glacier calving front positions is important for assessing the status of glaciers.
Deep learning-based methods have shown great potential for glacier calving front delineation from optical and radar satellite imagery.
We propose Attention-Multi-hooking-Deep-supervision HookNet (AMD-HookNet), a novel glacier calving front segmentation framework.
- Score: 17.60067480799222
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Knowledge on changes in glacier calving front positions is important for
assessing the status of glaciers. Remote sensing imagery provides the ideal
database for monitoring calving front positions, however, it is not feasible to
perform this task manually for all calving glaciers globally due to
time-constraints. Deep learning-based methods have shown great potential for
glacier calving front delineation from optical and radar satellite imagery. The
calving front is represented as a single thin line between the ocean and the
glacier, which makes the task vulnerable to inaccurate predictions. The limited
availability of annotated glacier imagery leads to a lack of data diversity
(not all possible combinations of different weather conditions, terminus
shapes, sensors, etc. are present in the data), which exacerbates the
difficulty of accurate segmentation. In this paper, we propose
Attention-Multi-hooking-Deep-supervision HookNet (AMD-HookNet), a novel glacier
calving front segmentation framework for synthetic aperture radar (SAR) images.
The proposed method aims to enhance the feature representation capability
through multiple information interactions between low-resolution and
high-resolution inputs based on a two-branch U-Net. The attention mechanism,
integrated into the two branch U-Net, aims to interact between the
corresponding coarse and fine-grained feature maps. This allows the network to
automatically adjust feature relationships, resulting in accurate
pixel-classification predictions. Extensive experiments and comparisons on the
challenging glacier segmentation benchmark dataset CaFFe show that our
AMD-HookNet achieves a mean distance error of 438 m to the ground truth
outperforming the current state of the art by 42%, which validates its
effectiveness.
Related papers
- Scalable Glacier Mapping using Deep Learning and Open Earth Observation Data Matches the Accuracy of Manual Delineation [0.718723384367814]
Glacier-VisionTransformer-U-Net (GlaViTU) is a convolutional-transformer deep learning model.
Adding synthetic aperture radar data, namely, backscatter and interferometric coherence, increases the accuracy in all regions where available.
We release a benchmark dataset that covers 9% of glaciers worldwide.
arXiv Detail & Related papers (2024-01-25T20:41:17Z) - Learning Real-World Image De-Weathering with Imperfect Supervision [57.748585821252824]
Existing real-world de-weathering datasets often exhibit inconsistent illumination, position, and textures between the ground-truth images and the input degraded images.
We develop a Consistent Label Constructor (CLC) to generate a pseudo-label as consistent as possible with the input degraded image.
We combine the original imperfect labels and pseudo-labels to jointly supervise the de-weathering model by the proposed Information Allocation Strategy.
arXiv Detail & Related papers (2023-10-23T14:02:57Z) - Accelerating Scalable Graph Neural Network Inference with Node-Adaptive
Propagation [80.227864832092]
Graph neural networks (GNNs) have exhibited exceptional efficacy in a diverse array of applications.
The sheer size of large-scale graphs presents a significant challenge to real-time inference with GNNs.
We propose an online propagation framework and two novel node-adaptive propagation methods.
arXiv Detail & Related papers (2023-10-17T05:03:00Z) - Unsupervised Landmark Discovery Using Consistency Guided Bottleneck [63.624186864522315]
We introduce a consistency-guided bottleneck in an image reconstruction-based pipeline.
We propose obtaining pseudo-supervision via forming landmark correspondence across images.
The consistency then modulates the uncertainty of the discovered landmarks in the generation of adaptive heatmaps.
arXiv Detail & Related papers (2023-09-19T10:57:53Z) - GlacierNet2: A Hybrid Multi-Model Learning Architecture for Alpine
Glacier Mapping [5.953569982292301]
Thematic and quantitative information regarding glacier geometry is fundamental for understanding climate forcing and the sensitivity of glaciers to climate change.
accurately mapping debris-cover glaciers (DCGs) is notoriously difficult based upon the use of spectral information and conventional machine-learning techniques.
The objective of this research is to improve upon an earlier proposed deep-learning-based approach, GlacierNet, which was developed to exploit a convolutional neural-network segmentation model to accurately outline regional DCG ablation zones.
arXiv Detail & Related papers (2022-04-06T14:39:34Z) - Highly Accurate Dichotomous Image Segmentation [139.79513044546]
A new task called dichotomous image segmentation (DIS) aims to segment highly accurate objects from natural images.
We collect the first large-scale dataset, DIS5K, which contains 5,470 high-resolution (e.g., 2K, 4K or larger) images.
We also introduce a simple intermediate supervision baseline (IS-Net) using both feature-level and mask-level guidance for DIS model training.
arXiv Detail & Related papers (2022-03-06T20:09:19Z) - On Mathews Correlation Coefficient and Improved Distance Map Loss for
Automatic Glacier Calving Front Segmentation in SAR Imagery [7.64750171496838]
The vast majority of outlet glaciers and ice streams of the polar ice sheets end in the ocean.
Ice mass loss via calving of the glaciers into the ocean has increased over the last few decades.
Deep neural network-based semantic segmentation pipelines can be used to delineate the acquired SAR imagery.
arXiv Detail & Related papers (2021-02-16T17:53:34Z) - Bayesian U-Net for Segmenting Glaciers in SAR Imagery [7.960675807187592]
We propose to compute uncertainty and use it in an Uncertainty Optimization regime as a novel two-stage process.
We show that feeding the uncertainty map to the network leads to 95.24% Dice similarity.
This is an overall improvement in the segmentation performance compared to the state-of-the-art deterministic U-Net-based glacier segmentation pipelines.
arXiv Detail & Related papers (2021-01-08T23:17:49Z) - Glacier Calving Front Segmentation Using Attention U-Net [7.64750171496838]
We show a method to segment the glacier calving fronts from SAR images in an end-to-end fashion using Attention U-Net.
Adding attention modules to the state-of-the-art U-Net network lets us analyze the learning process by extracting its attention maps.
Our proposed attention U-Net performs comparably to the standard U-Net while providing additional insight into those regions on which the network learned to focus more.
arXiv Detail & Related papers (2021-01-08T23:06:21Z) - Machine Learning for Glacier Monitoring in the Hindu Kush Himalaya [54.12023102155757]
Glacier mapping is key to ecological monitoring in the hkh region.
Climate change poses a risk to individuals whose livelihoods depend on the health of glacier ecosystems.
We present a machine learning based approach to support ecological monitoring, with a focus on glaciers.
arXiv Detail & Related papers (2020-12-09T12:48:06Z) - Anchor-free Small-scale Multispectral Pedestrian Detection [88.7497134369344]
We propose a method for effective and efficient multispectral fusion of the two modalities in an adapted single-stage anchor-free base architecture.
We aim at learning pedestrian representations based on object center and scale rather than direct bounding box predictions.
Results show our method's effectiveness in detecting small-scaled pedestrians.
arXiv Detail & Related papers (2020-08-19T13:13:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.