Pixel-wise Distance Regression for Glacier Calving Front Detection and
Segmentation
- URL: http://arxiv.org/abs/2103.05715v1
- Date: Tue, 9 Mar 2021 20:58:33 GMT
- Title: Pixel-wise Distance Regression for Glacier Calving Front Detection and
Segmentation
- Authors: Amirabbas Davari, Christoph Baller, Thorsten Seehaus, Matthias Braun,
Andreas Maier, Vincent Christlein
- Abstract summary: Deep learning approaches have been investigated for monitoring the evolution and status of glaciers.
In this work, we propose to mitigate the class-imbalance between the calving front class and the non-calving front class by reformulating the segmentation problem into a pixel-wise regression task.
A Convolutional Neural Network gets optimized to predict the distance values to the glacier front for each pixel in the image.
- Score: 7.64750171496838
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Glacier calving front position (CFP) is an important glaciological variable.
Traditionally, delineating the CFPs has been carried out manually, which was
subjective, tedious and expensive. Automating this process is crucial for
continuously monitoring the evolution and status of glaciers. Recently, deep
learning approaches have been investigated for this application. However, the
current methods get challenged by a severe class-imbalance problem. In this
work, we propose to mitigate the class-imbalance between the calving front
class and the non-calving front class by reformulating the segmentation problem
into a pixel-wise regression task. A Convolutional Neural Network gets
optimized to predict the distance values to the glacier front for each pixel in
the image. The resulting distance map localizes the CFP and is further
post-processed to extract the calving front line. We propose three
post-processing methods, one method based on statistical thresholding, a second
method based on conditional random fields (CRF), and finally the use of a
second U-Net. The experimental results confirm that our approach significantly
outperforms the state-of-the-art methods and produces accurate delineation. The
Second U-Net obtains the best performance results, resulting in an average
improvement of about 21% dice coefficient enhancement.
Related papers
- Adaptive Guidance: Training-free Acceleration of Conditional Diffusion
Models [44.58960475893552]
"Adaptive Guidance" (AG) is an efficient variant of computation-Free Guidance (CFG)
AG preserves CFG's image quality while reducing by 25%.
" LinearAG" offers even cheaper inference at the cost of deviating from the baseline model.
arXiv Detail & Related papers (2023-12-19T17:08:48Z) - DC4L: Distribution Shift Recovery via Data-Driven Control for Deep Learning Models [4.374569172244273]
We propose to use control for learned models to recover from distribution shifts online.
Our method applies a sequence of semantic-preserving transformations to bring the shifted data closer in distribution to the training set.
We show that our method generalizes to composites of shifts from the ImageNet-C benchmark, achieving improvements in average accuracy of up to 9.81%.
arXiv Detail & Related papers (2023-02-20T22:06:26Z) - Post-Processing Temporal Action Detection [134.26292288193298]
Temporal Action Detection (TAD) methods typically take a pre-processing step in converting an input varying-length video into a fixed-length snippet representation sequence.
This pre-processing step would temporally downsample the video, reducing the inference resolution and hampering the detection performance in the original temporal resolution.
We introduce a novel model-agnostic post-processing method without model redesign and retraining.
arXiv Detail & Related papers (2022-11-27T19:50:37Z) - Implicit Bias in Leaky ReLU Networks Trained on High-Dimensional Data [63.34506218832164]
In this work, we investigate the implicit bias of gradient flow and gradient descent in two-layer fully-connected neural networks with ReLU activations.
For gradient flow, we leverage recent work on the implicit bias for homogeneous neural networks to show that leakyally, gradient flow produces a neural network with rank at most two.
For gradient descent, provided the random variance is small enough, we show that a single step of gradient descent suffices to drastically reduce the rank of the network, and that the rank remains small throughout training.
arXiv Detail & Related papers (2022-10-13T15:09:54Z) - GradViT: Gradient Inversion of Vision Transformers [83.54779732309653]
We demonstrate the vulnerability of vision transformers (ViTs) to gradient-based inversion attacks.
We introduce a method, named GradViT, that optimize random noise into naturally looking images.
We observe unprecedentedly high fidelity and closeness to the original (hidden) data.
arXiv Detail & Related papers (2022-03-22T17:06:07Z) - Poseur: Direct Human Pose Regression with Transformers [119.79232258661995]
We propose a direct, regression-based approach to 2D human pose estimation from single images.
Our framework is end-to-end differentiable, and naturally learns to exploit the dependencies between keypoints.
Ours is the first regression-based approach to perform favorably compared to the best heatmap-based pose estimation methods.
arXiv Detail & Related papers (2022-01-19T04:31:57Z) - Learning from Images: Proactive Caching with Parallel Convolutional
Neural Networks [94.85780721466816]
A novel framework for proactive caching is proposed in this paper.
It combines model-based optimization with data-driven techniques by transforming an optimization problem into a grayscale image.
Numerical results show that the proposed scheme can reduce 71.6% computation time with only 0.8% additional performance cost.
arXiv Detail & Related papers (2021-08-15T21:32:47Z) - On Mathews Correlation Coefficient and Improved Distance Map Loss for
Automatic Glacier Calving Front Segmentation in SAR Imagery [7.64750171496838]
The vast majority of outlet glaciers and ice streams of the polar ice sheets end in the ocean.
Ice mass loss via calving of the glaciers into the ocean has increased over the last few decades.
Deep neural network-based semantic segmentation pipelines can be used to delineate the acquired SAR imagery.
arXiv Detail & Related papers (2021-02-16T17:53:34Z) - Bayesian U-Net for Segmenting Glaciers in SAR Imagery [7.960675807187592]
We propose to compute uncertainty and use it in an Uncertainty Optimization regime as a novel two-stage process.
We show that feeding the uncertainty map to the network leads to 95.24% Dice similarity.
This is an overall improvement in the segmentation performance compared to the state-of-the-art deterministic U-Net-based glacier segmentation pipelines.
arXiv Detail & Related papers (2021-01-08T23:17:49Z) - An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks.
We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem.
We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
arXiv Detail & Related papers (2020-12-06T18:55:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.