Scribble-based Weakly Supervised Deep Learning for Road Surface
Extraction from Remote Sensing Images
- URL: http://arxiv.org/abs/2010.13106v1
- Date: Sun, 25 Oct 2020 12:40:30 GMT
- Title: Scribble-based Weakly Supervised Deep Learning for Road Surface
Extraction from Remote Sensing Images
- Authors: Yao Wei, Shunping Ji
- Abstract summary: We propose a scribble-based weakly supervised road surface extraction method named ScRoadExtractor.
To propagate semantic information from sparse scribbles to unlabeled pixels, we introduce a road label propagation algorithm.
The proposal masks generated from the road label propagation algorithm are utilized to train a dual-branch encoder-decoder network.
- Score: 7.1577508803778045
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Road surface extraction from remote sensing images using deep learning
methods has achieved good performance, while most of the existing methods are
based on fully supervised learning, which requires a large amount of training
data with laborious per-pixel annotation. In this paper, we propose a
scribble-based weakly supervised road surface extraction method named
ScRoadExtractor, which learns from easily accessible scribbles such as
centerlines instead of densely annotated road surface ground-truths. To
propagate semantic information from sparse scribbles to unlabeled pixels, we
introduce a road label propagation algorithm which considers both the
buffer-based properties of road networks and the color and spatial information
of super-pixels. The proposal masks generated from the road label propagation
algorithm are utilized to train a dual-branch encoder-decoder network we
designed, which consists of a semantic segmentation branch and an auxiliary
boundary detection branch. We perform experiments on three diverse road
datasets that are comprised of highresolution remote sensing satellite and
aerial images across the world. The results demonstrate that ScRoadExtractor
exceed the classic scribble-supervised segmentation method by 20% for the
intersection over union (IoU) indicator and outperform the state-of-the-art
scribble-based weakly supervised methods at least 4%.
Related papers
- Fine-Grained Extraction of Road Networks via Joint Learning of
Connectivity and Segmentation [5.496893845821393]
Road network extraction from satellite images is widely applicated in intelligent traffic management and autonomous driving fields.
The high-resolution remote sensing images contain complex road areas and distracted background, which make it a challenge for road extraction.
We present a stacked multitask network for end-to-end segmenting roads while preserving connectivity correctness.
arXiv Detail & Related papers (2023-12-07T22:57:17Z) - Learning Semantic Segmentation with Query Points Supervision on Aerial Images [57.09251327650334]
We present a weakly supervised learning algorithm to train semantic segmentation algorithms.
Our proposed approach performs accurate semantic segmentation and improves efficiency by significantly reducing the cost and time required for manual annotation.
arXiv Detail & Related papers (2023-09-11T14:32:04Z) - Patched Line Segment Learning for Vector Road Mapping [34.16241268436923]
We build upon a well-defined Patched Line Segment representation for road graphs that holds geometric significance.
Our method achieves state-of-the-art performance with just 6 GPU hours of training, leading to a substantial 32-fold reduction in training costs.
arXiv Detail & Related papers (2023-09-06T11:33:25Z) - De-coupling and De-positioning Dense Self-supervised Learning [65.56679416475943]
Dense Self-Supervised Learning (SSL) methods address the limitations of using image-level feature representations when handling images with multiple objects.
We show that they suffer from coupling and positional bias, which arise from the receptive field increasing with layer depth and zero-padding.
We demonstrate the benefits of our method on COCO and on a new challenging benchmark, OpenImage-MINI, for object classification, semantic segmentation, and object detection.
arXiv Detail & Related papers (2023-03-29T18:07:25Z) - PaRK-Detect: Towards Efficient Multi-Task Satellite Imagery Road
Extraction via Patch-Wise Keypoints Detection [12.145321599949236]
We propose a new scheme for multi-task satellite imagery road extraction, Patch-wise Road Keypoints Detection (PaRK-Detect)
Our framework predicts the position of patch-wise road keypoints and the adjacent relationships between them to construct road graphs in a single pass.
We evaluate our approach against the existing state-of-the-art methods on DeepGlobe, Massachusetts Roads, and RoadTracer datasets and achieve competitive or better results.
arXiv Detail & Related papers (2023-02-26T08:26:26Z) - Aerial Images Meet Crowdsourced Trajectories: A New Approach to Robust
Road Extraction [110.61383502442598]
We introduce a novel neural network framework termed Cross-Modal Message Propagation Network (CMMPNet)
CMMPNet is composed of two deep Auto-Encoders for modality-specific representation learning and a tailor-designed Dual Enhancement Module for cross-modal representation refinement.
Experiments on three real-world benchmarks demonstrate the effectiveness of our CMMPNet for robust road extraction.
arXiv Detail & Related papers (2021-11-30T04:30:10Z) - PP-LinkNet: Improving Semantic Segmentation of High Resolution Satellite
Imagery with Multi-stage Training [4.694536172504848]
Road network and building footprint extraction is essential for many applications such as updating maps, traffic regulations, city planning, ride-hailing, disaster response textitetc.
arXiv Detail & Related papers (2020-10-14T10:23:48Z) - Photon-Driven Neural Path Guiding [102.12596782286607]
We present a novel neural path guiding approach that can reconstruct high-quality sampling distributions for path guiding from a sparse set of samples.
We leverage photons traced from light sources as the input for sampling density reconstruction, which is highly effective for challenging scenes with strong global illumination.
Our approach achieves significantly better rendering results of testing scenes than previous state-of-the-art path guiding methods.
arXiv Detail & Related papers (2020-10-05T04:54:01Z) - Weakly-Supervised Semantic Segmentation by Iterative Affinity Learning [86.45526827323954]
Weakly-supervised semantic segmentation is a challenging task as no pixel-wise label information is provided for training.
We propose an iterative algorithm to learn such pairwise relations.
We show that the proposed algorithm performs favorably against the state-of-the-art methods.
arXiv Detail & Related papers (2020-02-19T10:32:03Z) - Towards Reading Beyond Faces for Sparsity-Aware 4D Affect Recognition [55.15661254072032]
We present a sparsity-aware deep network for automatic 4D facial expression recognition (FER)
We first propose a novel augmentation method to combat the data limitation problem for deep learning.
We then present a sparsity-aware deep network to compute the sparse representations of convolutional features over multi-views.
arXiv Detail & Related papers (2020-02-08T13:09:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.