TopoAL: An Adversarial Learning Approach for Topology-Aware Road Segmentation

• URL: http://arxiv.org/abs/2007.09084v1
• Date: Fri, 17 Jul 2020 16:06:45 GMT
• Title: TopoAL: An Adversarial Learning Approach for Topology-Aware Road Segmentation
• Authors: Subeesh Vasu, Mateusz Kozinski, Leonardo Citraro, and Pascal Fua
• Abstract summary: We introduce an Adversarial Learning (AL) strategy tailored for our purposes. We use a more sophisticated discriminator that returns a label pyramid describing what portions of the road network are correct. We will show that it outperforms state-of-the-art ones on the challenging RoadTracer dataset.
• Score: 56.353558147044
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Most state-of-the-art approaches to road extraction from aerial images rely on a CNN trained to label road pixels as foreground and remainder of the image as background. The CNN is usually trained by minimizing pixel-wise losses, which is less than ideal to produce binary masks that preserve the road network's global connectivity. To address this issue, we introduce an Adversarial Learning (AL) strategy tailored for our purposes. A naive one would treat the segmentation network as a generator and would feed its output along with ground-truth segmentations to a discriminator. It would then train the generator and discriminator jointly. We will show that this is not enough because it does not capture the fact that most errors are local and need to be treated as such. Instead, we use a more sophisticated discriminator that returns a label pyramid describing what portions of the road network are correct at several different scales. This discriminator and the structured labels it returns are what gives our approach its edge and we will show that it outperforms state-of-the-art ones on the challenging RoadTracer dataset.

Related papers

• Learning Semantic Segmentation with Query Points Supervision on Aerial Images [57.09251327650334]
  We present a weakly supervised learning algorithm to train semantic segmentation algorithms. Our proposed approach performs accurate semantic segmentation and improves efficiency by significantly reducing the cost and time required for manual annotation.
  arXiv  Detail & Related papers  (2023-09-11T14:32:04Z)
• Leveraging Uncertainty for Deep Interpretable Classification and Weakly-Supervised Segmentation of Histology Images [25.429124017422385]
  Deep weakly supervised methods allow image classification and ROI segmentation for interpretability. These methods lack mechanisms for modeling explicitly non-discriminative regions which raises false-positive rates. We propose novel regularization terms, which enable the model to seek both non-discriminative and discriminative regions.
  arXiv  Detail & Related papers  (2022-05-12T02:18:23Z)
• From Explanations to Segmentation: Using Explainable AI for Image Segmentation [1.8581514902689347]
  We build upon the advances of the Explainable AI (XAI) community and extract a pixel-wise binary segmentation. We show that we achieve similar results compared to an established U-Net segmentation architecture. The proposed method can be trained in a weakly supervised fashion, as the training samples must be only labeled on image-level.
  arXiv  Detail & Related papers  (2022-02-01T10:26:10Z)
• Learning To Segment Dominant Object Motion From Watching Videos [72.57852930273256]
  We envision a simple framework for dominant moving object segmentation that neither requires annotated data to train nor relies on saliency priors or pre-trained optical flow maps. Inspired by a layered image representation, we introduce a technique to group pixel regions according to their affine parametric motion. This enables our network to learn segmentation of the dominant foreground object using only RGB image pairs as input for both training and inference.
  arXiv  Detail & Related papers  (2021-11-28T14:51:00Z)
• Weakly-Supervised Semantic Segmentation by Learning Label Uncertainty [8.074019565026544]
  We present a new loss function to train a segmentation network with only a small subset of pixel-perfect labels. Our loss trains the network to learn a label uncertainty within the bounding-box, which can be leveraged to perform online bootstrapping. We trained each task on a dataset comprised of only 18% pixel-perfect and 82% bounding-box labels.
  arXiv  Detail & Related papers  (2021-10-12T12:19:22Z)
• Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalization [112.68171734288237]
  We propose a novel framework for discriminative pixel-level tasks using a generative model of both images and labels. We learn a generative adversarial network that captures the joint image-label distribution and is trained efficiently using a large set of unlabeled images. We demonstrate strong in-domain performance compared to several baselines, and are the first to showcase extreme out-of-domain generalization.
  arXiv  Detail & Related papers  (2021-04-12T21:41:25Z)
• Adversarial Segmentation Loss for Sketch Colorization [14.681690787310103]
  We introduce a new method for generating color images from sketches or edge maps. We argue that segmentation information could provide valuable guidance for sketch colorization. Our model improves its baseline up to 35 points on the FID metric.
  arXiv  Detail & Related papers  (2021-02-11T18:54:56Z)
• R-MNet: A Perceptual Adversarial Network for Image Inpainting [5.471225956329675]
  We propose a Wasserstein GAN combined with a new reverse mask operator, namely Reverse Masking Network (R-MNet), a perceptual adversarial network for image inpainting. We show that our method is able to generalize to high-resolution inpainting task, and further show more realistic outputs that are plausible to the human visual system.
  arXiv  Detail & Related papers  (2020-08-11T10:58:10Z)
• Weakly-Supervised Semantic Segmentation by Iterative Affinity Learning [86.45526827323954]
  Weakly-supervised semantic segmentation is a challenging task as no pixel-wise label information is provided for training. We propose an iterative algorithm to learn such pairwise relations. We show that the proposed algorithm performs favorably against the state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-02-19T10:32:03Z)
• Image Fine-grained Inpainting [89.17316318927621]
  We present a one-stage model that utilizes dense combinations of dilated convolutions to obtain larger and more effective receptive fields. To better train this efficient generator, except for frequently-used VGG feature matching loss, we design a novel self-guided regression loss. We also employ a discriminator with local and global branches to ensure local-global contents consistency.
  arXiv  Detail & Related papers  (2020-02-07T03:45:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.