Active Boundary Loss for Semantic Segmentation

• URL: http://arxiv.org/abs/2102.02696v1
• Date: Thu, 4 Feb 2021 15:47:54 GMT
• Title: Active Boundary Loss for Semantic Segmentation
• Authors: Chi Wang, Yunke Zhang, Miaomiao Cui, Jinlin Liu, Peiran Ren, Yin Yang, Xuansong Xie, XianSheng Hua, Hujun Bao, Weiwei Xu
• Abstract summary: This paper proposes a novel active boundary loss for semantic segmentation. It can progressively encourage the alignment between predicted boundaries and ground-truth boundaries during end-to-end training. Experimental results show that training with the active boundary loss can effectively improve the boundary F-score and mean Intersection-over-Union.
• Score: 58.72057610093194
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper proposes a novel active boundary loss for semantic segmentation. It can progressively encourage the alignment between predicted boundaries and ground-truth boundaries during end-to-end training, which is not explicitly enforced in commonly used cross-entropy loss. Based on the predicted boundaries detected from the segmentation results using current network parameters, we formulate the boundary alignment problem as a differentiable direction vector prediction problem to guide the movement of predicted boundaries in each iteration. Our loss is model-agnostic and can be plugged into the training of segmentation networks to improve the boundary details. Experimental results show that training with the active boundary loss can effectively improve the boundary F-score and mean Intersection-over-Union on challenging image and video object segmentation datasets.

Related papers

• Revisiting Edge Perturbation for Graph Neural Network in Graph Data Augmentation and Attack [58.440711902319855]
  Edge perturbation is a method to modify graph structures. It can be categorized into two veins based on their effects on the performance of graph neural networks (GNNs) We propose a unified formulation and establish a clear boundary between two categories of edge perturbation methods.
  arXiv  Detail & Related papers  (2024-03-10T15:50:04Z)
• PnPNet: Pull-and-Push Networks for Volumetric Segmentation with Boundary Confusion [25.12551124399544]
  U-shape networks cannot effectively resolve this challenge due to the lack of boundary shape constraints. We reconceptualize boundary generation by encompassing the interaction dynamics adjacent adjacent regions. Core ingredients of Net contain the pushing and pulling branches to squeeze the boundary region.
  arXiv  Detail & Related papers  (2023-12-13T17:50:31Z)
• Push-the-Boundary: Boundary-aware Feature Propagation for Semantic Segmentation of 3D Point Clouds [0.5249805590164901]
  We propose a boundary-aware feature propagation mechanism to improve semantic segmentation near object boundaries. With one shared encoder, our network outputs (i) boundary localization, (ii) prediction of directions pointing to the object's interior, and (iii) semantic segmentation, in three parallel streams. Our proposed approach yields consistent improvements by reducing boundary errors.
  arXiv  Detail & Related papers  (2022-12-23T15:42:01Z)
• Zero Pixel Directional Boundary by Vector Transform [77.63061686394038]
  We re-interpret boundaries as 1-D surfaces and formulate a one-to-one vector transform function that allows for training of boundary prediction completely avoiding the class imbalance issue. Our problem formulation leads to the estimation of direction as well as richer contextual information of the boundary, and, if desired, the availability of zero-pixel thin boundaries also at training time.
  arXiv  Detail & Related papers  (2022-03-16T17:55:31Z)
• Contrastive Boundary Learning for Point Cloud Segmentation [81.7289734276872]
  We propose a novel contrastive boundary learning framework for point cloud segmentation. We experimentally show that CBL consistently improves different baselines and assists them to achieve compelling performance on boundaries.
  arXiv  Detail & Related papers  (2022-03-10T10:08:09Z)
• Boundary Guided Context Aggregation for Semantic Segmentation [23.709865471981313]
  We exploit boundary as a significant guidance for context aggregation to promote the overall semantic understanding of an image. We conduct extensive experiments on the Cityscapes and ADE20K databases, and comparable results are achieved with the state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-10-27T17:04:38Z)
• InverseForm: A Loss Function for Structured Boundary-Aware Segmentation [80.39674800972182]
  We present a novel boundary-aware loss term for semantic segmentation using an inverse-transformation network. This plug-in loss term complements the cross-entropy loss in capturing boundary transformations. We analyze the quantitative and qualitative effects of our loss function on three indoor and outdoor segmentation benchmarks.
  arXiv  Detail & Related papers  (2021-04-06T18:52:45Z)
• Edge-Preserving Guided Semantic Segmentation for VIPriors Challenge [3.435043566706133]
  Current state-of-the-art and deep learning-based semantic segmentation techniques are hard to train well. We propose edge-preserving guidance to obtain the extra prior information. Experiments demonstrate that the proposed method can achieve excellent performance under small-scale training set.
  arXiv  Detail & Related papers  (2020-07-17T11:49:10Z)
• DeepStrip: High Resolution Boundary Refinement [60.00241966809684]
  We propose to convert regions of interest into strip images and compute a boundary prediction in the strip domain. To detect the target boundary, we present a framework with two prediction layers. We enforce a matching consistency and C0 continuity regularization to the network to reduce false alarms.
  arXiv  Detail & Related papers  (2020-03-25T22:44:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.