Edge-aware Plug-and-play Scheme for Semantic Segmentation

• URL: http://arxiv.org/abs/2303.10307v1
• Date: Sat, 18 Mar 2023 02:17:37 GMT
• Title: Edge-aware Plug-and-play Scheme for Semantic Segmentation
• Authors: Jianye Yi and Xiaopin Zhong and Weixiang Liu and Wenxuan Zhu and Zongze Wu and Yuanlong Deng
• Abstract summary: The proposed method can be seamlessly integrated into any state-of-the-art (SOTA) models with zero modification. The experimental results indicate that the proposed method can be seamlessly integrated into any state-of-the-art (SOTA) models with zero modification.
• Score: 4.297988192695948
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Semantic segmentation is a classic and fundamental computer vision problem dedicated to assigning each pixel with its corresponding class. Some recent methods introduce edge-based information for improving the segmentation performance. However these methods are specific and limited to certain network architectures, and they can not be transferred to other models or tasks. Therefore, we propose an abstract and universal edge supervision method called Edge-aware Plug-and-play Scheme (EPS), which can be easily and quickly applied to any semantic segmentation models. The core is edge-width/thickness preserving guided for semantic segmentation. The EPS first extracts the Edge Ground Truth (Edge GT) with a predefined edge thickness from the training data; and then for any network architecture, it directly copies the decoder head for the auxiliary task with the Edge GT supervision. To ensure the edge thickness preserving consistantly, we design a new boundarybased loss, called Polar Hausdorff (PH) Loss, for the auxiliary supervision. We verify the effectiveness of our EPS on the Cityscapes dataset using 22 models. The experimental results indicate that the proposed method can be seamlessly integrated into any state-of-the-art (SOTA) models with zero modification, resulting in promising enhancement of the segmentation performance.

Related papers

• SuperEdge: Towards a Generalization Model for Self-Supervised Edge Detection [2.912976132828368]
  State-of-the-art pixel-wise annotations are labor-intensive and subject to inconsistencies when acquired manually. We propose a novel self-supervised approach for edge detection that employs a multi-level, multi-homography technique to transfer annotations from synthetic to real-world datasets. Our method eliminates the dependency on manual annotated edge labels, thereby enhancing its generalizability across diverse datasets.
  arXiv  Detail & Related papers  (2024-01-04T15:21:53Z)
• Edge-Aware Mirror Network for Camouflaged Object Detection [5.032585246295627]
  We propose a novel Edge-aware Mirror Network (EAMNet) to model edge detection and camouflaged object segmentation. EAMNet has a two-branch architecture, where a segmentation-induced edge aggregation module and an edge-induced integrity aggregation module are designed to cross-guide the segmentation branch and edge detection branch. Experiment results show that EAMNet outperforms existing cutting-edge baselines on three widely used COD datasets.
  arXiv  Detail & Related papers  (2023-07-08T08:14:49Z)
• SegT: A Novel Separated Edge-guidance Transformer Network for Polyp Segmentation [10.144870911523622]
  We propose a novel separated edge-guidance transformer (SegT) network that aims to build an effective polyp segmentation model. A transformer encoder that learns a more robust representation than existing CNN-based approaches was specifically applied. To evaluate the effectiveness of SegT, we conducted experiments with five challenging public datasets.
  arXiv  Detail & Related papers  (2023-06-19T08:32:05Z)
• Refined Edge Usage of Graph Neural Networks for Edge Prediction [51.06557652109059]
  We propose a novel edge prediction paradigm named Edge-aware Message PassIng neuRal nEtworks (EMPIRE) We first introduce an edge splitting technique to specify use of each edge where each edge is solely used as either the topology or the supervision. In order to emphasize the differences between pairs connected by supervision edges and pairs unconnected, we further weight the messages to highlight the relative ones that can reflect the differences.
  arXiv  Detail & Related papers  (2022-12-25T23:19:56Z)
• LESS: Label-Efficient Semantic Segmentation for LiDAR Point Clouds [62.49198183539889]
  We propose a label-efficient semantic segmentation pipeline for outdoor scenes with LiDAR point clouds. Our method co-designs an efficient labeling process with semi/weakly supervised learning. Our proposed method is even highly competitive compared to the fully supervised counterpart with 100% labels.
  arXiv  Detail & Related papers  (2022-10-14T19:13:36Z)
• Attention-based fusion of semantic boundary and non-boundary information to improve semantic segmentation [9.518010235273783]
  This paper introduces a method for image semantic segmentation grounded on a novel fusion scheme. The main goal of our proposal is to explore object boundary information to improve the overall segmentation performance. Our proposed model achieved the best mIoU on the CityScapes, CamVid, and Pascal Context data sets, and the second best on Mapillary Vistas.
  arXiv  Detail & Related papers  (2021-08-05T20:46:53Z)
• Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentation [86.44301443789763]
  We propose Affinity Attention Graph Neural Network ($A2$GNN) for weakly supervised semantic segmentation. Our approach achieves new state-of-the-art performances on Pascal VOC 2012 datasets.
  arXiv  Detail & Related papers  (2021-06-08T02:19:21Z)
• Boundary-Aware Geometric Encoding for Semantic Segmentation of Point Clouds [45.270215729464056]
  Boundary information plays a significant role in 2D image segmentation, while usually being ignored in 3D point cloud segmentation. We propose a Boundary Prediction Module (BPM) to predict boundary points. Based on the predicted boundary, a boundary-aware Geometric. GEM is designed to encode geometric information and aggregate features with discrimination in a neighborhood.
  arXiv  Detail & Related papers  (2021-01-07T05:38:19Z)
• Towards Efficient Scene Understanding via Squeeze Reasoning [71.1139549949694]
  We propose a novel framework called Squeeze Reasoning. Instead of propagating information on the spatial map, we first learn to squeeze the input feature into a channel-wise global vector. We show that our approach can be modularized as an end-to-end trained block and can be easily plugged into existing networks.
  arXiv  Detail & Related papers  (2020-11-06T12:17:01Z)
• Improving Semantic Segmentation via Decoupled Body and Edge Supervision [89.57847958016981]
  Existing semantic segmentation approaches either aim to improve the object's inner consistency by modeling the global context, or refine objects detail along their boundaries by multi-scale feature fusion. In this paper, a new paradigm for semantic segmentation is proposed. Our insight is that appealing performance of semantic segmentation requires textitexplicitly modeling the object textitbody and textitedge, which correspond to the high and low frequency of the image. We show that the proposed framework with various baselines or backbone networks leads to better object inner consistency and object boundaries.
  arXiv  Detail & Related papers  (2020-07-20T12:11:22Z)
• Spatial Pyramid Based Graph Reasoning for Semantic Segmentation [67.47159595239798]
  We apply graph convolution into the semantic segmentation task and propose an improved Laplacian. The graph reasoning is directly performed in the original feature space organized as a spatial pyramid. We achieve comparable performance with advantages in computational and memory overhead.
  arXiv  Detail & Related papers  (2020-03-23T12:28:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.