Boundary Guided Context Aggregation for Semantic Segmentation
- URL: http://arxiv.org/abs/2110.14587v1
- Date: Wed, 27 Oct 2021 17:04:38 GMT
- Title: Boundary Guided Context Aggregation for Semantic Segmentation
- Authors: Haoxiang Ma, Hongyu Yang and Di Huang
- Abstract summary: We exploit boundary as a significant guidance for context aggregation to promote the overall semantic understanding of an image.
We conduct extensive experiments on the Cityscapes and ADE20K databases, and comparable results are achieved with the state-of-the-art methods.
- Score: 23.709865471981313
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The recent studies on semantic segmentation are starting to notice the
significance of the boundary information, where most approaches see boundaries
as the supplement of semantic details. However, simply combing boundaries and
the mainstream features cannot ensure a holistic improvement of semantics
modeling. In contrast to the previous studies, we exploit boundary as a
significant guidance for context aggregation to promote the overall semantic
understanding of an image. To this end, we propose a Boundary guided Context
Aggregation Network (BCANet), where a Multi-Scale Boundary extractor (MSB)
borrowing the backbone features at multiple scales is specifically designed for
accurate boundary detection. Based on which, a Boundary guided Context
Aggregation module (BCA) improved from Non-local network is further proposed to
capture long-range dependencies between the pixels in the boundary regions and
the ones inside the objects. By aggregating the context information along the
boundaries, the inner pixels of the same category achieve mutual gains and
therefore the intra-class consistency is enhanced. We conduct extensive
experiments on the Cityscapes and ADE20K databases, and comparable results are
achieved with the state-of-the-art methods, clearly demonstrating the
effectiveness of the proposed one.
Related papers
- Contextrast: Contextual Contrastive Learning for Semantic Segmentation [9.051352746190448]
We propose Contextrast, a contrastive learning-based semantic segmentation method.
Our proposed method comprises two parts: a) contextual contrastive learning (CCL) and b) boundary-aware negative sampling.
We demonstrate that our Contextrast substantially enhances the performance of semantic segmentation networks.
arXiv Detail & Related papers (2024-04-16T15:04:55Z) - EtC: Temporal Boundary Expand then Clarify for Weakly Supervised Video
Grounding with Multimodal Large Language Model [63.93372634950661]
We propose a new perspective that maintains the integrity of the original temporal content while introducing more valuable information for expanding the incomplete boundaries.
Motivated by video continuity, i.e., visual similarity across adjacent frames, we use powerful multimodal large language models (MLLMs) to annotate each frame within initial pseudo boundaries.
arXiv Detail & Related papers (2023-12-05T04:15:56Z) - Push-the-Boundary: Boundary-aware Feature Propagation for Semantic
Segmentation of 3D Point Clouds [0.5249805590164901]
We propose a boundary-aware feature propagation mechanism to improve semantic segmentation near object boundaries.
With one shared encoder, our network outputs (i) boundary localization, (ii) prediction of directions pointing to the object's interior, and (iii) semantic segmentation, in three parallel streams.
Our proposed approach yields consistent improvements by reducing boundary errors.
arXiv Detail & Related papers (2022-12-23T15:42:01Z) - Contrastive Boundary Learning for Point Cloud Segmentation [81.7289734276872]
We propose a novel contrastive boundary learning framework for point cloud segmentation.
We experimentally show that CBL consistently improves different baselines and assists them to achieve compelling performance on boundaries.
arXiv Detail & Related papers (2022-03-10T10:08:09Z) - Attention-based fusion of semantic boundary and non-boundary information
to improve semantic segmentation [9.518010235273783]
This paper introduces a method for image semantic segmentation grounded on a novel fusion scheme.
The main goal of our proposal is to explore object boundary information to improve the overall segmentation performance.
Our proposed model achieved the best mIoU on the CityScapes, CamVid, and Pascal Context data sets, and the second best on Mapillary Vistas.
arXiv Detail & Related papers (2021-08-05T20:46:53Z) - Look Closer to Segment Better: Boundary Patch Refinement for Instance
Segmentation [51.59290734837372]
We propose a conceptually simple yet effective post-processing refinement framework to improve the boundary quality.
The proposed BPR framework yields significant improvements over the Mask R-CNN baseline on Cityscapes benchmark.
By applying the BPR framework to the PolyTransform + SegFix baseline, we reached 1st place on the Cityscapes leaderboard.
arXiv Detail & Related papers (2021-04-12T07:10:48Z) - Active Boundary Loss for Semantic Segmentation [58.72057610093194]
This paper proposes a novel active boundary loss for semantic segmentation.
It can progressively encourage the alignment between predicted boundaries and ground-truth boundaries during end-to-end training.
Experimental results show that training with the active boundary loss can effectively improve the boundary F-score and mean Intersection-over-Union.
arXiv Detail & Related papers (2021-02-04T15:47:54Z) - Affinity Space Adaptation for Semantic Segmentation Across Domains [57.31113934195595]
In this paper, we address the problem of unsupervised domain adaptation (UDA) in semantic segmentation.
Motivated by the fact that source and target domain have invariant semantic structures, we propose to exploit such invariance across domains.
We develop two affinity space adaptation strategies: affinity space cleaning and adversarial affinity space alignment.
arXiv Detail & Related papers (2020-09-26T10:28:11Z) - Think about boundary: Fusing multi-level boundary information for
landmark heatmap regression [51.48533538153833]
We study a two-stage but end-to-end approach for exploring the relationship between the facial boundary and landmarks.
We get boundary-aware landmark predictions, which consists of two modules: the self-calibrated boundary estimation (SCBE) module and the boundary-aware landmark transform (BALT) module.
Our approach outperforms state-of-the-art methods in the literature.
arXiv Detail & Related papers (2020-08-25T10:14:13Z) - Joint Semantic Segmentation and Boundary Detection using Iterative
Pyramid Contexts [35.28037460530125]
We present a joint multi-task learning framework for semantic segmentation and boundary detection.
For semantic boundary detection, we propose the novel spatial gradient fusion to suppress nonsemantic edges.
Our experiments demonstrate superior performance over state-of-the-art works.
arXiv Detail & Related papers (2020-04-16T14:46:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.