Grouping Boundary Proposals for Fast Interactive Image Segmentation
- URL: http://arxiv.org/abs/2309.04169v1
- Date: Fri, 8 Sep 2023 07:22:54 GMT
- Title: Grouping Boundary Proposals for Fast Interactive Image Segmentation
- Authors: Li Liu and Da Chen and Minglei Shu and Laurent D. Cohen
- Abstract summary: We introduce a new image segmentation model based on the minimal geodesic framework.
We use an adaptive cut-based circular optimal path scheme and a graph-based boundary proposals grouping scheme.
Experimental results show that the proposed model indeed outperforms state-of-the-art minimal paths-based image segmentation approaches.
- Score: 19.337758803223917
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Geodesic models are known as an efficient tool for solving various image
segmentation problems. Most of existing approaches only exploit local pointwise
image features to track geodesic paths for delineating the objective
boundaries. However, such a segmentation strategy cannot take into account the
connectivity of the image edge features, increasing the risk of shortcut
problem, especially in the case of complicated scenario. In this work, we
introduce a new image segmentation model based on the minimal geodesic
framework in conjunction with an adaptive cut-based circular optimal path
computation scheme and a graph-based boundary proposals grouping scheme.
Specifically, the adaptive cut can disconnect the image domain such that the
target contours are imposed to pass through this cut only once. The boundary
proposals are comprised of precomputed image edge segments, providing the
connectivity information for our segmentation model. These boundary proposals
are then incorporated into the proposed image segmentation model, such that the
target segmentation contours are made up of a set of selected boundary
proposals and the corresponding geodesic paths linking them. Experimental
results show that the proposed model indeed outperforms state-of-the-art
minimal paths-based image segmentation approaches.
Related papers
- QIS : Interactive Segmentation via Quasi-Conformal Mappings [3.096214093393036]
We propose a quasi-conformal interactive segmentation (QIS) model, which incorporates user input in the form of positive and negative clicks.
We provide a thorough analysis of the proposed model, including theoretical support for the ability of QIS to include or exclude regions of interest.
arXiv Detail & Related papers (2024-02-22T16:49:58Z) - Temporal Segment Transformer for Action Segmentation [54.25103250496069]
We propose an attention based approach which we call textittemporal segment transformer, for joint segment relation modeling and denoising.
The main idea is to denoise segment representations using attention between segment and frame representations, and also use inter-segment attention to capture temporal correlations between segments.
We show that this novel architecture achieves state-of-the-art accuracy on the popular 50Salads, GTEA and Breakfast benchmarks.
arXiv Detail & Related papers (2023-02-25T13:05:57Z) - BoundarySqueeze: Image Segmentation as Boundary Squeezing [104.43159799559464]
We propose a novel method for fine-grained high-quality image segmentation of both objects and scenes.
Inspired by dilation and erosion from morphological image processing techniques, we treat the pixel level segmentation problems as squeezing object boundary.
Our method yields large gains on COCO, Cityscapes, for both instance and semantic segmentation and outperforms previous state-of-the-art PointRend in both accuracy and speed under the same setting.
arXiv Detail & Related papers (2021-05-25T04:58:51Z) - SCNet: Enhancing Few-Shot Semantic Segmentation by Self-Contrastive
Background Prototypes [56.387647750094466]
Few-shot semantic segmentation aims to segment novel-class objects in a query image with only a few annotated examples.
Most of advanced solutions exploit a metric learning framework that performs segmentation through matching each pixel to a learned foreground prototype.
This framework suffers from biased classification due to incomplete construction of sample pairs with the foreground prototype only.
arXiv Detail & Related papers (2021-04-19T11:21:47Z) - Active Boundary Loss for Semantic Segmentation [58.72057610093194]
This paper proposes a novel active boundary loss for semantic segmentation.
It can progressively encourage the alignment between predicted boundaries and ground-truth boundaries during end-to-end training.
Experimental results show that training with the active boundary loss can effectively improve the boundary F-score and mean Intersection-over-Union.
arXiv Detail & Related papers (2021-02-04T15:47:54Z) - Nonparametric clustering for image segmentation [0.0]
We discuss the application of nonparametric clustering to image segmentation and provide an algorithm specific for this task.
Pixel similarity is evaluated in terms of density of the color representation and the adjacency structure of the pixels is exploited.
The proposed method works both to segment an image and to detect its boundaries and can be seen as a generalization to color images of the class of thresholding methods.
arXiv Detail & Related papers (2021-01-20T22:27:44Z) - Pixel-Level Cycle Association: A New Perspective for Domain Adaptive
Semantic Segmentation [169.82760468633236]
We propose to build the pixel-level cycle association between source and target pixel pairs.
Our method can be trained end-to-end in one stage and introduces no additional parameters.
arXiv Detail & Related papers (2020-10-31T00:11:36Z) - Geodesic Paths for Image Segmentation with Implicit Region-based
Homogeneity Enhancement [19.309722425910465]
We introduce a flexible interactive image segmentation model based on the Eikonal partial differential equation (PDE) framework.
The proposed model indeed outperforms state-of-the-art minimal paths-based image segmentation approaches.
arXiv Detail & Related papers (2020-08-16T13:29:11Z) - Improving Semantic Segmentation via Decoupled Body and Edge Supervision [89.57847958016981]
Existing semantic segmentation approaches either aim to improve the object's inner consistency by modeling the global context, or refine objects detail along their boundaries by multi-scale feature fusion.
In this paper, a new paradigm for semantic segmentation is proposed.
Our insight is that appealing performance of semantic segmentation requires textitexplicitly modeling the object textitbody and textitedge, which correspond to the high and low frequency of the image.
We show that the proposed framework with various baselines or backbone networks leads to better object inner consistency and object boundaries.
arXiv Detail & Related papers (2020-07-20T12:11:22Z) - A Region-based Randers Geodesic Approach for Image Segmentation [16.091797508701045]
We introduce a new variational image segmentation model based on the minimal geodesic path framework.
We also suggest a practical interactive image segmentation strategy, where the target boundary can be delineated by the concatenation of several piecewise geodesic paths.
arXiv Detail & Related papers (2019-12-20T22:17:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.