PolarMask++: Enhanced Polar Representation for Single-Shot Instance Segmentation and Beyond

• URL: http://arxiv.org/abs/2105.02184v1
• Date: Wed, 5 May 2021 16:55:53 GMT
• Title: PolarMask++: Enhanced Polar Representation for Single-Shot Instance Segmentation and Beyond
• Authors: Enze Xie, Wenhai Wang, Mingyu Ding, Ruimao Zhang, Ping Luo
• Abstract summary: PolarMask reformulates the instance segmentation problem as predicting the contours of objects in the polar coordinate. Two modules are carefully designed (i.e. soft polar centerness and polar IoU loss) to sample high-quality center examples. PolarMask is fully convolutional and can be easily embedded into most off-the-shelf detection methods.
• Score: 47.518550130850755
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reducing the complexity of the pipeline of instance segmentation is crucial for real-world applications. This work addresses this issue by introducing an anchor-box free and single-shot instance segmentation framework, termed PolarMask, which reformulates the instance segmentation problem as predicting the contours of objects in the polar coordinate, with several appealing benefits. (1) The polar representation unifies instance segmentation (masks) and object detection (bounding boxes) into a single framework, reducing the design and computational complexity. (2) Two modules are carefully designed (i.e. soft polar centerness and polar IoU loss) to sample high-quality center examples and optimize polar contour regression, making the performance of PolarMask does not depend on the bounding box prediction results and thus becomes more efficient in training. (3) PolarMask is fully convolutional and can be easily embedded into most off-the-shelf detection methods. To further improve the accuracy of the framework, a Refined Feature Pyramid is introduced to further improve the feature representation at different scales, termed PolarMask++. Extensive experiments demonstrate the effectiveness of both PolarMask and PolarMask++, which achieve competitive results on instance segmentation in the challenging COCO dataset with single-model and single-scale training and testing, as well as new state-of-the-art results on rotate text detection and cell segmentation. We hope the proposed polar representation can provide a new perspective for designing algorithms to solve single-shot instance segmentation. The codes and models are available at: github.com/xieenze/PolarMask.

Related papers

• Bridge the Points: Graph-based Few-shot Segment Anything Semantically [79.1519244940518]
  Recent advancements in pre-training techniques have enhanced the capabilities of vision foundation models. Recent studies extend the SAM to Few-shot Semantic segmentation (FSS) We propose a simple yet effective approach based on graph analysis.
  arXiv  Detail & Related papers  (2024-10-09T15:02:28Z)
• MP-PolarMask: A Faster and Finer Instance Segmentation for Concave Images [4.977034524493568]
  PolarMask is a unique model that represents an object by a Polar coordinate system. There are two deficiencies associated with PolarMask: (i) inability of representing concave objects and (ii) inefficiency in using ray regression. We propose MP-PolarMask (Multi-Point PolarMask) by taking advantage of multiple Polar systems.
  arXiv  Detail & Related papers  (2024-06-03T14:20:34Z)
• Polar-Doc: One-Stage Document Dewarping with Multi-Scope Constraints under Polar Representation [26.050987382098107]
  Document dewarping aims to eliminate geometric deformation in photographed documents to benefit text recognition. In this work, we explore Polar coordinates representation for each point in document dewarping, namely Polar-Doc. We propose a novel multi-scope Polar-Doc-IOU loss to constrain the relationship among control points as a grid-based regularization.
  arXiv  Detail & Related papers  (2023-12-13T06:50:30Z)
• PARTNER: Level up the Polar Representation for LiDAR 3D Object Detection [81.16859686137435]
  We present PARTNER, a novel 3D object detector in the polar coordinate. Our method outperforms the previous polar-based works with remarkable margins of 3.68% and 9.15% on and ONCE validation set.
  arXiv  Detail & Related papers  (2023-08-08T01:59:20Z)
• Applying Eigencontours to PolarMask-Based Instance Segmentation [40.13463458124477]
  Eigencontours are the first data-driven contour descriptors based on singular value decomposition. In this report, we incorporate eigencontours into the PolarMask network for instance segmentation.
  arXiv  Detail & Related papers  (2022-08-24T01:33:18Z)
• SiamPolar: Semi-supervised Realtime Video Object Segmentation with Polar Representation [6.108508667949229]
  We propose a semi-supervised real-time method based on the Siamese network using a new polar representation. The polar representation could reduce the parameters for encoding masks with subtle accuracy loss. An asymmetric siamese network is also developed to extract the features from different spatial scales.
  arXiv  Detail & Related papers  (2021-10-27T21:10:18Z)
• NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go [109.88509362837475]
  We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes. NeuroMorph produces smooth and point-to-point correspondences between them. It works well for a large variety of input shapes, including non-isometric pairs from different object categories.
  arXiv  Detail & Related papers  (2021-06-17T12:25:44Z)
• Finding Geometric Models by Clustering in the Consensus Space [61.65661010039768]
  We propose a new algorithm for finding an unknown number of geometric models, e.g., homographies. We present a number of applications where the use of multiple geometric models improves accuracy. These include pose estimation from multiple generalized homographies; trajectory estimation of fast-moving objects.
  arXiv  Detail & Related papers  (2021-03-25T14:35:07Z)
• Fast Single-shot Ship Instance Segmentation Based on Polar Template Mask in Remote Sensing Images [7.45725819658858]
  We propose a single-shot convolutional neural network structure, which is conceptually simple and straightforward. Our method, termed with SSS-Net, detects targets based on the location of the object's center. Experiments on both the Airbus Ship Detection Challenge dataset and the ISAIDships dataset show that SSS-Net has strong competitiveness in precision and speed for ship instance segmentation.
  arXiv  Detail & Related papers  (2020-08-28T02:38:04Z)
• PointINS: Point-based Instance Segmentation [117.38579097923052]
  Mask representation in instance segmentation with Point-of-Interest (PoI) features is challenging because learning a high-dimensional mask feature for each instance requires a heavy computing burden. We propose an instance-aware convolution, which decomposes this mask representation learning task into two tractable modules. Along with instance-aware convolution, we propose PointINS, a simple and practical instance segmentation approach.
  arXiv  Detail & Related papers  (2020-03-13T08:24:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.