ContourRender: Detecting Arbitrary Contour Shape For Instance Segmentation In One Pass

• URL: http://arxiv.org/abs/2106.03382v1
• Date: Mon, 7 Jun 2021 07:23:03 GMT
• Title: ContourRender: Detecting Arbitrary Contour Shape For Instance Segmentation In One Pass
• Authors: Tutian Tang, Wenqiang Xu, Ruolin Ye, Yan-Feng Wang, Cewu Lu
• Abstract summary: We argue that the difficulty in regressing the contour points in one pass is mainly due to the ambiguity when discretizing a smooth contour into a polygon. To address the ambiguity, we propose a novel differentiable rendering-based approach named textbfContourRender. It first predicts a contour generated by an invertible shape signature, and then optimize the contour with the more stable silhouette by converting it to a contour mesh and rendering the mesh to a 2D map.
• Score: 48.57232627854642
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Direct contour regression for instance segmentation is a challenging task. Previous works usually achieve it by learning to progressively refine the contour prediction or adopting a shape representation with limited expressiveness. In this work, we argue that the difficulty in regressing the contour points in one pass is mainly due to the ambiguity when discretizing a smooth contour into a polygon. To address the ambiguity, we propose a novel differentiable rendering-based approach named \textbf{ContourRender}. During training, it first predicts a contour generated by an invertible shape signature, and then optimizes the contour with the more stable silhouette by converting it to a contour mesh and rendering the mesh to a 2D map. This method significantly improves the quality of contour without iterations or cascaded refinements. Moreover, as optimization is not needed during inference, the inference speed will not be influenced. Experiments show the proposed ContourRender outperforms all the contour-based instance segmentation approaches on COCO, while stays competitive with the iteration-based state-of-the-art on Cityscapes. In addition, we specifically select a subset from COCO val2017 named COCO ContourHard-val to further demonstrate the contour quality improvements. Codes, models, and dataset split will be released.

Related papers

• AdaContour: Adaptive Contour Descriptor with Hierarchical Representation [52.381359663689004]
  Existing angle-based contour descriptors suffer from lossy representation for non-star shapes. AdaCon is able to represent shapes more accurately robustly than other descriptors.
  arXiv  Detail & Related papers  (2024-04-12T07:30:24Z)
• Corner-to-Center Long-range Context Model for Efficient Learned Image Compression [70.0411436929495]
  In the framework of learned image compression, the context model plays a pivotal role in capturing the dependencies among latent representations. We propose the textbfCorner-to-Center transformer-based Context Model (C$3$M) designed to enhance context and latent predictions. In addition, to enlarge the receptive field in the analysis and synthesis transformation, we use the Long-range Crossing Attention Module (LCAM) in the encoder/decoder.
  arXiv  Detail & Related papers  (2023-11-29T21:40:28Z)
• High-fidelity Interpretable Inverse Rig: An Accurate and Sparse Solution Optimizing the Quartic Blendshape Model [0.0]
  We propose a method to fit arbitrarily accurate blendshape rig models by solving the inverse rig problem in realistic human face animation. We show experimentally that the proposed method yields solutions with mesh error comparable to or lower than the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2023-02-09T18:15:08Z)
• Recurrent Generic Contour-based Instance Segmentation with Progressive Learning [111.31166268300817]
  We propose a novel deep network architecture, i.e., PolySnake, for generic contour-based instance segmentation. Motivated by the classic Snake algorithm, the proposed PolySnake achieves superior and robust segmentation performance.
  arXiv  Detail & Related papers  (2023-01-21T05:34:29Z)
• SharpContour: A Contour-based Boundary Refinement Approach for Efficient and Accurate Instance Segmentation [29.051499127975703]
  We propose an efficient contour-based boundary refinement approach, named SharpContour, to tackle the segmentation of boundary area. Our method deforms the contour iteratively by updating offsets in a discrete manner. Experiments show that SharpContour achieves competitive gains whilst preserving high efficiency.
  arXiv  Detail & Related papers  (2022-03-24T19:37:20Z)
• Deep Rectangling for Image Stitching: A Learning Baseline [57.76737888499145]
  We build the first image stitching rectangling dataset with a large diversity in irregular boundaries and scenes. Experiments demonstrate our superiority over traditional methods both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2022-03-08T03:34:10Z)
• Deep Shells: Unsupervised Shape Correspondence with Optimal Transport [52.646396621449]
  We propose a novel unsupervised learning approach to 3D shape correspondence. We show that the proposed method significantly improves over the state-of-the-art on multiple datasets.
  arXiv  Detail & Related papers  (2020-10-28T22:24:07Z)
• ContourRend: A Segmentation Method for Improving Contours by Rendering [10.13129256609938]
  Mask-based segmentation can not handle contour features well on a coarse prediction grid. We propose Contourend which adopts convolution contour to refine segmentation contours. Our method reaches 72.41% mean intersection over union (IoU) and surpasses baseline Polygon-GCN by 1.22%.
  arXiv  Detail & Related papers  (2020-07-15T02:16:00Z)
• ProAlignNet : Unsupervised Learning for Progressively Aligning Noisy Contours [12.791313859673187]
  "ProAlignNet" accounts for large scale misalignments and complex transformations between the contour shapes. It learns by training with a novel loss function which is derived an upperbound of a proximity-sensitive and local shape-dependent similarity metric. In two real-world applications, the proposed models consistently perform superior to state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-05-23T14:56:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.