SOLOv2: Dynamic and Fast Instance Segmentation

• URL: http://arxiv.org/abs/2003.10152v3
• Date: Fri, 23 Oct 2020 23:49:17 GMT
• Title: SOLOv2: Dynamic and Fast Instance Segmentation
• Authors: Xinlong Wang, Rufeng Zhang, Tao Kong, Lei Li, Chunhua Shen
• Abstract summary: We build a simple, direct, and fast instance segmentation framework with strong performance. We take one step further by dynamically learning the mask head of the object segmenter. We demonstrate a simple direct instance segmentation system, outperforming a few state-of-the-art methods in both speed and accuracy.
• Score: 102.15325936477362
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In this work, we aim at building a simple, direct, and fast instance segmentation framework with strong performance. We follow the principle of the SOLO method of Wang et al. "SOLO: segmenting objects by locations". Importantly, we take one step further by dynamically learning the mask head of the object segmenter such that the mask head is conditioned on the location. Specifically, the mask branch is decoupled into a mask kernel branch and mask feature branch, which are responsible for learning the convolution kernel and the convolved features respectively. Moreover, we propose Matrix NMS (non maximum suppression) to significantly reduce the inference time overhead due to NMS of masks. Our Matrix NMS performs NMS with parallel matrix operations in one shot, and yields better results. We demonstrate a simple direct instance segmentation system, outperforming a few state-of-the-art methods in both speed and accuracy. A light-weight version of SOLOv2 executes at 31.3 FPS and yields 37.1% AP. Moreover, our state-of-the-art results in object detection (from our mask byproduct) and panoptic segmentation show the potential to serve as a new strong baseline for many instance-level recognition tasks besides instance segmentation. Code is available at: https://git.io/AdelaiDet

Related papers

• SOLO: A Simple Framework for Instance Segmentation [84.00519148562606]
  "instance categories" assigns categories to each pixel within an instance according to the instance's location. "SOLO" is a simple, direct, and fast framework for instance segmentation with strong performance. Our approach achieves state-of-the-art results for instance segmentation in terms of both speed and accuracy.
  arXiv  Detail & Related papers  (2021-06-30T09:56:54Z)
• RefineMask: Towards High-Quality Instance Segmentation with Fine-Grained Features [53.71163467683838]
  RefineMask is a new method for high-quality instance segmentation of objects and scenes. It incorporates fine-grained features during the instance-wise segmenting process in a multi-stage manner. It succeeds in segmenting hard cases such as bent parts of objects that are over-smoothed by most previous methods.
  arXiv  Detail & Related papers  (2021-04-17T15:09:20Z)
• Instance and Panoptic Segmentation Using Conditional Convolutions [96.7275593916409]
  We propose a simple yet effective framework for instance and panoptic segmentation, termed CondInst. We show that CondInst can achieve improved accuracy and inference speed on both instance and panoptic segmentation tasks.
  arXiv  Detail & Related papers  (2021-02-05T06:57:02Z)
• Mask Encoding for Single Shot Instance Segmentation [97.99956029224622]
  We propose a simple singleshot instance segmentation framework, termed mask encoding based instance segmentation (MEInst) Instead of predicting the two-dimensional mask directly, MEInst distills it into a compact and fixed-dimensional representation vector. We show that the much simpler and flexible one-stage instance segmentation method, can also achieve competitive performance.
  arXiv  Detail & Related papers  (2020-03-26T02:51:17Z)
• PointINS: Point-based Instance Segmentation [117.38579097923052]
  Mask representation in instance segmentation with Point-of-Interest (PoI) features is challenging because learning a high-dimensional mask feature for each instance requires a heavy computing burden. We propose an instance-aware convolution, which decomposes this mask representation learning task into two tractable modules. Along with instance-aware convolution, we propose PointINS, a simple and practical instance segmentation approach.
  arXiv  Detail & Related papers  (2020-03-13T08:24:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.