EffSeg: Efficient Fine-Grained Instance Segmentation using Structure-Preserving Sparsity

• URL: http://arxiv.org/abs/2307.01545v1
• Date: Tue, 4 Jul 2023 07:58:23 GMT
• Title: EffSeg: Efficient Fine-Grained Instance Segmentation using Structure-Preserving Sparsity
• Authors: C\'edric Picron, Tinne Tuytelaars
• Abstract summary: We propose EffSeg performing fine-grained instance segmentation in an efficient way by using our Structure-Preserving Sparsity (SPS) method. EffSeg achieves similar performance on COCO compared to RefineMask, while reducing the number of FLOPs by 71% and increasing the FPS by 29%.
• Score: 41.24728444810133
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Many two-stage instance segmentation heads predict a coarse 28x28 mask per instance, which is insufficient to capture the fine-grained details of many objects. To address this issue, PointRend and RefineMask predict a 112x112 segmentation mask resulting in higher quality segmentations. Both methods however have limitations by either not having access to neighboring features (PointRend) or by performing computation at all spatial locations instead of sparsely (RefineMask). In this work, we propose EffSeg performing fine-grained instance segmentation in an efficient way by using our Structure-Preserving Sparsity (SPS) method based on separately storing the active features, the passive features and a dense 2D index map containing the feature indices. The goal of the index map is to preserve the 2D spatial configuration or structure between the features such that any 2D operation can still be performed. EffSeg achieves similar performance on COCO compared to RefineMask, while reducing the number of FLOPs by 71% and increasing the FPS by 29%. Code will be released.

Related papers

• DynaMask: Dynamic Mask Selection for Instance Segmentation [21.50329070835023]
  We develop a Mask Switch Module (MSM) with negligible computational cost to select the most suitable mask resolution for each instance. The proposed method, namely DynaMask, brings consistent and noticeable performance improvements over other state-of-the-arts at a moderate computation overhead.
  arXiv  Detail & Related papers  (2023-03-14T13:01:25Z)
• Sparse Instance Activation for Real-Time Instance Segmentation [72.23597664935684]
  We propose a conceptually novel, efficient, and fully convolutional framework for real-time instance segmentation. SparseInst has extremely fast inference speed and achieves 40 FPS and 37.9 AP on the COCO benchmark.
  arXiv  Detail & Related papers  (2022-03-24T03:15:39Z)
• Real-time Instance Segmentation with Discriminative Orientation Maps [0.16311150636417257]
  We propose a real-time instance segmentation framework termed OrienMask. A mask head is added to predict some discriminative orientation maps. All instances that match with the same anchor size share a common orientation map.
  arXiv  Detail & Related papers  (2021-06-23T07:27:35Z)
• RefineMask: Towards High-Quality Instance Segmentation with Fine-Grained Features [53.71163467683838]
  RefineMask is a new method for high-quality instance segmentation of objects and scenes. It incorporates fine-grained features during the instance-wise segmenting process in a multi-stage manner. It succeeds in segmenting hard cases such as bent parts of objects that are over-smoothed by most previous methods.
  arXiv  Detail & Related papers  (2021-04-17T15:09:20Z)
• SipMask: Spatial Information Preservation for Fast Image and Video Instance Segmentation [149.242230059447]
  We propose a fast single-stage instance segmentation method called SipMask. It preserves instance-specific spatial information by separating mask prediction of an instance to different sub-regions of a detected bounding-box. In terms of real-time capabilities, SipMask outperforms YOLACT with an absolute gain of 3.0% (mask AP) under similar settings.
  arXiv  Detail & Related papers  (2020-07-29T12:21:00Z)
• SOLOv2: Dynamic and Fast Instance Segmentation [102.15325936477362]
  We build a simple, direct, and fast instance segmentation framework with strong performance. We take one step further by dynamically learning the mask head of the object segmenter. We demonstrate a simple direct instance segmentation system, outperforming a few state-of-the-art methods in both speed and accuracy.
  arXiv  Detail & Related papers  (2020-03-23T09:44:21Z)
• PointINS: Point-based Instance Segmentation [117.38579097923052]
  Mask representation in instance segmentation with Point-of-Interest (PoI) features is challenging because learning a high-dimensional mask feature for each instance requires a heavy computing burden. We propose an instance-aware convolution, which decomposes this mask representation learning task into two tractable modules. Along with instance-aware convolution, we propose PointINS, a simple and practical instance segmentation approach.
  arXiv  Detail & Related papers  (2020-03-13T08:24:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.