Accelerating the creation of instance segmentation training sets through
bounding box annotation
- URL: http://arxiv.org/abs/2205.11563v1
- Date: Mon, 23 May 2022 18:37:03 GMT
- Title: Accelerating the creation of instance segmentation training sets through
bounding box annotation
- Authors: Niels Sayez and Christophe De Vleeschouwer
- Abstract summary: Our work proposes to delineate instances in three steps, based on a semi-automatic approach.
The sole definition of extreme points results in a model accuracy that would require up to 10 times more resources if the masks were defined through fully manual delineation.
- Score: 25.85927871251385
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Collecting image annotations remains a significant burden when deploying CNN
in a specific applicative context. This is especially the case when the
annotation consists in binary masks covering object instances. Our work
proposes to delineate instances in three steps, based on a semi-automatic
approach: (1) the extreme points of an object (left-most, right-most, top,
bottom pixels) are manually defined, thereby providing the object bounding-box,
(2) a universal automatic segmentation tool like Deep Extreme Cut is used to
turn the bounded object into a segmentation mask that matches the extreme
points; and (3) the predicted mask is manually corrected. Various strategies
are then investigated to balance the human manual annotation resources between
bounding-box definition and mask correction, including when the correction of
instance masks is prioritized based on their overlap with other instance
bounding-boxes, or the outcome of an instance segmentation model trained on a
partially annotated dataset. Our experimental study considers a teamsport
player segmentation task, and measures how the accuracy of the Panoptic-Deeplab
instance segmentation model depends on the human annotation resources
allocation strategy. It reveals that the sole definition of extreme points
results in a model accuracy that would require up to 10 times more resources if
the masks were defined through fully manual delineation of instances. When
targeting higher accuracies, prioritizing the mask correction among the
training set instances is also shown to save up to 80\% of correction
annotation resources compared to a systematic frame by frame correction of
instances, for a same trained instance segmentation model accuracy.
Related papers
- Outline-Guided Object Inpainting with Diffusion Models [11.391452115311798]
Instance segmentation datasets play a crucial role in training accurate and robust computer vision models.
We show how this issue can be mitigated by starting with small annotated instance segmentation datasets and augmenting them to obtain a sizeable annotated dataset.
We generate new images using a diffusion-based inpainting model to fill out the masked area with a desired object class by guiding the diffusion through the object outline.
arXiv Detail & Related papers (2024-02-26T09:21:17Z) - Skeleton-Guided Instance Separation for Fine-Grained Segmentation in
Microscopy [23.848474219551818]
One of the fundamental challenges in microscopy (MS) image analysis is instance segmentation (IS)
We propose a novel one-stage framework named A2B-IS to address this challenge and enhance the accuracy of IS in MS images.
Our method has been thoroughly validated on two large-scale MS datasets.
arXiv Detail & Related papers (2024-01-18T11:14:32Z) - PWISeg: Point-based Weakly-supervised Instance Segmentation for Surgical
Instruments [27.89003436883652]
We propose a weakly-supervised surgical instrument segmentation approach, named Point-based Weakly-supervised Instance (PWISeg)
PWISeg adopts an FCN-based architecture with point-to-box and point-to-mask branches to model the relationships between feature points and bounding boxes.
Based on this, we propose a key pixel association loss and a key pixel distribution loss, driving the point-to-mask branch to generate more accurate segmentation predictions.
arXiv Detail & Related papers (2023-11-16T11:48:29Z) - Weakly Supervised 3D Instance Segmentation without Instance-level
Annotations [57.615325809883636]
3D semantic scene understanding tasks have achieved great success with the emergence of deep learning, but often require a huge amount of manually annotated training data.
We propose the first weakly-supervised 3D instance segmentation method that only requires categorical semantic labels as supervision.
By generating pseudo instance labels from categorical semantic labels, our designed approach can also assist existing methods for learning 3D instance segmentation at reduced annotation cost.
arXiv Detail & Related papers (2023-08-03T12:30:52Z) - SIM: Semantic-aware Instance Mask Generation for Box-Supervised Instance
Segmentation [22.930296667684125]
We propose a new box-supervised instance segmentation approach by developing a Semantic-aware Instance Mask (SIM) generation paradigm.
Considering that the semantic-aware prototypes cannot distinguish different instances of the same semantics, we propose a self-correction mechanism.
Extensive experimental results demonstrate the superiority of our proposed SIM approach over other state-of-the-art methods.
arXiv Detail & Related papers (2023-03-14T05:59:25Z) - Collaborative Propagation on Multiple Instance Graphs for 3D Instance
Segmentation with Single-point Supervision [63.429704654271475]
We propose a novel weakly supervised method RWSeg that only requires labeling one object with one point.
With these sparse weak labels, we introduce a unified framework with two branches to propagate semantic and instance information.
Specifically, we propose a Cross-graph Competing Random Walks (CRW) algorithm that encourages competition among different instance graphs.
arXiv Detail & Related papers (2022-08-10T02:14:39Z) - Box-supervised Instance Segmentation with Level Set Evolution [41.19797478617953]
We propose a box-supervised instance segmentation approach, which integrates the classical level set model with deep neural network delicately.
A simple mask supervised SOLOv2 model is adapted to predict the instance-aware mask map as the level set for each instance.
The experimental results on four challenging benchmarks demonstrate the leading performance of our proposed approach.
arXiv Detail & Related papers (2022-07-19T03:59:44Z) - Sparse Instance Activation for Real-Time Instance Segmentation [72.23597664935684]
We propose a conceptually novel, efficient, and fully convolutional framework for real-time instance segmentation.
SparseInst has extremely fast inference speed and achieves 40 FPS and 37.9 AP on the COCO benchmark.
arXiv Detail & Related papers (2022-03-24T03:15:39Z) - Scaling up instance annotation via label propagation [69.8001043244044]
We propose a highly efficient annotation scheme for building large datasets with object segmentation masks.
We exploit these similarities by using hierarchical clustering on mask predictions made by a segmentation model.
We show that we obtain 1M object segmentation masks with a total annotation time of only 290 hours.
arXiv Detail & Related papers (2021-10-05T18:29:34Z) - SOLO: A Simple Framework for Instance Segmentation [84.00519148562606]
"instance categories" assigns categories to each pixel within an instance according to the instance's location.
"SOLO" is a simple, direct, and fast framework for instance segmentation with strong performance.
Our approach achieves state-of-the-art results for instance segmentation in terms of both speed and accuracy.
arXiv Detail & Related papers (2021-06-30T09:56:54Z) - PointINS: Point-based Instance Segmentation [117.38579097923052]
Mask representation in instance segmentation with Point-of-Interest (PoI) features is challenging because learning a high-dimensional mask feature for each instance requires a heavy computing burden.
We propose an instance-aware convolution, which decomposes this mask representation learning task into two tractable modules.
Along with instance-aware convolution, we propose PointINS, a simple and practical instance segmentation approach.
arXiv Detail & Related papers (2020-03-13T08:24:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.