Weakly-Supervised Salient Object Detection via Scribble Annotations
- URL: http://arxiv.org/abs/2003.07685v1
- Date: Tue, 17 Mar 2020 12:59:50 GMT
- Title: Weakly-Supervised Salient Object Detection via Scribble Annotations
- Authors: Jing Zhang, Xin Yu, Aixuan Li, Peipei Song, Bowen Liu and Yuchao Dai
- Abstract summary: We propose a weakly-supervised salient object detection model to learn saliency from scribble labels.
We present a new metric, termed saliency structure measure, to measure the structure alignment of the predicted saliency maps.
Our method not only outperforms existing weakly-supervised/unsupervised methods, but also is on par with several fully-supervised state-of-the-art models.
- Score: 54.40518383782725
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Compared with laborious pixel-wise dense labeling, it is much easier to label
data by scribbles, which only costs 1$\sim$2 seconds to label one image.
However, using scribble labels to learn salient object detection has not been
explored. In this paper, we propose a weakly-supervised salient object
detection model to learn saliency from such annotations. In doing so, we first
relabel an existing large-scale salient object detection dataset with
scribbles, namely S-DUTS dataset. Since object structure and detail information
is not identified by scribbles, directly training with scribble labels will
lead to saliency maps of poor boundary localization. To mitigate this problem,
we propose an auxiliary edge detection task to localize object edges
explicitly, and a gated structure-aware loss to place constraints on the scope
of structure to be recovered. Moreover, we design a scribble boosting scheme to
iteratively consolidate our scribble annotations, which are then employed as
supervision to learn high-quality saliency maps. As existing saliency
evaluation metrics neglect to measure structure alignment of the predictions,
the saliency map ranking metric may not comply with human perception. We
present a new metric, termed saliency structure measure, to measure the
structure alignment of the predicted saliency maps, which is more consistent
with human perception. Extensive experiments on six benchmark datasets
demonstrate that our method not only outperforms existing
weakly-supervised/unsupervised methods, but also is on par with several
fully-supervised state-of-the-art models. Our code and data is publicly
available at https://github.com/JingZhang617/Scribble_Saliency.
Related papers
- Scribble Hides Class: Promoting Scribble-Based Weakly-Supervised
Semantic Segmentation with Its Class Label [16.745019028033518]
We propose a class-driven scribble promotion network, which utilizes both scribble annotations and pseudo-labels informed by image-level classes and global semantics for supervision.
Experiments on the ScribbleSup dataset with different qualities of scribble annotations outperform all the previous methods, demonstrating the superiority and robustness of our method.
arXiv Detail & Related papers (2024-02-27T14:51:56Z) - Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud [69.36717778451667]
Existing methods for large-scale point cloud semantic segmentation require expensive, tedious and error-prone manual point-wise annotations.
We propose an effective weakly supervised method containing two components to solve the problem.
The experimental results show the large gain against existing weakly supervised and comparable results to fully supervised methods.
arXiv Detail & Related papers (2022-12-09T09:42:26Z) - Weakly-Supervised Salient Object Detection Using Point Supervison [17.88596733603456]
Current state-of-the-art saliency detection models rely heavily on large datasets of accurate pixel-wise annotations.
We propose a novel weakly-supervised salient object detection method using point supervision.
Our method outperforms the previous state-of-the-art methods trained with the stronger supervision.
arXiv Detail & Related papers (2022-03-22T12:16:05Z) - Scribble-based Boundary-aware Network for Weakly Supervised Salient
Object Detection in Remote Sensing Images [10.628932392896374]
We propose a novel weakly-supervised salient object detection framework to predict the saliency of remote sensing images from sparse scribble annotations.
Specifically, we design a boundary-aware module (BAM) to explore the object boundary semantics, which is explicitly supervised by the high-confidence object boundary (pseudo) labels.
Then, the boundary semantics are integrated with high-level features to guide the salient object detection under the supervision of scribble labels.
arXiv Detail & Related papers (2022-02-07T20:32:21Z) - Learning to Detect Instance-level Salient Objects Using Complementary
Image Labels [55.049347205603304]
We present the first weakly-supervised approach to the salient instance detection problem.
We propose a novel weakly-supervised network with three branches: a Saliency Detection Branch leveraging class consistency information to locate candidate objects; a Boundary Detection Branch exploiting class discrepancy information to delineate object boundaries; and a Centroid Detection Branch using subitizing information to detect salient instance centroids.
arXiv Detail & Related papers (2021-11-19T10:15:22Z) - Unsupervised Object Detection with LiDAR Clues [70.73881791310495]
We present the first practical method for unsupervised object detection with the aid of LiDAR clues.
In our approach, candidate object segments based on 3D point clouds are firstly generated.
Then, an iterative segment labeling process is conducted to assign segment labels and to train a segment labeling network.
The labeling process is carefully designed so as to mitigate the issue of long-tailed and open-ended distribution.
arXiv Detail & Related papers (2020-11-25T18:59:54Z) - Weakly-supervised Salient Instance Detection [65.0408760733005]
We present the first weakly-supervised approach to the salient instance detection problem.
We propose a novel weakly-supervised network with three branches: a Saliency Detection Branch leveraging class consistency information to locate candidate objects; a Boundary Detection Branch exploiting class discrepancy information to delineate object boundaries; and a Centroid Detection Branch using subitizing information to detect salient instance centroids.
arXiv Detail & Related papers (2020-09-29T09:47:23Z) - Structured Prediction with Partial Labelling through the Infimum Loss [85.4940853372503]
The goal of weak supervision is to enable models to learn using only forms of labelling which are cheaper to collect.
This is a type of incomplete annotation where, for each datapoint, supervision is cast as a set of labels containing the real one.
This paper provides a unified framework based on structured prediction and on the concept of infimum loss to deal with partial labelling.
arXiv Detail & Related papers (2020-03-02T13:59:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.