Weakly Supervised Learning with Side Information for Noisy Labeled Images

• URL: http://arxiv.org/abs/2008.11586v2
• Date: Fri, 4 Sep 2020 08:02:28 GMT
• Title: Weakly Supervised Learning with Side Information for Noisy Labeled Images
• Authors: Lele Cheng, Xiangzeng Zhou, Liming Zhao, Dangwei Li, Hong Shang, Yun Zheng, Pan Pan, Yinghui Xu
• Abstract summary: We present an efficient weakly supervised learning by using a Side Information Network (SINet) The proposed SINet consists of a visual prototype module and a noise weighting module. The propsed SINet can largely alleviate the negative impact of noisy image labels.
• Score: 41.37584960976829
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In many real-world datasets, like WebVision, the performance of DNN based classifier is often limited by the noisy labeled data. To tackle this problem, some image related side information, such as captions and tags, often reveal underlying relationships across images. In this paper, we present an efficient weakly supervised learning by using a Side Information Network (SINet), which aims to effectively carry out a large scale classification with severely noisy labels. The proposed SINet consists of a visual prototype module and a noise weighting module. The visual prototype module is designed to generate a compact representation for each category by introducing the side information. The noise weighting module aims to estimate the correctness of each noisy image and produce a confidence score for image ranking during the training procedure. The propsed SINet can largely alleviate the negative impact of noisy image labels, and is beneficial to train a high performance CNN based classifier. Besides, we released a fine-grained product dataset called AliProducts, which contains more than 2.5 million noisy web images crawled from the internet by using queries generated from 50,000 fine-grained semantic classes. Extensive experiments on several popular benchmarks (i.e. Webvision, ImageNet and Clothing-1M) and our proposed AliProducts achieve state-of-the-art performance. The SINet has won the first place in the classification task on WebVision Challenge 2019, and outperformed other competitors by a large margin.

Related papers

• Adaptive Noise-Tolerant Network for Image Segmentation [1.57731592348751]
  We study whether integrating imperfect or noisy segmentation results from off-the-shelf segmentation algorithms may help achieve better segmentation results through a new Adaptive Noise-Tolerant Network (ANTN) model. We extend the noisy label deep learning to image segmentation with two novel aspects: (1) multiple noisy labels can be integrated into one deep learning model; (2) noisy segmentation modeling, including probabilistic parameters, is adaptive, depending on the given testing image appearance.
  arXiv  Detail & Related papers  (2025-01-13T09:49:34Z)
• Noise-Tolerant Hybrid Prototypical Learning with Noisy Web Data [72.32706907910477]
  We focus on the challenging problem of learning an unbiased classifier from a large number of potentially relevant but noisily labeled web images. In the few clean and many noisy scenarios, the class prototype can be severely biased due to the presence of irrelevant noisy images. Our approach considers the diversity of noisy images by explicit division and overcomes the optimization discrepancy issue.
  arXiv  Detail & Related papers  (2025-01-05T08:21:43Z)
• UnSeg: One Universal Unlearnable Example Generator is Enough against All Image Segmentation [64.01742988773745]
  An increasing privacy concern exists regarding training large-scale image segmentation models on unauthorized private data. We exploit the concept of unlearnable examples to make images unusable to model training by generating and adding unlearnable noise into the original images. We empirically verify the effectiveness of UnSeg across 6 mainstream image segmentation tasks, 10 widely used datasets, and 7 different network architectures.
  arXiv  Detail & Related papers  (2024-10-13T16:34:46Z)
• Exploiting Category Names for Few-Shot Classification with Vision-Language Models [78.51975804319149]
  Vision-language foundation models pretrained on large-scale data provide a powerful tool for many visual understanding tasks. This paper shows that we can significantly improve the performance of few-shot classification by using the category names to initialize the classification head.
  arXiv  Detail & Related papers  (2022-11-29T21:08:46Z)
• Multi-label Iterated Learning for Image Classification with Label Ambiguity [3.5736176624479654]
  We propose multi-label iterated learning (MILe) to incorporate the inductive biases of multi-label learning from single labels. MILe is a simple yet effective procedure that builds a multi-label description of the image by propagating binary predictions. We show that MILe is effective reducing label noise, achieving state-of-the-art performance on real-world large-scale noisy data such as WebVision.
  arXiv  Detail & Related papers  (2021-11-23T22:10:00Z)
• Group-Wise Semantic Mining for Weakly Supervised Semantic Segmentation [49.90178055521207]
  This work addresses weakly supervised semantic segmentation (WSSS), with the goal of bridging the gap between image-level annotations and pixel-level segmentation. We formulate WSSS as a novel group-wise learning task that explicitly models semantic dependencies in a group of images to estimate more reliable pseudo ground-truths. In particular, we devise a graph neural network (GNN) for group-wise semantic mining, wherein input images are represented as graph nodes.
  arXiv  Detail & Related papers  (2020-12-09T12:40:13Z)
• Attention-Aware Noisy Label Learning for Image Classification [97.26664962498887]
  Deep convolutional neural networks (CNNs) learned on large-scale labeled samples have achieved remarkable progress in computer vision. The cheapest way to obtain a large body of labeled visual data is to crawl from websites with user-supplied labels, such as Flickr. This paper proposes the attention-aware noisy label learning approach to improve the discriminative capability of the network trained on datasets with potential label noise.
  arXiv  Detail & Related papers  (2020-09-30T15:45:36Z)
• Learning from Noisy Labels with Noise Modeling Network [7.523041606515877]
  Noise Modeling Network (NMN) follows our convolutional neural network (CNN) and integrates with it. NMN learns the distribution of noise patterns directly from the noisy data. We show that the integrated NMN/CNN learning system consistently improves the classification performance.
  arXiv  Detail & Related papers  (2020-05-01T20:32:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.