Anno-incomplete Multi-dataset Detection

• URL: http://arxiv.org/abs/2408.16247v1
• Date: Thu, 29 Aug 2024 03:58:21 GMT
• Title: Anno-incomplete Multi-dataset Detection
• Authors: Yiran Xu, Haoxiang Zhong, Kai Wu, Jialin Li, Yong Liu, Chengjie Wang, Shu-Tao Xia, Hongen Liao,
• Abstract summary: We propose a novel problem as "-incomplete Multi-dataset Detection" We develop an end-to-end multi-task learning architecture which can accurately detect all the object categories with multiple partially annotated datasets.
• Score: 67.69438032767613
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Object detectors have shown outstanding performance on various public datasets. However, annotating a new dataset for a new task is usually unavoidable in real, since 1) a single existing dataset usually does not contain all object categories needed; 2) using multiple datasets usually suffers from annotation incompletion and heterogeneous features. We propose a novel problem as "Annotation-incomplete Multi-dataset Detection", and develop an end-to-end multi-task learning architecture which can accurately detect all the object categories with multiple partially annotated datasets. Specifically, we propose an attention feature extractor which helps to mine the relations among different datasets. Besides, a knowledge amalgamation training strategy is incorporated to accommodate heterogeneous features from different sources. Extensive experiments on different object detection datasets demonstrate the effectiveness of our methods and an improvement of 2.17%, 2.10% in mAP can be achieved on COCO and VOC respectively.

Related papers

• Data exploitation: multi-task learning of object detection and semantic segmentation on partially annotated data [4.9914667450658925]
  We study the joint learning of object detection and semantic segmentation, the two most popular vision problems. We propose employing knowledge distillation to leverage joint-task optimization.
  arXiv  Detail & Related papers  (2023-11-07T14:49:54Z)
• infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-information [68.76707843019886]
  infoVerse is a universal framework for dataset characterization. infoVerse captures multidimensional characteristics of datasets by incorporating various model-driven meta-information. In three real-world applications (data pruning, active learning, and data annotation), the samples chosen on infoVerse space consistently outperform strong baselines.
  arXiv  Detail & Related papers  (2023-05-30T18:12:48Z)
• Detection Hub: Unifying Object Detection Datasets via Query Adaptation on Language Embedding [137.3719377780593]
  A new design (named Detection Hub) is dataset-aware and category-aligned. It mitigates the dataset inconsistency and provides coherent guidance for the detector to learn across multiple datasets. The categories across datasets are semantically aligned into a unified space by replacing one-hot category representations with word embedding.
  arXiv  Detail & Related papers  (2022-06-07T17:59:44Z)
• Addressing Multiple Salient Object Detection via Dual-Space Long-Range Dependencies [3.8824028205733017]
  Salient object detection plays an important role in many downstream tasks. We propose a network architecture incorporating non-local feature information in both the spatial and channel spaces. We show that our approach accurately locates multiple salient regions even in complex scenarios.
  arXiv  Detail & Related papers  (2021-11-04T23:16:53Z)
• Simple multi-dataset detection [83.9604523643406]
  We present a simple method for training a unified detector on multiple large-scale datasets. We show how to automatically integrate dataset-specific outputs into a common semantic taxonomy. Our approach does not require manual taxonomy reconciliation.
  arXiv  Detail & Related papers  (2021-02-25T18:55:58Z)
• DAIL: Dataset-Aware and Invariant Learning for Face Recognition [67.4903809903022]
  To achieve good performance in face recognition, a large scale training dataset is usually required. It is problematic and troublesome to naively combine different datasets due to two major issues. Naively treating the same person as different classes in different datasets during training will affect back-propagation. manually cleaning labels may take formidable human efforts, especially when there are millions of images and thousands of identities.
  arXiv  Detail & Related papers  (2021-01-14T01:59:52Z)
• Object Detection with a Unified Label Space from Multiple Datasets [94.33205773893151]
  Given multiple datasets with different label spaces, the goal of this work is to train a single object detector predicting over the union of all the label spaces. Consider an object category like faces that is annotated in one dataset, but is not annotated in another dataset. Some categories, like face here, would thus be considered foreground in one dataset, but background in another. We propose loss functions that carefully integrate partial but correct annotations with complementary but noisy pseudo labels.
  arXiv  Detail & Related papers  (2020-08-15T00:51:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.