Feedback-driven object detection and iterative model improvement

• URL: http://arxiv.org/abs/2411.19835v2
• Date: Tue, 14 Jan 2025 14:53:10 GMT
• Title: Feedback-driven object detection and iterative model improvement
• Authors: Sönke Tenckhoff, Mario Koddenbrock, Erik Rodner,
• Abstract summary: We present the development and evaluation of a platform designed to interactively improve object detection models. The platform allows uploading and annotating images as well as fine-tuning object detection models. We show evidence for a significant time reduction of up to 53% for semi-automatic compared to manual annotation.
• Score: 2.3700911865675187
• License:
• Abstract: Automated object detection has become increasingly valuable across diverse applications, yet efficient, high-quality annotation remains a persistent challenge. In this paper, we present the development and evaluation of a platform designed to interactively improve object detection models. The platform allows uploading and annotating images as well as fine-tuning object detection models. Users can then manually review and refine annotations, further creating improved snapshots that are used for automatic object detection on subsequent image uploads - a process we refer to as semi-automatic annotation resulting in a significant gain in annotation efficiency. Whereas iterative refinement of model results to speed up annotation has become common practice, we are the first to quantitatively evaluate its benefits with respect to time, effort, and interaction savings. Our experimental results show clear evidence for a significant time reduction of up to 53% for semi-automatic compared to manual annotation. Importantly, these efficiency gains did not compromise annotation quality, while matching or occasionally even exceeding the accuracy of manual annotations. These findings demonstrate the potential of our lightweight annotation platform for creating high-quality object detection datasets and provide best practices to guide future development of annotation platforms. The platform is open-source, with the frontend and backend repositories available on GitHub (https://github.com/ml-lab-htw/iterative-annotate). To support the understanding of our labeling process, we have created an explanatory video demonstrating the methodology using microscopy images of E. coli bacteria as an example. The video is available on YouTube (https://www.youtube.com/watch?v=CM9uhE8NN5E).

Related papers

• Automatic Image Annotation for Mapped Features Detection [6.300346102366891]
  Road features are a key enabler for autonomous driving and localization. Modern deep learning-based perception systems need a significant amount of annotated data. In this paper, we consider the fusion of three automatic annotation methods in images.
  arXiv  Detail & Related papers  (2024-12-11T09:06:52Z)
• Rethinking Image-to-Video Adaptation: An Object-centric Perspective [61.833533295978484]
  We propose a novel and efficient image-to-video adaptation strategy from the object-centric perspective. Inspired by human perception, we integrate a proxy task of object discovery into image-to-video transfer learning.
  arXiv  Detail & Related papers  (2024-07-09T13:58:10Z)
• On-the-Fly Point Annotation for Fast Medical Video Labeling [1.890063512530524]
  In medical research, deep learning models rely on high-quality annotated data. The need to adjust two corners makes the process inherently frame-by-frame. We propose an on-the-fly method for live video annotation to enhance the annotation efficiency.
  arXiv  Detail & Related papers  (2024-04-22T16:59:43Z)
• Helping Hands: An Object-Aware Ego-Centric Video Recognition Model [60.350851196619296]
  We introduce an object-aware decoder for improving the performance of ego-centric representations on ego-centric videos. We show that the model can act as a drop-in replacement for an ego-awareness video model to improve performance through visual-text grounding.
  arXiv  Detail & Related papers  (2023-08-15T17:58:11Z)
• Quality and Efficiency of Manual Annotation: Pre-annotation Bias [1.949293198748152]
  The aim of the experiment is to judge the final annotation quality when pre-annotation is used. The experiment confirmed that the pre-annotation is an efficient tool for faster manual syntactic annotation.
  arXiv  Detail & Related papers  (2023-06-15T17:41:14Z)
• Annotation Error Detection: Analyzing the Past and Present for a More Coherent Future [63.99570204416711]
  We reimplement 18 methods for detecting potential annotation errors and evaluate them on 9 English datasets. We define a uniform evaluation setup including a new formalization of the annotation error detection task. We release our datasets and implementations in an easy-to-use and open source software package.
  arXiv  Detail & Related papers  (2022-06-05T22:31:45Z)
• Omni-DETR: Omni-Supervised Object Detection with Transformers [165.4190908259015]
  We consider the problem of omni-supervised object detection, which can use unlabeled, fully labeled and weakly labeled annotations. Under this unified architecture, different types of weak labels can be leveraged to generate accurate pseudo labels. We have found that weak annotations can help to improve detection performance and a mixture of them can achieve a better trade-off between annotation cost and accuracy.
  arXiv  Detail & Related papers  (2022-03-30T06:36:09Z)
• Weakly Supervised Video Salient Object Detection [79.51227350937721]
  We present the first weakly supervised video salient object detection model based on relabeled "fixation guided scribble annotations" An "Appearance-motion fusion module" and bidirectional ConvLSTM based framework are proposed to achieve effective multi-modal learning and long-term temporal context modeling.
  arXiv  Detail & Related papers  (2021-04-06T09:48:38Z)
• Composable Augmentation Encoding for Video Representation Learning [94.2358972764708]
  We focus on contrastive methods for self-supervised video representation learning. A common paradigm in contrastive learning is to construct positive pairs by sampling different data views for the same instance, with different data instances as negatives. We propose an 'augmentation aware' contrastive learning framework, where we explicitly provide a sequence of augmentation parameterisations. We show that our method encodes valuable information about specified spatial or temporal augmentation, and in doing so also achieve state-of-the-art performance on a number of video benchmarks.
  arXiv  Detail & Related papers  (2021-04-01T16:48:53Z)
• Cross-Model Image Annotation Platform with Active Learning [0.0]
  This work presents an End-to-End pipeline tool for object annotation and recognition. We have developed a modular image annotation platform which seamlessly incorporates assisted image annotation, active learning and model training and evaluation. The highest accuracy achieved is 74%.
  arXiv  Detail & Related papers  (2020-08-06T01:42:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.