CLAD: A realistic Continual Learning benchmark for Autonomous Driving

• URL: http://arxiv.org/abs/2210.03482v1
• Date: Fri, 7 Oct 2022 12:08:25 GMT
• Title: CLAD: A realistic Continual Learning benchmark for Autonomous Driving
• Authors: Eli Verwimp, Kuo Yang, Sarah Parisot, Hong Lanqing, Steven McDonagh, Eduardo P\'erez-Pellitero, Matthias De Lange and Tinne Tuytelaars
• Abstract summary: This paper describes the design and the ideas motivating a new Continual Learning benchmark for Autonomous Driving. The benchmark uses SODA10M, a recently released large-scale dataset that concerns autonomous driving related problems. We introduce CLAD-C, an online classification benchmark realised through a chronological data stream that poses both class and domain incremental challenges. We examine the inherent difficulties and challenges posed by the benchmark, through a survey of the techniques and methods used by the top-3 participants in a CLAD-challenge workshop at ICCV 2021.
• Score: 33.95470797472666
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In this paper we describe the design and the ideas motivating a new Continual Learning benchmark for Autonomous Driving (CLAD), that focuses on the problems of object classification and object detection. The benchmark utilises SODA10M, a recently released large-scale dataset that concerns autonomous driving related problems. First, we review and discuss existing continual learning benchmarks, how they are related, and show that most are extreme cases of continual learning. To this end, we survey the benchmarks used in continual learning papers at three highly ranked computer vision conferences. Next, we introduce CLAD-C, an online classification benchmark realised through a chronological data stream that poses both class and domain incremental challenges; and CLAD-D, a domain incremental continual object detection benchmark. We examine the inherent difficulties and challenges posed by the benchmark, through a survey of the techniques and methods used by the top-3 participants in a CLAD-challenge workshop at ICCV 2021. We conclude with possible pathways to improve the current continual learning state of the art, and which directions we deem promising for future research.

Related papers

• Deep Learning-Based Object Pose Estimation: A Comprehensive Survey [73.74933379151419]
  We discuss the recent advances in deep learning-based object pose estimation. Our survey also covers multiple input data modalities, degrees-of-freedom of output poses, object properties, and downstream tasks.
  arXiv  Detail & Related papers  (2024-05-13T14:44:22Z)
• Multi-Label Continual Learning for the Medical Domain: A Novel Benchmark [47.52603262576663]
  We propose a novel benchmark combining the challenges of new class arrivals and domain shifts in a single framework. This benchmark aims to model a realistic CL setting for the multi-label classification problem in medical imaging.
  arXiv  Detail & Related papers  (2024-04-10T09:35:36Z)
• Self-Supervised Multi-Object Tracking For Autonomous Driving From Consistency Across Timescales [53.55369862746357]
  Self-supervised multi-object trackers have tremendous potential as they enable learning from raw domain-specific data. However, their re-identification accuracy still falls short compared to their supervised counterparts. We propose a training objective that enables self-supervised learning of re-identification features from multiple sequential frames.
  arXiv  Detail & Related papers  (2023-04-25T20:47:29Z)
• NEVIS'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision Research [96.53307645791179]
  We introduce the Never-Ending VIsual-classification Stream (NEVIS'22), a benchmark consisting of a stream of over 100 visual classification tasks. Despite being limited to classification, the resulting stream has a rich diversity of tasks from OCR, to texture analysis, scene recognition, and so forth. Overall, NEVIS'22 poses an unprecedented challenge for current sequential learning approaches due to the scale and diversity of tasks.
  arXiv  Detail & Related papers  (2022-11-15T18:57:46Z)
• Continual Learning for Human State Monitoring [20.8311956676327]
  We propose two new CL benchmarks for Human State Monitoring. We carefully designed the benchmarks to mirror real-world environments in which new subjects are continuously added. We conducted an empirical evaluation to assess the ability of popular CL strategies to mitigate forgetting in our benchmarks.
  arXiv  Detail & Related papers  (2022-06-29T19:23:13Z)
• Continual Object Detection: A review of definitions, strategies, and challenges [0.0]
  The field of Continual Learning investigates the ability to learn consecutive tasks without losing performance on those previously learned. We believe that research in continual object detection deserves even more attention due to its vast range of applications in robotics and autonomous vehicles.
  arXiv  Detail & Related papers  (2022-05-30T21:57:48Z)
• vCLIMB: A Novel Video Class Incremental Learning Benchmark [53.90485760679411]
  We introduce vCLIMB, a novel video continual learning benchmark. vCLIMB is a standardized test-bed to analyze catastrophic forgetting of deep models in video continual learning. We propose a temporal consistency regularization that can be applied on top of memory-based continual learning methods.
  arXiv  Detail & Related papers  (2022-01-23T22:14:17Z)
• International Workshop on Continual Semi-Supervised Learning: Introduction, Benchmarks and Baselines [20.852277473776617]
  The aim of this paper is to formalize a new continual semi-supervised learning (CSSL) paradigm. The paper introduces two new benchmarks specifically designed to assess CSSL on two important computer vision tasks. We describe the Continual Activity Recognition (CAR) and Continual Crowd Counting (CCC) challenges built upon those benchmarks, the baseline models proposed for the challenges, and describe a simple CSSL baseline.
  arXiv  Detail & Related papers  (2021-10-27T17:34:40Z)
• CVPR 2020 Continual Learning in Computer Vision Competition: Approaches, Results, Current Challenges and Future Directions [25.791936837340877]
  The first Continual Learning in Computer Vision challenge held at CVPR in 2020 has been one of the first opportunities to evaluate different continual learning algorithms. We report the main results of the competition, which counted more than 79 teams registered, 11 finalists and 2300$ in prizes.
  arXiv  Detail & Related papers  (2020-09-14T08:53:05Z)
• Self-supervised Video Object Segmentation [76.83567326586162]
  The objective of this paper is self-supervised representation learning, with the goal of solving semi-supervised video object segmentation (a.k.a. dense tracking) We make the following contributions: (i) we propose to improve the existing self-supervised approach, with a simple, yet more effective memory mechanism for long-term correspondence matching; (ii) by augmenting the self-supervised approach with an online adaptation module, our method successfully alleviates tracker drifts caused by spatial-temporal discontinuity; (iv) we demonstrate state-of-the-art results among the self-supervised approaches on DAVIS-2017 and YouTube
  arXiv  Detail & Related papers  (2020-06-22T17:55:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.