Continual Learning for Out-of-Distribution Pedestrian Detection
- URL: http://arxiv.org/abs/2306.15117v1
- Date: Mon, 26 Jun 2023 23:55:00 GMT
- Title: Continual Learning for Out-of-Distribution Pedestrian Detection
- Authors: Mahdiyar Molahasani, Ali Etemad, Michael Greenspan
- Abstract summary: A continual learning solution is proposed to address the out-of-distribution generalization problem for pedestrian detection.
Our method adopts and modifies Elastic Weight Consolidation to a backbone object detection network.
We show that when trained with one dataset and fine-tuned on another, our solution learns the new distribution and maintains its performance on the previous one.
- Score: 16.457778420360537
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: A continual learning solution is proposed to address the out-of-distribution
generalization problem for pedestrian detection. While recent pedestrian
detection models have achieved impressive performance on various datasets, they
remain sensitive to shifts in the distribution of the inference data. Our
method adopts and modifies Elastic Weight Consolidation to a backbone object
detection network, in order to penalize the changes in the model weights based
on their importance towards the initially learned task. We show that when
trained with one dataset and fine-tuned on another, our solution learns the new
distribution and maintains its performance on the previous one, avoiding
catastrophic forgetting. We use two popular datasets, CrowdHuman and
CityPersons for our cross-dataset experiments, and show considerable
improvements over standard fine-tuning, with a 9% and 18% miss rate percent
reduction improvement in the CrowdHuman and CityPersons datasets, respectively.
Related papers
- Diffusion-based Neural Network Weights Generation [85.6725307453325]
We propose an efficient and adaptive transfer learning scheme through dataset-conditioned pretrained weights sampling.
Specifically, we use a latent diffusion model with a variational autoencoder that can reconstruct the neural network weights.
arXiv Detail & Related papers (2024-02-28T08:34:23Z) - Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruning [50.809769498312434]
We propose a novel dataset pruning method termed as Temporal Dual-Depth Scoring (TDDS)
Our method achieves 54.51% accuracy with only 10% training data, surpassing random selection by 7.83% and other comparison methods by at least 12.69%.
arXiv Detail & Related papers (2023-11-22T03:45:30Z) - AnoShift: A Distribution Shift Benchmark for Unsupervised Anomaly
Detection [7.829710051617368]
We introduce an unsupervised anomaly detection benchmark with data that shifts over time, built over Kyoto-2006+, a traffic dataset for network intrusion detection.
We first highlight the non-stationary nature of the data, using a basic per-feature analysis, t-SNE, and an Optimal Transport approach for measuring the overall distribution distances between years.
We validate the performance degradation over time with diverse models, ranging from classical approaches to deep learning.
arXiv Detail & Related papers (2022-06-30T17:59:22Z) - Invariance Learning in Deep Neural Networks with Differentiable Laplace
Approximations [76.82124752950148]
We develop a convenient gradient-based method for selecting the data augmentation.
We use a differentiable Kronecker-factored Laplace approximation to the marginal likelihood as our objective.
arXiv Detail & Related papers (2022-02-22T02:51:11Z) - Weakly Supervised Change Detection Using Guided Anisotropic Difusion [97.43170678509478]
We propose original ideas that help us to leverage such datasets in the context of change detection.
First, we propose the guided anisotropic diffusion (GAD) algorithm, which improves semantic segmentation results.
We then show its potential in two weakly-supervised learning strategies tailored for change detection.
arXiv Detail & Related papers (2021-12-31T10:03:47Z) - Variation-Incentive Loss Re-weighting for Regression Analysis on Biased
Data [8.115323786541078]
We aim to improve the accuracy of the regression analysis by addressing the data skewness/bias during model training.
We propose a Variation-Incentive Loss re-weighting method (VILoss) to optimize the gradient descent-based model training for regression analysis.
arXiv Detail & Related papers (2021-09-14T10:22:21Z) - Semi-supervised Long-tailed Recognition using Alternate Sampling [95.93760490301395]
Main challenges in long-tailed recognition come from the imbalanced data distribution and sample scarcity in its tail classes.
We propose a new recognition setting, namely semi-supervised long-tailed recognition.
We demonstrate significant accuracy improvements over other competitive methods on two datasets.
arXiv Detail & Related papers (2021-05-01T00:43:38Z) - Generalized ODIN: Detecting Out-of-distribution Image without Learning
from Out-of-distribution Data [87.61504710345528]
We propose two strategies for freeing a neural network from tuning with OoD data, while improving its OoD detection performance.
We specifically propose to decompose confidence scoring as well as a modified input pre-processing method.
Our further analysis on a larger scale image dataset shows that the two types of distribution shifts, specifically semantic shift and non-semantic shift, present a significant difference.
arXiv Detail & Related papers (2020-02-26T04:18:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.