Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights

• URL: http://arxiv.org/abs/2303.07557v2
• Date: Tue, 2 Apr 2024 17:01:05 GMT
• Title: Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights
• Authors: Kamil Faber, Roberto Corizzo, Bartlomiej Sniezynski, Nathalie Japkowicz,
• Abstract summary: Lifelong anomaly detection provides intrinsically different challenges compared to the more widely explored classification setting. First, we explain why lifelong anomaly detection is relevant, defining challenges and opportunities to design anomaly detection methods that deal with lifelong learning complexities. Third, we perform experiments with popular anomaly detection methods on proposed lifelong scenarios, emphasizing the gap in performance that could be gained with the adoption of lifelong learning.
• Score: 3.654287752011122
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Anomaly detection is of paramount importance in many real-world domains, characterized by evolving behavior. Lifelong learning represents an emerging trend, answering the need for machine learning models that continuously adapt to new challenges in dynamic environments while retaining past knowledge. However, limited efforts are dedicated to building foundations for lifelong anomaly detection, which provides intrinsically different challenges compared to the more widely explored classification setting. In this paper, we face this issue by exploring, motivating, and discussing lifelong anomaly detection, trying to build foundations for its wider adoption. First, we explain why lifelong anomaly detection is relevant, defining challenges and opportunities to design anomaly detection methods that deal with lifelong learning complexities. Second, we characterize learning settings and a scenario generation procedure that enables researchers to experiment with lifelong anomaly detection using existing datasets. Third, we perform experiments with popular anomaly detection methods on proposed lifelong scenarios, emphasizing the gap in performance that could be gained with the adoption of lifelong learning. Overall, we conclude that the adoption of lifelong anomaly detection is important to design more robust models that provide a comprehensive view of the environment, as well as simultaneous adaptation and knowledge retention.

Related papers

• Seeing Unseen: Discover Novel Biomedical Concepts via Geometry-Constrained Probabilistic Modeling [53.7117640028211]
  We present a geometry-constrained probabilistic modeling treatment to resolve the identified issues. We incorporate a suite of critical geometric properties to impose proper constraints on the layout of constructed embedding space. A spectral graph-theoretic method is devised to estimate the number of potential novel classes.
  arXiv  Detail & Related papers  (2024-03-02T00:56:05Z)
• A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning [76.47138162283714]
  Forgetting refers to the loss or deterioration of previously acquired information or knowledge. Forgetting is a prevalent phenomenon observed in various other research domains within deep learning. Survey argues that forgetting is a double-edged sword and can be beneficial and desirable in certain cases.
  arXiv  Detail & Related papers  (2023-07-16T16:27:58Z)
• Deep Learning for Time Series Anomaly Detection: A Survey [53.83593870825628]
  Time series anomaly detection has applications in a wide range of research fields and applications, including manufacturing and healthcare. The large size and complex patterns of time series have led researchers to develop specialised deep learning models for detecting anomalous patterns. This survey focuses on providing structured and comprehensive state-of-the-art time series anomaly detection models through the use of deep learning.
  arXiv  Detail & Related papers  (2022-11-09T22:40:22Z)
• Spatio-temporal predictive tasks for abnormal event detection in videos [60.02503434201552]
  We propose new constrained pretext tasks to learn object level normality patterns. Our approach consists in learning a mapping between down-scaled visual queries and their corresponding normal appearance and motion characteristics. Experiments on several benchmark datasets demonstrate the effectiveness of our approach to localize and track anomalies.
  arXiv  Detail & Related papers  (2022-10-27T19:45:12Z)
• LifeLonger: A Benchmark for Continual Disease Classification [59.13735398630546]
  We introduce LifeLonger, a benchmark for continual disease classification on the MedMNIST collection. Task and class incremental learning of diseases address the issue of classifying new samples without re-training the models from scratch. Cross-domain incremental learning addresses the issue of dealing with datasets originating from different institutions while retaining the previously obtained knowledge.
  arXiv  Detail & Related papers  (2022-04-12T12:25:05Z)
• Deep Video Anomaly Detection: Opportunities and Challenges [12.077052764803161]
  Anomaly detection is a popular and vital task in various research contexts. Deep learning has shown its capacity in a number of domains, ranging from acoustics, images, to natural language processing. There are numerous advantages if such intelligent systems could be realised in our daily lives.
  arXiv  Detail & Related papers  (2021-10-11T08:41:51Z)
• Lifelong Intent Detection via Multi-Strategy Rebalancing [18.424132535727217]
  In this paper, we propose Lifelong Intent Detection (LID), which continually trains an ID model on new data to learn newly emerging intents. Existing lifelong learning methods usually suffer from a serious imbalance between old and new data in the LID task. We propose a novel lifelong learning method, Multi-Strategy Rebalancing (MSR), which consists of cosine normalization, hierarchical knowledge distillation, and inter-class margin loss.
  arXiv  Detail & Related papers  (2021-08-10T04:35:13Z)
• Continual Novelty Detection [37.43667292607965]
  We show that Continual Learning affects the behaviour of novelty detection algorithms, while novelty detection can pinpoint insights in the behaviour of a continual learner. We believe that the coupling of the two problems is a promising direction to bring vision models into practice.
  arXiv  Detail & Related papers  (2021-06-24T12:30:41Z)
• ARCADe: A Rapid Continual Anomaly Detector [25.34227775187408]
  We address a novel learning problem of continual anomaly detection (CAD) We propose ARCADe, an approach to train neural networks to be robust against the major challenges of this new learning problem. The results of our experiments on three datasets show that ARCADe substantially outperforms baselines from the continual learning and anomaly detection literature.
  arXiv  Detail & Related papers  (2020-08-10T11:59:32Z)
• Deep Learning for Anomaly Detection: A Review [150.9270911031327]
  This paper surveys the research of deep anomaly detection with a comprehensive taxonomy, covering advancements in three high-level categories and 11 fine-grained categories of the methods. We review their key intuitions, objective functions, underlying assumptions, advantages and disadvantages, and discuss how they address the aforementioned challenges.
  arXiv  Detail & Related papers  (2020-07-06T02:21:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.