Unsupervised Anomaly Detection in Multivariate Time Series across Heterogeneous Domains
- URL: http://arxiv.org/abs/2503.23060v1
- Date: Sat, 29 Mar 2025 12:38:28 GMT
- Title: Unsupervised Anomaly Detection in Multivariate Time Series across Heterogeneous Domains
- Authors: Vincent Jacob, Yanlei Diao,
- Abstract summary: We introduce a unifying framework for benchmarking unsupervised anomaly detection methods.<n>We then highlight the problem of shifts in normal behaviors that can occur in practical AIOps scenarios.<n>To tackle anomaly detection under domain shift, we propose a novel approach, Domain-Invariant VAE for Anomaly Detection.
- Score: 0.8427519082414066
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The widespread adoption of digital services, along with the scale and complexity at which they operate, has made incidents in IT operations increasingly more likely, diverse, and impactful. This has led to the rapid development of a central aspect of "Artificial Intelligence for IT Operations" (AIOps), focusing on detecting anomalies in vast amounts of multivariate time series data generated by service entities. In this paper, we begin by introducing a unifying framework for benchmarking unsupervised anomaly detection (AD) methods, and highlight the problem of shifts in normal behaviors that can occur in practical AIOps scenarios. To tackle anomaly detection under domain shift, we then cast the problem in the framework of domain generalization and propose a novel approach, Domain-Invariant VAE for Anomaly Detection (DIVAD), to learn domain-invariant representations for unsupervised anomaly detection. Our evaluation results using the Exathlon benchmark show that the two main DIVAD variants significantly outperform the best unsupervised AD method in maximum performance, with 20% and 15% improvements in maximum peak F1-scores, respectively. Evaluation using the Application Server Dataset further demonstrates the broader applicability of our domain generalization methods.
Related papers
- CICADA: Cross-Domain Interpretable Coding for Anomaly Detection and Adaptation in Multivariate Time Series [24.307819352969037]
We introduce CICADA (Cross-domain Interpretable Coding for Anomaly Detection and Adaptation), with four key innovations.
CICADA captures domain-agnostic anomaly features with high flexibility and interpretability.
Trials on synthetic and real-world industrial datasets demonstrate that CICADA outperforms state-of-the-art methods in both cross-domain detection performance and interpretability.
arXiv Detail & Related papers (2025-05-01T09:26:40Z) - Adapting Large Language Models for Multi-Domain Retrieval-Augmented-Generation [59.58987161199141]
Multi-domain applications face challenges like lack of diverse benchmarks and poor out-of-domain generalization.
We introduce a diverse benchmark comprising a variety of question-answering tasks from 8 sources and covering 13 domains.
Our findings highlight key strategies for improving multi-domain RAG robustness.
arXiv Detail & Related papers (2025-04-03T09:03:40Z) - ROADS: Robust Prompt-driven Multi-Class Anomaly Detection under Domain Shift [5.492174268132387]
ROADS employs a hierarchical class-aware prompt integration mechanism to mitigate interference among anomaly classes.
Experiments on MVTec-AD and VISA datasets demonstrate that ROADS surpasses state-of-the-art methods in both anomaly detection and localization.
arXiv Detail & Related papers (2024-11-25T02:34:40Z) - See it, Think it, Sorted: Large Multimodal Models are Few-shot Time Series Anomaly Analyzers [23.701716999879636]
Time series anomaly detection (TSAD) is becoming increasingly vital due to the rapid growth of time series data.
We introduce a pioneering framework called the Time Series Anomaly Multimodal Analyzer (TAMA) to enhance both the detection and interpretation of anomalies.
arXiv Detail & Related papers (2024-11-04T10:28:41Z) - Disentangling Masked Autoencoders for Unsupervised Domain Generalization [57.56744870106124]
Unsupervised domain generalization is fast gaining attention but is still far from well-studied.
Disentangled Masked Auto (DisMAE) aims to discover the disentangled representations that faithfully reveal intrinsic features.
DisMAE co-trains the asymmetric dual-branch architecture with semantic and lightweight variation encoders.
arXiv Detail & Related papers (2024-07-10T11:11:36Z) - DACAD: Domain Adaptation Contrastive Learning for Anomaly Detection in Multivariate Time Series [25.434379659643707]
In time series anomaly detection, the scarcity of labeled data poses a challenge to the development of accurate models.
We propose a novel Domain Contrastive learning model for Anomaly Detection in time series (DACAD)
Our model employs supervised contrastive loss for the source domain and self-supervised contrastive triplet loss for the target domain.
arXiv Detail & Related papers (2024-04-17T11:20:14Z) - DIGIC: Domain Generalizable Imitation Learning by Causal Discovery [69.13526582209165]
Causality has been combined with machine learning to produce robust representations for domain generalization.
We make a different attempt by leveraging the demonstration data distribution to discover causal features for a domain generalizable policy.
We design a novel framework, called DIGIC, to identify the causal features by finding the direct cause of the expert action from the demonstration data distribution.
arXiv Detail & Related papers (2024-02-29T07:09:01Z) - NormAUG: Normalization-guided Augmentation for Domain Generalization [60.159546669021346]
We propose a simple yet effective method called NormAUG (Normalization-guided Augmentation) for deep learning.
Our method introduces diverse information at the feature level and improves the generalization of the main path.
In the test stage, we leverage an ensemble strategy to combine the predictions from the auxiliary path of our model, further boosting performance.
arXiv Detail & Related papers (2023-07-25T13:35:45Z) - On Certifying and Improving Generalization to Unseen Domains [87.00662852876177]
Domain Generalization aims to learn models whose performance remains high on unseen domains encountered at test-time.
It is challenging to evaluate DG algorithms comprehensively using a few benchmark datasets.
We propose a universal certification framework that can efficiently certify the worst-case performance of any DG method.
arXiv Detail & Related papers (2022-06-24T16:29:43Z) - A Novel Mix-normalization Method for Generalizable Multi-source Person
Re-identification [49.548815417844786]
Person re-identification (Re-ID) has achieved great success in the supervised scenario.
It is difficult to directly transfer the supervised model to arbitrary unseen domains due to the model overfitting to the seen source domains.
We propose MixNorm, which consists of domain-aware mix-normalization (DMN) and domain-ware center regularization (DCR)
arXiv Detail & Related papers (2022-01-24T18:09:38Z) - Model-Based Domain Generalization [96.84818110323518]
We propose a novel approach for the domain generalization problem called Model-Based Domain Generalization.
Our algorithms beat the current state-of-the-art methods on the very-recently-proposed WILDS benchmark by up to 20 percentage points.
arXiv Detail & Related papers (2021-02-23T00:59:02Z) - Dependency-based Anomaly Detection: a General Framework and Comprehensive Evaluation [33.31923133201812]
This paper introduces Dependency-based Anomaly Detection (DepAD)
DepAD reframes unsupervised anomaly detection as supervised feature selection and prediction tasks.
Two DepAD algorithms emerge as all-rounders and superior performers in handling a wide range of datasets.
arXiv Detail & Related papers (2020-11-13T01:39:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.