Cross-System Categorization of Abnormal Traces in Microservice-Based Systems via Meta-Learning

• URL: http://arxiv.org/abs/2403.18998v4
• Date: Tue, 25 Feb 2025 08:50:14 GMT
• Title: Cross-System Categorization of Abnormal Traces in Microservice-Based Systems via Meta-Learning
• Abstract summary: TraFaultDia is an AIOps framework to automatically classify abnormal traces into fault categories for MSS.<n>TraFaultDia achieves 93.26% and 85.20% accuracy on 50 new classification tasks for TrainTicket and OnlineBoutique.<n>In the cross-system context, when TraFaultDia is applied to a MSS different from the one it is trained on, TraFaultDia gets an average accuracy of 92.19% and 84.77%.
• Score: 8.634734590552537
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Microservice-based systems (MSS) may fail with various fault types. While existing AIOps methods excel at detecting abnormal traces and locating the responsible service(s), human efforts are still required for diagnosing specific fault types and failure causes.This paper presents TraFaultDia, a novel AIOps framework to automatically classify abnormal traces into fault categories for MSS. We treat the classification process as a series of multi-class classification tasks, where each task represents an attempt to classify abnormal traces into specific fault categories for a MSS. TraFaultDia leverages meta-learning to train on several abnormal trace classification tasks with a few labeled instances from a MSS, enabling quick adaptation to new, unseen abnormal trace classification tasks with a few labeled instances across MSS. TraFaultDia's use cases are scalable depending on how fault categories are built from anomalies within MSS. We evaluated TraFaultDia on two MSS, TrainTicket and OnlineBoutique, with open datasets where each fault category is linked to faulty system components (service/pod) and a root cause. TraFaultDia automatically classifies abnormal traces into these fault categories, thus enabling the automatic identification of faulty system components and root causes without manual analysis. TraFaultDia achieves 93.26% and 85.20% accuracy on 50 new classification tasks for TrainTicket and OnlineBoutique, respectively, when trained within the same MSS with 10 labeled instances per category. In the cross-system context, when TraFaultDia is applied to a MSS different from the one it is trained on, TraFaultDia gets an average accuracy of 92.19% and 84.77% for the same set of 50 new, unseen abnormal trace classification tasks of the respective systems, also with 10 labeled instances provided for each fault category per task in each system.

Related papers

• Characterizing Faults in Agentic AI: A Taxonomy of Types, Symptoms, and Root Causes [6.568786173861302]
  Agentic AI systems combine large language model (LLM) reasoning with external invocation tool and long-horizon task execution.<n>There is limited empirical understanding of how faults originate, manifest, and propagate in real-world agentic AI systems.
  arXiv  Detail & Related papers  (2026-03-06T20:12:29Z)
• Universal Transformation of One-Class Classifiers for Unsupervised Anomaly Detection [51.73001988341294]
  Anomaly detection is typically formulated as a one-class classification problem.<n>We present a dataset folding method that transforms an arbitrary one-class classifier-based anomaly detector into a fully unsupervised method.
  arXiv  Detail & Related papers  (2026-02-13T16:54:12Z)
• Cross-talk based multi-task learning for fault classification of physically coupled machine system [3.9571744700171756]
  We use a multi-task learning framework to jointly learn fault conditions and the related physical variables.<n>We build on our previously introduced residual neural dimension reductor model, and extend its application to two benchmarks.<n>Our residual neural dimension reductor consistently outperformed single-task models, multi-class models that merge all label combinations, and shared trunk multi-task models.
  arXiv  Detail & Related papers  (2026-02-05T00:10:16Z)
• UniADC: A Unified Framework for Anomaly Detection and Classification [18.556123041540577]
  We introduce the task of unified anomaly detection and classification, which aims to simultaneously detect anomalous regions in images and identify their specific categories.<n>We propose UniADC, a unified anomaly detection and classification model that can effectively perform both tasks with only a few or even no anomaly images.<n>We conduct extensive experiments on three anomaly detection and classification datasets, including MVTec-FS, MTD, and WFDD, and the results demonstrate that UniADC consistently outperforms existing methods in anomaly detection, localization, and classification.
  arXiv  Detail & Related papers  (2025-11-10T02:42:08Z)
• Class-wise Autoencoders Measure Classification Difficulty And Detect Label Mistakes [22.45812577928658]
  We introduce a new framework for analyzing classification datasets based on the ratios of reconstruction errors between autoencoders trained on individual classes. This analysis framework enables efficient characterization of datasets on the sample, class, and entire dataset levels.
  arXiv  Detail & Related papers  (2024-12-03T17:29:00Z)
• Meta-UAD: A Meta-Learning Scheme for User-level Network Traffic Anomaly Detection [15.038762892493219]
  We propose textitMeta-UAD, a Meta-learning scheme for User-level network traffic Anomaly Detection. We use the CICFlowMeter to extract 81 flow-level statistical features and remove some invalid ones. Compared with existing models, the results further demonstrate the superiority of Meta-UAD with 15% - 43% gains in F1-score.
  arXiv  Detail & Related papers  (2024-08-30T06:05:15Z)
• CHASE: A Causal Heterogeneous Graph based Framework for Root Cause Analysis in Multimodal Microservice Systems [22.00860661894853]
  We propose a Causal Heterogeneous grAph baSed framEwork for root cause analysis, namely CHASE, for microservice systems with multimodal data. CHASE learns from the constructed hypergraph with hyperedges representing the flow of causality and performs root cause localization.
  arXiv  Detail & Related papers  (2024-06-28T07:46:51Z)
• Sequential Binary Classification for Intrusion Detection [0.0]
  IDS datasets suffer from high class imbalance, which impacts the performance of standard ML models. This paper explores a structural approach to handling class imbalance in multi-class classification problems. Experiments on benchmark IDS datasets demonstrate that the structural approach to handling class-imbalance, as exemplified by SBC, is a viable approach to handling the issue.
  arXiv  Detail & Related papers  (2024-06-10T08:34:13Z)
• Task-Distributionally Robust Data-Free Meta-Learning [99.56612787882334]
  Data-Free Meta-Learning (DFML) aims to efficiently learn new tasks by leveraging multiple pre-trained models without requiring their original training data. For the first time, we reveal two major challenges hindering their practical deployments: Task-Distribution Shift ( TDS) and Task-Distribution Corruption (TDC)
  arXiv  Detail & Related papers  (2023-11-23T15:46:54Z)
• Twin Graph-based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System [24.2074235652359]
  We propose MSTGAD, which seamlessly integrates all available data modalities via attentive multi-modal learning. We construct a transformer-based neural network with both spatial and temporal attention mechanisms to model the inter-correlations between different modalities. This enables us to detect anomalies automatically and accurately in real-time.
  arXiv  Detail & Related papers  (2023-10-07T06:28:41Z)
• Self-Adaptive Label Augmentation for Semi-supervised Few-shot Classification [121.63992191386502]
  Few-shot classification aims to learn a model that can generalize well to new tasks when only a few labeled samples are available. We propose a semi-supervised few-shot classification method that assigns an appropriate label to each unlabeled sample by a manually defined metric. A major novelty of SALA is the task-adaptive metric, which can learn the metric adaptively for different tasks in an end-to-end fashion.
  arXiv  Detail & Related papers  (2022-06-16T13:14:03Z)
• Continual Object Detection via Prototypical Task Correlation Guided Gating Mechanism [120.1998866178014]
  We present a flexible framework for continual object detection via pRotOtypical taSk corrElaTion guided gaTingAnism (ROSETTA) Concretely, a unified framework is shared by all tasks while task-aware gates are introduced to automatically select sub-models for specific tasks. Experiments on COCO-VOC, KITTI-Kitchen, class-incremental detection on VOC and sequential learning of four tasks show that ROSETTA yields state-of-the-art performance.
  arXiv  Detail & Related papers  (2022-05-06T07:31:28Z)
• Merging Subject Matter Expertise and Deep Convolutional Neural Network for State-Based Online Machine-Part Interaction Classification [5.216662889312795]
  Machine-part interaction classification is a key capability required by Cyber-Physical Systems (CPS), a pivotal enabler of Smart Manufacturing (SM) In this work, we address point detection and time series classification for machine-part interactions with a deep Convolutional Neural Network (CNN) based framework.
  arXiv  Detail & Related papers  (2021-12-08T20:23:13Z)
• Tradeoffs in Streaming Binary Classification under Limited Inspection Resources [14.178224954581069]
  We consider an imbalanced binary classification problem, where events arrive sequentially and only a limited number of suspicious events can be inspected. We analytically characterize the tradeoff between the minority-class detection rate and the inspection capacity. We implement the selection methods on a real public fraud detection dataset and compare the empirical results with analytical bounds.
  arXiv  Detail & Related papers  (2021-10-05T23:23:11Z)
• Self-Trained One-class Classification for Unsupervised Anomaly Detection [56.35424872736276]
  Anomaly detection (AD) has various applications across domains, from manufacturing to healthcare. In this work, we focus on unsupervised AD problems whose entire training data are unlabeled and may contain both normal and anomalous samples. To tackle this problem, we build a robust one-class classification framework via data refinement. We show that our method outperforms state-of-the-art one-class classification method by 6.3 AUC and 12.5 average precision.
  arXiv  Detail & Related papers  (2021-06-11T01:36:08Z)
• Adaptive Class Suppression Loss for Long-Tail Object Detection [49.7273558444966]
  We devise a novel Adaptive Class Suppression Loss (ACSL) to improve the detection performance of tail categories. Our ACSL achieves 5.18% and 5.2% improvements with ResNet50-FPN, and sets a new state of the art.
  arXiv  Detail & Related papers  (2021-04-02T05:12:31Z)
• Meta-learning One-class Classifiers with Eigenvalue Solvers for Supervised Anomaly Detection [55.888835686183995]
  We propose a neural network-based meta-learning method for supervised anomaly detection. We experimentally demonstrate that the proposed method achieves better performance than existing anomaly detection and few-shot learning methods.
  arXiv  Detail & Related papers  (2021-03-01T01:43:04Z)
• TELESTO: A Graph Neural Network Model for Anomaly Classification in Cloud Services [77.454688257702]
  Machine learning (ML) and artificial intelligence (AI) are applied on IT system operation and maintenance. One direction aims at the recognition of re-occurring anomaly types to enable remediation automation. We propose a method that is invariant to dimensionality changes of given data.
  arXiv  Detail & Related papers  (2021-02-25T14:24:49Z)
• Meta-Generating Deep Attentive Metric for Few-shot Classification [53.07108067253006]
  We present a novel deep metric meta-generation method to generate a specific metric for a new few-shot learning task. In this study, we structure the metric using a three-layer deep attentive network that is flexible enough to produce a discriminative metric for each task. We gain surprisingly obvious performance improvement over state-of-the-art competitors, especially in the challenging cases.
  arXiv  Detail & Related papers  (2020-12-03T02:07:43Z)
• Theoretical Insights Into Multiclass Classification: A High-dimensional Asymptotic View [82.80085730891126]
  We provide the first modernally precise analysis of linear multiclass classification. Our analysis reveals that the classification accuracy is highly distribution-dependent. The insights gained may pave the way for a precise understanding of other classification algorithms.
  arXiv  Detail & Related papers  (2020-11-16T05:17:29Z)
• Data-Driven Fault Diagnosis Analysis and Open-Set Classification of Time-Series Data [1.0152838128195467]
  A framework for data-driven analysis and open-set classification is developed for fault diagnosis applications. A data-driven fault classification algorithm is proposed which can handle imbalanced datasets, class overlapping, and unknown faults. An algorithm is proposed to estimate the size of the fault when training data contains information from known fault realizations.
  arXiv  Detail & Related papers  (2020-09-10T09:53:13Z)
• Revisiting LSTM Networks for Semi-Supervised Text Classification via Mixed Objective Function [106.69643619725652]
  We develop a training strategy that allows even a simple BiLSTM model, when trained with cross-entropy loss, to achieve competitive results. We report state-of-the-art results for text classification task on several benchmark datasets.
  arXiv  Detail & Related papers  (2020-09-08T21:55:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.