COCA: Generative Root Cause Analysis for Distributed Systems with Code Knowledge

• URL: http://arxiv.org/abs/2503.23051v1
• Date: Sat, 29 Mar 2025 11:56:48 GMT
• Title: COCA: Generative Root Cause Analysis for Distributed Systems with Code Knowledge
• Abstract summary: We propose COCA, a code knowledge enhanced root cause analysis approach for issue reports.<n>Based on the data within issue reports, COCA intelligently extracts relevant code snippets and reconstructs execution paths.<n>Our evaluation on datasets from five real-world distributed systems demonstrates that COCA significantly outperforms existing methods.
• Score: 33.88776152946711
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Runtime failures are commonplace in modern distributed systems. When such issues arise, users often turn to platforms such as Github or JIRA to report them and request assistance. Automatically identifying the root cause of these failures is critical for ensuring high reliability and availability. However, prevailing automatic root cause analysis (RCA) approaches rely significantly on comprehensive runtime monitoring data, which is often not fully available in issue platforms. Recent methods leverage large language models (LLMs) to analyze issue reports, but their effectiveness is limited by incomplete or ambiguous user-provided information. To obtain more accurate and comprehensive RCA results, the core idea of this work is to extract additional diagnostic clues from code to supplement data-limited issue reports. Specifically, we propose COCA, a code knowledge enhanced root cause analysis approach for issue reports. Based on the data within issue reports, COCA intelligently extracts relevant code snippets and reconstructs execution paths, providing a comprehensive execution context for further RCA. Subsequently, COCA constructs a prompt combining historical issue reports along with profiled code knowledge, enabling the LLMs to generate detailed root cause summaries and localize responsible components. Our evaluation on datasets from five real-world distributed systems demonstrates that COCA significantly outperforms existing methods, achieving a 28.3% improvement in root cause localization and a 22.0% improvement in root cause summarization. Furthermore, COCA's performance consistency across various LLMs underscores its robust generalizability.

Related papers

• ARGUS: MCP-Grounded Root Cause Analysis for Kubernetes Incidents [0.9685837672183747]
  ARGUS connects a commercial to live observability data through MCP servers covering Prometheus state, metrics, logs, and NATS messaging.<n>ARGUS named the correct root cause in all ten scenarios with an aggregate MCP success ratio of 0.91.<n>Our central finding is a diagnostic/prescriptive asymmetry: ARGUS reliably identifies what went wrong, but is perceived as less reliable or trustworthy at specifying what to do next.
  arXiv  Detail & Related papers  (2026-08-24T10:48:21Z)
• TrajAudit: Automated Failure Diagnosis for Agentic Coding Systems [18.833806809109536]
  Agentic systems have been widely studied to automate software engineering jobs such as bug fixing.<n>Existing automated failure diagnosis approaches leverage task execution trajectories, yet their effectiveness degrades as trajectory length and complexity increase.<n>For repository-level coding tasks specifically, trajectories are laden with noise, such as redundant program structure and verbose code context.<n>We propose TrajAudit, the first failure diagnosis framework for repository-level coding trajectories.
  arXiv  Detail & Related papers  (2026-05-26T05:24:37Z)
• Multi-Agent Systems for Root Cause Analysis in Microservices [58.95503998127531]
  LATS-RCA is a multi-agent framework for root cause analysis in MSS.<n> Reflection scores are used to guide the search toward the most likely root cause.<n>We evaluate LATS-RCA on the open-source industrial MSS, Light-OAuth2.
  arXiv  Detail & Related papers  (2026-05-05T08:39:42Z)
• Dynamic analysis enhances issue resolution [53.50448142467294]
  DAIRA (Dynamic Analysis-enhanced Issue Resolution Agent) is an automated repair framework that embeds dynamic analysis into the agent's reasoning cycle.<n> Driven by a Test Tracing-Driven methodology, DAIRA utilizes lightweight monitors to extract critical runtime data.<n>When powered by Gemini 3 Flash Preview, DAIRA establishes a new state-of-the-art (SOTA) performance, achieving a 79.4% resolution rate on the SWE-bench Verified dataset.
  arXiv  Detail & Related papers  (2026-03-23T14:48:54Z)
• TraceSIR: A Multi-Agent Framework for Structured Analysis and Reporting of Agentic Execution Traces [32.4073751390339]
  We propose TraceSIR, a framework for structured analysis and reporting of agentic execution traces.<n>TraceSIR coordinates three specialized agents: StructureAgent, InsightAgent, and ReportAgent.<n>Experiments show that TraceSIR consistently produces coherent, informative, and actionable reports.
  arXiv  Detail & Related papers  (2026-02-28T12:33:24Z)
• When Benchmarks Lie: Evaluating Malicious Prompt Classifiers Under True Distribution Shift [0.0]
  We present a comprehensive analysis using a benchmark of 18 datasets spanning harmful requests, jailbreaks, indirect prompt injections, and extraction attacks.<n>We propose Leave-One-Dataset-Out (LODO) evaluation to measure true out-of-distribution generalization.
  arXiv  Detail & Related papers  (2026-02-15T14:21:43Z)
• CoDA: Agentic Systems for Collaborative Data Visualization [57.270599188947294]
  Deep research has revolutionized data analysis, yet data scientists still devote substantial time to manually crafting visualizations.<n>Existing approaches, including simple single- or multi-agent systems, often oversimplify the task.<n>We introduce CoDA, a multi-agent system that employs specialized LLM agents for metadata analysis, task planning, code generation, and self-reflection.
  arXiv  Detail & Related papers  (2025-10-03T17:30:16Z)
• DeepSieve: Information Sieving via LLM-as-a-Knowledge-Router [57.28685457991806]
  DeepSieve is an agentic RAG framework that incorporates information sieving via LLM-as-a-knowledge-router.<n>Our design emphasizes modularity, transparency, and adaptability, leveraging recent advances in agentic system design.
  arXiv  Detail & Related papers  (2025-07-29T17:55:23Z)
• Simplifying Root Cause Analysis in Kubernetes with StateGraph and LLM [13.293736787442414]
  We introduce SynergyRCA, an innovative tool for root cause analysis.<n> SynergyRCA constructs a StateGraph to capture spatial and temporal relationships.<n>It can identify root causes in an average time of about two minutes and achieves an impressive precision of approximately 0.90.
  arXiv  Detail & Related papers  (2025-06-03T06:09:13Z)
• LogRCA: Log-based Root Cause Analysis for Distributed Services [4.049637286678329]
  We propose LogRCA, a novel method for identifying a minimal set of log lines that together describe a root cause. LogRCA uses a semi-supervised learning approach to deal with rare and unknown errors and is designed to handle noisy data. We evaluated our approach on a large-scale production log data set of 44.3 million log lines, which contains 80 failures, whose root causes were labeled by experts.
  arXiv  Detail & Related papers  (2024-05-22T12:50:56Z)
• Exploring LLM-based Agents for Root Cause Analysis [17.053079105858497]
  Root cause analysis (RCA) is a critical part of the incident management process. Large Language Models (LLMs) have been used to perform RCA, but are not able to collect additional diagnostic information. We present an evaluation of a ReAct agent equipped with retrieval tools, on an out-of-distribution dataset of production incidents collected at Microsoft.
  arXiv  Detail & Related papers  (2024-03-07T00:44:01Z)
• Multi-modal Causal Structure Learning and Root Cause Analysis [67.67578590390907]
  We propose Mulan, a unified multi-modal causal structure learning method for root cause localization. We leverage a log-tailored language model to facilitate log representation learning, converting log sequences into time-series data. We also introduce a novel key performance indicator-aware attention mechanism for assessing modality reliability and co-learning a final causal graph.
  arXiv  Detail & Related papers  (2024-02-04T05:50:38Z)
• ESRO: Experience Assisted Service Reliability against Outages [2.647000585570866]
  We build a diagnostic service called ESRO that recommends root causes and remediation for failures. We evaluate our model on several cloud service outages of a large enterprise over the course of 2 years.
  arXiv  Detail & Related papers  (2023-09-13T18:04:52Z)
• Automatic Root Cause Analysis via Large Language Models for Cloud Incidents [51.94361026233668]
  We introduce RCACopilot, an on-call system empowered by a large language model for automating root cause analysis of cloud incidents. RCACopilot matches incoming incidents to corresponding incident handlers based on their alert types, aggregates the critical runtime diagnostic information, predicts the incident's root cause category, and provides an explanatory narrative. We evaluate RCACopilot using a real-world dataset consisting of a year's worth of incidents from Microsoft.
  arXiv  Detail & Related papers  (2023-05-25T06:44:50Z)
• Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sources [87.26486246513063]
  Chain-of-knowledge (CoK) is a framework that augments large language models. CoK consists of three stages: reasoning preparation, dynamic knowledge adapting, and answer consolidation.
  arXiv  Detail & Related papers  (2023-05-22T17:34:23Z)
• Disentangled Causal Graph Learning for Online Unsupervised Root Cause Analysis [49.910053255238566]
  Root cause analysis (RCA) can identify the root causes of system faults/failures by analyzing system monitoring data. Previous research has mostly focused on developing offline RCA algorithms, which often require manually initiating the RCA process. We propose CORAL, a novel online RCA framework that can automatically trigger the RCA process and incrementally update the RCA model.
  arXiv  Detail & Related papers  (2023-05-18T01:27:48Z)
• Generic and Robust Root Cause Localization for Multi-Dimensional Data in Online Service Systems [22.308016571592105]
  Localizing root causes for multi-dimensional data is critical to ensure online service systems' reliability. This paper proposes a generic and robust root cause localization approach for multi-dimensional data, PSqueeze. Case studies in several production systems demonstrate that PSqueeze is helpful to fault diagnosis in the real world.
  arXiv  Detail & Related papers  (2023-05-05T07:22:30Z)
• BALANCE: Bayesian Linear Attribution for Root Cause Localization [19.30952654225615]
  Root Cause Analysis (RCA) plays an indispensable role in distributed data system maintenance and operations. This paper opens up the possibilities of exploiting the recently developed framework of explainable AI (XAI) for the purpose of RCA. We propose BALANCE, which formulates the problem of RCA through the lens of attribution in XAI.
  arXiv  Detail & Related papers  (2023-01-31T11:49:26Z)
• Mining Root Cause Knowledge from Cloud Service Incident Investigations for AIOps [71.12026848664753]
  Root Cause Analysis (RCA) of any service-disrupting incident is one of the most critical as well as complex tasks in IT processes. In this work, we present ICA and the downstream Incident Search and Retrieval based RCA pipeline, built at Salesforce.
  arXiv  Detail & Related papers  (2022-04-21T02:33:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.