Comparison of Static Analysis Architecture Recovery Tools for Microservice Applications

• URL: http://arxiv.org/abs/2412.08352v1
• Date: Wed, 11 Dec 2024 12:46:16 GMT
• Title: Comparison of Static Analysis Architecture Recovery Tools for Microservice Applications
• Authors: Simon Schneider, Alexander Bakhtin, Xiaozhou Li, Jacopo Soldani, Antonio Brogi, Tomas Cerny, Riccardo Scandariato, Davide Taibi,
• Abstract summary: This paper presents the results of a multivocal literature review with the goal of identifying architecture recovery tools for microservice applications. The best-performing tool exhibited an overall F1-score of 0.86. The possibility of combining multiple tools to increase the recovery correctness was investigated, yielding a combination of four individual tools that achieves an F1-score of 0.91.
• Score: 41.962720602828085
• License:
• Abstract: Architecture recovery tools help software engineers obtain an overview of the structure of their software systems during all phases of the software development life cycle. This is especially important for microservice applications because they consist of multiple interacting microservices, which makes it more challenging to oversee the architecture. Various tools and techniques for architecture recovery (also called architecture reconstruction) have been presented in academic and gray literature sources, but no overview and comparison of their accuracy exists. This paper presents the results of a multivocal literature review with the goal of identifying architecture recovery tools for microservice applications and a comparison of the identified tools' architectural recovery accuracy. We focused on static tools since they can be integrated into fast-paced CI/CD pipelines. 13 such tools were identified from the literature and nine of them could be executed and compared on their capability of detecting different system characteristics. The best-performing tool exhibited an overall F1-score of 0.86. Additionally, the possibility of combining multiple tools to increase the recovery correctness was investigated, yielding a combination of four individual tools that achieves an F1-score of 0.91. Registered report: The methodology of this study has been peer-reviewed and accepted as a registered report at MSR'24: arXiv:2403.06941

Related papers

• Build Optimization: A Systematic Literature Review [0.0]
  Continuous Integration (CI) consists of an automated build process involving continuous compilation, testing, and packaging of the software system. To better understand the literature so as to help practitioners find solutions for their problems and guide future research, we conduct a systematic review of 97 studies on build optimization published between 2006 and 2024. The identified build optimization studies focus on two main challenges: (1) long build durations, and (2) build failures.
  arXiv  Detail & Related papers  (2025-01-21T07:32:06Z)
• Re-Invoke: Tool Invocation Rewriting for Zero-Shot Tool Retrieval [47.81307125613145]
  Re-Invoke is an unsupervised tool retrieval method designed to scale effectively to large toolsets without training. We employ a novel multi-view similarity ranking strategy based on intents to pinpoint the most relevant tools for each query. Our evaluation demonstrates that Re-Invoke significantly outperforms state-of-the-art alternatives in both single-tool and multi-tool scenarios.
  arXiv  Detail & Related papers  (2024-08-03T22:49:27Z)
• An Analysis of MLOps Architectures: A Systematic Mapping Study [12.399094410444743]
  This study provides an overview of the state of the art in MLOps from an architectural perspective. Researchers and practitioners can use our findings to inform the architecture design of their MLOps systems.
  arXiv  Detail & Related papers  (2024-06-28T11:38:50Z)
• Towards Completeness-Oriented Tool Retrieval for Large Language Models [60.733557487886635]
  Real-world systems often incorporate a wide array of tools, making it impractical to input all tools into Large Language Models. Existing tool retrieval methods primarily focus on semantic matching between user queries and tool descriptions. We propose a novel modelagnostic COllaborative Learning-based Tool Retrieval approach, COLT, which captures not only the semantic similarities between user queries and tool descriptions but also takes into account the collaborative information of tools.
  arXiv  Detail & Related papers  (2024-05-25T06:41:23Z)
• Comparison of Static Analysis Architecture Recovery Tools for Microservice Applications [43.358953895199264]
  We will identify static analysis architecture recovery tools for microservice applications via a multi-vocal literature review. We will then execute them on a common dataset and compare the measured effectiveness in architecture recovery.
  arXiv  Detail & Related papers  (2024-03-11T17:26:51Z)
• Software Architecture Recovery with Information Fusion [14.537490019685384]
  We propose SARIF, a fully automated architecture recovery technique. It incorporates three types of comprehensive information, including dependencies, code text and folder structure. SARIF is 36.1% more accurate than the best of the previous techniques on average.
  arXiv  Detail & Related papers  (2023-11-08T12:35:37Z)
• Tool-Augmented Reward Modeling [58.381678612409]
  We propose a tool-augmented preference modeling approach, named Themis, to address limitations by empowering RMs with access to external environments. Our study delves into the integration of external tools into RMs, enabling them to interact with diverse external sources. In human evaluations, RLHF trained with Themis attains an average win rate of 32% when compared to baselines.
  arXiv  Detail & Related papers  (2023-10-02T09:47:40Z)
• PyRCA: A Library for Metric-based Root Cause Analysis [66.72542200701807]
  PyRCA is an open-source machine learning library of Root Cause Analysis (RCA) for Artificial Intelligence for IT Operations (AIOps) It provides a holistic framework to uncover the complicated metric causal dependencies and automatically locate root causes of incidents.
  arXiv  Detail & Related papers  (2023-06-20T09:55:10Z)
• Open Tracing Tools: Overview and Critical Comparison [10.196089289625599]
  This paper aims to provide an overview of popular Open tracing tools via comparison. We first identified ra30 tools in an objective, systematic, and reproducible manner. We then characterized each tool looking at the 1) measured features, 2) popularity both in peer-reviewed literature and online media, and 3) benefits and issues.
  arXiv  Detail & Related papers  (2022-07-14T12:52:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.