Can an LLM Detect Instances of Microservice Infrastructure Patterns?

• URL: http://arxiv.org/abs/2603.23073v1
• Date: Tue, 24 Mar 2026 11:08:59 GMT
• Title: Can an LLM Detect Instances of Microservice Infrastructure Patterns?
• Abstract summary: MicroPAD is a tool to identify architectural patterns in software artifacts written in any language.<n>It is capable of detecting pattern instances across multiple languages and artifact types.<n> patterns associated with recognizable, dominant artifacts were detected more reliably.
• Score: 0.8318686824572802
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Architectural patterns are frequently found in various software artifacts. The wide variety of patterns and their implementations makes detection challenging with current tools, especially since they often only support detecting patterns in artifacts written in a single language. Large Language Models (LLMs), trained on a diverse range of software artifacts and knowledge, might overcome the limitations of existing approaches. However, their true effectiveness and the factors influencing their performance have not yet been thoroughly examined. To better understand this, we developed MicroPAD. This tool utilizes GPT 5 nano to identify architectural patterns in software artifacts written in any language, based on natural-language pattern descriptions. We used MicroPAD to evaluate an LLM's ability to detect instances of architectural patterns, particularly infrastructure-related microservice patterns. To accomplish this, we selected a set of GitHub repositories and contacted their top contributors to create a new, human-annotated dataset of 190 repositories containing microservice architectural patterns. The results show that MicroPAD was capable of detecting pattern instances across multiple languages and artifact types. The detection performance varied across patterns (F1 scores ranging from 0.09 to 0.70), specifically in relation to their prevalence and the distinctiveness of the artifacts through which they manifest. We also found that patterns associated with recognizable, dominant artifacts were detected more reliably. Whether these findings generalize to other LLMs and tools is a promising direction for future research.

Related papers

• Are LLMs Ready for Anti-Pattern Detection in Microservice Architectures? [4.339839287869652]
  Microservice systems are prone to recurrent architectural anti-patterns (APs) that hinder maintainability, evolvability, and operational quality.<n>This paper investigates whether large language models (LLMs) are ready to support architectural anti-pattern detection in microservice architectures.
  arXiv  Detail & Related papers  (2026-06-25T12:03:24Z)
• Compressed Sensing for Capability Localization in Large Language Models [58.574245030744834]
  Large language models (LLMs) exhibit a wide range of capabilities, including mathematical reasoning, code generation, and linguistic behaviors.<n>We show that many capabilities are highly localized to small subsets of attention heads within Transformer architectures.
  arXiv  Detail & Related papers  (2026-02-11T16:06:59Z)
• ArtifactLens: Hundreds of Labels Are Enough for Artifact Detection with VLMs [43.85474845650244]
  ArtifactLens achieves state-of-the-art on five human artifact benchmarks.<n>We show that pretrained VLMs already encode the knowledge needed to detect artifacts.<n>Our methods generalize to other artifact types - object morphology, animal anatomy, and entity interactions.
  arXiv  Detail & Related papers  (2026-02-10T07:16:22Z)
• IAD-GPT: Advancing Visual Knowledge in Multimodal Large Language Model for Industrial Anomaly Detection [70.02774285130238]
  This paper explores the combination of rich text semantics with both image-level and pixel-level information from images.<n>We propose IAD-GPT, a novel paradigm based on MLLMs for Industrial Anomaly Detection.<n>Experiments on MVTec-AD and VisA datasets demonstrate our state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-10-16T02:48:05Z)
• DetectAnyLLM: Towards Generalizable and Robust Detection of Machine-Generated Text Across Domains and Models [60.713908578319256]
  We propose Direct Discrepancy Learning (DDL) to optimize the detector with task-oriented knowledge.<n>Built upon this, we introduce DetectAnyLLM, a unified detection framework that achieves state-of-the-art MGTD performance.<n>MIRAGE samples human-written texts from 10 corpora across 5 text-domains, which are then re-generated or revised using 17 cutting-edge LLMs.
  arXiv  Detail & Related papers  (2025-09-15T10:59:57Z)
• DoorDet: Semi-Automated Multi-Class Door Detection Dataset via Object Detection and Large Language Models [26.43839593818403]
  We present a semi-automated pipeline to construct a multi-class door detection dataset with minimal manual effort.<n>Our method significantly reduces annotation cost while producing a dataset suitable for benchmarking neural models in floor plan analysis.<n>This work demonstrates the potential of combining deep learning and multimodal reasoning for efficient dataset construction in complex real-world domains.
  arXiv  Detail & Related papers  (2025-08-11T07:41:09Z)
• Automated Microservice Pattern Instance Detection Using Infrastructure-as-Code Artifacts and Large Language Models [0.0]
  This article presents our ongoing PhD research, early experiments, and a prototype for a tool we call MicroPAD for automating the detection of microservice pattern instances.<n>The prototype uses Large Language Models (LLMs) to analyze Infrastructure-as-Code (IaC) artifacts to aid detection, aiming to keep costs low and maximize the scope of detectable patterns.
  arXiv  Detail & Related papers  (2025-02-06T16:22:14Z)
• LLMs for Generation of Architectural Components: An Exploratory Empirical Study in the Serverless World [0.0]
  This paper studies the capability of Large Language Models to generate architectural components for Functions as a Service (F)<n>The small size of their architectural components make this architectural style amenable for generation using current LLMs.<n>We evaluate correctness through existing tests present in the repositories and use metrics from the Software Engineering (SE) and Natural Language Processing (NLP) domains.
  arXiv  Detail & Related papers  (2025-02-04T18:06:04Z)
• Enhancing LLM's Ability to Generate More Repository-Aware Unit Tests Through Precise Contextual Information Injection [4.367526927436771]
  Large Language Models (LLMs) guided by prompt engineering have gained attention for their ability to handle a broad range of tasks.<n>LLMs may exhibit hallucinations when generating unit tests for focal methods or functions due to their lack of awareness regarding the project's global context.<n>We propose RATester, which enhances the LLM's ability to generate more repository-aware unit tests.
  arXiv  Detail & Related papers  (2025-01-13T15:43:36Z)
• Do Membership Inference Attacks Work on Large Language Models? [141.2019867466968]
  Membership inference attacks (MIAs) attempt to predict whether a particular datapoint is a member of a target model's training data. We perform a large-scale evaluation of MIAs over a suite of language models trained on the Pile, ranging from 160M to 12B parameters. We find that MIAs barely outperform random guessing for most settings across varying LLM sizes and domains.
  arXiv  Detail & Related papers  (2024-02-12T17:52:05Z)
• Multi-modal Transformers Excel at Class-agnostic Object Detection [105.10403103027306]
  We argue that existing methods lack a top-down supervision signal governed by human-understandable semantics. We develop an efficient and flexible MViT architecture using multi-scale feature processing and deformable self-attention. We show the significance of MViT proposals in a diverse range of applications.
  arXiv  Detail & Related papers  (2021-11-22T18:59:29Z)
• Stance Detection Benchmark: How Robust Is Your Stance Detection? [65.91772010586605]
  Stance Detection (StD) aims to detect an author's stance towards a certain topic or claim. We introduce a StD benchmark that learns from ten StD datasets of various domains in a multi-dataset learning setting. Within this benchmark setup, we are able to present new state-of-the-art results on five of the datasets.
  arXiv  Detail & Related papers  (2020-01-06T13:37:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.