A Metrics-Oriented Architectural Model to Characterize Complexity on Machine Learning-Enabled Systems
- URL: http://arxiv.org/abs/2506.08153v1
- Date: Mon, 09 Jun 2025 19:02:19 GMT
- Title: A Metrics-Oriented Architectural Model to Characterize Complexity on Machine Learning-Enabled Systems
- Authors: Renato Cordeiro Ferreira,
- Abstract summary: This research aims to introduce a metrics-based architectural model to characterize the complexity of MLES.<n>The goal is to support architectural decisions, providing a guideline for the inception and growth of these systems.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: How can the complexity of ML-enabled systems be managed effectively? The goal of this research is to investigate how complexity affects ML-Enabled Systems (MLES). To address this question, this research aims to introduce a metrics-based architectural model to characterize the complexity of MLES. The goal is to support architectural decisions, providing a guideline for the inception and growth of these systems. This paper showcases the first step for creating the metrics-based architectural model: an extension of a reference architecture that can describe MLES to collect their metrics.
Related papers
- A Tale of Two Systems: Characterizing Architectural Complexity on Machine Learning-Enabled Systems [0.0]
This research aims to introduce a metrics-based architectural model to characterize the complexity of ML-Enabled Systems.<n>The goal is to support architectural decisions, providing a guideline for the inception and growth of these systems.
arXiv Detail & Related papers (2025-06-12T20:54:28Z) - Building LLM Agents by Incorporating Insights from Computer Systems [23.3629124649768]
We advocate for building LLM agents by incorporating insights from computer systems.<n>Inspired by the von Neumann architecture, we propose a structured framework for LLM agentic systems.
arXiv Detail & Related papers (2025-04-06T13:38:37Z) - Large Language Model Agent: A Survey on Methodology, Applications and Challenges [88.3032929492409]
Large Language Model (LLM) agents, with goal-driven behaviors and dynamic adaptation capabilities, potentially represent a critical pathway toward artificial general intelligence.<n>This survey systematically deconstructs LLM agent systems through a methodology-centered taxonomy.<n>Our work provides a unified architectural perspective, examining how agents are constructed, how they collaborate, and how they evolve over time.
arXiv Detail & Related papers (2025-03-27T12:50:17Z) - Boost, Disentangle, and Customize: A Robust System2-to-System1 Pipeline for Code Generation [58.799397354312596]
Large language models (LLMs) have demonstrated remarkable capabilities in various domains, particularly in system 1 tasks.<n>Recent research on System2-to-System1 methods surge, exploring the System 2 reasoning knowledge via inference-time computation.<n>In this paper, we focus on code generation, which is a representative System 2 task, and identify two primary challenges.
arXiv Detail & Related papers (2025-02-18T03:20:50Z) - A quantitative framework for evaluating architectural patterns in ML systems [49.1574468325115]
This study proposes a framework for quantitative assessment of architectural patterns in ML systems.<n>We focus on scalability and performance metrics for cost-effective CPU-based inference.
arXiv Detail & Related papers (2025-01-20T15:30:09Z) - Configurable Foundation Models: Building LLMs from a Modular Perspective [115.63847606634268]
A growing tendency to decompose LLMs into numerous functional modules allows for inference with part of modules and dynamic assembly of modules to tackle complex tasks.
We coin the term brick to represent each functional module, designating the modularized structure as customizable foundation models.
We present four brick-oriented operations: retrieval and routing, merging, updating, and growing.
We find that the FFN layers follow modular patterns with functional specialization of neurons and functional neuron partitions.
arXiv Detail & Related papers (2024-09-04T17:01:02Z) - An Analysis of MLOps Architectures: A Systematic Mapping Study [12.399094410444743]
This study provides an overview of the state of the art in MLOps from an architectural perspective.
Researchers and practitioners can use our findings to inform the architecture design of their MLOps systems.
arXiv Detail & Related papers (2024-06-28T11:38:50Z) - Enhancing Architecture Frameworks by Including Modern Stakeholders and their Views/Viewpoints [48.87872564630711]
The stakeholders with data science and Machine Learning related concerns, such as data scientists and data engineers, are yet to be included in existing architecture frameworks.<n>We surveyed 61 subject matter experts from over 25 organizations in 10 countries.
arXiv Detail & Related papers (2023-08-09T21:54:34Z) - Real-world Machine Learning Systems: A survey from a Data-Oriented
Architecture Perspective [7.574538335342942]
Data-oriented Architecture (DOA) is an emerging concept that equips systems better for integrating ML models.
DOA extends current architectures to create data-driven, loosely coupled, decentralised, open systems.
This paper answers these questions by surveying real-world deployments of ML-based systems.
arXiv Detail & Related papers (2023-02-09T17:57:02Z) - Is a Modular Architecture Enough? [80.32451720642209]
We provide a thorough assessment of common modular architectures, through the lens of simple and known modular data distributions.
We highlight the benefits of modularity and sparsity and reveal insights on the challenges faced while optimizing modular systems.
arXiv Detail & Related papers (2022-06-06T16:12:06Z) - A Survey of Machine Learning for Computer Architecture and Systems [18.620218353713476]
It has been a long time that computer architecture and systems are optimized to enable efficient execution of machine learning (ML) algorithms or models.
Now, it is time to reconsider the relationship between ML and systems, and let ML transform the way that computer architecture and systems are designed.
arXiv Detail & Related papers (2021-02-16T04:09:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.