A Systematic Mapping Study on Architectural Approaches to Software Performance Analysis

• URL: http://arxiv.org/abs/2410.17372v1
• Date: Tue, 22 Oct 2024 19:12:03 GMT
• Title: A Systematic Mapping Study on Architectural Approaches to Software Performance Analysis
• Authors: Yutong Zhao, Lu Xiao, Chenhao Wei, Rick Kazman, Ye Yang,
• Abstract summary: This paper presents a systematic mapping study of 109 papers that integrate software architecture and performance analysis. We focus on five research questions that provide guidance for researchers and practitioners to gain an in-depth understanding of this research area.
• Score: 8.629569588488328
• License:
• Abstract: Software architecture is the foundation of a system's ability to achieve various quality attributes, including software performance. However, there lacks comprehensive and in-depth understanding of why and how software architecture and performance analysis are integrated to guide related future research. To fill this gap, this paper presents a systematic mapping study of 109 papers that integrate software architecture and performance analysis. We focused on five research questions that provide guidance for researchers and practitioners to gain an in-depth understanding of this research area. These questions addressed: a systematic mapping of related studies based on the high-level research purposes and specific focuses (RQ1), the software development activities these studies intended to facilitate (RQ2), the typical study templates of different research purposes (RQ3), the available tools and instruments for automating the analysis (RQ4), and the evaluation methodology employed in the studies (RQ5). Through these research questions, we also identified critical research gaps and future directions, including: 1) the lack of available tools and benchmark datasets to support replication, cross-validation and comparison of studies; 2) the need for architecture and performance analysis techniques that handle the challenges in emerging software domains; 3) the lack of consideration of practical factors that impact the adoption of the architecture and performance analysis approaches; and finally 4) the need for the adoption of modern ML/AI techniques to efficiently integrate architecture and performance analysis.

Related papers

• A Survey of Model Architectures in Information Retrieval [64.75808744228067]
  We focus on two key aspects: backbone models for feature extraction and end-to-end system architectures for relevance estimation. We trace the development from traditional term-based methods to modern neural approaches, particularly highlighting the impact of transformer-based models and subsequent large language models (LLMs) We conclude by discussing emerging challenges and future directions, including architectural optimizations for performance and scalability, handling of multimodal, multilingual data, and adaptation to novel application domains beyond traditional search paradigms.
  arXiv  Detail & Related papers  (2025-02-20T18:42:58Z)
• MLGym: A New Framework and Benchmark for Advancing AI Research Agents [51.9387884953294]
  We introduce Meta MLGym and MLGym-Bench, a new framework and benchmark for evaluating and developing large language models on AI research tasks. This is the first Gym environment for machine learning (ML) tasks, enabling research on reinforcement learning (RL) algorithms for training such agents. We evaluate a number of frontier large language models (LLMs) on our benchmarks such as Claude-3.5-Sonnet, Llama-3.1 405B, GPT-4o, o1-preview, and Gemini-1.5 Pro.
  arXiv  Detail & Related papers  (2025-02-20T12:28:23Z)
• A quantitative framework for evaluating architectural patterns in ML systems [49.1574468325115]
  This study proposes a framework for quantitative assessment of architectural patterns in ML systems. We focus on scalability and performance metrics for cost-effective CPU-based inference.
  arXiv  Detail & Related papers  (2025-01-20T15:30:09Z)
• Data Analysis in the Era of Generative AI [56.44807642944589]
  This paper explores the potential of AI-powered tools to reshape data analysis, focusing on design considerations and challenges. We explore how the emergence of large language and multimodal models offers new opportunities to enhance various stages of data analysis workflow. We then examine human-centered design principles that facilitate intuitive interactions, build user trust, and streamline the AI-assisted analysis workflow across multiple apps.
  arXiv  Detail & Related papers  (2024-09-27T06:31:03Z)
• Ontology Embedding: A Survey of Methods, Applications and Resources [54.3453925775069]
  Onologies are widely used for representing domain knowledge and meta data. logical reasoning that can directly support are quite limited in learning, approximation and prediction. One straightforward solution is to integrate statistical analysis and machine learning.
  arXiv  Detail & Related papers  (2024-06-16T14:49:19Z)
• Comparison of Static Analysis Architecture Recovery Tools for Microservice Applications [43.358953895199264]
  We will identify static analysis architecture recovery tools for microservice applications via a multi-vocal literature review. We will then execute them on a common dataset and compare the measured effectiveness in architecture recovery.
  arXiv  Detail & Related papers  (2024-03-11T17:26:51Z)
• From Requirements to Architecture: An AI-Based Journey to Semi-Automatically Generate Software Architectures [2.4150871564195007]
  We propose a method to generate software architecture candidates based on requirements using artificial intelligence techniques. We further envision an automatic evaluation and trade-off analysis of the generated architecture candidates.
  arXiv  Detail & Related papers  (2024-01-25T10:56:58Z)
• PerfDetectiveAI -- Performance Gap Analysis and Recommendation in Software Applications [0.0]
  PerfDetectiveAI, a conceptual framework for performance gap analysis and suggestion in software applications is introduced in this research. Modern machine learning (ML) and artificial intelligence (AI) techniques are used in PerfDetectiveAI to monitor performance measurements and identify areas of underperformance in software applications.
  arXiv  Detail & Related papers  (2023-06-11T02:53:04Z)
• GLUECons: A Generic Benchmark for Learning Under Constraints [102.78051169725455]
  In this work, we create a benchmark that is a collection of nine tasks in the domains of natural language processing and computer vision. We model external knowledge as constraints, specify the sources of the constraints for each task, and implement various models that use these constraints.
  arXiv  Detail & Related papers  (2023-02-16T16:45:36Z)
• Computer vision-based analysis of buildings and built environments: A systematic review of current approaches [0.98314893665023]
  This paper presents a first systematic review of the computer vision-based analysis of buildings and the built environments. It reveals current research gaps and trends, and highlights two main categories of research aims.
  arXiv  Detail & Related papers  (2022-08-01T14:17:51Z)
• A review of ontologies for smart and continuous commissioning [0.0]
  Ontologies play an important role in continuous commissioning ( SCCx) of buildings as they facilitate data and reasoning by machines. This paper reviews the state-of-the-art research on building data since 2014 within the SCCx domain.
  arXiv  Detail & Related papers  (2022-05-11T13:59:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.