Benchmarks for End-to-End Microservices Testing

• URL: http://arxiv.org/abs/2306.05895v1
• Date: Fri, 9 Jun 2023 13:42:53 GMT
• Title: Benchmarks for End-to-End Microservices Testing
• Authors: Sheldon Smith, Ethan Robinson, Timmy Frederiksen, Trae Stevens, Tomas Cerny, Miroslav Bures, Davide Taibi
• Abstract summary: We created a test benchmark containing full functional testing coverage for two well-established open-source microservice systems. We also conducted a case study to identify the best approaches to take to validate a full coverage of tests.
• Score: 2.6245844272542027
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Testing microservice systems involves a large amount of planning and problem-solving. The difficulty of testing microservice systems increases as the size and structure of such systems become more complex. To help the microservice community and simplify experiments with testing and traffic simulation, we created a test benchmark containing full functional testing coverage for two well-established open-source microservice systems. Through our benchmark design, we aimed to demonstrate ways to overcome certain challenges and find effective strategies when testing microservices. In addition, to demonstrate our benchmark use, we conducted a case study to identify the best approaches to take to validate a full coverage of tests using service-dependency graph discovery and business process discovery using tracing.

Related papers

• AutoPT: How Far Are We from the End2End Automated Web Penetration Testing? [54.65079443902714]
  We introduce AutoPT, an automated penetration testing agent based on the principle of PSM driven by LLMs. Our results show that AutoPT outperforms the baseline framework ReAct on the GPT-4o mini model.
  arXiv  Detail & Related papers  (2024-11-02T13:24:30Z)
• Step-by-Step Reasoning for Math Problems via Twisted Sequential Monte Carlo [55.452453947359736]
  We introduce a novel verification method based on Twisted Sequential Monte Carlo (TSMC) We apply TSMC to Large Language Models by estimating the expected future rewards at partial solutions. This approach results in a more straightforward training target that eliminates the need for step-wise human annotations.
  arXiv  Detail & Related papers  (2024-10-02T18:17:54Z)
• Provably Neural Active Learning Succeeds via Prioritizing Perplexing Samples [53.95282502030541]
  Neural Network-based active learning (NAL) is a cost-effective data selection technique that utilizes neural networks to select and train on a small subset of samples. We try to move one step forward by offering a unified explanation for the success of both query criteria-based NAL from a feature learning view.
  arXiv  Detail & Related papers  (2024-06-06T10:38:01Z)
• Benchmarking Data Management Systems for Microservices [1.9948490148513414]
  Microservice architectures are a popular choice for deploying large-scale data-intensive applications. Existing microservice benchmarks lack essential data management challenges. Online Marketplace is a novel benchmark that embraces core data management requirements.
  arXiv  Detail & Related papers  (2024-05-19T11:55:45Z)
• A Benchmark for Data Management in Microservices [1.9338699922911442]
  We present Online Marketplace, a microservice benchmark that incorporates core data management challenges. These challenges include transaction processing, query processing, event processing, constraint enforcement, and data replication. We present the challenges we faced in creating workloads that accurately reflect the state-of-the-art data platforms.
  arXiv  Detail & Related papers  (2024-03-19T10:14:48Z)
• Migration to Microservices: A Comparative Study of Decomposition Strategies and Analysis Metrics [0.5076419064097734]
  We present a novel clustering method to identify potential in a given monolithic application. Our approach employs a density-based clustering algorithm considering static analysis, structural, and semantic relationships between classes.
  arXiv  Detail & Related papers  (2024-02-13T14:15:00Z)
• End-to-End Test Coverage Metrics in Microservice Systems: An Automated Approach [2.6245844272542027]
  This paper introduces test coverage metrics for evaluating the extent of E2E test suite coverage for microservice endpoints. Next, it presents an automated approach to compute these metrics to provide feedback on the completeness of E2E test suites.
  arXiv  Detail & Related papers  (2023-08-18T02:30:19Z)
• Generalizable Metric Network for Cross-domain Person Re-identification [55.71632958027289]
  Cross-domain (i.e., domain generalization) scene presents a challenge in Re-ID tasks. Most existing methods aim to learn domain-invariant or robust features for all domains. We propose a Generalizable Metric Network (GMN) to explore sample similarity in the sample-pair space.
  arXiv  Detail & Related papers  (2023-06-21T03:05:25Z)
• AI Techniques in the Microservices Life-Cycle: A Survey [10.06596283248616]
  In microservice systems, functionalities are provided by loosely coupled, small services, each focusing on a specific business capability. Building a system according to the architectural style brings a number of challenges, mainly related to how different are deployed and coordinated. In this paper, we provide a survey about how techniques in the area of Artificial Intelligence have been used to tackle these challenges.
  arXiv  Detail & Related papers  (2023-05-25T14:24:37Z)
• Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms [52.58031087639394]
  micro-expressions are involuntary and transient facial expressions. They can provide important information in a broad range of applications such as lie detection, criminal detection, etc. Since micro-expressions are transient and of low intensity, their detection and recognition is difficult and relies heavily on expert experiences.
  arXiv  Detail & Related papers  (2022-01-30T05:14:13Z)
• Deep neural networks approach to microbial colony detection -- a comparative analysis [52.77024349608834]
  This study investigates the performance of three deep learning approaches for object detection on the AGAR dataset. The achieved results may serve as a benchmark for future experiments.
  arXiv  Detail & Related papers  (2021-08-23T12:06:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.