MicroRes: Versatile Resilience Profiling in Microservices via Degradation Dissemination Indexing
- URL: http://arxiv.org/abs/2212.12850v3
- Date: Thu, 21 Mar 2024 04:12:43 GMT
- Title: MicroRes: Versatile Resilience Profiling in Microservices via Degradation Dissemination Indexing
- Authors: Tianyi Yang, Cheryl Lee, Jiacheng Shen, Yuxin Su, Yongqiang Yang, Michael R. Lyu,
- Abstract summary: Microservice resilience, the ability to recover from failures and continue providing reliable and responsive services, is crucial for cloud vendors.
The current practice relies on manually configured specific rules to a certain microservice system, resulting in labor-intensity and flexibility issues.
Our insight is that resilient deployment can effectively prevent the dissemination of degradation from system performance to user-aware metrics, and the latter affects service quality.
- Score: 29.456286275972474
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Microservice resilience, the ability of microservices to recover from failures and continue providing reliable and responsive services, is crucial for cloud vendors. However, the current practice relies on manually configured rules specific to a certain microservice system, resulting in labor-intensity and flexibility issues, given the large scale and high dynamics of microservices. A more labor-efficient and versatile solution is desired. Our insight is that resilient deployment can effectively prevent the dissemination of degradation from system performance metrics to user-aware metrics, and the latter directly affects service quality. In other words, failures in a non-resilient deployment can impact both types of metrics, leading to user dissatisfaction. With this in mind, we propose MicroRes, the first versatile resilience profiling framework for microservices via degradation dissemination indexing. MicroRes first injects failures into microservices and collects available monitoring metrics. Then, it ranks the metrics according to their contributions to the overall service degradation. It produces a resilience index by how much the degradation is disseminated from system performance metrics to user-aware metrics. Higher degradation dissemination indicates lower resilience. We evaluate MicroRes on two open-source and one industrial microservice system. The experiments show MicroRes' efficient and effective resilience profiling of microservices. We also showcase MicroRes' practical usage in production.
Related papers
- AutoPT: How Far Are We from the End2End Automated Web Penetration Testing? [54.65079443902714]
We introduce AutoPT, an automated penetration testing agent based on the principle of PSM driven by LLMs.
Our results show that AutoPT outperforms the baseline framework ReAct on the GPT-4o mini model.
arXiv Detail & Related papers (2024-11-02T13:24:30Z) - Adaptive Temporal Motion Guided Graph Convolution Network for Micro-expression Recognition [48.21696443824074]
We propose a novel framework for micro-expression recognition, named the Adaptive Temporal Motion Guided Graph Convolution Network (ATM-GCN)
Our framework excels at capturing temporal dependencies between frames across the entire clip, thereby enhancing micro-expression recognition at the clip level.
arXiv Detail & Related papers (2024-06-13T10:57:24Z) - Benchmarking Data Management Systems for Microservices [1.9948490148513414]
Microservice architectures are a popular choice for deploying large-scale data-intensive applications.
Existing microservice benchmarks lack essential data management challenges.
Online Marketplace is a novel benchmark that embraces core data management requirements.
arXiv Detail & Related papers (2024-05-19T11:55:45Z) - Digital Twin-assisted Reinforcement Learning for Resource-aware
Microservice Offloading in Edge Computing [12.972771759204264]
We introduce a novel microservice offloading algorithm, DTDRLMO, which leverages deep reinforcement learning (DRL) and digital twin technology.
Specifically, we employ digital twin techniques to predict and adapt to changing edge node loads and network conditions of Collaborative edge computing in real-time.
This approach enables the generation of an efficient offloading plan, selecting the most suitable edge node for each microservice.
arXiv Detail & Related papers (2024-03-13T16:44:36Z) - Benchmarks for End-to-End Microservices Testing [2.6245844272542027]
We created a test benchmark containing full functional testing coverage for two well-established open-source microservice systems.
We also conducted a case study to identify the best approaches to take to validate a full coverage of tests.
arXiv Detail & Related papers (2023-06-09T13:42:53Z) - Reclaimer: A Reinforcement Learning Approach to Dynamic Resource
Allocation for Cloud Microservices [4.397680391942813]
We introduce Reclaimer, a deep learning model that adapts to changes in the number and behavior of runtime changes in order to minimize CPU core allocation while meeting requirements.
When evaluated with two micro-service-based applications, Reclaimer reduces the mean CPU core allocation by 38.4% to 74.4% relative to the industry-standard scaling solution.
arXiv Detail & Related papers (2023-04-17T01:44:05Z) - Research on Efficiency Analysis of Microservices [0.0]
This study proposes an efficiency analysis framework based on queuing models to analyze the efficiency difference of breaking down traditional large services into n.
It found that breaking down into multiple can effectively improve system efficiency and proved that when the time of the large service is evenly distributed among multiple, the best improvement effect can be achieved.
arXiv Detail & Related papers (2023-03-21T02:00:28Z) - RelaxLoss: Defending Membership Inference Attacks without Losing Utility [68.48117818874155]
We propose a novel training framework based on a relaxed loss with a more achievable learning target.
RelaxLoss is applicable to any classification model with added benefits of easy implementation and negligible overhead.
Our approach consistently outperforms state-of-the-art defense mechanisms in terms of resilience against MIAs.
arXiv Detail & Related papers (2022-07-12T19:34:47Z) - Efficient Micro-Structured Weight Unification and Pruning for Neural
Network Compression [56.83861738731913]
Deep Neural Network (DNN) models are essential for practical applications, especially for resource limited devices.
Previous unstructured or structured weight pruning methods can hardly truly accelerate inference.
We propose a generalized weight unification framework at a hardware compatible micro-structured level to achieve high amount of compression and acceleration.
arXiv Detail & Related papers (2021-06-15T17:22:59Z) - ReMP: Rectified Metric Propagation for Few-Shot Learning [67.96021109377809]
A rectified metric space is learned to maintain the metric consistency from training to testing.
Numerous analyses indicate that a simple modification of the objective can yield substantial performance gains.
The proposed ReMP is effective and efficient, and outperforms the state of the arts on various standard few-shot learning datasets.
arXiv Detail & Related papers (2020-12-02T00:07:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.