How Does Microservice Granularity Impact Energy Consumption and Performance? A Controlled Experiment

• URL: http://arxiv.org/abs/2502.00482v1
• Date: Sat, 01 Feb 2025 16:10:14 GMT
• Title: How Does Microservice Granularity Impact Energy Consumption and Performance? A Controlled Experiment
• Abstract summary: We conducted a controlled experiment using two open-source microservice-based systems of different scales.<n>For each system, we created three levels of granularity by or merging services.<n>Fine granularity consumed on average 461 J more energy (13%) and added 5.2 ms to response time (14%) compared to coarse granularity.
• Score: 8.756462820891306
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Context: Microservice architectures are a widely used software deployment approach, with benefits regarding flexibility and scalability. However, their impact on energy consumption is poorly understood, and often overlooked in favor of performance and other quality attributes (QAs). One understudied concept in this area is microservice granularity, i.e., over how many services the system functionality is distributed. Objective: We therefore aim to analyze the relationship between microservice granularity and two critical QAs in microservice-based systems: energy consumption and performance. Method: We conducted a controlled experiment using two open-source microservice-based systems of different scales: the small Pet Clinic system and the large Train Ticket system. For each system, we created three levels of granularity by merging or splitting services (coarse, medium, and fine) and then exposed them to five levels of request frequency. Results: Our findings revealed that: i) granularity significantly affected both energy consumption and response time, e.g., in the large system, fine granularity consumed on average 461 J more energy (13%) and added 5.2 ms to response time (14%) compared to coarse granularity; ii) higher request loads significantly increased both energy consumption and response times, with moving from 40 to 400 requests / s resulting in 651 J higher energy consumption (23%) and 41.2 ms longer response times (98%); iii) there is a complex relationship between granularity, system scale, energy consumption, and performance that warrants careful consideration in microservice design. We derive generalizable takeaways from our results. Conclusion: Microservices practitioners should take our findings into account when making granularity-related decisions, especially for large-scale systems.

Related papers

• Spanergy: Energy-aware Distributed Tracing for Microservices [0.0]
  This paper presents Spanergy, an energy-aware distributed tracing approach.<n>It correlates per-microservice power measurements with attributes measured energy consumption to request segments i.e. trace spans.<n>Spanergy reveals that a non-negligible fraction of request energy comes from spans outside the latency-critical path.
  arXiv  Detail & Related papers  (2026-07-27T17:15:29Z)
• An Empirical Study on How Architectural Topology Affects Microservice Performance and Energy Usage [0.0]
  This study quantifies the impact of topologies on energy efficiency and performance across six canonical ones.<n>Probabilistic and Parallel Fan-Out emerging as the most energy-efficient under dense-bound loads.
  arXiv  Detail & Related papers  (2026-03-31T17:14:41Z)
• Performance Antipatterns: Angel or Devil for Power Consumption? [45.34301783539974]
  This paper investigates whether widely studied performance antipatterns also negatively influence power usage.<n>We implement ten instantaneous antipatterns as isolated and evaluate them under controlled load conditions.<n>Results show that while all antipatterns degrade performance as expected, only a subset exhibit a statistically significant relationship between response time and increased power consumption.
  arXiv  Detail & Related papers  (2026-02-12T15:37:21Z)
• From Prompts to Power: Measuring the Energy Footprint of LLM Inference [1.9116784879310027]
  We present a large-scale measurement-based study comprising over 32,500 measurements across 21 GPU configurations and 155 model architectures.<n>Using the vLLM inference engine, we quantify energy usage at the prompt level and identify how architectural and operational factors shape energy demand.<n>We develop a predictive model that accurately estimates inference energy consumption across unseen architectures and hardware, and implement it as a browser extension to raise awareness of the environmental impact of generative AI.
  arXiv  Detail & Related papers  (2025-11-05T15:06:46Z)
• EfficientLLM: Efficiency in Large Language Models [64.3537131208038]
  Large Language Models (LLMs) have driven significant progress, yet their growing counts and context windows incur prohibitive compute, energy, and monetary costs.<n>We introduce EfficientLLM, a novel benchmark and the first comprehensive empirical study evaluating efficiency techniques for LLMs at scale.
  arXiv  Detail & Related papers  (2025-05-20T02:27:08Z)
• The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimization [18.675499212393785]
  Energy remains a metric that is often overlooked, under-explored, or poorly understood in the context of building ML systems.<n>We present the ML.ENERGY Benchmark, a benchmark suite and tool for measuring inference energy consumption under realistic service environments.
  arXiv  Detail & Related papers  (2025-05-09T18:27:32Z)
• Distributed Multi-Head Learning Systems for Power Consumption Prediction [59.293903039988884]
  We propose Distributed Multi-Head learning (DMH) systems for power consumption prediction in smart factories.<n>DMH systems are designed as distributed and split learning, reducing the client-to-server transmission cost.<n>DMH-E system reduces the error of the state-of-the-art systems by 14.5% to 24.0%.
  arXiv  Detail & Related papers  (2025-01-21T13:46:23Z)
• Unveiling the Energy Vampires: A Methodology for Debugging Software Energy Consumption [5.602876058122268]
  This paper presents an energy debug methodology for identifying and isolating energy consumption hotspots in software systems.<n>Our analysis reveals significant energy consumption differences between Alpine and Ubuntu distributions.<n>By isolating and benchmarking memcpy, we confirm it as the primary cause of the energy discrepancy.
  arXiv  Detail & Related papers  (2024-12-13T11:49:19Z)
• MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from μWatts to MWatts for Sustainable AI [5.50579824344998]
  Machine learning (ML) technologies have led to a surge in power consumption across diverse systems. This paper introduceserf Power, a comprehensive benchmarking methodology to evaluate the energy efficiency of ML systems at power levels ranging from microwatts to megawatts.
  arXiv  Detail & Related papers  (2024-10-15T20:06:33Z)
• Power Hungry Processing: Watts Driving the Cost of AI Deployment? [74.19749699665216]
  generative, multi-purpose AI systems promise a unified approach to building machine learning (ML) models into technology. This ambition of generality'' comes at a steep cost to the environment, given the amount of energy these systems require and the amount of carbon that they emit. We measure deployment cost as the amount of energy and carbon required to perform 1,000 inferences on representative benchmark dataset using these models. We conclude with a discussion around the current trend of deploying multi-purpose generative ML systems, and caution that their utility should be more intentionally weighed against increased costs in terms of energy and emissions
  arXiv  Detail & Related papers  (2023-11-28T15:09:36Z)
• Multiagent Reinforcement Learning with an Attention Mechanism for Improving Energy Efficiency in LoRa Networks [52.96907334080273]
  As the network scale increases, the energy efficiency of LoRa networks decreases sharply due to severe packet collisions. We propose a transmission parameter allocation algorithm based on multiagent reinforcement learning (MALoRa) Simulation results demonstrate that MALoRa significantly improves the system EE compared with baseline algorithms.
  arXiv  Detail & Related papers  (2023-09-16T11:37:23Z)
• Research on Efficiency Analysis of Microservices [0.0]
  This study proposes an efficiency analysis framework based on queuing models to analyze the efficiency difference of breaking down traditional large services into n. It found that breaking down into multiple can effectively improve system efficiency and proved that when the time of the large service is evenly distributed among multiple, the best improvement effect can be achieved.
  arXiv  Detail & Related papers  (2023-03-21T02:00:28Z)
• Machine Learning for QoS Prediction in Vehicular Communication: Challenges and Solution Approaches [46.52224306624461]
  We consider maximum throughput prediction enhancing, for example, streaming or high-definition mapping applications. We highlight how confidence can be built on machine learning technologies by better understanding the underlying characteristics of the collected data. We use explainable AI to show that machine learning can learn underlying principles of wireless networks without being explicitly programmed.
  arXiv  Detail & Related papers  (2023-02-23T12:29:20Z)
• MicroRes: Versatile Resilience Profiling in Microservices via Degradation Dissemination Indexing [29.456286275972474]
  Microservice resilience, the ability to recover from failures and continue providing reliable and responsive services, is crucial for cloud vendors. The current practice relies on manually configured specific rules to a certain microservice system, resulting in labor-intensity and flexibility issues. Our insight is that resilient deployment can effectively prevent the dissemination of degradation from system performance to user-aware metrics, and the latter affects service quality.
  arXiv  Detail & Related papers  (2022-12-25T03:56:42Z)
• Deep Reinforcement Learning Based Multidimensional Resource Management for Energy Harvesting Cognitive NOMA Communications [64.1076645382049]
  Combination of energy harvesting (EH), cognitive radio (CR), and non-orthogonal multiple access (NOMA) is a promising solution to improve energy efficiency. In this paper, we study the spectrum, energy, and time resource management for deterministic-CR-NOMA IoT systems.
  arXiv  Detail & Related papers  (2021-09-17T08:55:48Z)
• A Framework for Energy and Carbon Footprint Analysis of Distributed and Federated Edge Learning [48.63610479916003]
  This article breaks down and analyzes the main factors that influence the environmental footprint of distributed learning policies. It models both vanilla and decentralized FL policies driven by consensus. Results show that FL allows remarkable end-to-end energy savings (30%-40%) for wireless systems characterized by low bit/Joule efficiency.
  arXiv  Detail & Related papers  (2021-03-18T16:04:42Z)
• Appliance-Level Monitoring with Micro-Moment Smart Plugs [2.294014185517203]
  A micro-moment-based smart plug system is proposed as part of a larger multi-appliance energy efficiency program. The plug also allows home automation capability. Current implementation results show that the proposed system delivers cost-effective deployment.
  arXiv  Detail & Related papers  (2020-12-10T16:22:40Z)
• Risk-Aware Energy Scheduling for Edge Computing with Microgrid: A Multi-Agent Deep Reinforcement Learning Approach [82.6692222294594]
  We study a risk-aware energy scheduling problem for a microgrid-powered MEC network. We derive the solution by applying a multi-agent deep reinforcement learning (MADRL)-based advantage actor-critic (A3C) algorithm with shared neural networks.
  arXiv  Detail & Related papers  (2020-02-21T02:14:38Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.