An Auto-Scaling Approach for Serverless Environments Based on a Multi-Expert Consensus Mechanism

• URL: http://arxiv.org/abs/2607.15511v1
• Date: Thu, 16 Jul 2026 23:48:37 GMT
• Title: An Auto-Scaling Approach for Serverless Environments Based on a Multi-Expert Consensus Mechanism
• Abstract summary: dependency-aware autoscaling framework integrates graph-based bottleneck identification, short-term workload forecasting, multi-model consensus, and cost-aware control.<n>Controller incorporates cold-start awareness and cost comparison to select among scale-up, scale-down, and hold actions.
• Score: 0.3058685580689604
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Serverless computing provides automatic resource management and pay-per-use execution, but effective autoscaling remains challenging because of dynamic workloads, cold-start latency, and dependencies among functions. We present a dependency-aware autoscaling framework that integrates graph-based bottleneck identification, short-term workload forecasting, multi-model consensus, and cost-aware scaling control. Serverless applications are represented as directed dependency graphs, and structurally important functions are identified using weighted degree centrality. Resource demand is predicted using lightweight MLP, LSTM, and CNN models. Their outputs are combined through a performance-weighted probabilistic ensemble inspired by Bayesian model averaging. The controller further incorporates cold-start awareness and cost comparison to select among scale-up, scale-down, and hold actions. Experiments using real workload traces show that supervised forecasting substantially outperforms unsupervised clustering for autoscaling decision generation. The proposed ensemble achieves 99.88 percent prediction accuracy and reduces prediction error compared with representative hybrid forecasting methods. Evaluations across multiple cloud pricing models also demonstrate consistent infrastructure cost reductions while maintaining performance targets. The results show that combining dependency analysis, multi-expert forecasting, and cost-aware control provides a robust and practical solution for serverless autoscaling.

Related papers

• A Two-Stage Forecasting System for CPU Workload Prediction in Private Clouds [0.4202074945058886]
  This study proposes a two-stage integrated forecasting model that explicitly models this dependency by first forecasting customer service requests.<n>The proposed work was evaluated using real-world traces collected from a private cloud environment comprising ten applications.
  arXiv  Detail & Related papers  (2026-09-03T07:15:44Z)
• ScaleSense: Cost-Intelligent Scaling Framework via Learned Resource Estimation in Alibaba AnalyticDB [59.708423132520515]
  Cloud-native serverless data warehouses achieve fine-grained elasticity by decoupling storage from compute.<n>Yet determining the optimal resource allocation for highly heterogeneous ad-hoc queries remains a formidable industrial challenge.<n>We propose ScaleSense, a proactive, query-level resource scaling framework.
  arXiv  Detail & Related papers  (2026-08-08T06:10:35Z)
• ComplexMCP: Evaluation of LLM Agents in Dynamic, Interdependent, and Large-Scale Tool Sandbox [61.862814740220806]
  $textbfComplexMCP$ is a benchmark designed to evaluate agents in rigorous conditions.<n>Built on the Model Context Protocol (MCP), $textbfComplexMCP$ provides over 300 meticulously tested tools.
  arXiv  Detail & Related papers  (2026-05-11T16:20:51Z)
• MsFormer: Enabling Robust Predictive Maintenance Services for Industrial Devices [53.94035827454474]
  We propose a lightweight Multi-scale Transformer designed as a unified AI service model for reliable industrial predictive maintenance.<n>MsFormer incorporates a Multi-scale Sampling (MS) module and a tailored position encoding mechanism to capture sequential correlations.<n>Experiments on real-world datasets demonstrate that the proposed framework achieves significant performance improvements over state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-03-24T11:12:50Z)
• Reliable LLM-Based Edge-Cloud-Expert Cascades for Telecom Knowledge Systems [54.916243942641444]
  Large language models (LLMs) are emerging as key enablers of automation in domains such as telecommunications.<n>We study an edge-cloud-expert cascaded LLM-based knowledge system that supports decision-making through a question-and-answer pipeline.
  arXiv  Detail & Related papers  (2025-12-23T03:10:09Z)
• Budget-Aware Tool-Use Enables Effective Agent Scaling [82.6942342482552]
  Scaling test-time computation improves performance across different tasks on large language models (LLMs)<n>We study how to scale such agents effectively under explicit tool-call budgets, focusing on web search agents.<n>We introduce the Budget Tracker, a lightweight plug-in that provides the agent with continuous budget awareness.
  arXiv  Detail & Related papers  (2025-11-21T07:18:55Z)
• Online Ensemble Transformer for Accurate Cloud Workload Forecasting in Predictive Auto-Scaling [9.687789919349523]
  We propose a novel online ensemble model, E3Former, for online workload forecasting in large-scale predictive auto-scaling.<n>Our model synergizes the predictive capabilities of multipleworks to surmount the limitations of single-model approaches.<n>Our method has been deployed within ByteDance's Intelligent Horizontal Pod Auto-scaling (IHPA) platform.
  arXiv  Detail & Related papers  (2025-08-18T09:48:12Z)
• CSGO: Generalized Optimization for Cold Start in Wireless Collaborative Edge LLM Systems [62.24576366776727]
  We propose a latency-aware scheduling framework to minimize total inference latency.<n>We show that the proposed method significantly reduces cold-start latency compared to baseline strategies.
  arXiv  Detail & Related papers  (2025-08-15T07:49:22Z)
• The Larger the Merrier? Efficient Large AI Model Inference in Wireless Edge Networks [56.37880529653111]
  The demand for large computation model (LAIM) services is driving a paradigm shift from traditional cloud-based inference to edge-based inference for low-latency, privacy-preserving applications.<n>In this paper, we investigate the LAIM-inference scheme, where a pre-trained LAIM is pruned and partitioned into on-device and on-server sub-models for deployment.
  arXiv  Detail & Related papers  (2025-05-14T08:18:55Z)
• OptScaler: A Collaborative Framework for Robust Autoscaling in the Cloud [10.97507717758812]
  We propose OptScaler, a collaborative autoscaling framework that integrates proactive and reactive modules through an optimization module.<n> Numerical results have demonstrated the superiority of our workload prediction model and the collaborative framework.
  arXiv  Detail & Related papers  (2023-10-26T04:38:48Z)
• A Deep Recurrent-Reinforcement Learning Method for Intelligent AutoScaling of Serverless Functions [18.36339203254509]
  F introduces a lightweight, function-based cloud execution model that finds its relevance in a range of applications like IoT-edge data processing and anomaly detection.
  arXiv  Detail & Related papers  (2023-08-11T04:41:19Z)
• A Meta Reinforcement Learning Approach for Predictive Autoscaling in the Cloud [10.970391043991363]
  We propose an end-to-end predictive meta model-based RL algorithm, aiming to optimally allocate resource to maintain a stable CPU utilization level. Our algorithm not only ensures the predictability and accuracy of the scaling strategy, but also enables the scaling decisions to adapt to the changing workloads with high sample efficiency.
  arXiv  Detail & Related papers  (2022-05-31T13:54:04Z)
• A Predictive Autoscaler for Elastic Batch Jobs [8.354712625979776]
  Large batch jobs such as Deep Learning, HPC and Spark require far more computational resources and higher cost than conventional online service. We propose a predictive autoscaler to provide an elastic interface for the customers and overprovision instances.
  arXiv  Detail & Related papers  (2020-10-10T17:35:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.