A Two-Stage Forecasting System for CPU Workload Prediction in Private Clouds

• URL: http://arxiv.org/abs/2609.03457v1
• Date: Thu, 03 Sep 2026 07:15:44 GMT
• Title: A Two-Stage Forecasting System for CPU Workload Prediction in Private Clouds
• Abstract summary: This study proposes a two-stage integrated forecasting model that explicitly models this dependency by first forecasting customer service requests.<n>The proposed work was evaluated using real-world traces collected from a private cloud environment comprising ten applications.
• Score: 0.4202074945058886
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Accurate cloud resource forecasting is essential for proactive resource provisioning, maintaining Quality of Service (QoS), and reducing operational costs in dynamic cloud environments. The existing forecasting approaches predominantly estimate future CPU workload directly from historical resource traces, which often overlook the relationship between customer service demand and subsequent resource consumption. This study proposes a two-stage integrated forecasting model that explicitly models this dependency by first forecasting customer service requests, expressed as Transactions Per Second (TPS), and subsequently estimating future CPU workload from the TPS forecast. Both the forecasting component and resource prediction component employed the XGBoost model within a cascaded learning architecture, complemented by adaptive online retraining using an expanding-window strategy to address concept drift in continuously evolving cloud workloads. The proposed work was evaluated using real-world traces collected from a private cloud environment comprising ten applications. Experimental results demonstrate robust forecasting performance by achieving Symmetric Mean Absolute Percentage Error (SMAPE) below $7\%$ for most applications, with the best-performing application achieving an MAE of $0.7372$, RMSE of $1.1866$, SMAPE of $3.57\%$, and an R2 of $0.9185$. Horizon-wise drift analysis confirmed stable recursive forecasting behavior with controlled error accumulation across a 60-step prediction horizon. Compared with the conventional direct CPU forecasting method, the proposed two-stage integrated model gives improved forecasting robustness, computational efficiency, and interpretability, making it well-suited for proactive resource management and intelligent auto-scaling in cloud computing environments.

Related papers

• ScaleSense: Cost-Intelligent Scaling Framework via Learned Resource Estimation in Alibaba AnalyticDB [59.708423132520515]
  Cloud-native serverless data warehouses achieve fine-grained elasticity by decoupling storage from compute.<n>Yet determining the optimal resource allocation for highly heterogeneous ad-hoc queries remains a formidable industrial challenge.<n>We propose ScaleSense, a proactive, query-level resource scaling framework.
  arXiv  Detail & Related papers  (2026-08-08T06:10:35Z)
• An Auto-Scaling Approach for Serverless Environments Based on a Multi-Expert Consensus Mechanism [0.3058685580689604]
  dependency-aware autoscaling framework integrates graph-based bottleneck identification, short-term workload forecasting, multi-model consensus, and cost-aware control.<n>Controller incorporates cold-start awareness and cost comparison to select among scale-up, scale-down, and hold actions.
  arXiv  Detail & Related papers  (2026-07-16T23:48:37Z)
• CastFlow: Learning Role-Specialized Agentic Workflows for Time Series Forecasting [74.29761960394848]
  We propose CastFlow, a dynamic agentic forecasting framework for large language models (LLMs)<n>CastFlow organizes the forecasting process into planning, action, forecasting, and reflection, establishing an agentic workflow.<n>Third, CastFlow adopts a role-specialized design that combines general-purpose reasoning with specialized numerical forecasting.
  arXiv  Detail & Related papers  (2026-04-30T13:24:42Z)
• $V_{0.5}$: Generalist Value Model as a Prior for Sparse RL Rollouts [81.48669089692189]
  Generalist Value Models (such as $V_0.5$) achieve pre-trained value estimation by explicitly encoding model capabilities in-context.<n>We propose $V_0.5$, which adaptively fuses the baseline predicted by such value model with the empirical mean derived from sparse rollouts.<n>$V_0.5$ significantly outperforms GRPO and DAPO, achieving faster convergence and over some 10% performance improvement.
  arXiv  Detail & Related papers  (2026-03-11T14:57:41Z)
• Artificial Intelligence for Cost-Aware Resource Prediction in Big Data Pipelines [0.0]
  Over-provisioning leads to unnecessary costs, while under-provisioning risks performance degradation and SLA violations.<n>This work presents an artificial intelligence approach to predict resource utilization in big data pipelines using Random Forest regression.
  arXiv  Detail & Related papers  (2025-09-30T20:01:12Z)
• Online Ensemble Transformer for Accurate Cloud Workload Forecasting in Predictive Auto-Scaling [9.687789919349523]
  We propose a novel online ensemble model, E3Former, for online workload forecasting in large-scale predictive auto-scaling.<n>Our model synergizes the predictive capabilities of multipleworks to surmount the limitations of single-model approaches.<n>Our method has been deployed within ByteDance's Intelligent Horizontal Pod Auto-scaling (IHPA) platform.
  arXiv  Detail & Related papers  (2025-08-18T09:48:12Z)
• Hybrid Forecasting of Geopolitical Events [71.73737011120103]
  SAGE is a hybrid forecasting system that combines human and machine generated forecasts.<n>The system aggregates human and machine forecasts weighting both for propinquity and based on assessed skill.<n>We show that skilled forecasters who had access to machine-generated forecasts outperformed those who only viewed historical data.
  arXiv  Detail & Related papers  (2024-12-14T22:09:45Z)
• Hierarchical Forecasting at Scale [55.658563862299495]
  Existing hierarchical forecasting techniques scale poorly when the number of time series increases. We propose to learn a coherent forecast for millions of time series with a single bottom-level forecast model. We implement our sparse hierarchical loss function within an existing forecasting model at bol, a large European e-commerce platform.
  arXiv  Detail & Related papers  (2023-10-19T15:06:31Z)
• Streaming Motion Forecasting for Autonomous Driving [71.7468645504988]
  We introduce a benchmark that queries future trajectories on streaming data and we refer to it as "streaming forecasting" Our benchmark inherently captures the disappearance and re-appearance of agents, which is a safety-critical problem yet overlooked by snapshot-based benchmarks. We propose a plug-and-play meta-algorithm called "Predictive Streamer" that can adapt any snapshot-based forecaster into a streaming forecaster.
  arXiv  Detail & Related papers  (2023-10-02T17:13:16Z)
• A Predictive Autoscaler for Elastic Batch Jobs [8.354712625979776]
  Large batch jobs such as Deep Learning, HPC and Spark require far more computational resources and higher cost than conventional online service. We propose a predictive autoscaler to provide an elastic interface for the customers and overprovision instances.
  arXiv  Detail & Related papers  (2020-10-10T17:35:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.