Diffusion-Based Scenario Tree Generation for Multivariate Time Series Prediction and Multistage Stochastic Optimization

• URL: http://arxiv.org/abs/2509.14832v1
• Date: Thu, 18 Sep 2025 10:49:05 GMT
• Title: Diffusion-Based Scenario Tree Generation for Multivariate Time Series Prediction and Multistage Stochastic Optimization
• Authors: Stelios Zarifis, Ioannis Kordonis, Petros Maragos,
• Abstract summary: Diffusion Scenario Tree (DST) is a general framework for constructing scenario trees for multivariate prediction tasks.<n>We evaluate the framework on the optimization task of energy arbitrage in New York State's day-ahead electricity market.
• Score: 16.795461001108098
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Stochastic forecasting is critical for efficient decision-making in uncertain systems, such as energy markets and finance, where estimating the full distribution of future scenarios is essential. We propose Diffusion Scenario Tree (DST), a general framework for constructing scenario trees for multivariate prediction tasks using diffusion-based probabilistic forecasting models. DST recursively samples future trajectories and organizes them into a tree via clustering, ensuring non-anticipativity (decisions depending only on observed history) at each stage. We evaluate the framework on the optimization task of energy arbitrage in New York State's day-ahead electricity market. Experimental results show that our approach consistently outperforms the same optimization algorithms that use scenario trees from more conventional models and Model-Free Reinforcement Learning baselines. Furthermore, using DST for stochastic optimization yields more efficient decision policies, achieving higher performance by better handling uncertainty than deterministic and stochastic MPC variants using the same diffusion-based forecaster.

Related papers

• Synapse: Adaptive Arbitration of Complementary Expertise in Time Series Foundational Models [50.877082340479085]
  We study how different Time Series Foundational Models (TSFMs) exhibit specialized performance profiles across various forecasting settings.<n>We propose Synapse, a novel arbitration framework for TSFMs.<n>Results demonstrate that Synapse consistently outperforms other popular ensembling techniques as well as individual TSFMs.
  arXiv  Detail & Related papers  (2025-11-07T18:01:51Z)
• How to model Human Actions distribution with Event Sequence Data [22.25731364559209]
  We study the forecasting of the future distribution of events in human action sequences.<n>We find that a simple explicit distribution forecasting objective consistently surpasses complex implicit baselines.<n>This work provides a principled framework for selecting modeling strategies and offers practical guidance for building more accurate and robust forecasting systems.
  arXiv  Detail & Related papers  (2025-10-07T12:24:54Z)
• Diffusion-Based Forecasting for Uncertainty-Aware Model Predictive Control [22.60091645818101]
  We propose Diffusion-Informed Model Predictive Control (DI MPC), a generic framework for uncertainty-aware prediction and decision-making in partially observable systems.<n>In our approach, a diffusion-based time series forecasting model is used to probabilistically estimate the evolution of the system's components.<n>We evaluate the framework on the task of energy arbitrage, where a Battery Energy Storage System participates in the day-to-day electricity market of the New York state.
  arXiv  Detail & Related papers  (2025-03-19T10:48:26Z)
• Decision-Focused Fine-Tuning of Time Series Foundation Models for Dispatchable Feeder Optimization [0.5808168734833972]
  We use decision-focused fine-tuning within time series foundation models to offer a scalable and efficient solution for the dispatchable feeder optimization problem.<n>To obtain more robust predictions for scarce building data, we use Moirai as a state-of-the-art foundation model.<n>Comparing the decision-focused fine-tuned Moirai with a state-of-the-art classical prediction-focused fine-tuning Morai, we observe an improvement of 9.45% in average total daily costs.
  arXiv  Detail & Related papers  (2025-03-03T07:47:20Z)
• Global-Decision-Focused Neural ODEs for Proactive Grid Resilience Management [50.34345101758248]
  We propose predict-all-then-optimize-globally (PATOG), a framework that integrates outage prediction with globally optimized interventions.<n>Our approach ensures spatially and temporally coherent decision-making, improving both predictive accuracy and operational efficiency.<n>Experiments on synthetic and real-world datasets demonstrate significant improvements in outage prediction consistency and grid resilience.
  arXiv  Detail & Related papers  (2025-02-25T16:15:35Z)
• Ensemble Prediction via Covariate-dependent Stacking [0.0]
  This study proposes a novel approach to ensemble prediction, called co-dependent stacking'' (CDST) Unlike traditional stacking methods, CDST allows model weights to vary flexibly as a function of covariates, thereby enhancing predictive performance in complex scenarios. Our findings suggest that the CDST is especially valuable for, but not limited to,temporal-temporal prediction problems, offering a powerful tool for researchers and practitioners in various data analysis fields.
  arXiv  Detail & Related papers  (2024-08-19T07:31:31Z)
• When Rigidity Hurts: Soft Consistency Regularization for Probabilistic Hierarchical Time Series Forecasting [69.30930115236228]
  Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting. Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions. We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
  arXiv  Detail & Related papers  (2023-10-17T20:30:16Z)
• When Rigidity Hurts: Soft Consistency Regularization for Probabilistic Hierarchical Time Series Forecasting [69.30930115236228]
  Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting. Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions. We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
  arXiv  Detail & Related papers  (2022-06-16T06:13:53Z)
• Deep-Ensemble-Based Uncertainty Quantification in Spatiotemporal Graph Neural Networks for Traffic Forecasting [2.088376060651494]
  We focus on a diffusion convolutional recurrent neural network (DCRNN), a state-of-the-art method for short-term traffic forecasting. We develop a scalable deep ensemble approach to quantify uncertainties for DCRNN. We show that our generic and scalable approach outperforms the current state-of-the-art Bayesian and a number of other commonly used frequentist techniques.
  arXiv  Detail & Related papers  (2022-04-04T16:10:55Z)
• Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting [98.57851612518758]
  Probabilistic time series forecasting involves estimating the distribution of future based on its history. We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks. We show in experiments that our model produces accurate and sharp probabilistic forecasts.
  arXiv  Detail & Related papers  (2021-01-31T06:49:33Z)
• Probabilistic electric load forecasting through Bayesian Mixture Density Networks [70.50488907591463]
  Probabilistic load forecasting (PLF) is a key component in the extended tool-chain required for efficient management of smart energy grids. We propose a novel PLF approach, framed on Bayesian Mixture Density Networks. To achieve reliable and computationally scalable estimators of the posterior distributions, both Mean Field variational inference and deep ensembles are integrated.
  arXiv  Detail & Related papers  (2020-12-23T16:21:34Z)
• Probabilistic multivariate electricity price forecasting using implicit generative ensemble post-processing [0.0]
  We use a likelihood-free implicit generative model based on an ensemble of point forecasting models to generate multivariate electricity price scenarios. Our ensemble post-processing method outperforms well-established model combination benchmarks. As our method works on top of an ensemble of domain-specific expert models, it can readily be deployed to other forecasting tasks.
  arXiv  Detail & Related papers  (2020-05-27T15:22:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.