A Predict-then-Correct Loop Based on Few-Shot Continuous Contextual Bandit for Demand Forecasting

• URL: http://arxiv.org/abs/2607.16354v1
• Date: Fri, 17 Jul 2026 08:21:15 GMT
• Title: A Predict-then-Correct Loop Based on Few-Shot Continuous Contextual Bandit for Demand Forecasting
• Abstract summary: This study proposes a predict-then-correct (PtC) framework that retains a first-stage machine learning (ML) forecast and applies a few-shot continuous bandit correction policy.<n>Across Walmart retail data, PtC delivers statistically significant reductions in MAPE, MAE, and RMSE across stable & high volume, stable & low volume, and erratic & intermittent demand patterns.<n>These findings show that online forecast correction can bridge offline demand learning and real-time retail decision-making by adapting to sparse feedback without fully retraining the base forecasting model.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Retail demand forecasting remains difficult when demand shifts faster than static forecasting models can be retrained, especially in early demand cycles where newly observed labels are sparse. To address this, this study aims to improve adaptive retail forecasting by proposing a predict-then-correct (PtC) framework that retains a first-stage machine learning (ML) forecast and applies a few-shot continuous contextual bandit correction policy with similar-SKUs augmentation and top-p masked updating. Across Walmart retail data and an exclusive beverage dataset, PtC delivers statistically significant reductions in MAPE, MAE, and RMSE across stable & high volume, stable & low volume, and erratic & intermittent demand patterns, improves average RMSE by 9.52% over the ML-only baseline in the ablation study, and yields lower inventory costs than base-stock, proximal policy optimization, and soft actor-critic policies under the tested lead-time settings. These findings show that online forecast correction can bridge offline demand learning and real-time retail decision-making by adapting to sparse feedback without fully retraining the base forecasting model.

Related papers

• Censoring-Aware In-Context Learning for Generalized Supplier Lead Time Estimation in Supply Chain Planning [31.58956095041944]
  We propose LeadTime-ICL, a censoring-aware in-context learning model for probabilistic lead time forecasting.<n> LT-ICL combines a transformer backbone with a conditional normalizing-flow head, producing a full predictive distribution over lead times.<n>We evaluate LT-ICL on 24 proprietary supply-chain datasets spanning seven industries.
  arXiv  Detail & Related papers  (2026-07-20T21:45:43Z)
• Ratio-Variance Regularized Policy Optimization [64.95520246570446]
  We show that explicitly constraining the policy ratio variance provides a principled local approximation to trust-region constraints.<n>We introduce $bf R2bf VPO$ (Ratio-Variance Regularized Policy Optimization), which implements this constraint via a primal-dual optimization framework.
  arXiv  Detail & Related papers  (2026-05-26T09:53:42Z)
• Hedging Memory Horizons for Non-Stationary Prediction via Online Aggregation [6.623965101885557]
  MELO is a model-agnostic method that hedges across adaptation scales.<n>It wraps any non-anticipating base-predictor pool with exponentially weighted least-squares adaptation experts.<n>It aggregates raw and EWLS-adapted forecasts with MLpol, a parameter-free online aggregation rule.
  arXiv  Detail & Related papers  (2026-05-07T16:38:21Z)
• A Step Back: Prefix Importance Ratio Stabilizes Policy Optimization [58.116300485427764]
  Reinforcement learning post-training can elicit reasoning behaviors in large language models.<n> token-level correction often leads to unstable training dynamics when the degree of off-policyness is large.<n>We propose a simple yet effective objective, Minimum Prefix Ratio (MinPRO)
  arXiv  Detail & Related papers  (2026-01-30T08:47:19Z)
• Ratio-Variance Regularized Policy Optimization for Efficient LLM Fine-tuning [48.34492357368989]
  We propose a primal-dual framework that supports stable on-policy learning and enables principled off-policy data reuse.<n>$R2VPO$ achieves superior performance with average relative gains of up to 17% over strong clipping-based baselines.
  arXiv  Detail & Related papers  (2026-01-06T14:01:42Z)
• Optimization of Deep Learning Models for Dynamic Market Behavior Prediction [4.594360512414794]
  We study multi-horizon demand forecasting on e-commerce transactions using the UCI Online Retail II dataset.<n>We present a hybrid sequence model that combines multi-scale temporal convolutions, a gated recurrent module, and time-aware self-attention.<n>Results show consistent accuracy gains and improved on peak/holiday periods.
  arXiv  Detail & Related papers  (2025-11-24T13:30:52Z)
• BAPO: Stabilizing Off-Policy Reinforcement Learning for LLMs via Balanced Policy Optimization with Adaptive Clipping [69.74252624161652]
  We propose BAlanced Policy Optimization with Adaptive Clipping (BAPO)<n>BAPO dynamically adjusts clipping bounds to adaptively re-balance positive and negative contributions, preserve entropy, and stabilize RL optimization.<n>On AIME 2024 and AIME 2025 benchmarks, our 7B BAPO model surpasses open-source counterparts such as SkyWork-OR1-7B.
  arXiv  Detail & Related papers  (2025-10-21T12:55:04Z)
• TAT: Temporal-Aligned Transformer for Multi-Horizon Peak Demand Forecasting [51.37167759339485]
  We propose Temporal-Aligned Transformer (TAT), a multi-horizon forecaster leveraging apriori-known context variables for improving predictive performance.<n>Our model consists of an encoder and decoder, both embedded with a novel Temporal Alignment Attention (TAA) designed to learn context-dependent alignment for peak demand forecasting.<n>We demonstrate that TAT brings up to 30% accuracy on peak demand forecasting while maintaining competitive overall performance compared to other state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-07-14T14:51:24Z)
• Intelligent Routing for Sparse Demand Forecasting: A Comparative Evaluation of Selection Strategies [0.6798775532273751]
  parse and intermittent demand forecasting in supply chains presents a critical challenge.<n>We propose a Model-spanning framework that selects the most suitable forecasting model-spanning classical, ML, and DL methods for each product.<n>Experiments on the large-scale Favorita dataset show our deep learning (Inception Time) router improves forecasting accuracy by up to 11.8%.
  arXiv  Detail & Related papers  (2025-06-04T03:09:45Z)
• ReAugment: Model Zoo-Guided RL for Few-Shot Time Series Augmentation and Forecasting [74.00765474305288]
  We present a pilot study on using reinforcement learning (RL) for time series data augmentation.<n>Our method, ReAugment, tackles three critical questions: which parts of the training set should be augmented, how the augmentation should be performed, and what advantages RL brings to the process.
  arXiv  Detail & Related papers  (2024-09-10T07:34:19Z)
• F-FOMAML: GNN-Enhanced Meta-Learning for Peak Period Demand Forecasting with Proxy Data [65.6499834212641]
  We formulate the demand prediction as a meta-learning problem and develop the Feature-based First-Order Model-Agnostic Meta-Learning (F-FOMAML) algorithm. By considering domain similarities through task-specific metadata, our model improved generalization, where the excess risk decreases as the number of training tasks increases. Compared to existing state-of-the-art models, our method demonstrates a notable improvement in demand prediction accuracy, reducing the Mean Absolute Error by 26.24% on an internal vending machine dataset and by 1.04% on the publicly accessible JD.com dataset.
  arXiv  Detail & Related papers  (2024-06-23T21:28:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.