A Human-in-the-Loop Autonomous Agent for Industry Time Series Forecasting

• URL: http://arxiv.org/abs/2608.30976v1
• Date: Mon, 31 Aug 2026 15:36:41 GMT
• Title: A Human-in-the-Loop Autonomous Agent for Industry Time Series Forecasting
• Abstract summary: We present CastClaw, a forecasting system built through forecasting-oriented harness engineering.<n>CastClaw connects data, specialized models, analytical tools, user input, and a versioned execution record in one runtime.<n>CastClaw was validated offline on provincial electricity-load data from North China covering January--June 2026.
• Score: 48.586399370741965
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Real-world time-series forecasting is rarely a one-shot model invocation: practitioners must formulate tasks, connect data and models, incorporate domain expertise, assess prediction plausibility, and communicate uncertainty. Specialized forecasting models provide strong numerical predictions but usually operate in fixed pipelines, while general-purpose large language model (LLM) agents often lack forecasting-specific checks, constraints, and stopping rules. We present CastClaw, a human-in-the-loop autonomous forecasting system built through forecasting-oriented harness engineering. CastClaw connects data, specialized models, analytical tools, user input, and a versioned execution record in one runtime. Users specify the target, horizon, constraints, and hypotheses in natural language. Starting from a supplied or model-generated forecast, CastClaw checks temporal patterns and user constraints; when evidence is missing, it retrieves context, runs an analysis or another model, or asks the user. It then keeps, revises, or escalates the result under explicit stopping conditions. The output contains the final forecast and an execution report recording inputs, evidence, actions, and revisions. In this five-dataset electricity-price setting, CastClaw reports the lowest point-estimate MSE and MAE among 16 baselines. A Nord Pool case demonstrates the inspectable workflow. CastClaw was also validated offline on provincial electricity-load data from North China covering January--June 2026.

Related papers

• From Narrative to Auditable Forecasts: A Structured Scaffold for Agentic Forecasting [28.10023756949099]
  AuditForecast is an agentic scaffold for structured probabilistic forecasting.<n>It anchors the forecast with a suitable quantitative baseline model, uses model-guided data retrieval to derive a base probability, and then applies situational factor updates outside the model's scope.<n> AuditForecast produces an auditable forecasting report that makes forecast construction explicit and supports systematic post hoc analysis.
  arXiv  Detail & Related papers  (2026-09-05T05:58:39Z)
• LLM-based Agents for Forecasting and Prediction: Methods, Training, Evaluation, and Applications [76.41731220830714]
  Large language models (LLMs) now support forecasting systems that combine language-based reasoning with temporal data, evidence retrieval, external tools, and iterative prediction.<n>We examine applications in finance, weather, health, energy, and operations, and we summarize the benchmarks and datasets used for evaluation.
  arXiv  Detail & Related papers  (2026-08-24T10:02:39Z)
• Bridging the Last Mile of Time Series Forecasting with LLM Agents [0.6416429054645992]
  In real-world forecasting settings, a statistically plausible baseline is rarely the final forecast used in practice.<n>This practical stage remains underexplored in the forecasting literature.<n>We present an LLM-agent framework that sits on top of a forecasting backbone.
  arXiv  Detail & Related papers  (2026-06-01T17:03:40Z)
• Nexus : An Agentic Framework for Time Series Forecasting [72.73790673303154]
  Time series forecasting requires reasoning with unstructured contextual data such as news or events.<n>We introduce Nexus, a multi-agent forecasting framework that decomposes prediction into specialized stages.<n>We show that current-generation LLMs possess substantially stronger intrinsic forecasting ability than previously recognized.
  arXiv  Detail & Related papers  (2026-05-14T05:12:13Z)
• CastFlow: Learning Role-Specialized Agentic Workflows for Time Series Forecasting [74.29761960394848]
  We propose CastFlow, a dynamic agentic forecasting framework for large language models (LLMs)<n>CastFlow organizes the forecasting process into planning, action, forecasting, and reflection, establishing an agentic workflow.<n>Third, CastFlow adopts a role-specialized design that combines general-purpose reasoning with specialized numerical forecasting.
  arXiv  Detail & Related papers  (2026-04-30T13:24:42Z)
• Evaluation of a Foundational Model and Stochastic Models for Forecasting Sporadic or Spiky Production Outages of High-Performance Machine Learning Services [0.0]
  We optimize a state-of-the-art foundational model to forecast sporadic or spiky production outages of high-performance machine learning services.<n>The analysis helps us understand how each of the evaluated models performs for the sporadic or spiky events.<n>We use the models with optimal parameters to estimate a year-long outage statistics of a particular root cause with less than 6% value errors.
  arXiv  Detail & Related papers  (2025-06-30T23:59:12Z)
• Consistency Checks for Language Model Forecasters [54.62507816753479]
  We measure the performance of forecasters in terms of the consistency of their predictions on different logically-related questions.<n>We build an automated evaluation system that generates a set of base questions, instantiates consistency checks from these questions, elicits predictions of the forecaster, and measures the consistency of the predictions.
  arXiv  Detail & Related papers  (2024-12-24T16:51:35Z)
• Counterfactual Explanations for Time Series Forecasting [14.03870816983583]
  We formulate the novel problem of counterfactual generation for time series forecasting, and propose an algorithm, called ForecastCF. ForecastCF solves the problem by applying gradient-based perturbations to the original time series. Our results show that ForecastCF outperforms the baseline in terms of counterfactual validity and data manifold closeness.
  arXiv  Detail & Related papers  (2023-10-12T08:51:59Z)
• Greykite: Deploying Flexible Forecasting at Scale at LinkedIn [11.769823455954599]
  At LinkedIn, product owners use forecasts to set business targets, track outlook, and monitor health. We present Greykite, an open-source Python library for forecasting that has been deployed on over twenty use cases at LinkedIn. Our benchmark results show excellent out-of-the-box speed and accuracy on datasets from a variety of domains.
  arXiv  Detail & Related papers  (2022-07-15T23:57:10Z)
• Selective Prediction via Training Dynamics [31.708701583736644]
  We show that state-of-the-art selective prediction performance can be attained solely from studying the training dynamics of a model.<n>In particular, we reject data points exhibiting too much disagreement with the final prediction at late stages in training.<n>The proposed rejection mechanism is domain-agnostic (i.e., it works for both discrete and real-valued prediction) and can be flexibly combined with existing selective prediction approaches.
  arXiv  Detail & Related papers  (2022-05-26T17:51:29Z)
• AutoCP: Automated Pipelines for Accurate Prediction Intervals [84.16181066107984]
  This paper proposes an AutoML framework called Automatic Machine Learning for Conformal Prediction (AutoCP) Unlike the familiar AutoML frameworks that attempt to select the best prediction model, AutoCP constructs prediction intervals that achieve the user-specified target coverage rate. We tested AutoCP on a variety of datasets and found that it significantly outperforms benchmark algorithms.
  arXiv  Detail & Related papers  (2020-06-24T23:13:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.