HydroAgent: Closing the Gap Between Frontier LLMs and Human Experts in Hydrologic Model Calibration via Simulator-Grounded RL

• URL: http://arxiv.org/abs/2605.17792v1
• Date: Mon, 18 May 2026 03:17:38 GMT
• Title: HydroAgent: Closing the Gap Between Frontier LLMs and Human Experts in Hydrologic Model Calibration via Simulator-Grounded RL
• Abstract summary: Calibrating distributed hydrologic models is a critical bottleneck across operational water resources management.<n>We ask: can frontier large language model (LLM) agents replace the human hydrologic modeler, and if not, what would it take?<n>We benchmark nine frontier LLM agents on the operational CREST distributed hydrologic model used by the U.S. National Weather Service for flash-flood forecasting.
• Score: 6.680830184790049
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Calibrating distributed hydrologic models is a critical bottleneck across operational water resources management - streamflow prediction, reservoir operation, drought monitoring, infrastructure design, and flood forecasting all depend on it. Each basin demands an expert to translate hydrograph signatures into adjustments of a high-dimensional parameter vector, and the resulting workflow does not transfer between watersheds. We ask: can frontier large language model (LLM) agents replace the human hydrologic modeler, and if not, what would it take? We benchmark nine frontier LLM agents - Claude Opus 4.6/4.7, Sonnet 4.6, GPT-5/5.4/5.4-pro, and Gemini 2.5-pro/3.1-pro/3-flash - on the operational CREST distributed hydrologic model used by the U.S. National Weather Service for flash-flood forecasting. Best-of-twenty-rounds Nash-Sutcliffe Efficiency (NSE) across four held-out gauges spanning 329-40,792 km2 ranges from -0.16 (GPT-5.4) to 0.75 (Sonnet 4.6); the ceiling reproduces across all three vendors and capability tiers, with the strongest models concentrating in the 0.65-0.75 band, and no model reaches the human-expert reference except Opus-4.7 on one gauge. We argue this gap is not a parameter-count problem but a domain-grounding problem. We then propose HYDROAGENT, fine-tuning open-weight Qwen3-4B with supervised fine-tuning on 2,576 expert calibration trajectories and Group-Relative Policy Optimization using NSE as a verifiable reward from online CREST simulations - reinforcement learning with simulation feedback (RLSF). For Earth system science, a small domain-tuned policy with simulator-in-the-loop RL is a more compute-efficient and physically faithful path than scaling generic frontier models, and the multi-modal richness of Earth data - remote sensing, in-situ time series, and forecaster narrative - makes domain agents a leveraged direction for AI in physical science.

Related papers

• FlowATC: Aircraft Trajectory Prediction via Flow Matching [39.046509366232065]
  We present a flow-matching architecture trained exclusively on historical aircraft trajectories, with no route labels or chart supervision.<n>Our model is trained directly on the native, irregular ADS-B sampling interval.<n>We show that the error degrades gracefully with prediction horizon, and the architecture remains effective when retrained on temporally decimated feeds.
  arXiv  Detail & Related papers  (2026-09-15T02:21:06Z)
• Neural Operators for Immersed-Boundary Soft Swimmers Locomotion [1.9197165133437375]
  High-fidelity immersed-boundary simulation resolves the coupled motion of a deforming swimmer and its surrounding flow.<n>We develop neural-operator surrogates for temporal prediction of the hydrodynamic fields generated by swimmers.
  arXiv  Detail & Related papers  (2026-08-07T19:19:34Z)
• Tyche: One Step Flow for Efficient Probabilistic Weather Forecasting [48.263481135566316]
  We present Tyche, a one-step conditional flow model for efficient probabilistic weather forecasting.<n>Experiments on ERA5 at 1.5$circ$ and 6-hour resolution show that our Tyche, using merely a single NFE, matches or exceeds the forecast skill and calibration of state-of-the-art multi-step generative baselines.
  arXiv  Detail & Related papers  (2026-05-07T20:25:28Z)
• Stargazer: A Scalable Model-Fitting Benchmark Environment for AI Agents under Astrophysical Constraints [48.80158223838359]
  We introduce Stargazer, a scalable environment for evaluating AI agents on dynamic, iterative physics-grounded model-fitting tasks.<n>Stargazer comprises 120 tasks across three difficulty tiers, including 20 real archival cases.<n>Our evaluation of eight frontier agents reveals a gap between numerical optimization and adherence to physical constraints.
  arXiv  Detail & Related papers  (2026-04-17T03:38:50Z)
• AIFL: A Global Daily Streamflow Forecasting Model Using Deterministic LSTM Pre-trained on ERA5-Land and Fine-tuned on IFS [0.39918810815847444]
  This paper introduces AIFL (Artificial Intelligence for Floods), a deterministic LSTM-based model for global daily streamflow forecasting.<n>It is trained on 18,588 basins curated from the CARAVAN dataset.<n> Benchmarking results show that AIFL is highly competitive with current state-of-the-art global systems.
  arXiv  Detail & Related papers  (2026-02-18T16:26:36Z)
• AgentCPM-Explore: Realizing Long-Horizon Deep Exploration for Edge-Scale Agents [75.67445299298949]
  AgentCPM-Explore is a compact 4B agent model with high knowledge density and strong exploration capability.<n>We introduce a holistic training framework featuring parameter-space model fusion, reward signal denoising, and contextual information refinement.<n>AgentCPM-Explore achieves state-of-the-art (SOTA) performance among 4B-class models, matches or surpasses 8B-class SOTA models on four benchmarks, and even outperforms larger-scale models such as Claude-4.5-Sonnet or DeepSeek-v3.2 in five benchmarks.
  arXiv  Detail & Related papers  (2026-02-06T08:24:59Z)
• HydroGEM: A Self Supervised Zero Shot Hybrid TCN Transformer Foundation Model for Continental Scale Streamflow Quality Control [2.153503585184628]
  We introduce HydroGEM, a foundation model for continental-scale streamflow quality control.<n>HydroGEM uses two-stage training: self-supervised pretraining on 6.03 million sequences from 3,724 stations.<n>On held-out synthetic tests, HydroGEM F1 = 0.792 for detection and 6 reconstruction-error reduction, a 36.3% improvement over existing methods.
  arXiv  Detail & Related papers  (2025-12-16T05:39:26Z)
• A Space-Time Transformer for Precipitation Forecasting [38.87144329787491]
  SaTformer is a video transformer that skillfully forecasts extreme precipitation from satellite radiances.<n>We reformulate precipitation regression into a classification problem, and employ a class-weighted loss to address label imbalances.<n>Our model scored first place on the NeurIPS Weather4Cast 2025 Cumulative Rainfall challenge.
  arXiv  Detail & Related papers  (2025-11-14T09:10:31Z)
• Accelerating HEC-RAS: A Recurrent Neural Operator for Rapid River Forecasting [0.0]
  This paper introduces a deep learning surrogate that treats HEC-RAS not as a solver but as a data-generation engine.<n>Trained on 67 reaches of the Mississippi River Basin, the surrogate was evaluated on a year-long, unseen hold-out simulation.<n>Results show the model achieves a strong predictive accuracy, with a median absolute stage error of 0.31 feet.
  arXiv  Detail & Related papers  (2025-07-21T13:38:54Z)
• Pix2Geomodel: A Next-Generation Reservoir Geomodeling with Property-to-Property Translation [2.004012818482403]
  This study introduces Pix2Geomodel, a novel conditional generative adversarial network (cGAN) framework based on Pix2Pix.<n>It is designed to predict reservoir properties (facies, porosity, permeability, and water saturation) from the Rotliegend reservoir of the Groningen gas field.<n>Results demonstrated high accuracy for facies (PA 0.88, FWIoU 0.85) and water saturation (PA 0.96, FWIoU 0.95), with moderate success for porosity (PA 0.70, FWIoU 0.55) and permeability (PA 0.74, FWIoU 0.60), and robust translation performance
  arXiv  Detail & Related papers  (2025-06-21T15:58:27Z)
• FlowTS: Time Series Generation via Rectified Flow [67.41208519939626]
  FlowTS is an ODE-based model that leverages rectified flow with straight-line transport in probability space.<n>For unconditional setting, FlowTS achieves state-of-the-art performance, with context FID scores of 0.019 and 0.011 on Stock and ETTh datasets.<n>For conditional setting, we have achieved superior performance in solar forecasting.
  arXiv  Detail & Related papers  (2024-11-12T03:03:23Z)
• GeoFUSE: A High-Efficiency Surrogate Model for Seawater Intrusion Prediction and Uncertainty Reduction [0.10923877073891446]
  Seawater intrusion into coastal aquifers poses a significant threat to groundwater resources. We develop GeoFUSE, a novel deep-learning-based surrogate framework. We apply GeoFUSE to a 2D cross-section of the Beaver Creek tidal stream-floodplain system in Washington State.
  arXiv  Detail & Related papers  (2024-10-26T08:10:32Z)
• Graph Neural Networks for Pressure Estimation in Water Distribution Systems [44.99833362998488]
  Pressure and flow estimation in Water Distribution Networks (WDN) allows water management companies to optimize their control operations. We combine physics-based modeling and Graph Neural Networks (GNN), a data-driven approach, to address the pressure estimation problem. Our GNN-based model estimates the pressure of a large-scale WDN in The Netherlands with a MAE of 1.94mH$$O and a MAPE of 7%.
  arXiv  Detail & Related papers  (2023-11-17T15:30:12Z)
• Rapid Flood Inundation Forecast Using Fourier Neural Operator [77.30160833875513]
  Flood inundation forecast provides critical information for emergency planning before and during flood events. High-resolution hydrodynamic modeling has become more accessible in recent years, however, predicting flood extents at the street and building levels in real-time is still computationally demanding. We present a hybrid process-based and data-driven machine learning (ML) approach for flood extent and inundation depth prediction.
  arXiv  Detail & Related papers  (2023-07-29T22:49:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.