RESCORE: LLM-Driven Simulation Recovery in Control Systems Research Papers

• URL: http://arxiv.org/abs/2604.04324v1
• Date: Mon, 06 Apr 2026 00:13:14 GMT
• Title: RESCORE: LLM-Driven Simulation Recovery in Control Systems Research Papers
• Abstract summary: Reconstructing numerical simulations from control systems research papers is often hindered by underspecified parameters and ambiguous implementation details.<n>We define the task of Paper to Simulation Recoverability, the ability of an automated system to generate executable code that faithfully reproduces a paper's results.<n>We propose RESCORE, a three component LLM agentic framework, Analyzer, Coder, and Verifier.<n>Our method successfully recovers task coherent simulations for 40.7% of benchmark instances, outperforming single pass generation.
• Score: 18.24843021913362
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Reconstructing numerical simulations from control systems research papers is often hindered by underspecified parameters and ambiguous implementation details. We define the task of Paper to Simulation Recoverability, the ability of an automated system to generate executable code that faithfully reproduces a paper's results. We curate a benchmark of 500 papers from the IEEE Conference on Decision and Control (CDC) and propose RESCORE, a three component LLM agentic framework, Analyzer, Coder, and Verifier. RESCORE uses iterative execution feedback and visual comparison to improve reconstruction fidelity. Our method successfully recovers task coherent simulations for 40.7% of benchmark instances, outperforming single pass generation. Notably, the RESCORE automated pipeline achieves an estimated 10X speedup over manual human replication, drastically cutting the time and effort required to verify published control methodologies. We will release our benchmark and agents to foster community progress in automated research replication.

Related papers

• AgentR A Stateful and Recovery-Aware Software Architecture for LLM-based Auditable Workflows [14.042464830509864]
  AgentR represents research intent, generated queries, candidate paper assessments and gap analyses as durable workflow artifacts.<n>The design includes explicit processing state transitions, retries with exponential backoff, credit-aware pre-checks, ACID token-cost logging, and Type-2 slowly changing pricing records.<n>At the LLM stage, the system achieves 99.2% job completion, and mean latencies of 9.0 s, 18.9 s, and 25.4 s for intent decomposition, query generation, and paper scoring.
  arXiv  Detail & Related papers  (2026-08-15T14:51:43Z)
• A-SR: Self-Evolving Agentic LLMs for Symbolic Regression via Hierarchical Coordination [51.06539604709775]
  We propose A-SR, a self-evolving agentic framework that shifts the control unit from expression edits to role-conditioned evidence views.<n>A-SR coordinates formula discovery through routing among coordination protocols, an online evaluator-reward role policy, and state-routed process memory.
  arXiv  Detail & Related papers  (2026-08-05T14:01:10Z)
• AutoResearch: An Execution-Grounded Multi-Agent Framework for Reliable Research Workflow Automation [8.807417226975081]
  AutoResearch is an execution-grounded multi-agent framework for reliable research workflow automation.<n>System treats errors, citation-verification failures, and review-agent feedback as practical filtering signals for generated research artifacts.
  arXiv  Detail & Related papers  (2026-05-04T08:24:21Z)
• Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learning [79.88942231770629]
  Reinforcement learning (RL) has become a central post-training tool for improving the reasoning abilities of large language models (LLMs)<n>We formalize rollout pipelines with unified notation and introduce Generate-Filter-Control-Replay (GFCR)<n>We synthesize methods spanning RL with verifiable rewards, process supervision, judge-based gating, guided and tree/segment rollouts, adaptive compute allocation, early-exit and partial rollouts, throughput optimization, and replay/recomposition for self-improvement.
  arXiv  Detail & Related papers  (2026-04-08T00:53:29Z)
• AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discovery [49.77172027295716]
  AutoSOTA is an end-to-end automated research system that advances the latest State-Of-The-Art (SOTA) models published in top-tier AI papers.<n>It successfully discovers 105 new SOTA models that surpass the original reported methods, averaging approximately five hours per paper.
  arXiv  Detail & Related papers  (2026-04-07T07:52:01Z)
• Understanding by Reconstruction: Reversing the Software Development Process for LLM Pretraining [66.89012795621349]
  Large Language Models (LLMs) often struggle with the deep, long-horizon reasoning required for complex software engineering.<n>We propose a novel paradigm: understanding via reconstruction.<n>We introduce a framework that synthesizes latent agentic trajectories using a multi-agent simulation.
  arXiv  Detail & Related papers  (2026-03-11T09:23:20Z)
• PaperRepro: Automated Computational Reproducibility Assessment for Social Science Papers [33.12402746591649]
  PaperRepro is a novel two-stage, multi-agent approach for automated assessment.<n>In the execution stage, agents execute the reproduction package and edit the code to capture reproduced results as explicit artifacts.<n>In the evaluation stage, agents evaluate agents using explicit evidence.
  arXiv  Detail & Related papers  (2026-02-10T09:04:59Z)
• Autonomous Control Leveraging LLMs: An Agentic Framework for Next-Generation Industrial Automation [0.0]
  We introduce a unified agentic framework that leverages large language models (LLMs) for both discrete fault-recovery planning and continuous process control.<n>Our results demonstrate that, with structured feedback and modular agents, LLMs can unify high-level symbolic planningand low-level continuous control.
  arXiv  Detail & Related papers  (2025-07-03T11:20:22Z)
• AutoReproduce: Automatic AI Experiment Reproduction with Paper Lineage [62.049868205196425]
  AutoReproduce is a framework capable of automatically reproducing experiments described in research papers in an end-to-end manner.<n>Results show that AutoReproduce achieves an average performance gap of $22.1%$ on $89.74%$ of the executable experiment runs.
  arXiv  Detail & Related papers  (2025-05-27T03:15:21Z)
• Optimizing Case-Based Reasoning System for Functional Test Script Generation with Large Language Models [18.24326624696047]
  We propose a case-based reasoning (CBR) system, which maintains and leverages a case bank of test intent descriptions and corresponding test scripts.<n>To improve user experience further, we introduce Re4, an optimization method for the CBR system, comprising reranking-based retrieval finetuning and reinforced reuse finetuning.
  arXiv  Detail & Related papers  (2025-03-26T14:23:59Z)
• Optimizing Coverage-Driven Verification Using Machine Learning and PyUVM: A Novel Approach [2.3624953088402734]
  The complexity of System-on-Chip (SoC) designs has created a bottleneck in verification.<n>Existing verification techniques rely on time-consuming and redundant simulation regression.<n>We propose a novel methodology that leverages supervised Machine Learning (ML) to optimize simulation regressions.
  arXiv  Detail & Related papers  (2025-02-23T17:54:23Z)
• Chain-of-Retrieval Augmented Generation [91.02950964802454]
  This paper introduces an approach for training o1-like RAG models that retrieve and reason over relevant information step by step before generating the final answer.<n>Our proposed method, CoRAG, allows the model to dynamically reformulate the query based on the evolving state.
  arXiv  Detail & Related papers  (2025-01-24T09:12:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.