AutoREC: A software platform for developing reinforcement learning agents for equivalent circuit model generation from electrochemical impedance spectroscopy data
- URL: http://arxiv.org/abs/2604.27266v1
- Date: Wed, 29 Apr 2026 23:42:27 GMT
- Title: AutoREC: A software platform for developing reinforcement learning agents for equivalent circuit model generation from electrochemical impedance spectroscopy data
- Abstract summary: AutoREC is a Python package for developing reinforcement learning (RL) agents to automatically generate equivalent circuit models (ECMs) from electrochemical impedance spectroscopy (EIS) data.<n> ECMs are a standard framework for interpreting EIS data, but traditional identification is typically based on manual trial-and-error.
- Score: 5.498964035230184
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This paper introduces AutoREC, an open-source Python package for developing reinforcement learning (RL) agents to automatically generate equivalent circuit models (ECMs) from electrochemical impedance spectroscopy (EIS) data. While ECMs are a standard framework for interpreting EIS data, traditional identification is typically based on manual trial-and-error, which requires domain experts and limits scalability, particularly in autonomous experimental pipelines such as self-driving laboratories. AutoREC addresses this challenge by formulating ECM construction as a sequential decision-making problem within a Markov Decision Process framework. It implements a Double Deep Q-Network with prioritized experience replay, along with a dedicated dead-loop mitigation strategy, to efficiently explore a complex action space for circuit generation. To demonstrate the capabilities of the platform, we trained an RL agent using AutoREC and evaluated its strengths and limitations across diverse datasets, while also discussing possible strategies to mitigate these limitations in future agent designs. The trained agent achieved a success rate exceeding $99.6\%$ on synthetic datasets and demonstrated strong generalization to unseen experimental EIS data from batteries, corrosion, oxygen evolution reaction, and CO$_2$ reduction systems. These results position AutoREC as a promising platform for adaptive and data-driven ECM generation, with potential for integration into automated electrochemical workflows.
Related papers
- AutoOR: Scalably Post-training LLMs to Autoformalize Operations Research Problems [54.593031581486116]
We present AutoOR, a scalable synthetic data generation and reinforcement learning pipeline that trains LLMs to autoformalize optimization problems specified in natural language.<n>AutoOR generates verified training data from standard optimization forms and uses solver execution feedback as the reward signal for RL post-training.<n>We believe that methods such as AutoOR can significantly accelerate industrial decision-making with AI.
arXiv Detail & Related papers (2026-04-18T03:24:54Z) - Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learning [79.88942231770629]
Reinforcement learning (RL) has become a central post-training tool for improving the reasoning abilities of large language models (LLMs)<n>We formalize rollout pipelines with unified notation and introduce Generate-Filter-Control-Replay (GFCR)<n>We synthesize methods spanning RL with verifiable rewards, process supervision, judge-based gating, guided and tree/segment rollouts, adaptive compute allocation, early-exit and partial rollouts, throughput optimization, and replay/recomposition for self-improvement.
arXiv Detail & Related papers (2026-04-08T00:53:29Z) - AutoMIA: Improved Baselines for Membership Inference Attack via Agentic Self-Exploration [49.050688065974605]
Membership Inference Attacks (MIAs) serve as a fundamental auditing tool for evaluating training data leakage in machine learning models.<n>We propose AutoMIA, an agentic framework that reformulates membership inference as an automated process of self-exploration and strategy evolution.
arXiv Detail & Related papers (2026-04-01T15:17:45Z) - EmboCoach-Bench: Benchmarking AI Agents on Developing Embodied Robots [68.29056647487519]
Embodied AI is fueled by high-fidelity simulation and large-scale data collection.<n>However, this scaling capability remains bottlenecked by a reliance on labor-intensive manual oversight.<n>We introduce textscEmboCoach-Bench, a benchmark evaluating the capacity of LLM agents to autonomously engineer embodied policies.
arXiv Detail & Related papers (2026-01-29T11:33:49Z) - OSIRIS: Bridging Analog Circuit Design and Machine Learning with Scalable Dataset Generation [1.6249267147413524]
We present OSIRIS, a dataset generation pipeline for analog IC design.<n> OSIRIS produces comprehensive performance metrics and metadata.<n>We release a dataset consisting of 87,100 circuit variations generated with OSIRIS.
arXiv Detail & Related papers (2026-01-27T10:18:46Z) - AgentEvolver: Towards Efficient Self-Evolving Agent System [51.54882384204726]
We present AgentEvolver, a self-evolving agent system that drives autonomous agent learning.<n>AgentEvolver introduces three synergistic mechanisms: self-questioning, self-navigating, and self-attributing.<n>Preliminary experiments indicate that AgentEvolver achieves more efficient exploration, better sample utilization, and faster adaptation compared to traditional RL-based baselines.
arXiv Detail & Related papers (2025-11-13T15:14:47Z) - AutoMind: Adaptive Knowledgeable Agent for Automated Data Science [70.33796196103499]
Large Language Model (LLM) agents have shown great potential in addressing real-world data science problems.<n>Existing frameworks depend on rigid, pre-defined and inflexible coding strategies.<n>We introduce AutoMind, an adaptive, knowledgeable LLM-agent framework.
arXiv Detail & Related papers (2025-06-12T17:59:32Z) - ESTformer: Transformer utilising spatiotemporal dependencies for electroencephalogram super-resolution [17.375026288273794]
We develop an EEG framework that uses acquisition dependencies based on a transformer.<n>The Transformer for EEG SR tasks demonstrates the versatility of the Transformer for EEG SR tasks.<n>The superiority of the SR data was verified in an EEG-based person identification and emotion recognition task.
arXiv Detail & Related papers (2023-12-03T12:26:32Z) - Chemist-X: Large Language Model-empowered Agent for Reaction Condition Recommendation in Chemical Synthesis [55.30328162764292]
Chemist-X is a comprehensive AI agent that automates the reaction condition optimization (RCO) task in chemical synthesis.<n>The agent uses retrieval-augmented generation (RAG) technology and AI-controlled wet-lab experiment executions.<n>Results of our automatic wet-lab experiments, achieved by fully LLM-supervised end-to-end operation with no human in the lope, prove Chemist-X's ability in self-driving laboratories.
arXiv Detail & Related papers (2023-11-16T01:21:33Z) - Machine Learning Benchmarks for the Classification of Equivalent Circuit
Models from Electrochemical Impedance Spectra [0.0]
We showcase machine learning methods to classify the ECMs of 9,300 impedance spectra provided by QuantumScape for the BatteryDEV hackathon.
A key remaining challenge is the identifiability of the labels, underlined by the model performances and the comparison of misclassified spectra.
arXiv Detail & Related papers (2023-02-07T10:08:35Z) - Data-Driven Transferred Energy Management Strategy for Hybrid Electric
Vehicles via Deep Reinforcement Learning [3.313774035672581]
This paper proposes a real-time EMS via incorporating the DRL method and transfer learning (TL)
The related EMSs are derived from and evaluated on the real-world collected driving cycle dataset from Transportation Secure Data Center.
Simulation results indicate that the presented transfer DRL-based EMS could effectively reduce time consumption and guarantee control performance.
arXiv Detail & Related papers (2020-09-07T17:53:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.