Watts and Debts of Agentic Frameworks: An Empirical Study (Registered Report)
- URL: http://arxiv.org/abs/2606.10702v1
- Date: Tue, 09 Jun 2026 11:03:20 GMT
- Title: Watts and Debts of Agentic Frameworks: An Empirical Study (Registered Report)
- Abstract summary: Self-Admitted Technical Debt (SATD) and hardware-level runtime energy consumption will be studied.<n>Findings will establish whether automated source code analysis can serve as a reliable, early-warning proxy for energy-efficient framework selection.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Context: Every agentic AI system shipped to production carries two hidden risks: accumulated Technical Debt (TD) and unmonitored runtime energy costs. While functional benchmarking is common, the empirical link between internal structural quality (specifically TD) and dynamic energy consumption during execution remains unexplored, creating a blind spot for practitioners and organizations managing sustainability and operational budgets at scale. Goal: We propose a confirmatory empirical study correlating Self-Admitted Technical Debt (SATD) with hardware-level runtime energy consumption across agentic frameworks, to determine whether code quality can drive energy-aware design decisions. Method: We will evaluate five open-source agentic frameworks by executing a standardized task suite in a strictly controlled environment. SATD will be extracted via automated Python-based comment mining and categorized via LLM-based classification using fine-tuned prompt, while runtime energy will be measured at the hardware level. Our study will investigate three core research questions: (RQ1) the presence of TD within these frameworks; (RQ2) the variance in runtime energy consumption across architectures; and (RQ3) the statistical correlation between a framework's TD and its task-level energy consumption. Conclusion: The findings will establish whether automated source code analysis can serve as a reliable, early-warning proxy for energy-efficient framework selection, thereby advancing both green software engineering and agentic AI quality research.
Related papers
- WattCouncil: Context-Aware Household Energy Scenario Generation With Governed LLMs [1.0450509067356148]
WattCouncil is a data-generation framework in which household electricity demand is generated by a council of Large Language Model (LLM)-based agents.<n>Rather than acting as static predictors, these agents serve as adaptive decision-makers within a governed pipeline.<n>We evaluate the generated profiles against the detailed CER dataset, which contains over a year of load measurements for 4232 households.
arXiv Detail & Related papers (2026-07-12T11:28:02Z) - EvoBrowseComp: Benchmarking Search Agents on Evolving Knowledge [53.44952808455985]
EvoBrowseComp is an evolving benchmark of 400 English and 400 Chinese complex questions.<n>EvoBrowseComp can be regularly updated to prevent data contamination.<n>It establishes a scalable paradigm for auto-updatable, high-difficulty benchmarking.
arXiv Detail & Related papers (2026-06-11T09:48:32Z) - DuMate-DeepResearch: An Auditable Multi-Agent System with Recursive Search and Rubric-Grounded Reasoning [58.09293442211248]
Deep Research (DR) has emerged as a new agentic paradigm to tackle complex, open-ended research tasks.<n>This report presents DuMate-DeepResearch, a multi-agent DR framework built on the Qianfan Agent Foundry.
arXiv Detail & Related papers (2026-06-05T14:10:48Z) - Energy per Successful Goal: Goal-Level Energy Accounting for Agentic AI Systems [0.6338178373376447]
Current AI energy benchmarks measure consumption at the granularity of a single model invocation or training run.<n>We present A-LEMS, a cross-layer measurement framework that redefines the unit of AI energy accounting from energy per inference to Energy per Successful Goal (EpG)<n>EpG aggregates total workflow energy across all execution attempts, including failures and retries, normalized by successfully completed goals.
arXiv Detail & Related papers (2026-05-20T22:55:19Z) - Edge-AI-Driven Learning-to-Rank for Decentralized Task Allocation in Circular Smart Manufacturing [54.4933359656657]
This work proposes an Edge-AI-driven decentralized task allocation framework based on ranking-aware negotiation.<n>A ranking-aware formulation finally reshapes the learning objective to align with the ordering-based nature of winner selection.<n>Results show improved delay and deadline adherence under high load, and enhanced energy efficiency under tighter constraints.
arXiv Detail & Related papers (2026-05-14T20:38:25Z) - EnCoDe: Energy Estimation of Source Code At Design-Time [0.0]
Energy efficiency has emerged as a vital attribute of software quality, with significant implications for both environmental sustainability and operational costs.<n>Existing profiling tools operate only at runtime and coarse granularity, typically capturing energy at the process or method level.<n>We propose EnCoDe, a methodology for fine-grained, design-time energy estimation.
arXiv Detail & Related papers (2026-05-01T08:30:36Z) - Towards Energy-aware Requirements Dependency Classification: Knowledge-Graph vs. Vector-Retrieval Augmented Inference with SLMs [0.3499870393443268]
There is a growing need to transition toward Small Language Models (SLMs) and energy aware architectures for sustainable requirements engineering.<n>This study proposes and empirically evaluates an energy aware framework that compares Knowledge Graph-based Retrieval (KGR) with Vector-based Semantic Retrieval (VSR) to enhance SLM-based inference.
arXiv Detail & Related papers (2026-03-25T05:29:36Z) - MARS: Modular Agent with Reflective Search for Automated AI Research [48.54202614558741]
We introduce MARS, a framework optimized for autonomous AI research.<n>MARS relies on three pillars: (1) Budget-Aware Planning via cost-Aware Monte Carlo Tree Search (MCTS) to explicitly balance performance with execution expense; (2) Modular Construction, employing a "Design-Decompose-Implement" pipeline to manage complex repositories; and (3) Comparative Reflective Memory, which addresses credit assignment by analyzing solution differences to distill high-signal insights.
arXiv Detail & Related papers (2026-02-02T19:00:03Z) - EmboCoach-Bench: Benchmarking AI Agents on Developing Embodied Robots [68.29056647487519]
Embodied AI is fueled by high-fidelity simulation and large-scale data collection.<n>However, this scaling capability remains bottlenecked by a reliance on labor-intensive manual oversight.<n>We introduce textscEmboCoach-Bench, a benchmark evaluating the capacity of LLM agents to autonomously engineer embodied policies.
arXiv Detail & Related papers (2026-01-29T11:33:49Z) - SelfAI: Building a Self-Training AI System with LLM Agents [79.10991818561907]
SelfAI is a general multi-agent platform that combines a User Agent for translating high-level research objectives into standardized experimental configurations.<n>An Experiment Manager orchestrates parallel, fault-tolerant training across heterogeneous hardware while maintaining a structured knowledge base for continuous feedback.<n>Across regression, computer vision, scientific computing, medical imaging, and drug discovery benchmarks, SelfAI consistently achieves strong performance and reduces redundant trials.
arXiv Detail & Related papers (2025-11-29T09:18:39Z) - Smart but Costly? Benchmarking LLMs on Functional Accuracy and Energy Efficiency [5.771786260272727]
We present a framework, BRACE, to benchmark Code Language Models on a unified scale of energy efficiency and functional correctness.<n>We propose two rating methods: Concentric Incremental Rating Circles (CIRC) and Observation to Expectation Rating (OTER)<n>Our analysis reveals models generally perform better in the code summarization tasks as they are not enforced to generate a grammar-based and syntactically correct output.
arXiv Detail & Related papers (2025-11-10T23:44:48Z) - Metrics and evaluations for computational and sustainable AI efficiency [26.52588349722099]
Current approaches fail to provide a holistic view, making it difficult to compare and optimise systems.<n>We propose a unified and reproducible methodology for AI model inference that integrates computational and environmental metrics.<n>Our framework provides pragmatic, carbon-aware evaluation by systematically measuring latency and distributions throughput, energy consumption, and location-adjusted carbon emissions.
arXiv Detail & Related papers (2025-10-18T03:30:15Z) - Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol [83.83217247686402]
Large Language Models (LLMs) have evolved from simple text generators into complex software systems that integrate retrieval augmentation, tool invocation, and multi-turn interactions.<n>Their inherent non-determinism, dynamism, and context dependence pose fundamental challenges for quality assurance.<n>This paper decomposes LLM applications into a three-layer architecture: textbftextitSystem Shell Layer, textbftextitPrompt Orchestration Layer, and textbftextitLLM Inference Core.
arXiv Detail & Related papers (2025-08-28T13:00:28Z) - Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable
Edge Computing Systems [87.4519172058185]
An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied.
A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem.
Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
arXiv Detail & Related papers (2020-02-20T04:58:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.