Evaluating End-User Device Energy Models in Sustainability Reporting of Browser-Based Web Services

• URL: http://arxiv.org/abs/2510.12566v1
• Date: Tue, 14 Oct 2025 14:25:26 GMT
• Title: Evaluating End-User Device Energy Models in Sustainability Reporting of Browser-Based Web Services
• Authors: Maja H. Kirkeby, Timmie Lagermann,
• Abstract summary: Sustainability reporting in web-based services increasingly relies on simplified energy and carbon models.<n>This paper presents an empirical study evaluating how well such models reflect actual energy consumption.<n>Results show that the commonly applied constant-power approximation can diverge substantially from measured energy.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Sustainability reporting in web-based services increasingly relies on simplified energy and carbon models such as the Danish Agency of Digital Government's Digst framework and the United Kingdom-based DIMPACT model. Although these models are widely adopted, their accuracy and precision remain underexplored. This paper presents an empirical study evaluating how well such models reflect actual energy consumption during realistic user interactions with common website categories. Energy use was measured across shopping, booking, navigation, and news services using predefined user flows executed on four laptop platforms. The results show that the commonly applied constant-power approximation (P * t) can diverge substantially from measured energy, depending on website category, device type, and task characteristics. The findings demonstrate that model deviations are systematic rather than random and highlight the need for category-aware and device-reflective power parameters in reproducible sustainability reporting frameworks.

Related papers

• AI-CARE: Carbon-Aware Reporting Evaluation Metric for AI Models [2.7946918847372277]
  We propose AI-CARE, an evaluation tool for reporting energy consumption, and carbon emissions of machine learning models.<n>We demonstrate, through theoretical analysis and empirical validation, that carbon-aware benchmarking changes the relative ranking of models.<n>Our proposal aims to shift the research community toward transparent, multi-objective evaluation and align ML progress with global sustainability goals.
  arXiv  Detail & Related papers  (2026-02-17T21:52:48Z)
• PAI-Bench: A Comprehensive Benchmark For Physical AI [70.22914615084215]
  Video generative models often struggle to maintain physically coherent dynamics.<n>Multi-modal large language models exhibit limited performance in forecasting and causal interpretation.<n>These observations suggest that current systems are still at an early stage in handling the perceptual and predictive demands of Physical AI.
  arXiv  Detail & Related papers  (2025-12-01T18:47:39Z)
• Promoting Sustainable Web Agents: Benchmarking and Estimating Energy Consumption through Empirical and Theoretical Analysis [9.631189259234931]
  We show how different philosophies in web agent creation can severely impact the associated expended energy.<n>We highlight a lack of transparency regarding disclosing model parameters and processes used for some web agents as a limiting factor when estimating energy consumption.
  arXiv  Detail & Related papers  (2025-11-06T15:59:59Z)
• Comparing energy consumption and accuracy in text classification inference [0.9208007322096533]
  This study systematically evaluates the trade-offs between model accuracy and energy consumption in text classification inference.<n>The best-performing model in terms of accuracy can also be energy-efficient, while larger LLMs tend to consume significantly more energy with lower classification accuracy.
  arXiv  Detail & Related papers  (2025-08-19T18:00:08Z)
• Green MLOps to Green GenOps: An Empirical Study of Energy Consumption in Discriminative and Generative AI Operations [2.2765705959685234]
  This study investigates the energy consumption of Discriminative and Generative AI models within real-world MLOps pipelines.<n>We employ software-based power measurements to ensure ease of replication across diverse configurations, models, and datasets.
  arXiv  Detail & Related papers  (2025-03-31T10:28:04Z)
• Towards Sustainable Web Agents: A Plea for Transparency and Dedicated Metrics for Energy Consumption [4.614707355759162]
  This study explores the energy and CO2 cost associated with web agents.<n>Results show how different philosophies in web agent creation can severely impact the associated expended energy.<n>Our work advocates a change in thinking when evaluating web agents, warranting dedicated metrics for energy consumption and sustainability.
  arXiv  Detail & Related papers  (2025-02-25T06:58:40Z)
• Energy-based Automated Model Evaluation [19.90797626200033]
  We propose a novel measure -- Meta-Distribution Energy (MDE) -- that allows the AutoEval framework to be both more efficient and effective. MDE establishes a meta-distribution statistic, on the information (energy) associated with individual samples, then offer a smoother representation enabled by energy-based learning. We provide extensive experiments across modalities, datasets and different architectural backbones to validate MDE's validity.
  arXiv  Detail & Related papers  (2024-01-23T11:54:09Z)
• Power Hungry Processing: Watts Driving the Cost of AI Deployment? [74.19749699665216]
  generative, multi-purpose AI systems promise a unified approach to building machine learning (ML) models into technology. This ambition of generality'' comes at a steep cost to the environment, given the amount of energy these systems require and the amount of carbon that they emit. We measure deployment cost as the amount of energy and carbon required to perform 1,000 inferences on representative benchmark dataset using these models. We conclude with a discussion around the current trend of deploying multi-purpose generative ML systems, and caution that their utility should be more intentionally weighed against increased costs in terms of energy and emissions
  arXiv  Detail & Related papers  (2023-11-28T15:09:36Z)
• Efficiency Pentathlon: A Standardized Arena for Efficiency Evaluation [82.85015548989223]
  Pentathlon is a benchmark for holistic and realistic evaluation of model efficiency. Pentathlon focuses on inference, which accounts for a majority of the compute in a model's lifecycle. It incorporates a suite of metrics that target different aspects of efficiency, including latency, throughput, memory overhead, and energy consumption.
  arXiv  Detail & Related papers  (2023-07-19T01:05:33Z)
• A physics-based domain adaptation framework for modelling and forecasting building energy systems [5.8010446129208155]
  State-of-the-art machine-learning-based models are a popular choice for modeling and forecasting energy behavior in buildings. However, their architecture does not hold physical to mechanistic structures linked with governing physical phenomena. We introduce a novel SDA approach where instead of labeled data, we leverage the geometric structure of the LTI governed by heat transfer ordinary differential equations.
  arXiv  Detail & Related papers  (2022-08-19T17:27:39Z)
• SOLIS -- The MLOps journey from data acquisition to actionable insights [62.997667081978825]
  In this paper we present a unified deployment pipeline and freedom-to-operate approach that supports all requirements while using basic cross-platform tensor framework and script language engines. This approach however does not supply the needed procedures and pipelines for the actual deployment of machine learning capabilities in real production grade systems.
  arXiv  Detail & Related papers  (2021-12-22T14:45:37Z)
• Learning Discrete Energy-based Models via Auxiliary-variable Local Exploration [130.89746032163106]
  We propose ALOE, a new algorithm for learning conditional and unconditional EBMs for discrete structured data. We show that the energy function and sampler can be trained efficiently via a new variational form of power iteration. We present an energy model guided fuzzer for software testing that achieves comparable performance to well engineered fuzzing engines like libfuzzer.
  arXiv  Detail & Related papers  (2020-11-10T19:31:29Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.