Joint Optimization of Memory and Computing Frequency for Energy-Efficient DNN Inference

• URL: http://arxiv.org/abs/2608.13863v1
• Date: Fri, 14 Aug 2026 01:25:00 GMT
• Title: Joint Optimization of Memory and Computing Frequency for Energy-Efficient DNN Inference
• Abstract summary: Deep neural network (DNN) inference on mobile devices often incurs high latency and energy consumption due to limited computing and memory resources.<n>We consider the impact of memory frequency and computing frequency on DNN inference time, and jointly optimize these two together with communication resources for energy-efficient inference.<n>Our proposed algorithm significantly reduces the energy consumption of devices by up to 10.4% compared to other methods.
• Score: 9.303797341103534
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep neural network (DNN) inference on mobile devices often incurs high latency and energy consumption due to limited computing and memory resources. To enable energy-efficient DNN inference, most existing studies focus on dynamic voltage and frequency scaling (DVFS) for adjusting the computing frequency, while the impact of memory frequency on the inference performance has been greatly overlooked. In this paper, we consider the impact of memory frequency and computing frequency on DNN inference time, and jointly optimize these two frequencies together with communication resources for energy-efficient DNN inference. Based on a realistic inference time model, we formulate an optimization problem to minimize the energy consumption of all mobile devices under the deadline constraint. For local inference, we derive a near-optimal closed-form solution via convex optimization, while an optimal closed-form solution for transmission power is obtained for edge inference with the given bandwidth. Furthermore, we propose a low-complexity heuristic algorithm to effectively solve the overall problem with polynomial time complexity. Simulation results based on measured data show that the proposed near-optimal solution for local inference can achieve optimal performance under strict deadline constraints, with a performance gap of up to 2.5% compared with the optimal solution. Meanwhile, our proposed algorithm significantly reduces the energy consumption of devices by up to 10.4% compared to other methods.

Related papers

• Joint Optimization of Model Partitioning and Resource Allocation for Anti-Jamming Collaborative Inference Systems [52.842088497389746]
  This letter focuses on an anti-jamming collaborative inference system in the presence of a malicious jammer.<n>We first analyze the effects of jamming and DNN partitioning on inference accuracy via data regression.<n>We propose an efficient alternating optimization-based algorithm, which decomposes the problem into three subproblems.
  arXiv  Detail & Related papers  (2026-03-03T03:52:52Z)
• Joint Memory Frequency and Computing Frequency Scaling for Energy-efficient DNN Inference [9.303797341103534]
  High latency and energy overhead are inevitable on resource-constrained devices.<n>To address this challenge, most researchers focus on the dynamic voltage and frequency scaling (DVFS) technique.<n>In this paper, we first investigate the impact of joint memory frequency and computing frequency scaling on the inference time and energy consumption.
  arXiv  Detail & Related papers  (2025-09-22T16:20:29Z)
• Robust DNN Partitioning and Resource Allocation Under Uncertain Inference Time [9.303797341103534]
  In edge intelligence systems, deep neural network (DNN) partitioning and data offloading can provide real-time task inference for resource-constrained mobile devices.<n>We propose a robust optimization scheme to minimize the total energy consumption of mobile devices while meeting task probabilistic deadlines.
  arXiv  Detail & Related papers  (2025-03-27T13:06:26Z)
• Switchable Decision: Dynamic Neural Generation Networks [98.61113699324429]
  We propose a switchable decision to accelerate inference by dynamically assigning resources for each data instance. Our method benefits from less cost during inference while keeping the same accuracy.
  arXiv  Detail & Related papers  (2024-05-07T17:44:54Z)
• Energy-Efficient Power Control for Multiple-Task Split Inference in UAVs: A Tiny Learning-Based Approach [27.48920259431965]
  We present a two-timescale approach for energy minimization in split inference in unmanned aerial vehicles (UAVs) We replace the optimization of transmit power with that of transmission time to decrease the computational complexity of OP. Simulation results show that the proposed algorithm can achieve a higher probability of successful task completion with lower energy consumption.
  arXiv  Detail & Related papers  (2023-12-31T10:16:59Z)
• A Multi-Head Ensemble Multi-Task Learning Approach for Dynamical Computation Offloading [62.34538208323411]
  We propose a multi-head ensemble multi-task learning (MEMTL) approach with a shared backbone and multiple prediction heads (PHs) MEMTL outperforms benchmark methods in both the inference accuracy and mean square error without requiring additional training data.
  arXiv  Detail & Related papers  (2023-09-02T11:01:16Z)
• Joint Optimization of Energy Consumption and Completion Time in Federated Learning [10.085927375730812]
  Federated Learning (FL) is an intriguing distributed machine learning approach due to its privacy-preserving characteristics.<n>We formulate an algorithm to balance the trade-off between energy and execution latency, and thus accommodate different demands and application scenarios.
  arXiv  Detail & Related papers  (2022-09-29T16:05:28Z)
• Predictive GAN-powered Multi-Objective Optimization for Hybrid Federated Split Learning [56.125720497163684]
  We propose a hybrid federated split learning framework in wireless networks. We design a parallel computing scheme for model splitting without label sharing, and theoretically analyze the influence of the delayed gradient caused by the scheme on the convergence speed.
  arXiv  Detail & Related papers  (2022-09-02T10:29:56Z)
• Federated Learning for Energy-limited Wireless Networks: A Partial Model Aggregation Approach [79.59560136273917]
  limited communication resources, bandwidth and energy, and data heterogeneity across devices are main bottlenecks for federated learning (FL) We first devise a novel FL framework with partial model aggregation (PMA) The proposed PMA-FL improves 2.72% and 11.6% accuracy on two typical heterogeneous datasets.
  arXiv  Detail & Related papers  (2022-04-20T19:09:52Z)
• Energy-Efficient Model Compression and Splitting for Collaborative Inference Over Time-Varying Channels [52.60092598312894]
  We propose a technique to reduce the total energy bill at the edge device by utilizing model compression and time-varying model split between the edge and remote nodes. Our proposed solution results in minimal energy consumption and $CO$ emission compared to the considered baselines.
  arXiv  Detail & Related papers  (2021-06-02T07:36:27Z)
• Energy Efficient Edge Computing: When Lyapunov Meets Distributed Reinforcement Learning [12.845204986571053]
  In this work, we study the problem of energy-efficient offloading enabled by edge computing. In the considered scenario, multiple users simultaneously compete for radio and edge computing resources. The proposed solution also allows to increase the network's energy efficiency compared to a benchmark approach.
  arXiv  Detail & Related papers  (2021-03-31T11:02:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.