EREBA: Black-box Energy Testing of Adaptive Neural Networks

• URL: http://arxiv.org/abs/2202.06084v1
• Date: Sat, 12 Feb 2022 15:16:04 GMT
• Title: EREBA: Black-box Energy Testing of Adaptive Neural Networks
• Authors: Mirazul Haque, Yaswanth Yadlapalli, Wei Yang, and Cong Liu
• Abstract summary: This work investigates the energy robustness of Adaptive Neural Networks (AdNNs) We propose EREBA, the first black-box testing method for determining the energy robustness of an AdNN. EREBA explores and infers the relationship between inputs and the energy consumption of AdNNs to generate energy surging samples.
• Score: 7.886521856086982
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Recently, various Deep Neural Network (DNN) models have been proposed for environments like embedded systems with stringent energy constraints. The fundamental problem of determining the robustness of a DNN with respect to its energy consumption (energy robustness) is relatively unexplored compared to accuracy-based robustness. This work investigates the energy robustness of Adaptive Neural Networks (AdNNs), a type of energy-saving DNNs proposed for many energy-sensitive domains and have recently gained traction. We propose EREBA, the first black-box testing method for determining the energy robustness of an AdNN. EREBA explores and infers the relationship between inputs and the energy consumption of AdNNs to generate energy surging samples. Extensive implementation and evaluation using three state-of-the-art AdNNs demonstrate that test inputs generated by EREBA could degrade the performance of the system substantially. The test inputs generated by EREBA can increase the energy consumption of AdNNs by 2,000% compared to the original inputs. Our results also show that test inputs generated via EREBA are valuable in detecting energy surging inputs.

Related papers

• NAS-BNN: Neural Architecture Search for Binary Neural Networks [55.058512316210056]
  We propose a novel neural architecture search scheme for binary neural networks, named NAS-BNN. Our discovered binary model family outperforms previous BNNs for a wide range of operations (OPs) from 20M to 200M. In addition, we validate the transferability of these searched BNNs on the object detection task, and our binary detectors with the searched BNNs achieve a novel state-of-the-art result, e.g., 31.6% mAP with 370M OPs, on MS dataset.
  arXiv  Detail & Related papers  (2024-08-28T02:17:58Z)
• Advancing Spiking Neural Networks for Sequential Modeling with Central Pattern Generators [47.371024581669516]
  Spiking neural networks (SNNs) represent a promising approach to developing artificial neural networks. Applying SNNs to sequential tasks, such as text classification and time-series forecasting, has been hindered by the challenge of creating an effective and hardware-friendly spike-form positional encoding strategy. We propose a novel PE technique for SNNs, termed CPG-PE. We demonstrate that the commonly used sinusoidal PE is mathematically a specific solution to the membrane potential dynamics of a particular CPG.
  arXiv  Detail & Related papers  (2024-05-23T09:39:12Z)
• SparrowSNN: A Hardware/software Co-design for Energy Efficient ECG Classification [7.030659971563306]
  spiking neural networks (SNNs) are well-known for their energy efficiency. sparrowSNN achieves a state-of-the-art accuracy of 98.29% for SNNs, with energy consumption of 31.39nJ per inference and power usage of 6.1uW.
  arXiv  Detail & Related papers  (2024-05-06T10:30:05Z)
• Hardware-Aware DNN Compression via Diverse Pruning and Mixed-Precision Quantization [1.0235078178220354]
  We propose an automated framework to compress Deep Neural Networks (DNNs) in a hardware-aware manner by jointly employing pruning and quantization. Our framework achieves $39%$ average energy reduction for datasets $1.7%$ average accuracy loss and outperforms significantly the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2023-12-23T18:50:13Z)
• Energy-efficient DNN Inference on Approximate Accelerators Through Formal Property Exploration [1.0323063834827415]
  We present an automated framework for weight-to-approximation mapping for approximate Deep Neural Networks (DNNs) At the MAC unit level, our evaluation surpassed already energy-efficient mappings by more than $times2$ in terms of energy gains.
  arXiv  Detail & Related papers  (2022-07-25T17:07:00Z)
• Deep Reinforcement Learning with Spiking Q-learning [51.386945803485084]
  spiking neural networks (SNNs) are expected to realize artificial intelligence (AI) with less energy consumption. It provides a promising energy-efficient way for realistic control tasks by combining SNNs with deep reinforcement learning (RL)
  arXiv  Detail & Related papers  (2022-01-21T16:42:11Z)
• Adversarial Energy Disaggregation for Non-intrusive Load Monitoring [78.47901044638525]
  Energy disaggregation, also known as non-intrusive load monitoring (NILM), challenges the problem of separating the whole-home electricity usage into appliance-specific individual consumptions. Recent advances reveal that deep neural networks (DNNs) can get favorable performance for NILM. We introduce the idea of adversarial learning into NILM, which is new for the energy disaggregation task.
  arXiv  Detail & Related papers  (2021-08-02T03:56:35Z)
• Energy-based Unknown Intent Detection with Data Manipulation [48.76465739088016]
  Unknown intent detection aims to identify the out-of-distribution utterance whose intent has never appeared in the training set. We propose using energy scores for this task as the energy score is theoretically aligned with the density of the input.
  arXiv  Detail & Related papers  (2021-07-27T01:32:23Z)
• More Behind Your Electricity Bill: a Dual-DNN Approach to Non-Intrusive Load Monitoring [17.516784821462522]
  Non-intrusive load monitoring (NILM) aims to decompose the household energy consumption into itemised energy usage of individual appliances. Recent investigations have shown that deep neural networks (DNNs) based approaches are promising for the NILM task.
  arXiv  Detail & Related papers  (2021-06-01T08:06:33Z)
• DTNN: Energy-efficient Inference with Dendrite Tree Inspired Neural Networks for Edge Vision Applications [2.1800759000607024]
  We propose Dendrite-Tree based Neural Network (DTNN) for energy-efficient inference with table lookup operations enabled by activation quantization. DTNN achieved significant energy saving (19.4X and 64.9X improvement on ResNet-18 and VGG-11 with ImageNet, respectively) with negligible loss of accuracy.
  arXiv  Detail & Related papers  (2021-05-25T11:44:12Z)
• Risk-Aware Energy Scheduling for Edge Computing with Microgrid: A Multi-Agent Deep Reinforcement Learning Approach [82.6692222294594]
  We study a risk-aware energy scheduling problem for a microgrid-powered MEC network. We derive the solution by applying a multi-agent deep reinforcement learning (MADRL)-based advantage actor-critic (A3C) algorithm with shared neural networks.
  arXiv  Detail & Related papers  (2020-02-21T02:14:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.