Revealing Performance Issues in Server-side WebAssembly Runtimes via
Differential Testing
- URL: http://arxiv.org/abs/2309.12167v1
- Date: Thu, 21 Sep 2023 15:25:18 GMT
- Title: Revealing Performance Issues in Server-side WebAssembly Runtimes via
Differential Testing
- Authors: Shuyao Jiang, Ruiying Zeng, Zihao Rao, Jiazhen Gu, Yangfan Zhou,
Michael R. Lyu
- Abstract summary: We design a novel differential testing approach WarpDiff to identify performance issues in server-side Wasm runtimes.
We identify abnormal cases where the execution time ratio significantly deviates from the oracle ratio and locate the Wasm runtimes that cause the performance issues.
- Score: 28.187405253760687
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: WebAssembly (Wasm) is a bytecode format originally serving as a compilation
target for Web applications. It has recently been used increasingly on the
server side, e.g., providing a safer, faster, and more portable alternative to
Linux containers. With the popularity of server-side Wasm applications, it is
essential to study performance issues (i.e., abnormal latency) in Wasm
runtimes, as they may cause a significant impact on server-side applications.
However, there is still a lack of attention to performance issues in
server-side Wasm runtimes. In this paper, we design a novel differential
testing approach WarpDiff to identify performance issues in server-side Wasm
runtimes. The key insight is that in normal cases, the execution time of the
same test case on different Wasm runtimes should follow an oracle ratio. We
identify abnormal cases where the execution time ratio significantly deviates
from the oracle ratio and subsequently locate the Wasm runtimes that cause the
performance issues. We apply WarpDiff to test five popular server-side Wasm
runtimes using 123 test cases from the LLVM test suite and demonstrate the top
10 abnormal cases we identified. We further conduct an in-depth analysis of
these abnormal cases and summarize seven performance issues, all of which have
been confirmed by the developers. We hope our work can inspire future
investigation on improving Wasm runtime implementation and thus promoting the
development of server-side Wasm applications.
Related papers
- Research on WebAssembly Runtimes: A Survey [22.031129110987017]
WebAssembly (abbreviated as Wasm) was initially introduced for the Web but quickly extended its reach into various domains beyond the Web.
This paper provides a comprehensive survey of research on WebAssembly runtimes.
arXiv Detail & Related papers (2024-04-19T04:36:38Z) - Green AI: A Preliminary Empirical Study on Energy Consumption in DL
Models Across Different Runtime Infrastructures [56.200335252600354]
It is common practice to deploy pre-trained models on environments distinct from their native development settings.
This led to the introduction of interchange formats such as ONNX, which includes its infrastructure, and ONNX, which work as standard formats.
arXiv Detail & Related papers (2024-02-21T09:18:44Z) - WEFix: Intelligent Automatic Generation of Explicit Waits for Efficient
Web End-to-End Flaky Tests [13.280540531582945]
We propose WEFix, a technique that can automatically generate fix code for UI-based flakiness in web e2e testing.
We evaluate the effectiveness and efficiency of WEFix against 122 web e2e flaky tests from seven popular real-world projects.
arXiv Detail & Related papers (2024-02-15T06:51:53Z) - WRTester: Differential Testing of WebAssembly Runtimes via
Semantic-aware Binary Generation [19.78427170624683]
We present WRTester, a novel differential testing framework that can generated complicated Wasm test cases by disassembling and assembling real-world Wasm binaries.
For further pinpointing the root causes of unexpected behaviors, we design a runtime-agnostic root cause location method to accurately locate bugs.
We have uncovered 33 unique bugs in popular Wasm runtimes, among which 25 have been confirmed.
arXiv Detail & Related papers (2023-12-16T14:02:42Z) - A Comprehensive Trusted Runtime for WebAssembly with Intel SGX [2.6732136954707792]
We present Twine, a trusted runtime for running WebAssembly-compiled applications within TEEs.
It extends the standard WebAssembly system interface (WASI), providing controlled OS services, focusing on I/O.
We evaluate its performance using general-purpose benchmarks and real-world applications, showing it compares on par with state-of-the-art solutions.
arXiv Detail & Related papers (2023-12-14T16:19:00Z) - Align Your Prompts: Test-Time Prompting with Distribution Alignment for
Zero-Shot Generalization [64.62570402941387]
We use a single test sample to adapt multi-modal prompts at test time by minimizing the feature distribution shift to bridge the gap in the test domain.
Our method improves zero-shot top- 1 accuracy beyond existing prompt-learning techniques, with a 3.08% improvement over the baseline MaPLe.
arXiv Detail & Related papers (2023-11-02T17:59:32Z) - Overload: Latency Attacks on Object Detection for Edge Devices [47.9744734181236]
This paper investigates latency attacks on deep learning applications.
Unlike common adversarial attacks for misclassification, the goal of latency attacks is to increase the inference time.
We use object detection to demonstrate how such kind of attacks work.
arXiv Detail & Related papers (2023-04-11T17:24:31Z) - Automatic Cause Detection of Performance Problems in Web Applications [1.749935196721634]
We propose a method of extracting the internal behavior of web requests and introduce a pipeline that detects performance issues in web requests.
Experiments revealed that this pipeline is indeed able to detect slow web requests and provide additional insights into their true root causes.
arXiv Detail & Related papers (2021-03-08T18:17:40Z) - Emerging App Issue Identification via Online Joint Sentiment-Topic
Tracing [66.57888248681303]
We propose a novel emerging issue detection approach named MERIT.
Based on the AOBST model, we infer the topics negatively reflected in user reviews for one app version.
Experiments on popular apps from Google Play and Apple's App Store demonstrate the effectiveness of MERIT.
arXiv Detail & Related papers (2020-08-23T06:34:05Z) - Dynamic Causal Effects Evaluation in A/B Testing with a Reinforcement
Learning Framework [68.96770035057716]
A/B testing is a business strategy to compare a new product with an old one in pharmaceutical, technological, and traditional industries.
This paper introduces a reinforcement learning framework for carrying A/B testing in online experiments.
arXiv Detail & Related papers (2020-02-05T10:25:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.