Probabilistic Time Series Forecasting for Adaptive Monitoring in Edge
Computing Environments
- URL: http://arxiv.org/abs/2211.13729v1
- Date: Thu, 24 Nov 2022 17:35:14 GMT
- Title: Probabilistic Time Series Forecasting for Adaptive Monitoring in Edge
Computing Environments
- Authors: Dominik Scheinert, Babak Sistani Zadeh Aghdam, Soeren Becker, Odej
Kao, Lauritz Thamsen
- Abstract summary: In this paper, we propose a sampling-based and cloud-located approach for monitoring critical infrastructures.
We evaluate our prototype implementation for the monitoring pipeline on a publicly available streaming dataset.
- Score: 0.06999740786886537
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: With increasingly more computation being shifted to the edge of the network,
monitoring of critical infrastructures, such as intermediate processing nodes
in autonomous driving, is further complicated due to the typically
resource-constrained environments. In order to reduce the resource overhead on
the network link imposed by monitoring, various methods have been discussed
that either follow a filtering approach for data-emitting devices or conduct
dynamic sampling based on employed prediction models. Still, existing methods
are mainly requiring adaptive monitoring on edge devices, which demands device
reconfigurations, utilizes additional resources, and limits the sophistication
of employed models.
In this paper, we propose a sampling-based and cloud-located approach that
internally utilizes probabilistic forecasts and hence provides means of
quantifying model uncertainties, which can be used for contextualized
adaptations of sampling frequencies and consequently relieves constrained
network resources. We evaluate our prototype implementation for the monitoring
pipeline on a publicly available streaming dataset and demonstrate its positive
impact on resource efficiency in a method comparison.
Related papers
- Advancing Enterprise Spatio-Temporal Forecasting Applications: Data Mining Meets Instruction Tuning of Language Models For Multi-modal Time Series Analysis in Low-Resource Settings [0.0]
patio-temporal forecasting is crucial in transportation, logistics, and supply chain management.
We propose a dynamic, multi-modal approach that integrates the strengths of traditional forecasting methods and instruction tuning of small language models.
Our framework enables on-premises customization with reduced computational and memory demands, while maintaining inference speed and data privacy/security.
arXiv Detail & Related papers (2024-08-24T16:32:58Z) - Enhancing Cloud-Native Resource Allocation with Probabilistic Forecasting Techniques in O-RAN [3.190069716363552]
This paper examines the cloud-native aspects of Open Radio Access Network (O-RAN) together with the radio App (rApp) deployment options.
We show the advantages of Deep Autoregressive Recurrent network (DeepAR) over other deterministic probabilistic estimators.
arXiv Detail & Related papers (2024-07-19T15:04:15Z) - Distributed Markov Chain Monte Carlo Sampling based on the Alternating
Direction Method of Multipliers [143.6249073384419]
In this paper, we propose a distributed sampling scheme based on the alternating direction method of multipliers.
We provide both theoretical guarantees of our algorithm's convergence and experimental evidence of its superiority to the state-of-the-art.
In simulation, we deploy our algorithm on linear and logistic regression tasks and illustrate its fast convergence compared to existing gradient-based methods.
arXiv Detail & Related papers (2024-01-29T02:08:40Z) - Amortizing intractable inference in large language models [56.92471123778389]
We use amortized Bayesian inference to sample from intractable posterior distributions.
We empirically demonstrate that this distribution-matching paradigm of LLM fine-tuning can serve as an effective alternative to maximum-likelihood training.
As an important application, we interpret chain-of-thought reasoning as a latent variable modeling problem.
arXiv Detail & Related papers (2023-10-06T16:36:08Z) - Deep-Ensemble-Based Uncertainty Quantification in Spatiotemporal Graph
Neural Networks for Traffic Forecasting [2.088376060651494]
We focus on a diffusion convolutional recurrent neural network (DCRNN), a state-of-the-art method for short-term traffic forecasting.
We develop a scalable deep ensemble approach to quantify uncertainties for DCRNN.
We show that our generic and scalable approach outperforms the current state-of-the-art Bayesian and a number of other commonly used frequentist techniques.
arXiv Detail & Related papers (2022-04-04T16:10:55Z) - Probabilistic Forecasting with Generative Networks via Scoring Rule
Minimization [5.5643498845134545]
We use generative neural networks to parametrize distributions on high-dimensional spaces by transforming draws from a latent variable.
We train generative networks to minimize a predictive-sequential (or prequential) scoring rule on a recorded temporal sequence of the phenomenon of interest.
Our method outperforms state-of-the-art adversarial approaches, especially in probabilistic calibration.
arXiv Detail & Related papers (2021-12-15T15:51:12Z) - Interpretable Social Anchors for Human Trajectory Forecasting in Crowds [84.20437268671733]
We propose a neural network-based system to predict human trajectory in crowds.
We learn interpretable rule-based intents, and then utilise the expressibility of neural networks to model scene-specific residual.
Our architecture is tested on the interaction-centric benchmark TrajNet++.
arXiv Detail & Related papers (2021-05-07T09:22:34Z) - Sampling-free Variational Inference for Neural Networks with
Multiplicative Activation Noise [51.080620762639434]
We propose a more efficient parameterization of the posterior approximation for sampling-free variational inference.
Our approach yields competitive results for standard regression problems and scales well to large-scale image classification tasks.
arXiv Detail & Related papers (2021-03-15T16:16:18Z) - Towards AIOps in Edge Computing Environments [60.27785717687999]
This paper describes the system design of an AIOps platform which is applicable in heterogeneous, distributed environments.
It is feasible to collect metrics with a high frequency and simultaneously run specific anomaly detection algorithms directly on edge devices.
arXiv Detail & Related papers (2021-02-12T09:33:00Z) - Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for
Online Collision Avoidance [95.86944752753564]
We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties.
Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates.
The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
arXiv Detail & Related papers (2020-07-28T07:34:30Z) - Distributionally Robust Chance Constrained Programming with Generative
Adversarial Networks (GANs) [0.0]
A novel generative adversarial network (GAN) based data-driven distributionally robust chance constrained programming framework is proposed.
GAN is applied to fully extract distributional information from historical data in a nonparametric and unsupervised way.
The proposed framework is then applied to supply chain optimization under demand uncertainty.
arXiv Detail & Related papers (2020-02-28T00:05:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.