Many Field Packet Classification with Decomposition and Reinforcement
Learning
- URL: http://arxiv.org/abs/2205.07973v1
- Date: Mon, 16 May 2022 20:24:37 GMT
- Title: Many Field Packet Classification with Decomposition and Reinforcement
Learning
- Authors: Hasibul Jamil, Ning Yang and Ning Weng
- Abstract summary: We present a scalable learning-based packet classification engine by building an efficient data structure for different ruleset with many fields.
Our method consists of the decomposition of fields into subsets and building separate decision trees on those subsets using a deep reinforcement learning procedure.
The results show that the SD decomposition metrics results in 11.5% faster than DI metrics, 25% faster than random 2 and 40% faster than random 1.
- Score: 2.0915988632142275
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Scalable packet classification is a key requirement to support scalable
network applications like firewalls, intrusion detection, and differentiated
services. With ever increasing in the line-rate in core networks, it becomes a
great challenge to design a scalable packet classification solution using
hand-tuned heuristics approaches. In this paper, we present a scalable
learning-based packet classification engine by building an efficient data
structure for different ruleset with many fields. Our method consists of the
decomposition of fields into subsets and building separate decision trees on
those subsets using a deep reinforcement learning procedure. To decompose given
fields of a ruleset, we consider different grouping metrics like standard
deviation of individual fields and introduce a novel metric called diversity
index (DI). We examine different decomposition schemes and construct decision
trees for each scheme using deep reinforcement learning and compare the
results. The results show that the SD decomposition metrics results in 11.5%
faster than DI metrics, 25% faster than random 2 and 40% faster than random 1.
Furthermore, our learning-based selection method can be applied to varying
rulesets due to its ruleset independence.
Related papers
- Coordinated Multi-Neighborhood Learning on a Directed Acyclic Graph [6.727984016678534]
Learning the structure of causal directed acyclic graphs (DAGs) is useful in many areas of machine learning and artificial intelligence.
It is challenging to obtain good empirical and theoretical results without strong and often restrictive assumptions.
This paper develops a new constraint-based method for estimating the local structure around multiple user-specified target nodes.
arXiv Detail & Related papers (2024-05-24T08:49:43Z) - Multibit Tries Packet Classification with Deep Reinforcement Learning [0.0]
We present a scalable learning-based packet classification engine and its performance evaluation.
Our algorithm uses a few effective bits (EBs) to extract a large number of candidate rules with just a few of memory access.
Our EBs learning-based selection method is independent of the ruleset, which can be applied to varying rulesets.
arXiv Detail & Related papers (2022-05-17T19:53:25Z) - Semi-supervised Domain Adaptive Structure Learning [72.01544419893628]
Semi-supervised domain adaptation (SSDA) is a challenging problem requiring methods to overcome both 1) overfitting towards poorly annotated data and 2) distribution shift across domains.
We introduce an adaptive structure learning method to regularize the cooperation of SSL and DA.
arXiv Detail & Related papers (2021-12-12T06:11:16Z) - Manifold Regularized Dynamic Network Pruning [102.24146031250034]
This paper proposes a new paradigm that dynamically removes redundant filters by embedding the manifold information of all instances into the space of pruned networks.
The effectiveness of the proposed method is verified on several benchmarks, which shows better performance in terms of both accuracy and computational cost.
arXiv Detail & Related papers (2021-03-10T03:59:03Z) - Towards Improved and Interpretable Deep Metric Learning via Attentive
Grouping [103.71992720794421]
Grouping has been commonly used in deep metric learning for computing diverse features.
We propose an improved and interpretable grouping method to be integrated flexibly with any metric learning framework.
arXiv Detail & Related papers (2020-11-17T19:08:24Z) - Fast Few-Shot Classification by Few-Iteration Meta-Learning [173.32497326674775]
We introduce a fast optimization-based meta-learning method for few-shot classification.
Our strategy enables important aspects of the base learner objective to be learned during meta-training.
We perform a comprehensive experimental analysis, demonstrating the speed and effectiveness of our approach.
arXiv Detail & Related papers (2020-10-01T15:59:31Z) - Differentiable TAN Structure Learning for Bayesian Network Classifiers [19.30562170076368]
We consider learning of tree-augmented naive Bayes (TAN) structures for Bayesian network classifiers with discrete input features.
Instead of performing a optimization over the space of possible graph structures, the proposed method learns a distribution over graph structures.
Our method consistently outperforms random TAN structures and Chow-Liu TAN structures.
arXiv Detail & Related papers (2020-08-21T16:22:47Z) - Capturing scattered discriminative information using a deep architecture
in acoustic scene classification [49.86640645460706]
In this study, we investigate various methods to capture discriminative information and simultaneously mitigate the overfitting problem.
We adopt a max feature map method to replace conventional non-linear activations in a deep neural network.
Two data augment methods and two deep architecture modules are further explored to reduce overfitting and sustain the system's discriminative power.
arXiv Detail & Related papers (2020-07-09T08:32:06Z) - The Max-Cut Decision Tree: Improving on the Accuracy and Running Time of
Decision Trees [0.0]
The Max-Cut decision tree involves novel modifications to a standard, baseline model of classification decision tree construction, precisely CART Gini.
Our experiments show that this node-based localized PCA can dramatically improve classification, while also significantly decreasing computational time compared to the baseline decision tree.
Results are most significant when evaluated on data sets with higher dimensions, or more classes; which, for the example data set CIFAR-100, enable a 49% improvement in accuracy while reducing CPU time by 94%.
arXiv Detail & Related papers (2020-06-25T00:47:21Z) - Towards Model-Agnostic Post-Hoc Adjustment for Balancing Ranking
Fairness and Algorithm Utility [54.179859639868646]
Bipartite ranking aims to learn a scoring function that ranks positive individuals higher than negative ones from labeled data.
There have been rising concerns on whether the learned scoring function can cause systematic disparity across different protected groups.
We propose a model post-processing framework for balancing them in the bipartite ranking scenario.
arXiv Detail & Related papers (2020-06-15T10:08:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.