Evaluating Predictive Business Process Monitoring Approaches on Small
Event Logs
- URL: http://arxiv.org/abs/2104.00362v1
- Date: Thu, 1 Apr 2021 09:36:04 GMT
- Title: Evaluating Predictive Business Process Monitoring Approaches on Small
Event Logs
- Authors: Martin K\"appel, Stefan Jablonski, Stefan Sch\"onig
- Abstract summary: Predictive business process monitoring is concerned with the prediction how a running process instance will unfold up to its completion at runtime.
Most of the proposed approaches rely on a wide number of different machine learning (ML) techniques.
This paper develops an evaluation framework for comparing existing approaches with regard to their suitability for small data sets.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Predictive business process monitoring is concerned with the prediction how a
running process instance will unfold up to its completion at runtime. Most of
the proposed approaches rely on a wide number of different machine learning
(ML) techniques. In the last years numerous comparative studies, reviews, and
benchmarks of such approaches where published and revealed that they can be
successfully applied for different prediction targets. ML techniques require a
qualitatively and quantitatively sufficient data set. However, there are many
situations in business process management (BPM) where only a quantitatively
insufficient data set is available. The problem of insufficient data in the
context of BPM is still neglected. Hence, none of the comparative studies or
benchmarks investigates the performance of predictive business process
monitoring techniques in environments with small data sets. In this paper an
evaluation framework for comparing existing approaches with regard to their
suitability for small data sets is developed and exemplarily applied to
state-of-the-art approaches in predictive business process monitoring.
Related papers
- Context is Key: A Benchmark for Forecasting with Essential Textual Information [87.3175915185287]
"Context is Key" (CiK) is a time series forecasting benchmark that pairs numerical data with diverse types of carefully crafted textual context.
We evaluate a range of approaches, including statistical models, time series foundation models, and LLM-based forecasters.
Our experiments highlight the importance of incorporating contextual information, demonstrate surprising performance when using LLM-based forecasting models, and also reveal some of their critical shortcomings.
arXiv Detail & Related papers (2024-10-24T17:56:08Z) - Achieving Fairness in Predictive Process Analytics via Adversarial Learning [50.31323204077591]
This paper addresses the challenge of integrating a debiasing phase into predictive business process analytics.
Our framework leverages on adversial debiasing is evaluated on four case studies, showing a significant reduction in the contribution of biased variables to the predicted value.
arXiv Detail & Related papers (2024-10-03T15:56:03Z) - FRAPPE: A Group Fairness Framework for Post-Processing Everything [48.57876348370417]
We propose a framework that turns any regularized in-processing method into a post-processing approach.
We show theoretically and through experiments that our framework preserves the good fairness-error trade-offs achieved with in-processing.
arXiv Detail & Related papers (2023-12-05T09:09:21Z) - Performance-Preserving Event Log Sampling for Predictive Monitoring [0.3425341633647624]
We propose an instance selection procedure that allows sampling training process instances for prediction models.
We show that our instance selection procedure allows for a significant increase of training speed for next activity and remaining time prediction methods.
arXiv Detail & Related papers (2023-01-18T16:07:56Z) - Systematic Evaluation of Predictive Fairness [60.0947291284978]
Mitigating bias in training on biased datasets is an important open problem.
We examine the performance of various debiasing methods across multiple tasks.
We find that data conditions have a strong influence on relative model performance.
arXiv Detail & Related papers (2022-10-17T05:40:13Z) - Event Log Sampling for Predictive Monitoring [0.3425341633647624]
This paper proposes an instance selection procedure that allows sampling training process instances for prediction models.
We show that our sampling method allows for a significant increase of training speed for next activity prediction methods while maintaining reliable levels of prediction accuracy.
arXiv Detail & Related papers (2022-04-04T13:36:48Z) - Prescriptive Process Monitoring: Quo Vadis? [64.39761523935613]
The paper studies existing methods in this field via a Systematic Literature Review ( SLR)
The SLR provides insights into challenges and areas for future research that could enhance the usefulness and applicability of prescriptive process monitoring methods.
arXiv Detail & Related papers (2021-12-03T08:06:24Z) - What Averages Do Not Tell -- Predicting Real Life Processes with
Sequential Deep Learning [0.1376408511310322]
Process Mining concerns discovering insights on business processes from their execution data that are logged by systems.
Many Deep Learning techniques have been successfully adapted for predictive Process Mining that aims to predict process outcomes.
Traces in Process Mining are multimodal sequences and very differently structured than natural language sentences or images.
arXiv Detail & Related papers (2021-10-19T19:45:05Z) - An Investigation of Replay-based Approaches for Continual Learning [79.0660895390689]
Continual learning (CL) is a major challenge of machine learning (ML) and describes the ability to learn several tasks sequentially without catastrophic forgetting (CF)
Several solution classes have been proposed, of which so-called replay-based approaches seem very promising due to their simplicity and robustness.
We empirically investigate replay-based approaches of continual learning and assess their potential for applications.
arXiv Detail & Related papers (2021-08-15T15:05:02Z) - Interpreting Process Predictions using a Milestone-Aware Counterfactual
Approach [0.0]
We explore the use of a popular model-agnostic counterfactual algorithm, DiCE, in the context of predictive process analytics.
The analysis reveals that the algorithm is limited when being applied to derive explanations of process predictions.
We propose an approach that supports deriving milestone-aware counterfactuals at different stages of a trace to promote interpretability.
arXiv Detail & Related papers (2021-07-19T09:14:16Z) - Prescriptive Business Process Monitoring for Recommending Next Best
Actions [0.0]
Predictive business process monitoring (PBPM) techniques predict future process behaviour based on historical event log data.
Recent PBPM techniques use state-of-the-art deep neural networks (DNNs) to learn predictive models for producing more accurate predictions.
We present a PrBPM technique that transforms the next most likely activities into the next best actions regarding a given.
arXiv Detail & Related papers (2020-08-19T22:33:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.