A Discussion on Generalization in Next-Activity Prediction

• URL: http://arxiv.org/abs/2309.09618v1
• Date: Mon, 18 Sep 2023 09:42:36 GMT
• Title: A Discussion on Generalization in Next-Activity Prediction
• Authors: Luka Abb, Peter Pfeiffer, Peter Fettke, Jana-Rebecca Rehse
• Abstract summary: We show that there is an enormous amount of example leakage in all of the commonly used event logs. We argue that designing robust evaluations requires a more profound conceptual engagement with the topic of next-activity prediction.
• Score: 1.2289361708127877
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Next activity prediction aims to forecast the future behavior of running process instances. Recent publications in this field predominantly employ deep learning techniques and evaluate their prediction performance using publicly available event logs. This paper presents empirical evidence that calls into question the effectiveness of these current evaluation approaches. We show that there is an enormous amount of example leakage in all of the commonly used event logs, so that rather trivial prediction approaches perform almost as well as ones that leverage deep learning. We further argue that designing robust evaluations requires a more profound conceptual engagement with the topic of next-activity prediction, and specifically with the notion of generalization to new data. To this end, we present various prediction scenarios that necessitate different types of generalization to guide future research.

Related papers

• Human Action Anticipation: A Survey [86.415721659234]
  The literature on behavior prediction spans various tasks, including action anticipation, activity forecasting, intent prediction, goal prediction, and so on. Our survey aims to tie together this fragmented literature, covering recent technical innovations as well as the development of new large-scale datasets for model training and evaluation.
  arXiv  Detail & Related papers  (2024-10-17T21:37:40Z)
• PELP: Pioneer Event Log Prediction Using Sequence-to-Sequence Neural Networks [13.221876371019718]
  We present our approach to solving the event log prediction problem using the sequence-to-sequence deep learning approach. We evaluate and analyze the prediction outcomes on a variety of synthetic logs and seven real-life logs.
  arXiv  Detail & Related papers  (2023-12-15T12:30:30Z)
• Enhancing the Accuracy of Predictors of Activity Sequences of Business Processes [0.9668407688201361]
  The prediction of case suffixes provides input to estimate short-term workloads and execution times under different resource schedules. Existing methods to address this problem often generate suffixes wherein some activities are repeated many times, whereas this pattern is not observed in the data. The paper introduces a sampling approach aimed at reducing repetitions of activities in the predicted case suffixes.
  arXiv  Detail & Related papers  (2023-12-09T12:16:58Z)
• Encoder-Decoder Model for Suffix Prediction in Predictive Monitoring [0.0]
  Most approaches to the suffix prediction problem learn to predict the suffix by learning how to predict the next activity only. This paper proposes a novel architecture based on an encoder-decoder model with an attention mechanism that decouples the representation learning of the prefixes from the inference phase.
  arXiv  Detail & Related papers  (2022-11-29T11:27:29Z)
• Towards Out-of-Distribution Sequential Event Prediction: A Causal Treatment [72.50906475214457]
  The goal of sequential event prediction is to estimate the next event based on a sequence of historical events. In practice, the next-event prediction models are trained with sequential data collected at one time. We propose a framework with hierarchical branching structures for learning context-specific representations.
  arXiv  Detail & Related papers  (2022-10-24T07:54:13Z)
• What Should I Know? Using Meta-gradient Descent for Predictive Feature Discovery in a Single Stream of Experience [63.75363908696257]
  computational reinforcement learning seeks to construct an agent's perception of the world through predictions of future sensations. An open challenge in this line of work is determining from the infinitely many predictions that the agent could possibly make which predictions might best support decision-making. We introduce a meta-gradient descent process by which an agent learns what predictions to make, 2) the estimates for its chosen predictions, and 3) how to use those estimates to generate policies that maximize future reward.
  arXiv  Detail & Related papers  (2022-06-13T21:31:06Z)
• Review of Video Predictive Understanding: Early ActionRecognition and Future Action Prediction [39.966828592322315]
  Action prediction is a major sub-area of video predictive understanding. Various mathematical tools are widely adopted jointly with computer vision techniques for these two tasks. Structures that rely on deep convolutional neural networks and recurrent neural networks have been extensively proposed for improving the performance of existing vision tasks.
  arXiv  Detail & Related papers  (2021-07-11T22:46:52Z)
• Forecasting: theory and practice [65.71277206849244]
  This article provides a non-systematic review of the theory and the practice of forecasting. We provide an overview of a wide range of theoretical, state-of-the-art models, methods, principles, and approaches. We then demonstrate how such theoretical concepts are applied in a variety of real-life contexts.
  arXiv  Detail & Related papers  (2020-12-04T16:56:44Z)
• Video Prediction via Example Guidance [156.08546987158616]
  In video prediction tasks, one major challenge is to capture the multi-modal nature of future contents and dynamics. In this work, we propose a simple yet effective framework that can efficiently predict plausible future states.
  arXiv  Detail & Related papers  (2020-07-03T14:57:24Z)
• Counterfactual Predictions under Runtime Confounding [74.90756694584839]
  We study the counterfactual prediction task in the setting where all relevant factors are captured in the historical data. We propose a doubly-robust procedure for learning counterfactual prediction models in this setting.
  arXiv  Detail & Related papers  (2020-06-30T15:49:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.