Structural Positional Encoding for knowledge integration in transformer-based medical process monitoring

• URL: http://arxiv.org/abs/2403.08836v1
• Date: Wed, 13 Mar 2024 08:15:18 GMT
• Title: Structural Positional Encoding for knowledge integration in transformer-based medical process monitoring
• Abstract summary: We propose a predictive process monitoring approach relying on the use of a em transformer, a deep learning architecture based on the attention mechanism. A major contribution of our work lies in the incorporation of ontological domain-specific knowledge, carried out through a graph positional encoding technique.
• Score: 0.26999000177990923
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Predictive process monitoring is a process mining task aimed at forecasting information about a running process trace, such as the most correct next activity to be executed. In medical domains, predictive process monitoring can provide valuable decision support in atypical and nontrivial situations. Decision support and quality assessment in medicine cannot ignore domain knowledge, in order to be grounded on all the available information (which is not limited to data) and to be really acceptable by end users. In this paper, we propose a predictive process monitoring approach relying on the use of a {\em transformer}, a deep learning architecture based on the attention mechanism. A major contribution of our work lies in the incorporation of ontological domain-specific knowledge, carried out through a graph positional encoding technique. The paper presents and discusses the encouraging experimental result we are collecting in the domain of stroke management.

Related papers

• Feature Attribution-Based Explainability Analysis of Deep Learning Models in Predictive Process Monitoring [2.9503907416726745]
  We propose a local post-hoc explainability method for deep neural networks in outcome prediction.<n>The method relies on a control-flow-aware segmentation algorithm that partitions a trace into meaningful segments.<n>We demonstrate its usefulness on real-world event logs from a loan application process and an administrative process of a Dutch municipality.
  arXiv  Detail & Related papers  (2026-07-20T10:15:47Z)
• Towards a Virtual Neuroscientist: Autonomous Neuroimaging Analysis via Multi-Agent Collaboration [53.772014300855375]
  We introduce NIAgent, a multi-agent system for autonomous end-to-end neuroimaging analysis.<n>Unlike conventional flat tool-calling agents, NIAgent adopts a code-centric execution paradigm.<n>We propose a hierarchical verification framework for autonomous quality control, integrating cohort-level metric screening with agentic visual inspection.
  arXiv  Detail & Related papers  (2026-05-10T06:30:19Z)
• Improving Hospital Process Management through Process Mining: A Case Study on COVID-19 Clinical Pathways [1.7219362335740878]
  This study analyzes COVID-19 care pathways using the COVID Data for Shared Learning dataset.<n>We build a transparent, reproducible pipeline that transforms heterogeneous clinical tables into a process-mining-ready event log.
  arXiv  Detail & Related papers  (2026-04-28T09:24:27Z)
• Implicit Deformable Medical Image Registration with Learnable Kernels [0.6749750044497731]
  Deformable medical image registration is an essential task in computer-assisted interventions.<n>Recent AI methods can outperform traditional techniques in accuracy and speed.<n>We introduce a novel implicit registration framework that can predict accurate and reliable deformations.
  arXiv  Detail & Related papers  (2025-06-02T18:27:11Z)
• WISE: Unraveling Business Process Metrics with Domain Knowledge [0.0]
  Anomalies in complex industrial processes are often obscured by high variability and complexity of event data. We introduce WISE, a novel method for analyzing business process metrics through the integration of domain knowledge, process mining, and machine learning. We show that WISE enhances automation in business process analysis and effectively detects deviations from desired process flows.
  arXiv  Detail & Related papers  (2024-10-06T07:57:08Z)
• Attention Please: What Transformer Models Really Learn for Process Prediction [0.0]
  This paper examines whether the attention scores of a transformer based next-activity prediction model can serve as an explanation for its decision-making. We find that attention scores in next-activity prediction models can serve as explainers and exploit this fact in two proposed graph-based explanation approaches.
  arXiv  Detail & Related papers  (2024-08-12T08:20:38Z)
• Process Variant Analysis Across Continuous Features: A Novel Framework [0.0]
  This research addresses the challenge of effectively segmenting cases within operational processes. We present a novel approach employing a sliding window technique combined with the earth mover's distance to detect changes in control flow behavior. We validate our methodology through a real-life case study in collaboration with UWV, the Dutch employee insurance agency.
  arXiv  Detail & Related papers  (2024-05-06T16:10:13Z)
• DARE: Towards Robust Text Explanations in Biomedical and Healthcare Applications [54.93807822347193]
  We show how to adapt attribution robustness estimation methods to a given domain, so as to take into account domain-specific plausibility. Next, we provide two methods, adversarial training and FAR training, to mitigate the brittleness characterized by DARE. Finally, we empirically validate our methods with extensive experiments on three established biomedical benchmarks.
  arXiv  Detail & Related papers  (2023-07-05T08:11:40Z)
• Trace Encoding in Process Mining: a survey and benchmarking [0.34410212782758054]
  Methods are employed across several process mining tasks, including predictive process monitoring, anomalous case detection, clustering trace, etc. Most papers choose existing encoding methods arbitrarily or employ a strategy based on a specific expert knowledge domain. This work aims at providing a comprehensive survey on event log encoding by comparing 27 methods.
  arXiv  Detail & Related papers  (2023-01-05T17:25:30Z)
• Machine learning in bioprocess development: From promise to practice [58.720142291102135]
  Data-driven methods like machine learning (ML) approaches have a high potential to rationally explore large design spaces. The aim of this review is to demonstrate how ML methods have been applied so far in bioprocess development.
  arXiv  Detail & Related papers  (2022-10-04T13:48:59Z)
• Metrics reloaded: Recommendations for image analysis validation [59.60445111432934]
  Metrics Reloaded is a comprehensive framework guiding researchers in the problem-aware selection of metrics. The framework was developed in a multi-stage Delphi process and is based on the novel concept of a problem fingerprint. Based on the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics.
  arXiv  Detail & Related papers  (2022-06-03T15:56:51Z)
• Unsupervised deep learning techniques for powdery mildew recognition based on multispectral imaging [63.62764375279861]
  This paper presents a deep learning approach to automatically recognize powdery mildew on cucumber leaves. We focus on unsupervised deep learning techniques applied to multispectral imaging data. We propose the use of autoencoder architectures to investigate two strategies for disease detection.
  arXiv  Detail & Related papers  (2021-12-20T13:29:13Z)
• A2Log: Attentive Augmented Log Anomaly Detection [53.06341151551106]
  Anomaly detection becomes increasingly important for the dependability and serviceability of IT services. Existing unsupervised methods need anomaly examples to obtain a suitable decision boundary. We develop A2Log, which is an unsupervised anomaly detection method consisting of two steps: Anomaly scoring and anomaly decision.
  arXiv  Detail & Related papers  (2021-09-20T13:40:21Z)
• CoCoMoT: Conformance Checking of Multi-Perspective Processes via SMT (Extended Version) [62.96267257163426]
  We introduce the CoCoMoT (Computing Conformance Modulo Theories) framework. First, we show how SAT-based encodings studied in the pure control-flow setting can be lifted to our data-aware case. Second, we introduce a novel preprocessing technique based on a notion of property-preserving clustering.
  arXiv  Detail & Related papers  (2021-03-18T20:22:50Z)
• Explainable Artificial Intelligence for Process Mining: A General Overview and Application of a Novel Local Explanation Approach for Predictive Process Monitoring [0.0]
  This study proposes a conceptual framework sought to establish and promote understanding of decision-making environment. This study defines the local regions from the validation dataset by using the intermediate latent space representations. The adopted deep learning classifier achieves a good performance with the Area Under the ROC Curve of 0.94.
  arXiv  Detail & Related papers  (2020-09-04T10:28:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.