Top

Published in:

2024 | OriginalPaper | Chapter

A Discussion on Generalization in Next-Activity Prediction

Authors : Luka Abb, Peter Pfeiffer, Peter Fettke, Jana-Rebecca Rehse

Published in: Business Process Management Workshops

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Next activity prediction aims to forecast the future behavior of running process instances. Recent publications in this field predominantly employ deep learning techniques and evaluate their prediction performance using publicly available event logs. This paper presents empirical evidence that calls into question the effectiveness of these current evaluation approaches. We show that there is an enormous amount of example leakage in all of the commonly used event logs, so that rather trivial prediction approaches perform almost as well as ones that leverage deep learning. We further argue that designing robust evaluations requires a more profound conceptual engagement with the topic of next-activity prediction, and specifically with the notion of generalization to new data. To this end, we present various prediction scenarios that necessitate different types of generalization to guide future research.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter A Responsibility Framework for Computing Optimal Process Alignments

next chapter An Experiment on Transfer Learning for Suffix Prediction on Event Logs

https://gitlab.uni-mannheim.de/jpmac/ppm-generalization.

A notable exception to this is [8], which focuses on process model structures.

Breuker, D., Matzner, M., Delfmann, P., Becker, J.: Comprehensible predictive models for business processes. MIS Q. 40(4), 1009–1034 (2016)CrossRef

Brunk, J., Stottmeister, J., Weinzierl, S., Matzner, M., Becker, J.: Exploring the effect of context information on deep learning business process predictions. J. Decis. Syst. 29(sup1), 328–343 (2020)CrossRef

Di Francescomarino, C., Ghidini, C.: Predictive process monitoring. In: van der Aalst, W.M.P., Carmona, J. (eds.) Process Mining Handbook. Lecture Notes in Business Information Processing, vol. 448, pp. 320–346. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-08848-3_10CrossRef

Evermann, J., Rehse, J.R., Fettke, P.: Predicting process behaviour using deep learning. Decis. Support Syst. 100, 129–140 (2017)CrossRef

Kaufman, S., Rosset, S., Perlich, C.: Leakage in data mining: formulation, detection, and avoidance. In: KDD Conference, vol. 6, pp. 556–563. ACM, New YOrk (2011)

Neu, D., Lahann, J., Fettke, P.: A systematic literature review on state-of-the-art deep learning methods for process prediction. Art. Int. Rev. 55, 1–27 (2022)

Pasquadibisceglie, V., Appice, A., Castellano, G., Malerba, D.: A multi-view deep learning approach for predictive business process monitoring. IEEE Trans. Serv. Comp. 15(04), 2382–2395 (2022)CrossRef

Peeperkorn, J., Broucke, S.V., De Weerdt, J.: Can recurrent neural networks learn process model structure? J. Intell. Inf. Syst. 61, 1–25 (2022)

Pfeiffer, P., Lahann, J., Fettke, P.: Multivariate business process representation learning utilizing Gramian angular fields and convolutional neural networks. In: Polyvyanyy, A., Wynn, M.T., Van Looy, A., Reichert, M. (eds.) BPM 2021. LNCS, vol. 12875, pp. 327–344. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-85469-0_21CrossRef

10.

Pfeiffer, P., Lahann, J., Fettke, P.: The label ambiguity problem in process prediction. In: Cabanillas, C., Garmann-Johnsen, N.F., Koschmider, A. (eds.) BPM 2022. LNBIP, vol. 460, pp. 37–44. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-25383-6_4CrossRef

11.

Rama-Maneiro, E., Vidal, J., Lama, M.: Deep learning for predictive business process monitoring: review and benchmark. IEEE Trans. Serv. Comp. 16(1) (2021)

12.

Scheid, M., Rehse, J.R., Houy, C., Fettke, P.: Data set for MobIS challenge 2019 (2018). https://doi.org/10.13140/RG.2.2.11870.28487

13.

Tax, N., Teinemaa, I., van Zelst, S.J.: An interdisciplinary comparison of sequence modeling methods for next-element prediction. Softw. Syst. Model. 19(6), 1345–1365 (2020)CrossRef

14.

Verenich, I.: Helpdesk event log. https://doi.org/10.17632/39bp3vv62t.1

15.

Weytjens, H., De Weerdt, J.: Creating unbiased public benchmark datasets with data leakage prevention for predictive process monitoring. In: Marrella, A., Weber, B. (eds.) BPM 2021. LNBIP, vol. 436, pp. 18–29. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-94343-1_2CrossRef

Title: A Discussion on Generalization in Next-Activity Prediction
Authors: Luka Abb
Peter Pfeiffer
Peter Fettke
Jana-Rebecca Rehse
Publisher: Springer Nature Switzerland
Book: Business Process Management Workshops
Print ISBN: 978-3-031-50973-5

Electronic ISBN: 978-3-031-50974-2

Copyright Year: 2024
DOI: https://doi.org/10.1007/978-3-031-50974-2_2

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner