Top

Published in:

2024 | OriginalPaper | Chapter

Empirical Evidence of DMN Errors in the Wild - An SAP Signavio Case Study

Authors : Carl Corea, Timotheus Kampik, Patrick Delfmann

Published in: Business Process Management Workshops

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

While the Decision Model and Notation standard (DMN) is considered to be an increasingly popular standard, there is a broad consensus that human modelling errors can easily occur in the creation of DMN models. Yet, while this consensus is clear, there is only limited evidence of which error types exactly may occur in practice. In this work, we therefore present some empirical evidence on DMN errors in the wild. Specifically, we analyze the SAP-SAM dataset by SAP Signavio, containing over 500 000 real-world conceptual models. Our results show that modelling errors, such as missing rules, occur frequently in real-life settings (36.1% of all models contained some form of issue). Furthermore, we analyze the distribution of which error types have occurred (relative to an existing classification of DMN error types from a previous work). To the best of our knowledge, this is the largest DMN study conducted to date (N = 5 668 DMN models).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Pareto-Optimal Trace Generation from Declarative Process Models

next chapter Digital Twin of the Organization for Support of Customer Journeys and Business Processes

https://www.omg.org/spec/DMN/About-DMN/.

https://cloud.uni-koblenz-landau.de/s/yRbQWTiBtE9ZBFq.

https://www.signavio.com.

The SAP-SAM is available at https://zenodo.org/record/6964945. Example code that gives a starting point for working with the dataset is available at https://github.com/signavio/sap-sam. Excluding auto-generated example models, the dataset contains around 550,000 models in various notations.

The Pearson correlation coefficient r is a metric that measures the strength of the linear relationship between two variables, defined via \(r=\frac{\sum (x_i - \overline{x})(y_i - \overline{y})}{\sqrt{\sum (x_i - \overline{x})^2(y_i - \overline{y})^2}}\), where \(x_i, y_i\) are the individual samples of variables x, y, and \(\overline{x}, \overline{y}\) are the mean values over x and y. Note that r is a value between −1 and 1, where 1 is a strong positive correlation, and vice versa for \(-1\). For a positive number, the correlation can be read as “the more x, the more y”.

https://decisioncamp2020home.files.wordpress.com/2020/06/decisioncamp2020.alanfish.pdf.

Batoulis, K., Nesterenko, A., Repitsch, G., Weske, M.: Decision management in the insurance industry: standards and tools. In: Proceedings of the BPM 2017 Industry Track, Barcelona, Spain, pp. 52–63. CEUR-WS.org (2017)

Smit, K., Versendaal, J., Zoet, M.: Verification capabilities for business rules management in the Dutch governmental context. In: Proceedings of the 21st Pacific Conference on Information Systems (PACIS 2017), Langkawi, Malaysia, pp. 201–212. AISel (2017)

De Leoni, M., Felli, P., Montali, M.: Integrating BPMN and DMN: modeling and analysis. J. Data Semant. 10(1–2), 165–188 (2021)CrossRef

Kampik, T., et al.: SAP signavio academic models (2022)

Grohé, C.-C., Corea, C., Delfmann, P.: DMN 1.0 verification capabilities: an analysis of current tool support. In: Polyvyanyy, A., Wynn, M.T., Van Looy, A., Reichert, M. (eds.) BPM 2021. LNBIP, vol. 427, pp. 37–53. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-85440-9_3CrossRef

Felli, P., de Leoni, M., Montali, M.: Soundness verification of decision-aware process models with variable-to-variable conditions. In: 19th International Conference on Application of Concurrency to System Design (ACSD), pp. 82–91. IEEE (2019)

Batoulis, K., Weske, M.: Soundness of decision-aware business processes. In: Carmona, J., Engels, G., Kumar, A. (eds.) BPM 2017. LNBIP, vol. 297, pp. 106–124. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65015-9_7CrossRef

Vanthienen, J., Mues, C., Wets, G., Delaere, K.: A tool-supported approach to inter-tabular verification. Expert Syst. Appl. 15, 277–285 (1998)CrossRef

Hasic, F., Corea, C., Blatt, J., Delfmann, P., Serral, E.: Decision model change patterns for dynamic system evolution. Knowl. Inf. Syst. 62, 3665–3696 (2020)CrossRef

10.

Blatt, J.: Prototyping a verification tool for decision model and notation. Master’s thesis, University of Koblenz-Landau (2020)

11.

Hasić, F., Corea, C., Blatt, J., Delfmann, P., Serral, E.: A tool for the verification of decision model and notation (DMN) models. In: Dalpiaz, F., Zdravkovic, J., Loucopoulos, P. (eds.) RCIS 2020. LNBIP, vol. 385, pp. 536–542. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50316-1_35CrossRef

12.

Hasić, F., Vanthienen, J.: Complexity metrics for DMN decision models. Comput. Stand. Interfaces 65, 15–37 (2019)CrossRef

Title: Empirical Evidence of DMN Errors in the Wild - An SAP Signavio Case Study
Authors: Carl Corea
Timotheus Kampik
Patrick Delfmann
Publisher: Springer Nature Switzerland
Book: Business Process Management Workshops
Print ISBN: 978-3-031-50973-5

Electronic ISBN: 978-3-031-50974-2

Copyright Year: 2024
DOI: https://doi.org/10.1007/978-3-031-50974-2_25

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner