Skip to main content

2024 | OriginalPaper | Buchkapitel

Empirical Evidence of DMN Errors in the Wild - An SAP Signavio Case Study

verfasst von : Carl Corea, Timotheus Kampik, Patrick Delfmann

Erschienen in: Business Process Management Workshops

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

While the Decision Model and Notation standard (DMN) is considered to be an increasingly popular standard, there is a broad consensus that human modelling errors can easily occur in the creation of DMN models. Yet, while this consensus is clear, there is only limited evidence of which error types exactly may occur in practice. In this work, we therefore present some empirical evidence on DMN errors in the wild. Specifically, we analyze the SAP-SAM dataset by SAP Signavio, containing over 500 000 real-world conceptual models. Our results show that modelling errors, such as missing rules, occur frequently in real-life settings (36.1% of all models contained some form of issue). Furthermore, we analyze the distribution of which error types have occurred (relative to an existing classification of DMN error types from a previous work). To the best of our knowledge, this is the largest DMN study conducted to date (N = 5 668 DMN models).

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
4
The SAP-SAM is available at https://​zenodo.​org/​record/​6964945. Example code that gives a starting point for working with the dataset is available at https://​github.​com/​signavio/​sap-sam. Excluding auto-generated example models, the dataset contains around 550,000 models in various notations.
 
5
The Pearson correlation coefficient r is a metric that measures the strength of the linear relationship between two variables, defined via \(r=\frac{\sum (x_i - \overline{x})(y_i - \overline{y})}{\sqrt{\sum (x_i - \overline{x})^2(y_i - \overline{y})^2}}\), where \(x_i, y_i\) are the individual samples of variables xy, and \(\overline{x}, \overline{y}\) are the mean values over x and y. Note that r is a value between −1 and 1, where 1 is a strong positive correlation, and vice versa for \(-1\). For a positive number, the correlation can be read as “the more x, the more y”.
 
Literatur
1.
Zurück zum Zitat Batoulis, K., Nesterenko, A., Repitsch, G., Weske, M.: Decision management in the insurance industry: standards and tools. In: Proceedings of the BPM 2017 Industry Track, Barcelona, Spain, pp. 52–63. CEUR-WS.org (2017) Batoulis, K., Nesterenko, A., Repitsch, G., Weske, M.: Decision management in the insurance industry: standards and tools. In: Proceedings of the BPM 2017 Industry Track, Barcelona, Spain, pp. 52–63. CEUR-WS.org (2017)
2.
Zurück zum Zitat Smit, K., Versendaal, J., Zoet, M.: Verification capabilities for business rules management in the Dutch governmental context. In: Proceedings of the 21st Pacific Conference on Information Systems (PACIS 2017), Langkawi, Malaysia, pp. 201–212. AISel (2017) Smit, K., Versendaal, J., Zoet, M.: Verification capabilities for business rules management in the Dutch governmental context. In: Proceedings of the 21st Pacific Conference on Information Systems (PACIS 2017), Langkawi, Malaysia, pp. 201–212. AISel (2017)
3.
Zurück zum Zitat De Leoni, M., Felli, P., Montali, M.: Integrating BPMN and DMN: modeling and analysis. J. Data Semant. 10(1–2), 165–188 (2021)CrossRef De Leoni, M., Felli, P., Montali, M.: Integrating BPMN and DMN: modeling and analysis. J. Data Semant. 10(1–2), 165–188 (2021)CrossRef
4.
Zurück zum Zitat Kampik, T., et al.: SAP signavio academic models (2022) Kampik, T., et al.: SAP signavio academic models (2022)
6.
Zurück zum Zitat Felli, P., de Leoni, M., Montali, M.: Soundness verification of decision-aware process models with variable-to-variable conditions. In: 19th International Conference on Application of Concurrency to System Design (ACSD), pp. 82–91. IEEE (2019) Felli, P., de Leoni, M., Montali, M.: Soundness verification of decision-aware process models with variable-to-variable conditions. In: 19th International Conference on Application of Concurrency to System Design (ACSD), pp. 82–91. IEEE (2019)
8.
Zurück zum Zitat Vanthienen, J., Mues, C., Wets, G., Delaere, K.: A tool-supported approach to inter-tabular verification. Expert Syst. Appl. 15, 277–285 (1998)CrossRef Vanthienen, J., Mues, C., Wets, G., Delaere, K.: A tool-supported approach to inter-tabular verification. Expert Syst. Appl. 15, 277–285 (1998)CrossRef
9.
Zurück zum Zitat Hasic, F., Corea, C., Blatt, J., Delfmann, P., Serral, E.: Decision model change patterns for dynamic system evolution. Knowl. Inf. Syst. 62, 3665–3696 (2020)CrossRef Hasic, F., Corea, C., Blatt, J., Delfmann, P., Serral, E.: Decision model change patterns for dynamic system evolution. Knowl. Inf. Syst. 62, 3665–3696 (2020)CrossRef
10.
Zurück zum Zitat Blatt, J.: Prototyping a verification tool for decision model and notation. Master’s thesis, University of Koblenz-Landau (2020) Blatt, J.: Prototyping a verification tool for decision model and notation. Master’s thesis, University of Koblenz-Landau (2020)
12.
Zurück zum Zitat Hasić, F., Vanthienen, J.: Complexity metrics for DMN decision models. Comput. Stand. Interfaces 65, 15–37 (2019)CrossRef Hasić, F., Vanthienen, J.: Complexity metrics for DMN decision models. Comput. Stand. Interfaces 65, 15–37 (2019)CrossRef
Metadaten
Titel
Empirical Evidence of DMN Errors in the Wild - An SAP Signavio Case Study
verfasst von
Carl Corea
Timotheus Kampik
Patrick Delfmann
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-50974-2_25

Premium Partner