nach oben

Erschienen in:

2024 | OriginalPaper | Buchkapitel

Using Process Mining for Face Validity Assessment in Agent-Based Simulation Models: An Exploratory Case Study

verfasst von : Rob Bemthuis, Ruben Govers, Sanja Lazarova-Molnar

Erschienen in: Cooperative Information Systems

Verlag: Springer Nature Switzerland

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

In the field of simulation, the key objective of a system designer is to develop a model that performs a specific task and accurately represents real-world systems or processes. A valid simulation model allows for a better understanding of the system’s behavior and improved decision-making in the real world. Face validity is a subjective measure that assesses the extent to which a simulation model and its outcomes appear reasonable to an expert based on a superficial examination of the simulator’s realism. Process mining techniques, which are novel data-driven methods for obtaining real-life insights into processes based on event logs, show promise when combined with effective visualization techniques. These techniques can augment the face validity assessment of simulation models in reflecting real-life behavior and play a key role in supporting humans conducting such assessments. In this paper, we present an approach that utilizes process mining techniques to assess the face validity of agent-based simulation models. To illustrate our approach, we use the Schelling model of segregation. We demonstrate how graphical representation, immersive assessment, and sensitivity analysis can be used to assess face validity based on event logs produced by the simulation model. Our study shows that process mining in combination with visualization can strongly support humans in assessing face validity of agent-based simulation models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Rectify Sensor Data in IoT: A Case Study on Enabling Process Mining for Logistic Process in an Air Cargo Terminal

Nächstes Kapitel Towards Scaling External Feedback for Early-Stage Researchers: A Survey Study

van der Aalst, W.M.P.: Process Mining: Discovery, Conformance and Enhancement of Business Processes. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-19345-3CrossRefMATH

Belhadi, A., Djenouri, Y., Diaz, V.G., Houssein, E.H., Lin, J.C.W.: Hybrid intelligent framework for automated medical learning. Expert. Syst. 39(6), e12737 (2022). https://doi.org/10.1111/exsy.12737CrossRef

Bemthuis, R., Lazarova-Molnar, S.: An approach for face validity assessment of agent-based simulation models through outlier detection with process mining. In: Enterprise Design, Operations, and Computing (in press)

Bemthuis, R., Mes, M., Iacob, M.E., Havinga, P.: Using agent-based simulation for emergent behavior detection in cyber-physical systems. In: 2020 Winter Simulation Conference (WSC), pp. 230–241. IEEE (2020). https://doi.org/10.1109/WSC48552.2020.9383956

Bemthuis, R.H., Koot, M., Mes, M.R., Bukhsh, F.A., Iacob, M.E., Meratnia, N.: An agent-based process mining architecture for emergent behavior analysis. In: 2019 IEEE 23rd International Enterprise Distributed Object Computing Workshop (EDOCW), pp. 54–64. IEEE (2019). https://doi.org/10.1109/EDOCW.2019.00022

Bemthuis, R.H., Lazarova-Molnar, S.: Discovering agent models using process mining: initial approach and a case study. In: 2022 IEEE International Conference on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking (ISPA/BDCloud/SocialCom/SustainCom), pp. 163–172 (2022). https://doi.org/10.1109/ISPA-BDCloud-SocialCom-SustainCom57177.2022.00028

Berti, A., van Zelst, S.J., van der Aalst, W.M.P.: Process mining for python (PM4Py): bridging the gap between process-and data science. arXiv preprint arXiv:1905.06169 (2019)

Burattin, A.: Streaming process mining. In: van der Aalst, W.M.P., Carmona, J. (eds.) Process Mining Handbook. LNBIP, vol. 448, pp. 349–372. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-08848-3_11CrossRef

Cabac, L., Knaak, N., Moldt, D., Rölke, H.: Analysis of multi-agent interactions with process mining techniques. In: Fischer, K., Timm, I.J., André, E., Zhong, N. (eds.) MATES 2006. LNCS (LNAI), vol. 4196, pp. 12–23. Springer, Heidelberg (2006). https://doi.org/10.1007/11872283_2CrossRef

10.

Carter, F., et al.: Consensus guidelines for validation of virtual reality surgical simulators. Surv. Methodol. 19, 1523–1532 (2005). https://doi.org/10.1007/s00464-005-0384-2CrossRef

11.

Clark, W.A., Fossett, M.: Understanding the social context of the Schelling segregation model. Proc. Natl. Acad. Sci. 105(11), 4109–4114 (2008). https://doi.org/10.1073/pnas.0708155105CrossRef

12.

Ferreira, D.R., Szimanski, F., Ralha, C.G.: Mining the low-level behaviour of agents in high-level business processes. Int. J. Bus. Process Integr. Manag. 8 6(2), 146–166 (2013). https://doi.org/10.1504/IJBPIM.2013.054678CrossRef

13.

Foramitti, J.: AgentPy: a package for agent-based modeling in Python. J. Open Source Softw. 6(62), 3065 (2021). https://doi.org/10.21105/joss.03065CrossRef

14.

Halaška, M., Šperka, R.: Advantages of application of process mining and agent-based systems in business domain. In: Jezic, G., Chen-Burger, Y.-H.J., Howlett, R.J., Jain, L.C., Vlacic, L., Šperka, R. (eds.) KES-AMSTA-18 2018. SIST, vol. 96, pp. 177–186. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-92031-3_17CrossRef

15.

Hardesty, D.M., Bearden, W.O.: The use of expert judges in scale development: implications for improving face validity of measures of unobservable constructs. J. Bus. Res. 57(2), 98–107 (2004). https://doi.org/10.1016/S0148-2963(01)00295-8CrossRef

16.

Henry, A.D., Prałat, P., Zhang, C.Q.: Emergence of segregation in evolving social networks. Proc. Natl. Acad. Sci. 108(21), 8605–8610 (2011). https://doi.org/10.1073/pnas.1014486108MathSciNetCrossRefMATH

17.

Hill, A.L., Rand, D.G., Nowak, M.A., Christakis, N.A.: Infectious disease modeling of social contagion in networks. PLoS Comput. Biol. 6(11), e1000968 (2010). https://doi.org/10.1371/journal.pcbi.1000968MathSciNetCrossRef

18.

Hüllen, G., Zhai, J., Kim, S.H., Sinha, A., Realff, M.J., Boukouvala, F.: Managing uncertainty in data-driven simulation-based optimization. Comput. Chem. Eng. 136, 106519 (2020). https://doi.org/10.1016/j.compchemeng.2019.106519CrossRef

19.

Ito, S., Vymětal, D., Šperka, R., Halaška, M.: Process mining of a multi-agent business simulator. Comput. Math. Organ. Theory 24(4), 500–531 (2018). https://doi.org/10.1007/s10588-018-9268-6CrossRef

20.

Klügl, F.: A validation methodology for agent-based simulations. In: Proceedings of the 2008 ACM Symposium on Applied Computing, pp. 39–43 (2008). https://doi.org/10.1145/1363686.1363696

21.

Law, A.M., Kelton, W.D., Kelton, W.D.: Simulation Modeling and Analysis, vol. 3. McGraw-Hill, New York (2007)MATH

22.

Liu, Z., Li, X., Khojandi, A., Lazarova-Molnar, S.: On the extension of Schelling’s segregation model. In: 2019 Winter Simulation Conference (WSC), pp. 285–296. IEEE (2019). https://doi.org/10.1109/WSC40007.2019.9004848

23.

Mourtzis, D.: Simulation in the design and operation of manufacturing systems: state of the art and new trends. Int. J. Prod. Res. 58(7), 1927–1949 (2020). https://doi.org/10.1080/00207543.2019.1636321CrossRef

24.

Negahban, A., Smith, J.S.: Simulation for manufacturing system design and operation: literature review and analysis. J. Manuf. Syst. 33(2), 241–261 (2014). https://doi.org/10.1016/j.jmsy.2013.12.007CrossRef

25.

Royal, K.: “Face validity’’ is not a legitimate type of validity evidence! Am. J. Surg. 212(5), 1026–1027 (2016). https://doi.org/10.1016/j.amjsurg.2016.02.018CrossRef

26.

Rozinat, A., van der Aalst, W.M.P.: Conformance checking of processes based on monitoring real behavior. Inf. Syst. 33(1), 64–95 (2008). https://doi.org/10.1016/j.is.2007.07.001CrossRef

27.

Sargent, R.G.: Validation and verification of simulation models. In: Proceedings of the 24th Conference on Winter Simulation, pp. 104–114 (1992)

28.

Sargent, R.G.: Verification and validation of simulation models. In: Proceedings of the 2010 Winter Simulation Conference, pp. 166–183. IEEE (2010). https://doi.org/10.1109/WSC.2010.5679166

29.

Sargent, R.G.: Verification and validation of simulation models: an advanced tutorial. In: 2020 Winter Simulation Conference (WSC), pp. 16–29 (2020)

30.

Schelling, T.C.: Models of segregation. Am. Econ. Rev. 59(2), 488–493 (1969)

31.

Schelling, T.C.: Dynamic models of segregation. J. Math. Sociol. 1(2), 143–186 (1971)CrossRefMATH

32.

Sert, E., Bar-Yam, Y., Morales, A.J.: Segregation dynamics with reinforcement learning and agent based modeling. Sci. Rep. 10(1), 11771 (2020). https://doi.org/10.1038/s41598-020-68447-8CrossRef

33.

Shannon, R.: Introduction to the art and science of simulation. In: 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274), vol. 1, pp. 7–14 (1998). https://doi.org/10.1109/WSC.1998.744892

34.

Singh, A., Vainchtein, D., Weiss, H.: Schelling’s segregation model: parameters, scaling, and aggregation. Demogr. Res. 21, 341–366 (2009). https://doi.org/10.4054/DemRes.2009.21.12CrossRef

35.

Šperka, R., Spišák, M., Slaninová, K., Martinovič, J., Dráždilová, P.: Control loop model of virtual company in BPM simulation. In: Snášel, V., Abraham, A., Corchado, E. (eds.) Soft Computing Models in Industrial and Environmental Applications. AIS, pp. 515–524. Springer, Cham (2013). https://doi.org/10.1007/978-3-642-32922-7_53CrossRef

36.

Sulis, E., Taveter, K.: Beyond process simulation. In: Sulis, E., Taveter, K. (eds.) Agent-Based Business Process Simulation, pp. 175–182. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-98816-6_9CrossRef

37.

Tour, A., Polyvyanyy, A., Kalenkova, A.: Agent system mining: vision, benefits, and challenges. IEEE Access 9, 99480–99494 (2021). https://doi.org/10.1109/ACCESS.2021.3095464CrossRef

38.

Weijters, A.J.M.M., van der Aalst, W.M.P., de Medeiros, A.K.A.: Process mining with the HeuristicsMiner algorithm (2006)

Titel: Using Process Mining for Face Validity Assessment in Agent-Based Simulation Models: An Exploratory Case Study
verfasst von: Rob Bemthuis
Ruben Govers
Sanja Lazarova-Molnar
Verlag: Springer Nature Switzerland
Buch: Cooperative Information Systems
Print ISBN: 978-3-031-46845-2

Electronic ISBN: 978-3-031-46846-9

Copyright-Jahr: 2024
DOI: https://doi.org/10.1007/978-3-031-46846-9_17

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner