Skip to main content
main-content
Top

Hint

Swipe to navigate through the articles of this issue

Published in: Education and Information Technologies 6/2017

02-02-2017

An empirical verification of a-priori learning models on mailing archives in the context of online learning activities of participants in free\libre open source software (FLOSS) communities

Authors: Patrick Mukala, Antonio Cerone, Franco Turini

Published in: Education and Information Technologies | Issue 6/2017

Login to get access
share
SHARE

Abstract

Free\Libre Open Source Software (FLOSS) environments are increasingly dubbed as learning environments where practical software engineering skills can be acquired. Numerous studies have extensively investigated how knowledge is acquired in these environments through a collaborative learning model that define a learning process. Such a learning process, identified either as a result of surveys or by means of questionnaires, can be depicted through a series of graphical representations indicating the steps FLOSS community members go through as they acquire and exchange skills. These representations are referred to as a-priori learning models. They are Petri net-like workflow nets (WF-net) that provide a visual representation of the learning process as it is expected to occur. These models are representations of a learning framework or paradigm in FLOSS communities. As such, the credibility of any models is estimated through a process of model verification and validation. Therefore in this paper, we analyze these models in comparison with the real behavior captured in FLOSS repositories by means of conformance verification in process mining. The purpose of our study is twofold. Firstly, the results of our analysis provide insights on the possible discrepancies that are observed between the initial theoretical representations of learning processes and the real behavior captured in FLOSS event logs, constructed from mailing archives. Secondly, this comparison helps foster the understanding on how learning actually takes place in FLOSS environments based on empirical evidence directly from the data.
Literature
go back to reference Alur, R., Henzinger, T. A., & Vardi, M. Y. (2015). Theory in practice for system design and verification. ACM Siglog News, 2(1), 46–51. Alur, R., Henzinger, T. A., & Vardi, M. Y. (2015). Theory in practice for system design and verification. ACM Siglog News, 2(1), 46–51.
go back to reference Anderson, T. (2004). Teaching in an online learning context. Theory and practice of online learning, 273. Anderson, T. (2004). Teaching in an online learning context. Theory and practice of online learning, 273.
go back to reference Arbaugh, J. B. (2007). An empirical verification of the Community of Inquiry Framework. Journal of Asynchronous Learning Networks, 11(1), 73–85. Arbaugh, J. B. (2007). An empirical verification of the Community of Inquiry Framework. Journal of Asynchronous Learning Networks, 11(1), 73–85.
go back to reference Bartoletti, M., Degano, P., Ferrari, G. L., & Zunino, R. (2015). Model checking usage policies. Mathematical Structures in Computer Science, 25(03), 710–763. MathSciNetCrossRefMATH Bartoletti, M., Degano, P., Ferrari, G. L., & Zunino, R. (2015). Model checking usage policies. Mathematical Structures in Computer Science, 25(03), 710–763. MathSciNetCrossRefMATH
go back to reference Bojanowski, C. (2016). Verification, validation and optimization of finite element model of bus structure for rollover test. Bojanowski, C. (2016). Verification, validation and optimization of finite element model of bus structure for rollover test.
go back to reference Carson, J. S. (2002, December). Model verification and validation. In Simulation Conference, 2002. Proceedings of the Winter (Vol. 1, pp. 52–58). IEEE. Carson, J. S. (2002, December). Model verification and validation. In Simulation Conference, 2002. Proceedings of the Winter (Vol. 1, pp. 52–58). IEEE.
go back to reference Cerone, A. (2011). Learning and activity patterns in OSS communities and their impact on software quality. In Proc. of the 5th International Workshop on Foundations and Techniques for Open Source Software Certification. (OpenCert 2011). Vol 48 of electronic communications of the EASST. The European Association of Software Science and Technology. Cerone, A. (2011). Learning and activity patterns in OSS communities and their impact on software quality. In Proc. of the 5th International Workshop on Foundations and Techniques for Open Source Software Certification. (OpenCert 2011). Vol 48 of electronic communications of the EASST. The European Association of Software Science and Technology.
go back to reference Cerone, A. K., & Sowe, S. K. (2010). Using Free/Libre Open Source Software Projects as E-learning Tools. In Proc. of the 4th International Workshop on Foundations and Techniques for Open Source Software Certification. (OpenCert 2010), Vol. 33 of Electronic Communications of the EASST. The European Association of Software Science and Technology. Cerone, A. K., & Sowe, S. K. (2010). Using Free/Libre Open Source Software Projects as E-learning Tools. In Proc. of the 4th International Workshop on Foundations and Techniques for Open Source Software Certification. (OpenCert 2010), Vol. 33 of Electronic Communications of the EASST. The European Association of Software Science and Technology.
go back to reference Elliott, M. S., & Scacchi, W. (2005). Free software development: cooperation and conflict in. Free/Open Source Software Development, 152 Elliott, M. S., & Scacchi, W. (2005). Free software development: cooperation and conflict in. Free/Open Source Software Development, 152
go back to reference Fernandes, S., Cerone, A., & Barbosa, L. S. (2013). FLOSS Communities as Learning Networks. Int. Journal of Information and Education Technology, 3(2), pages 278–281, IACSIT Press, April 2013. Fernandes, S., Cerone, A., & Barbosa, L. S. (2013). FLOSS Communities as Learning Networks. Int. Journal of Information and Education Technology, 3(2), pages 278–281, IACSIT Press, April 2013.
go back to reference Fernandes, S., Cerone, A., & Barbosa, L. S. (2014a). Analysis of FLOSS Communities as Learning Contexts. Proc. of the 7th International Workshop on Foundations and Techniques for Open Source Software Certification. (OpenCert 2013), Vol. 8368 of Lecture Notes in Computer Science, pages 405–416, Springer. Fernandes, S., Cerone, A., & Barbosa, L. S. (2014a). Analysis of FLOSS Communities as Learning Contexts. Proc. of the 7th International Workshop on Foundations and Techniques for Open Source Software Certification. (OpenCert 2013), Vol. 8368 of Lecture Notes in Computer Science, pages 405–416, Springer.
go back to reference Fernandes, S., Cerone, A., Barbosa, L. S., & Papadopoulos, P. M. (2014b). Proc. of the 1st International Symposium on Innovation and Sustainability in Education (InSuEdu 2012), Vol. 7991 of Lecture Notes in Computer Science, pages 121–132. Springer. Fernandes, S., Cerone, A., Barbosa, L. S., & Papadopoulos, P. M. (2014b). Proc. of the 1st International Symposium on Innovation and Sustainability in Education (InSuEdu 2012), Vol. 7991 of Lecture Notes in Computer Science, pages 121–132. Springer.
go back to reference Glott, R., Meiszner, A., & Sowe, S. K. (2007). FLOSSCom phase 1 report: analysis of the informal learning environment of FLOSS communities. FLOSSCom Project. Glott, R., Meiszner, A., & Sowe, S. K. (2007). FLOSSCom phase 1 report: analysis of the informal learning environment of FLOSS communities. FLOSSCom Project.
go back to reference Glott, R., SPI, A. M., Sowe, S. K., Conolly, T., Healy, A., Ghosh, R., ... & West, D. (2011)FLOSSCom-Using the Principles of Informal Learning Environments of FLOSS Communities to Improve ICT Supported Formal Education. Glott, R., SPI, A. M., Sowe, S. K., Conolly, T., Healy, A., Ghosh, R., ... & West, D. (2011)FLOSSCom-Using the Principles of Informal Learning Environments of FLOSS Communities to Improve ICT Supported Formal Education.
go back to reference Greller, W., & Drachsler, H. (2012). Translating learning into numbers: a generic framework for learning analytics. Educational Technology & Society, 15(3), 42–57. Greller, W., & Drachsler, H. (2012). Translating learning into numbers: a generic framework for learning analytics. Educational Technology & Society, 15(3), 42–57.
go back to reference Hicks, J. L., Uchida, T. K., Seth, A., Rajagopal, A., & Delp, S. L. (2015). Is my model good enough? Best practices for verification and validation of musculoskeletal models and simulations of movement. Journal of Biomechanical Engineering, 137(2), 020905. CrossRef Hicks, J. L., Uchida, T. K., Seth, A., Rajagopal, A., & Delp, S. L. (2015). Is my model good enough? Best practices for verification and validation of musculoskeletal models and simulations of movement. Journal of Biomechanical Engineering, 137(2), 020905. CrossRef
go back to reference Kwiatkowska, M., Norman, G., & Parker, D. (2011, July). PRISM 4.0: Verification of probabilistic real-time systems. In International Conference on Computer Aided Verification (pp. 585–591). Springer Berlin Heidelberg. Kwiatkowska, M., Norman, G., & Parker, D. (2011, July). PRISM 4.0: Verification of probabilistic real-time systems. In International Conference on Computer Aided Verification (pp. 585–591). Springer Berlin Heidelberg.
go back to reference Lakhani, K. R., & Von Hippel, E. (2003). How open source software works:“free” user-to-user assistance. Research Policy, 32(6), 923–943. CrossRef Lakhani, K. R., & Von Hippel, E. (2003). How open source software works:“free” user-to-user assistance. Research Policy, 32(6), 923–943. CrossRef
go back to reference Larson, B. (2012). Delivering business intelligence with Microsoft SQL server 2012. McGraw-Hill Osborne Media. Larson, B. (2012). Delivering business intelligence with Microsoft SQL server 2012. McGraw-Hill Osborne Media.
go back to reference Meiszner, A., Glott, R., & Sowe, S. K. (2008). Free/libre open source software (FLOSS) communities as an example of successful open participatory learning ecosystems. UPGRADE, The European Journal for the Informatics Professional, 9(3), 62–68. Meiszner, A., Glott, R., & Sowe, S. K. (2008). Free/libre open source software (FLOSS) communities as an example of successful open participatory learning ecosystems. UPGRADE, The European Journal for the Informatics Professional, 9(3), 62–68.
go back to reference Meiszner, A., Stamelos, I., & Sowe, S. K. (2009). 1st international workshop on:‘designing for participatory Learning’Building from open source success to develop free ways to share and learn. In Open Source Ecosystems: Diverse Communities Interacting (pp. 355–356). Springer Berlin Heidelberg. Meiszner, A., Stamelos, I., & Sowe, S. K. (2009). 1st international workshop on:‘designing for participatory Learning’Building from open source success to develop free ways to share and learn. In Open Source Ecosystems: Diverse Communities Interacting (pp. 355–356). Springer Berlin Heidelberg.
go back to reference Mukala, P., Cerone, A., & Turini, F. (2014a). An Abstract State Machine (ASM) Representation of Learning Process in FLOSS Communities. Proc. of the 3rd International Symposium on Modelling and Knowledge Management for Sustainable Development (MoKMaSD 2014), Springer. Mukala, P., Cerone, A., & Turini, F. (2014a). An Abstract State Machine (ASM) Representation of Learning Process in FLOSS Communities. Proc. of the 3rd International Symposium on Modelling and Knowledge Management for Sustainable Development (MoKMaSD 2014), Springer.
go back to reference Mukala, P., Cerone, A., & Turini, F. (2014b). Ontolifloss: An ontology of learning in FLOSS. Proc. of the 3rd International Symposium on Modelling and Knowledge Management for Sustainable Development (MoKMaSD 2014), Springer. In Press Mukala, P., Cerone, A., & Turini, F. (2014b). Ontolifloss: An ontology of learning in FLOSS. Proc. of the 3rd International Symposium on Modelling and Knowledge Management for Sustainable Development (MoKMaSD 2014), Springer. In Press
go back to reference Mukala, P., Cerone, A., & Turini, F. (2015a). An exploration of learning processes as process maps in FLOSS repositories. In Internal technical reports 2015, Department of Computer science. Pisa: University of. Mukala, P., Cerone, A., & Turini, F. (2015a). An exploration of learning processes as process maps in FLOSS repositories. In Internal technical reports 2015, Department of Computer science. Pisa: University of.
go back to reference Mukala, P., Buijs, J.C.A.M., Leemans, M., van der Aalst, W.M.P. (2015b): Learning analytics on Coursera event data: a process mining approach. In proceedings of 5th SIMPDA, pp. 18–32 (2015) Mukala, P., Buijs, J.C.A.M., Leemans, M., van der Aalst, W.M.P. (2015b): Learning analytics on Coursera event data: a process mining approach. In proceedings of 5th SIMPDA, pp. 18–32 (2015)
go back to reference Murdock, J., & Allen, C. (2015, January). Visualization Techniques for Topic Model Checking. In AAAI (pp. 4284–4285). Murdock, J., & Allen, C. (2015, January). Visualization Techniques for Topic Model Checking. In AAAI (pp. 4284–4285).
go back to reference Ozkan, S., & Koseler, R. (2009). Multi-dimensional students’ evaluation of e-learning systems in the higher education context: an empirical investigation. Computers & Education, 53(4), 1285–1296. CrossRef Ozkan, S., & Koseler, R. (2009). Multi-dimensional students’ evaluation of e-learning systems in the higher education context: an empirical investigation. Computers & Education, 53(4), 1285–1296. CrossRef
go back to reference Papadopoulos, P. M., Stamelos, I. G., & Meiszner, A. (2013). Enhancing software engineering education through open source projects: four years of students’ perspectives. Education and Information Technologies, 18, 381. CrossRef Papadopoulos, P. M., Stamelos, I. G., & Meiszner, A. (2013). Enhancing software engineering education through open source projects: four years of students’ perspectives. Education and Information Technologies, 18, 381. CrossRef
go back to reference Paszkiewicz, Z. (2013, January). Process Mining Techniques in Conformance Testing of Inventory Processes: An Industrial Application. In Business Information Systems Workshops (pp. 302–313). Springer Berlin Heidelberg Paszkiewicz, Z. (2013, January). Process Mining Techniques in Conformance Testing of Inventory Processes: An Industrial Application. In Business Information Systems Workshops (pp. 302–313). Springer Berlin Heidelberg
go back to reference Poncin, W., Serebrenik, A., & van den Brand, M. (2011, March). Process mining software repositories. The 15th European Conference on Software Maintenance and Reengineering ({CSMR} 2011) took place in Oldenburg, Germany from 1-4 March 2011. Poncin, W., Serebrenik, A., & van den Brand, M. (2011, March). Process mining software repositories. The 15th European Conference on Software Maintenance and Reengineering ({CSMR} 2011) took place in Oldenburg, Germany from 1-4 March 2011.
go back to reference Rozinat, A., & van der Aalst, W. M. (2008). Conformance checking of processes based on monitoring real behavior. Information Systems, 33(1), 64–95. CrossRef Rozinat, A., & van der Aalst, W. M. (2008). Conformance checking of processes based on monitoring real behavior. Information Systems, 33(1), 64–95. CrossRef
go back to reference Shea, P., & Bidjerano, T. (2009). Community of inquiry as a theoretical framework to foster “epistemic engagement” and “cognitive presence” in online education. Computers & Education, 52(3), 543–553. CrossRef Shea, P., & Bidjerano, T. (2009). Community of inquiry as a theoretical framework to foster “epistemic engagement” and “cognitive presence” in online education. Computers & Education, 52(3), 543–553. CrossRef
go back to reference Singh, V., Nichols, D. M., & Twidale, M. B. (2009). Users of open source software: how do they get help? Washington, DC: IEEE Computer Society. Singh, V., Nichols, D. M., & Twidale, M. B. (2009). Users of open source software: how do they get help? Washington, DC: IEEE Computer Society.
go back to reference Sowe, S. K., & Stamelos, I. G. (2007). Involving software engineering students in open source software projects: experiences from a pilot study. Journal of Information Systems Education, 18(4), 425. Sowe, S. K., & Stamelos, I. G. (2007). Involving software engineering students in open source software projects: experiences from a pilot study. Journal of Information Systems Education, 18(4), 425.
go back to reference Sowe, S. K., & Stamelos, I. (2008). Reflection on Knowledge Sharing in F/OSS Projects. In Open Source Development, Communities and Quality (pp. 351–358). Springer US. Sowe, S. K., & Stamelos, I. (2008). Reflection on Knowledge Sharing in F/OSS Projects. In Open Source Development, Communities and Quality (pp. 351–358). Springer US.
go back to reference Steehouder, M. F. (2002). Beyond technical documentation: users helping each other. In Professional Communication Conference, 2002. IPCC 2002. Proceedings. IEEE International (pp. 489–499). IEEE Steehouder, M. F. (2002). Beyond technical documentation: users helping each other. In Professional Communication Conference, 2002. IPCC 2002. Proceedings. IEEE International (pp. 489–499). IEEE
go back to reference Thacker, B. H., Doebling, S. W., Hemez, F. M., Anderson, M. C., Pepin, J. E., & Rodriguez, E. A. (2004). Concepts of model verification and validation (no. LA-14167). Los Alamos: Los Alamos National Lab. CrossRef Thacker, B. H., Doebling, S. W., Hemez, F. M., Anderson, M. C., Pepin, J. E., & Rodriguez, E. A. (2004). Concepts of model verification and validation (no. LA-14167). Los Alamos: Los Alamos National Lab. CrossRef
go back to reference van der Aalst, W. M. (2005). Business alignment: using process mining as a tool for Delta analysis and conformance testing. Requirements Engineering, 10(3), 198–211. CrossRef van der Aalst, W. M. (2005). Business alignment: using process mining as a tool for Delta analysis and conformance testing. Requirements Engineering, 10(3), 198–211. CrossRef
go back to reference van der Aalst, W. M., & de Medeiros, A. K. A. (2005). Process mining and security: detecting anomalous process executions and checking process conformance. Electronic Notes in Theoretical Computer Science, 121, 3–21. CrossRefMATH van der Aalst, W. M., & de Medeiros, A. K. A. (2005). Process mining and security: detecting anomalous process executions and checking process conformance. Electronic Notes in Theoretical Computer Science, 121, 3–21. CrossRefMATH
go back to reference Walton, M., Boley, L., Keenan, L., Kerstman, E., Shah, R., Young, M., et al. (2015). Integrated medical model (IMM) project verification, validation, and credibility (VVandC). Washington, DC: NASA. Walton, M., Boley, L., Keenan, L., Kerstman, E., Shah, R., Young, M., et al. (2015). Integrated medical model (IMM) project verification, validation, and credibility (VVandC). Washington, DC: NASA.
go back to reference Wilson, G., & Stacey, E. (2004). Online interaction impacts on learning: teaching the teachers to teach online. Australasian Journal of Educational Technology, 20(1), 33–48. CrossRef Wilson, G., & Stacey, E. (2004). Online interaction impacts on learning: teaching the teachers to teach online. Australasian Journal of Educational Technology, 20(1), 33–48. CrossRef
Metadata
Title
An empirical verification of a-priori learning models on mailing archives in the context of online learning activities of participants in free\libre open source software (FLOSS) communities
Authors
Patrick Mukala
Antonio Cerone
Franco Turini
Publication date
02-02-2017
Publisher
Springer US
Published in
Education and Information Technologies / Issue 6/2017
Print ISSN: 1360-2357
Electronic ISSN: 1573-7608
DOI
https://doi.org/10.1007/s10639-017-9573-6

Other articles of this Issue 6/2017

Education and Information Technologies 6/2017 Go to the issue

Premium Partner