nach oben

Software and Systems Modeling

22.01.2024 | Special Section Paper

Assessing the testing skills transfer of model-based testing on testing skill acquisition

verfasst von: Felix Cammaerts, Monique Snoeck

Erschienen in: Software and Systems Modeling

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

When creating a software model, it is necessary that it accurately captures the desired behaviour, while at the same time ensuring that any undesired behaviour is excluded. On the one hand, formal verification tools can be used to check the internal consistency of a software system, ensuring that the behaviour of one software component does not contradict another. On the other hand, software testing is essential to check the external validity of the model more comprehensively. Unfortunately, software testing is often overlooked in curricula, resulting in graduates with inadequate software testing skills for industry. Software testing tools such as TesCaV can be used to help teachers teach software testing topics in a non-intrusive and less time-consuming way. Previous research has shown that TesCaV is easy to use and that novice users produce better quality software tests when using TesCaV. However, it has remained unclear whether learners retain the skills they gain from using TesCaV even when the tool is not offered for help. In order to understand the positive effect of TesCaV on learners’ software testing skills, this study conducted an experiment with 45 participants. The experiment used a pretest-treatment-posttest design. The results show that participants feel equally confident about the completeness of their test coverage, even though they identify more test cases. It is concluded that for course design, a capsule such as TesCaV can help students to understand the full complexity of software testing and help them to be more systematic in their approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Nur mit Berechtigung zugänglich

More information about this course can be found at https://onderwijsaanbod.kuleuven.be/syllabi/e/D0I71AE.htm.

Ethical approval for this research can be found under number G-2023-6441-R3(MIN).

Britton, T., Jeng, L., Carver, G., Cheak, P., Katzenellenbogen, T.: Reversible Debugging Software. Judge Bus. School, Univ. Cambridge, Tech. Rep 229 (2013)

Cammaerts, F., Snoeck, M.: Comparing different visualizations for feedback on test execution in a model-driven engineering environment. In: International Conference on Business Process Modeling, Development and Support, pp. 312–326. Springer, Berlin (2023)

Cammaerts, F., Verbruggen, C., Snoeck, M.: Investigating the effectiveness of model-based testing on testing skill acquisition. In: Proceedings of the Practice of Enterprise Modeling: 15th IFIP WG 8.1 Working Conference, PoEM 2022, London, UK, November 23–25, 2022, pp. 3–17. Springer, Berlin (2022)

Carver, J.C., Kraft, N.A.: Evaluating the testing ability of senior-level computer science students. In: 2011 24th IEEE-CS Conference on Software Engineering Education and Training (CSEE &T), pp. 169–178. IEEE (2011)

Chan, F.T., Tse, T.H., Tang, W.H., Chen, T.Y.: Software testing education and training in Hong Kong. In: Fifth International Conference on Quality Software (QSIC’05), pp. 313–316. IEEE (2005)

Cordova, L., Carver, J., Gershmel, N., Walia, G.: A comparison of inquiry-based conceptual feedback vs. traditional detailed feedback mechanisms in software testing education: an empirical investigation. In: Proceedings of the 52nd ACM Technical Symposium on Computer Science Education, pp. 87–93 (2021)

Cowling, T.: Stages in teaching software testing. In: 2012 34th International Conference on Software Engineering (ICSE), pp. 1185–1194. IEEE (2012)

Edwards, S.H.: Teaching software testing: automatic grading meets test-first coding. In: Companion of the 18th Annual ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications, pp. 318–319 (2003)

Fraser, G., Gambi, A., Kreis, M., Rojas, J.M.: Gamifying a software testing course with code defenders. In: Proceedings of the 50th ACM Technical Symposium on Computer Science Education, pp. 571–577 (2019)

10.

Garousi, V., Mathur, A.: Current state of the software testing education in North American academia and some recommendations for the new educators. In: 2010 23rd IEEE Conference on Software Engineering Education and Training, pp. 89–96. IEEE (2010)

11.

Garousi, V., Rainer, A., Lauvås Jr, P., Arcuri, A.: Software-testing education: a systematic literature mapping. J. Syst. Softw. 165, 110570 (2020)

12.

Graham, D., Black, R., Van Veenendaal, E.: Foundations of Software Testing ISTQB Certification. Cengage Learning (2021)

13.

Kirkpatrick, D.L., Craig, R.L.: Evaluation of Training. Evaluation of Short-Term Training in Rehabilitation, p. 35 (1970)

14.

Krasner, H.: The cost of poor software quality in the US: a 2020 report. In: Proceedings of the Consortium Information Software QualityTM (CISQTM)

15.

Li, W., Le Gall, F., Spaseski, N.: A survey on model-based testing tools for test case generation. In: Tools and Methods of Program Analysis: 4th International Conference, TMPA 2017, Moscow, Russia, March 3–4, 2017, Revised Selected Papers 4, pp. 77–89. Springer, Berlin (2018)

16.

Marín, B., Alarcón, S., Giachetti, G., Snoeck, M.: TesCaV: an approach for learning model-based testing and coverage in practice. In: Research Challenges in Information Science: 14th International Conference, RCIS 2020, Limassol, Cyprus, September 23–25, 2020, Proceedings 14, pp. 302–317. Springer, Berlin (2020)

17.

Marín, B., Gallardo, C., Quiroga, D., Giachetti, G., Serral, E.: Testing of model-driven development applications. Softw Qual. J. 25(2017), 407–435 (2017)CrossRef

18.

Marín, B., Vos, T.E.J.., Paiva, A.C.R., Fasolino, A.R., Snoeck, M.: ENACTEST-European innovation alliance for testing education. In: RCIS Workshops (2022)

19.

Martinez, A.: Use of JiTT in a graduate software testing course: an experience report. In: Proceedings of the 40th International Conference on Software Engineering: Software Engineering Education and Training, pp. 108–115 (2018)

20.

Pérez, C., Marín, B.: Automatic generation of test cases from UML models. CLEI Electron. J. 21, 1 (2018)

21.

Rojas, J.M., Fraser, G..: Code defenders: a mutation testing game. In: 2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 162–167. IEEE (2016)

22.

Ruiz, J., Snoeck, M.: Adapting Kirkpatrick’s evaluation model to technology enhanced learning. In: Proceedings of the 21st ACM/IEEE International Conference on Model Driven Engineering Languages and Systems: Companion Proceedings, pp. 135–142

23.

Strategic Planning: The Economic Impacts of Inadequate Infrastructure for Software Testing, p. 1. National Institute of Standards and Technology (2002)

24.

Sarkar, A., Bell, T.: Teaching black-box testing to high school students. In: Proceedings of the 8th Workshop in Primary and Secondary Computing Education, pp. 75–78 (2013)

25.

Scatalon, L.P., Carver, J.C., Garcia, R.E., Barbosa, E.F.: Software testing in introductory programming courses: a systematic mapping study. In: Proceedings of the 50th ACM Technical Symposium on Computer Science Education, pp. 421–427 (2019)

26.

Sedrakyan, G., Snoeck, M.: Lightweight semantic prototyper for conceptual modeling. In: Advances in Conceptual Modeling: ER 2014 Workshops, ENMO, MoBiD, MReBA, QMMQ, SeCoGIS, WISM, and ER Demos, Atlanta, GA, USA, October 27–29, 2014. Proceedings 33, pp. 298–302. Springer, Berlin (2014)

27.

Sedrakyan, G., Snoeck, M., Poelmans, S.: Assessing the effectiveness of feedback enabled simulation in teaching conceptual modeling. Comput. Educ. 78(2014), 367–382 (2014)CrossRef

28.

Serral Asensio, E., Ruiz, J., Elen, J., Snoeck, M.: Conceptualizing the domain of automated feedback for learners. In: IberoAmerican Conference on Software Engineering, pp. 223–236. Curran Associates (2019)

29.

Spacco, J., Hovemeyer, D., Pugh, W., Emad, F., Hollingsworth, J.K., Padua-Perez, N.: Experiences with marmoset: designing and using an advanced submission and testing system for programming courses. ACM Sigcse Bull. 38(3), 13–17 (2006)

30.

UML, OMG and I MOF: The unified modeling language UML (2011)

31.

Utting, M., Legeard, B.: Practical Model-Based Testing: A Tools Approach. Morgan Kaufman, San Francisco (2007)

32.

Van Merriënboer, J.J.G., Kirschner, P.A.: Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design. Routledge, London (2017)CrossRef

33.

Zakaria, Z.: A state of practice on teaching software verification and validation. In: 2009 Annual Conference & Exposition, pp. 14–112 (2009)

Titel: Assessing the testing skills transfer of model-based testing on testing skill acquisition
verfasst von: Felix Cammaerts
Monique Snoeck
Publikationsdatum: 22.01.2024
Verlag: Springer Berlin Heidelberg
Erschienen in: Software and Systems Modeling
Print ISSN: 1619-1366
Elektronische ISSN: 1619-1374
DOI: https://doi.org/10.1007/s10270-023-01141-1

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Premium Partner