nach oben

Erschienen in:

2021 | OriginalPaper | Buchkapitel

Web Test Automation: Insights from the Grey Literature

verfasst von : Filippo Ricca, Andrea Stocco

Erschienen in: SOFSEM 2021: Theory and Practice of Computer Science

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

This paper provides the results of a survey of the grey literature concerning best practices for end-to-end web test automation. We analyzed more than 2,400 sources (e.g., blog posts, white-papers, user manuals, GitHub repositories) looking for guidelines by IT professionals on how to develop and maintain web test code. Ultimately, we filtered 142 relevant documents from which we extracted a taxonomy of guidelines divided into technical tips (i.e., concerning the development, maintenance, and execution of web tests), and business-level tips (i.e, concerning the planning and management of testing teams, design, and process). The paper concludes by distilling the ten most cited best practices for developing good quality automated web tests.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Using Process Models to Understand Security Standards

Nächstes Kapitel A Pipeline for Measuring Brand Loyalty Through Social Media Mining

https://martinfowler.com/articles/practical-test-pyramid.html.

Alimadadi, S., Mesbah, A., Pattabiraman, K.: Hybrid DOM-sensitive change impact analysis for JavaScript. In: Proceedings of the 29th European Conference on Object-Oriented Programming, ECOOP 2015, vol. 37, pp. 321–345 (2015)

Alimadadi, S., Mesbah, A., Pattabiraman, K.: Understanding asynchronous interactions in full-stack Javascript. In: Proceedings of the 38th International Conference on Software Engineering, ICSE 2016, pp. 1169–1180. ACM (2016)

Alimadadi, S., Sequeira, S., Mesbah, A., Pattabiraman, K.: Understanding Javascript event-based interactions. In: Proceedings of the 36th International Conference on Software Engineering, ICSE 2014, pp. 367–377. ACM (2014)

Biagiola, M., Stocco, A., Mesbah, A., Ricca, F., Tonella, P.: Web test dependency detection. In: Proceedings of 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2019, p. 12. ACM (2019)

Biagiola, M., Stocco, A., Ricca, F., Tonella, P.: Diversity-based web test generation. In: Proceedings of 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2019, p. 12. ACM (2019)

Biagiola, M., Stocco, A., Ricca, F., Tonella, P.: Dependency-aware web test generation. In: Proceedings of 13th IEEE International Conference on Software Testing, Verification and Validation, ICST 2020, p. 12. IEEE (2020)

Cerioli, M., Leotta, M., Ricca, F.: What 5 million job advertisements tell us about testing: a preliminary empirical investigation. In: Proceedings of the 35th Annual ACM Symposium on Applied Computing (2020)

Choudhary, S.R., Zhao, D., Versee, H., Orso, A.: WATER: web application TEst Repair. In: Proceedings of 1st International Workshop on End-to-End Test Script Engineering, ETSE 2011, pp. 24–29. ACM (2011)

Doğan, S., Betin-Can, A., Garousi, V.: Web application testing: a systematic literature review. J. Syst. Softw. 91, 174–201 (2014)CrossRef

10.

Rafi, D.M., Moses, K.R.K., Petersen, K., Mäntylä, M.V.: Benefits and limitations of automated software testing: Systematic literature review and practitioner survey. In: 2012 7th International Workshop on Automation of Software Test (AST), pp. 36–42 (2012). https://doi.org/10.1109/IWAST.2012.6228988

11.

Eck, M., Palomba, F., Castelluccio, M., Bacchelli, A.: Understanding flaky tests: the developer’s perspective. In: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2019, pp. 830–840. ACM (2019)

12.

Elbaum, S., Karre, S., Rothermel, G.: Improving web application testing with user session data. In: Proceedings of 25th International Conference on Software Engineering, 2003, pp. 49–59 (2003)

13.

Gamido, H., Gamido, M.: Comparative review of the features of automated software testing tools. Int. J. Electr. Comput. Eng. 9, 4473–4478 (2019). 10.11591/ijece.v9i5.pp4473-4478

14.

García, B., Gallego, M., Gortázar, F., Munoz-Organero, M.: A survey of the selenium ecosystem. Electronics 9, 1067 (2020)CrossRef

15.

Garousi, V., Felderer, M., Mäntylä, M.V.: Guidelines for including grey literature and conducting multivocal literature reviews in software engineering. IST 106, 101–121 (2019)

16.

Garousi, V., Felderer, M., Mäntylä, M.V., Rainer, A.: Benefitting from the grey literature in software engineering research. Contemporary Empirical Methods in Software Engineering, pp. 385–413. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-32489-6_14CrossRef

17.

Garousi, V., Mäntylä, M.V.: When and what to automate in software testing? a multi-vocal literature review. IST 76, 92–117 (2016)

18.

Garousi, V., Mesbah, A., Betin-Can, A., Mirshokraie, S.: A systematic mapping study of web application testing. IST 55(8), 1374–1396 (2013)

19.

Gyimesi, P., et al.: BugJS: a benchmark and taxonomy of javascript bugs. Software Testing, Verification And Reliability (2020)

20.

Hammoudi, M., Rothermel, G., Stocco, A.: WATERFALL: an incremental approach for repairing record-replay tests of web applications. In: Proceedings of 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, FSE 2016, pp. 751–762. ACM (2016)

21.

Hammoudi, M., Rothermel, G., Tonella, P.: Why do record/replay tests of web applications break? In: Proceedings of 9th International Conference on Software Testing, Verification and Validation, ICST 2016, pp. 180–190. IEEE (2016)

22.

Imtiaz, J., Sherin, S., Khan, M.U., Iqbal, M.Z.: A systematic literature review of test breakage prevention and repair techniques. IST 113, 1–19 (2019)

23.

Kitchenham, B., Charters, S.: Guidelines for performing systematic literature reviews in software engineering (2007)

24.

Leotta, M., Clerissi, D., Ricca, F., Tonella, P.: Approaches and tools for automated end-to-end web testing. Adv. Comput. 101, 193–237 (2016)CrossRef

25.

Leotta, M., Stocco, A., Ricca, F., Tonella, P.: Using multi-locators to increase the robustness of web test cases. In: Proceedings of 8th IEEE International Conference on Software Testing, Verification and Validation, ICST 2015, pp. 1–10. IEEE (2015)

26.

Leotta, M., Stocco, A., Ricca, F., Tonella, P.: Robula+: an algorithm for generating robust Xpath locators for web testing. J. Softw. Evol. Process 28, 177–204 (2016)CrossRef

27.

Leotta, M., Stocco, A., Ricca, F., Tonella, P.: PESTO: automated migration of DOM-based web tests towards the visual approach. Softw. Test. Verification Reliab. 28(4), e1665 (2018)CrossRef

28.

Li, Y.F., Das, P.K., Dowe, D.L.: Two decades of web application testing-a survey of recent advances. Inf. Syst. 43, 20–54 (2014)CrossRef

29.

Mesbah, A., van Deursen, A., Lenselink, S.: Crawling ajax-based web applications through dynamic analysis of user interface state changes. ACM Trans. Web 6(1), 3:1–3:30 (2012)

30.

Mesbah, A., van Deursen, A., Roest, D.: Invariant-based automatic testing of modern web applications. IEEE TSE 38(1), 35–53 (2012)

31.

Mirshokraie, S., Mesbah, A., Pattabiraman, K.: Efficient javascript mutation testing. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation, pp. 74–83 (2013)

32.

Mirzaaghaei, M., Mesbah, A.: Dom-based test adequacy criteria for web applications. In: Proceedings of the 2014 International Symposium on Software Testing and Analysis, ISSTA 2014, pp. 71–81. ACM (2014)

33.

Ramler, R., Wolfmaier, K.: Economic perspectives in test automation: Balancing automated and manual testing with opportunity cost. In: Proceedings of 1st International Workshop on Automation of Software Test, AST 2006, pp. 85–91. ACM (2006)

34.

Raulamo-Jurvanen, P., Mäntylä, M., Garousi, V.: Choosing the right test automation tool: a grey literature review of practitioner sources. In: Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering, EASE 2017, pp. 21–30. ACM (2017)

35.

Replication Package. https://github.com/riccaF/sofsem2021-replication-package-material/ (2020)

36.

Ricca, F., Leotta, M., Stocco, A.: Three open problems in the context of e2e web testing and a vision: Neonate. In: Advances in Computers (01 2018)

37.

Ricca, F., Tonella, P.: Analysis and testing of web applications. In: Proceedings of the 23rd International Conference on Software Engineering, ICSE 2001, pp. 25–34 (2001)

38.

Spadini, D., Palomba, F., Baum, T., Hanenberg, S., Bruntink, M., Bacchelli, A.: Test-driven code review: an empirical study. In: 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE), pp. 1061–1072 (2019)

39.

Stocco, A., Leotta, M., Ricca, F., Tonella, P.: APOGEN: automatic page object generator for web testing. Software Qual. J. 25(3), 1007–1039 (2017)CrossRef

40.

Stocco, A., Yandrapally, R., Mesbah, A.: Visual web test repair. In: Proceedings of the 26th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2018, pp. 503–514. ACM (2018)

41.

Tonella, P., Ricca, F., Marchetto, A.: Recent advances in web testing. Adv. Comput. 93, 1–51 (2014)CrossRef

Titel: Web Test Automation: Insights from the Grey Literature
verfasst von: Filippo Ricca
Andrea Stocco
Verlag: Springer International Publishing
Buch: SOFSEM 2021: Theory and Practice of Computer Science
Print ISBN: 978-3-030-67730-5

Electronic ISBN: 978-3-030-67731-2

Copyright-Jahr: 2021
DOI: https://doi.org/10.1007/978-3-030-67731-2_35

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner