Skip to main content
Erschienen in: Cluster Computing 1/2017

13.02.2017

Exploratory testing supported by automated reengineering of model of the system under test

verfasst von: Karel Frajtak, Miroslav Bures, Ivan Jelinek

Erschienen in: Cluster Computing | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Exploratory Testing technique is well applicable to software development projects, where test basis is not available (or at least not complete and consistent to the extent allowing the creation of efficient test cases). The key factor for the efficiency of this technique is a structured process for the recording of explored path in the system under test. This approach also allows the creation of the test cases during exploratory testing process. These test cases can be used in the following re-testing of the system. If performed manually, the efficiency of such process strongly depends on the team organization and systematic work of the individuals in the team. This process can be aided by an automated support. In the paper, a framework, which automatically records selected tester’s actions in the system under test is presented. From these recordings, a model of the screen and action flows is reengineered and test cases are prepared. Tester is also able to define more meta-data in the test cases during this process. The recorded model and defined test cases are then available for the next rounds of testing. The performed case study shows that Exploratory Testing aided by this machine support is less resource demanding than Exploratory Testing performed manually only. Also, larger part of SUT was explored during the tests, when this systematic support was available to testers.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Eldh, S., Hansson, H., Punnekkat, S., Pettersson, A., Sundmark, D.: A framework for comparing efficiency, effectiveness and applicability of software testing techniques. In: Proceedings of the Testing: Academic and Industrial Conference—Practice And Research Techniques, 2006. TAIC PART 2006, pp. 159–170 (2006) Eldh, S., Hansson, H., Punnekkat, S., Pettersson, A., Sundmark, D.: A framework for comparing efficiency, effectiveness and applicability of software testing techniques. In: Proceedings of the Testing: Academic and Industrial Conference—Practice And Research Techniques, 2006. TAIC PART 2006, pp. 159–170 (2006)
2.
Zurück zum Zitat Tinkham, A., Kaner, C.: Learning styles and exploratory testing. In: Proceedings of the Pacific Northwest Software Quality Conference (PNSQC) (2003) Tinkham, A., Kaner, C.: Learning styles and exploratory testing. In: Proceedings of the Pacific Northwest Software Quality Conference (PNSQC) (2003)
3.
Zurück zum Zitat Shufer, I., Ledenev, A., Burg, Y.: System and method for monitoring exploratory testing by a plurality of testers (2013). US Patent 8,555,253 Shufer, I., Ledenev, A., Burg, Y.: System and method for monitoring exploratory testing by a plurality of testers (2013). US Patent 8,555,253
4.
Zurück zum Zitat Homès, B.: Fundamentals of Software Testing. Wiley, New York (2013) Homès, B.: Fundamentals of Software Testing. Wiley, New York (2013)
5.
Zurück zum Zitat Reeves, J.W.: What is software design. C++ J., 2(2):14–12 (1992) Reeves, J.W.: What is software design. C++ J., 2(2):14–12 (1992)
6.
Zurück zum Zitat Mesbah, A., Van Deursen, A., Lenselink, S.: Crawling ajax-based web applications through dynamic analysis of user interface state changes. ACM Trans. Web 6(1), 3 (2012)CrossRef Mesbah, A., Van Deursen, A., Lenselink, S.: Crawling ajax-based web applications through dynamic analysis of user interface state changes. ACM Trans. Web 6(1), 3 (2012)CrossRef
7.
Zurück zum Zitat Bellucci, F., Ghiani, G., Paternò, F., Porta, C.: Automatic reverse engineering of interactive dynamic web applications to support adaptation across platforms. In: Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces, pp. 217–226. ACM (2012) Bellucci, F., Ghiani, G., Paternò, F., Porta, C.: Automatic reverse engineering of interactive dynamic web applications to support adaptation across platforms. In: Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces, pp. 217–226. ACM (2012)
8.
Zurück zum Zitat Sacramento, C., Paiva, A.C.R.: Web application model generation through reverse engineering and UI pattern inferring. In: 2014 9th International Conference on the Quality of Information and Communications Technology (QUATIC), pp. 105–115. IEEE (2014) Sacramento, C., Paiva, A.C.R.: Web application model generation through reverse engineering and UI pattern inferring. In: 2014 9th International Conference on the Quality of Information and Communications Technology (QUATIC), pp. 105–115. IEEE (2014)
9.
Zurück zum Zitat Deutsch, Alin: Sui, Liying, Vianu, Victor: Specification and verification of data-driven web applications. J. Comput. Syst. Sci. 73(3), 442–474 (2007)CrossRef Deutsch, Alin: Sui, Liying, Vianu, Victor: Specification and verification of data-driven web applications. J. Comput. Syst. Sci. 73(3), 442–474 (2007)CrossRef
10.
Zurück zum Zitat Bures, M.: Decision theorem for construction of adaptive hypermedia system. In: 2nd IASTED International Conference on Web Technologies, Applications and Services, pp. 84–89 (2006) Bures, M.: Decision theorem for construction of adaptive hypermedia system. In: 2nd IASTED International Conference on Web Technologies, Applications and Services, pp. 84–89 (2006)
11.
Zurück zum Zitat Cerny, T., Donahoo, M.J.: On separation of platform-independent particles in user interfaces. Cluster Comput. 18(3), 1215–1228 (2015)CrossRef Cerny, T., Donahoo, M.J.: On separation of platform-independent particles in user interfaces. Cluster Comput. 18(3), 1215–1228 (2015)CrossRef
12.
Zurück zum Zitat Cerny, T., Macik, M., Donahoo, M.J., Janousek, J.: On distributed concern delivery in user interface design. Comput. Sci. Inform. Syst. 12(2), 655–681 (2015)CrossRef Cerny, T., Macik, M., Donahoo, M.J., Janousek, J.: On distributed concern delivery in user interface design. Comput. Sci. Inform. Syst. 12(2), 655–681 (2015)CrossRef
13.
Zurück zum Zitat Dolezel, M.: Images of enterprise test organizations: factory, center of excellence, or community?. In: International Conference on Software Quality. Complexity and Challenges of Software Engineering in Emerging Technologies, pp. 105–116. Springer (2017) Dolezel, M.: Images of enterprise test organizations: factory, center of excellence, or community?. In: International Conference on Software Quality. Complexity and Challenges of Software Engineering in Emerging Technologies, pp. 105–116. Springer (2017)
14.
Zurück zum Zitat Kumar, B., Singh, K.: Testing uml designs using class, sequence and activity diagrams. Int. J. Innov. Res. Sci. Technol. 2(3), 71–81 (2015)MathSciNet Kumar, B., Singh, K.: Testing uml designs using class, sequence and activity diagrams. Int. J. Innov. Res. Sci. Technol. 2(3), 71–81 (2015)MathSciNet
15.
Zurück zum Zitat Yue, T., Ali, S., Briand, L.: Automated transition from use cases to UML state machines to support state-based testing. In: Modelling Foundations and Applications, pp. 115–131. Springer, Berlin (2011) Yue, T., Ali, S., Briand, L.: Automated transition from use cases to UML state machines to support state-based testing. In: Modelling Foundations and Applications, pp. 115–131. Springer, Berlin (2011)
16.
Zurück zum Zitat Lipka, R., Potuzak, T., Brada, P., Hnetynka, P., Vinarek, J.: A method for semi–automated generation of test scenarios based on use cases. In: Software Engineering and Advanced Applications (SEAA), 41st Euromicro Conference on IEEE, pp. 241–244 (2015) Lipka, R., Potuzak, T., Brada, P., Hnetynka, P., Vinarek, J.: A method for semi–automated generation of test scenarios based on use cases. In: Software Engineering and Advanced Applications (SEAA), 41st Euromicro Conference on IEEE, pp. 241–244 (2015)
17.
Zurück zum Zitat Potuzak, T., Lipka, R.: Interface-based semi-automated generation of scenarios for simulation testing of software components. In: SIMUL, pp. 35–42. IARIA (2014) Potuzak, T., Lipka, R.: Interface-based semi-automated generation of scenarios for simulation testing of software components. In: SIMUL, pp. 35–42. IARIA (2014)
18.
Zurück zum Zitat Ricca, F., Tonella, P.: Analysis and testing of web applications. In: Proceedings of the 23rd International Conference on Software Engineering, pp. 25–34. IEEE Computer Society (2001) Ricca, F., Tonella, P.: Analysis and testing of web applications. In: Proceedings of the 23rd International Conference on Software Engineering, pp. 25–34. IEEE Computer Society (2001)
19.
Zurück zum Zitat Morgado, I.C., Paiva, A.C.R.: Testing approach for mobile applications through reverse engineering of UI patterns. In: 2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW), pp. 42–49 (2015) Morgado, I.C., Paiva, A.C.R.: Testing approach for mobile applications through reverse engineering of UI patterns. In: 2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW), pp. 42–49 (2015)
20.
Zurück zum Zitat Liu, C.H., Lu, C.Y., Cheng, S.J., Chang, K.Y., Hsiao, Y.C., Chu, W.M.: Capture-replay testing for android applications. In: 2014 International Symposium on Computer, Consumer and Control (IS3C), pp. 1129–1132 (2014) Liu, C.H., Lu, C.Y., Cheng, S.J., Chang, K.Y., Hsiao, Y.C., Chu, W.M.: Capture-replay testing for android applications. In: 2014 International Symposium on Computer, Consumer and Control (IS3C), pp. 1129–1132 (2014)
21.
Zurück zum Zitat Itkonen, J., Mäntylä, M.V.: Are test cases needed? replicated comparison between exploratory and test-case-based software testing. Empir. Softw. Eng. 19(2), 303–342 (2014)CrossRef Itkonen, J., Mäntylä, M.V.: Are test cases needed? replicated comparison between exploratory and test-case-based software testing. Empir. Softw. Eng. 19(2), 303–342 (2014)CrossRef
22.
Zurück zum Zitat Itkonen, J., Mäntylä, M.V., Lassenius, C.: Defect detection efficiency: test case based vs. exploratory testing. Proceedings of the First International Symposium on Empirical Software Engineering and Measurement. ESEM ’07, pp. 61–70. IEEE Computer Society, Washington, DC, USA (2007) Itkonen, J., Mäntylä, M.V., Lassenius, C.: Defect detection efficiency: test case based vs. exploratory testing. Proceedings of the First International Symposium on Empirical Software Engineering and Measurement. ESEM ’07, pp. 61–70. IEEE Computer Society, Washington, DC, USA (2007)
23.
Zurück zum Zitat do Nascimento, L.H.O., Machado, P.D.L.: An experimental evaluation of approaches to feature testing in the mobile phone applications domain. In: Workshop on Domain Specific Approaches to Software Test Automation: In Conjunction with the 6th ESEC/FSE Joint Meeting, pp. 27–33. ACM (2007) do Nascimento, L.H.O., Machado, P.D.L.: An experimental evaluation of approaches to feature testing in the mobile phone applications domain. In: Workshop on Domain Specific Approaches to Software Test Automation: In Conjunction with the 6th ESEC/FSE Joint Meeting, pp. 27–33. ACM (2007)
24.
Zurück zum Zitat Shah, S.M.A., Gencel, C., Alvi, U.S., Petersen, K.: Towards a hybrid testing process unifying exploratory testing and scripted testing. J. Softw. Evol. Process 26(2), 220–250 (2014)CrossRef Shah, S.M.A., Gencel, C., Alvi, U.S., Petersen, K.: Towards a hybrid testing process unifying exploratory testing and scripted testing. J. Softw. Evol. Process 26(2), 220–250 (2014)CrossRef
25.
Zurück zum Zitat Kim, D.-K., Lee, L.-S.: Reverse engineering from exploratory testing to specification-based testing. Int J Softw Eng Appl 8(11), 197–208 (2014) Kim, D.-K., Lee, L.-S.: Reverse engineering from exploratory testing to specification-based testing. Int J Softw Eng Appl 8(11), 197–208 (2014)
27.
Zurück zum Zitat Amalfitano, D., Fasolino, A.R., Tramontana, P., Ta, B.D., Memon, A.M.: Mobiguitar: automated model-based testing of mobile apps. IEEE Softw. 32(5), 53–59 (2015) Amalfitano, D., Fasolino, A.R., Tramontana, P., Ta, B.D., Memon, A.M.: Mobiguitar: automated model-based testing of mobile apps. IEEE Softw. 32(5), 53–59 (2015)
28.
Zurück zum Zitat Entin, V., Winder, M., Zhang, B., Christmann, S.: Combining model-based and capture-replay testing techniques of graphical user interfaces: an industrial approach. In: 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 572–577 (2011) Entin, V., Winder, M., Zhang, B., Christmann, S.: Combining model-based and capture-replay testing techniques of graphical user interfaces: an industrial approach. In: 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 572–577 (2011)
30.
Zurück zum Zitat Mugshot: Deterministic Capture and Replay for JavaScript Applications. USENIX (2010) Mugshot: Deterministic Capture and Replay for JavaScript Applications. USENIX (2010)
31.
Zurück zum Zitat Leotta, M., Clerissi, D., Ricca, F., Tonella, P.: Capture-replay vs. programmable web testing: an empirical assessment during test case evolution. In: 2013 20th Working Conference on Reverse Engineering (WCRE), pp. 272–281 (2013) Leotta, M., Clerissi, D., Ricca, F., Tonella, P.: Capture-replay vs. programmable web testing: an empirical assessment during test case evolution. In: 2013 20th Working Conference on Reverse Engineering (WCRE), pp. 272–281 (2013)
Metadaten
Titel
Exploratory testing supported by automated reengineering of model of the system under test
verfasst von
Karel Frajtak
Miroslav Bures
Ivan Jelinek
Publikationsdatum
13.02.2017
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 1/2017
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-0773-z

Weitere Artikel der Ausgabe 1/2017

Cluster Computing 1/2017 Zur Ausgabe