Skip to main content
Top

2017 | OriginalPaper | Chapter

A Comparative Study of Software Testing Techniques

Authors : Meriem Atifi, Abdelaziz Mamouni, Abdelaziz Marzak

Published in: Networked Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nowadays, software systems have become an essential element in our daily life. To ensure the quality and operation of software, testing activities have become primordial in the software development life cycle (SDLC). Indeed, software bugs can potentially cause dramatic consequences if the product is released to the end user without testing. The software testing role is to verify that the actual result and the expected result are consistent and ensure that the system is delivered without bugs. Many techniques, approaches and tools have been proposed to help check that the system is defect free. In this paper, we highlight two software testing techniques considered among the most used techniques to perform software tests, and then we perform a comparative study of these techniques, the approaches that supports studied techniques, and the tools used for each technique. We have selected the first technique based on the 2014 survey [62] that heighted the motivations for using the Model-based-testing, and by analyzing the survey results we have found that some MBT limits are benefits in Risk based testing, the second technique in our study.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Pretschner, A.: Model-based-testing. In: ICSE, pp. 722–732 (2005) Pretschner, A.: Model-based-testing. In: ICSE, pp. 722–732 (2005)
2.
go back to reference Utting, M., Pretschner, A., Legeard, B.: A Taxonomy of Model-Based Testing, a School of Computing and Mathematical Sciences (2006) Utting, M., Pretschner, A., Legeard, B.: A Taxonomy of Model-Based Testing, a School of Computing and Mathematical Sciences (2006)
3.
go back to reference Alam, M.M.: Risk-based testing techniques: a perspective study. Int. J. Comput. Appl. 65, 33–41 (2013). (0975–8887) Alam, M.M.: Risk-based testing techniques: a perspective study. Int. J. Comput. Appl. 65, 33–41 (2013). (0975–8887)
4.
go back to reference Utting, M., Legeard, B.: Practical Model-Based Testing: A Tools Approach. ACM, Inc. (2017) Utting, M., Legeard, B.: Practical Model-Based Testing: A Tools Approach. ACM, Inc. (2017)
5.
go back to reference Erdogan, G.: Approaches for the combined use of risk analysis and testing: a systematic literature review. Int. J. Softw. Tools Technol. Transfer 16, 627–642 (2014). Springer-Verlag Berlin HeidelbergCrossRef Erdogan, G.: Approaches for the combined use of risk analysis and testing: a systematic literature review. Int. J. Softw. Tools Technol. Transfer 16, 627–642 (2014). Springer-Verlag Berlin HeidelbergCrossRef
6.
go back to reference Felderer, M.: A classification for model-based security testing. In: The Third International Conference on Advances in System Testing and Validation Lifecycle (2011) Felderer, M.: A classification for model-based security testing. In: The Third International Conference on Advances in System Testing and Validation Lifecycle (2011)
7.
go back to reference Felderer, M.: A taxonomy of risk-based testing. Int. J. Softw. Tools Technol. Transfer 16, 559–568 (2014)CrossRef Felderer, M.: A taxonomy of risk-based testing. Int. J. Softw. Tools Technol. Transfer 16, 559–568 (2014)CrossRef
9.
go back to reference Palanivel, M., Selvadurai, K.: Risk-driven security testing using risk analysis with threat modeling approach, Palanivel and Selvadurai SpringerPlus (2014) Palanivel, M., Selvadurai, K.: Risk-driven security testing using risk analysis with threat modeling approach, Palanivel and Selvadurai SpringerPlus (2014)
11.
go back to reference Dranidis, D.: JSXM: a tool for automated test generation. In: Proceeding SEFM 2012 Proceedings of the 10th International Conference on Software Engineering and Formal Methods (2012) Dranidis, D.: JSXM: a tool for automated test generation. In: Proceeding SEFM 2012 Proceedings of the 10th International Conference on Software Engineering and Formal Methods (2012)
12.
go back to reference Aichernig, B.: MoMuT: UML model-based mutation testing for UML. In: 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST) (2015) Aichernig, B.: MoMuT: UML model-based mutation testing for UML. In: 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST) (2015)
13.
go back to reference Pretschner, A.: One evaluation of model-based testing and its automation. In: ICSE 2005, 15–21 May 2005 Pretschner, A.: One evaluation of model-based testing and its automation. In: ICSE 2005, 15–21 May 2005
15.
go back to reference Dalal, S.R., Jain, A., Karunanithi, N.: Model-based testing in practice. In: ICSE 1999, May 1999 Dalal, S.R., Jain, A., Karunanithi, N.: Model-based testing in practice. In: ICSE 1999, May 1999
16.
go back to reference Dias Neto, A.C., Travassos, G.H.: A survey on model-based testing approaches: a systematic review. In: WEASEL Tech 2007, November 2007 Dias Neto, A.C., Travassos, G.H.: A survey on model-based testing approaches: a systematic review. In: WEASEL Tech 2007, November 2007
17.
go back to reference Cristi, M.: Using {log} as a Test Case Generator for Z Specifications. GNCS project PICT 2011-1002 Cristi, M.: Using {log} as a Test Case Generator for Z Specifications. GNCS project PICT 2011-1002
18.
go back to reference Sarma, M., Murthy, P.V.R.: Model-based testing in industry – a case study with two MBT tools. ACM, 2–8 May 2010 Sarma, M., Murthy, P.V.R.: Model-based testing in industry – a case study with two MBT tools. ACM, 2–8 May 2010
19.
go back to reference Dias Neto, A.C., Travassos, G.H.: Characterization of model-based software testing approaches, Technical report at PESC/COPPE/UFRJ, Brazil, Published August 2007 Dias Neto, A.C., Travassos, G.H.: Characterization of model-based software testing approaches, Technical report at PESC/COPPE/UFRJ, Brazil, Published August 2007
20.
go back to reference Amland, S.: Risk-based testing: risk analysis fundamentals and metrics for software testing including a financial application case study. J. Syst. Softw. 53, 287–295 (2000)CrossRef Amland, S.: Risk-based testing: risk analysis fundamentals and metrics for software testing including a financial application case study. J. Syst. Softw. 53, 287–295 (2000)CrossRef
21.
go back to reference Felderer, M., Haisjackl, C., Breu, R., Motz, J.: Integrating manual and automatic risk assessment for risk-based testing. In: Biffl, S., Winkler, D., Bergsmann, J. (eds.) SWQD 2012. LNBIP, vol. 94, pp. 159–180. Springer, Heidelberg (2012). doi:10.1007/978-3-642-27213-4_11 CrossRef Felderer, M., Haisjackl, C., Breu, R., Motz, J.: Integrating manual and automatic risk assessment for risk-based testing. In: Biffl, S., Winkler, D., Bergsmann, J. (eds.) SWQD 2012. LNBIP, vol. 94, pp. 159–180. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-27213-4_​11 CrossRef
22.
go back to reference Felderer, M., Ramler, R.: Experiences and challenges of introducing risk-based testing in an industrial project. In: Winkler, D., Biffl, S., Bergsmann, J. (eds.) SWQD 2013. LNBIP, vol. 133, pp. 10–29. Springer, Heidelberg (2013). doi:10.1007/978-3-642-35702-2_3 CrossRef Felderer, M., Ramler, R.: Experiences and challenges of introducing risk-based testing in an industrial project. In: Winkler, D., Biffl, S., Bergsmann, J. (eds.) SWQD 2013. LNBIP, vol. 133, pp. 10–29. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-35702-2_​3 CrossRef
23.
go back to reference Redmill, F.: Exploring risk-based testing and its implications. Softw. Test. Verif. Reliab. 14, 3–15 (2004)CrossRef Redmill, F.: Exploring risk-based testing and its implications. Softw. Test. Verif. Reliab. 14, 3–15 (2004)CrossRef
24.
go back to reference Redmill, F.: Theory and practice of risk-based testing. Softw. Test. Verif. Reliab. 15, 3–20 (2005)CrossRef Redmill, F.: Theory and practice of risk-based testing. Softw. Test. Verif. Reliab. 15, 3–20 (2005)CrossRef
25.
go back to reference Yoon, H., Choi, B.: A test case prioritization based on degree of risk exposure and its empirical study. Int. J. Softw. Eng. Knowl. Eng. 21, 191–209 (2011)CrossRef Yoon, H., Choi, B.: A test case prioritization based on degree of risk exposure and its empirical study. Int. J. Softw. Eng. Knowl. Eng. 21, 191–209 (2011)CrossRef
26.
go back to reference Gleirscher, M.: Hazard-based selection of test cases. In: Proceeding if the Sixth International Workshop on Automation of Software Test (AST 2011), pp. 64–70. ACM, New York (2011) Gleirscher, M.: Hazard-based selection of test cases. In: Proceeding if the Sixth International Workshop on Automation of Software Test (AST 2011), pp. 64–70. ACM, New York (2011)
28.
go back to reference Ray, M., Mohapatra, D.P.: Risk analysis: a guiding force in the improvement of testing. IET Softw. 7, 29–46 (2013)CrossRef Ray, M., Mohapatra, D.P.: Risk analysis: a guiding force in the improvement of testing. IET Softw. 7, 29–46 (2013)CrossRef
29.
go back to reference Kloos, J., Hussain, T., Eschbach, R.: Risk-based testing of safetycritical embedded systems driven by fault tree analysis. In: Proceeding of the Fourth International Conference on Software Testing, Verification and Validation Workshops (ICSTW 2011), pp. 26–33. IEEE, New York (2011) Kloos, J., Hussain, T., Eschbach, R.: Risk-based testing of safetycritical embedded systems driven by fault tree analysis. In: Proceeding of the Fourth International Conference on Software Testing, Verification and Validation Workshops (ICSTW 2011), pp. 26–33. IEEE, New York (2011)
30.
go back to reference Nazier, R., Bauer, T.: Automated risk-based testing by integrating safety analysis information into system behavior models. In: Proceeding of the 23rd International Symposium on Software Reliability Engineering Workshops (ISSREW 2012), pp. 213–218. IEEE, New York (2012) Nazier, R., Bauer, T.: Automated risk-based testing by integrating safety analysis information into system behavior models. In: Proceeding of the 23rd International Symposium on Software Reliability Engineering Workshops (ISSREW 2012), pp. 213–218. IEEE, New York (2012)
31.
go back to reference Wendland, M.-F., Kranz, M., Schieferdecker, I.: A systematic approach to risk-based testing using risk-annotated requirements models. In: Proceeding of the Seventh International Conference on Software Engineering Advances (ICSEA 2012), pp. 636–642. IARA (2012) Wendland, M.-F., Kranz, M., Schieferdecker, I.: A systematic approach to risk-based testing using risk-annotated requirements models. In: Proceeding of the Seventh International Conference on Software Engineering Advances (ICSEA 2012), pp. 636–642. IARA (2012)
32.
go back to reference Xu, D., Tu, M., Sandford, M., Thomas, L., Woodraska, D., Xu, W.: Automated security test generation with formal threat models. IEEE Trans. Dependable Secure Comput. 9, 526–540 (2012)CrossRef Xu, D., Tu, M., Sandford, M., Thomas, L., Woodraska, D., Xu, W.: Automated security test generation with formal threat models. IEEE Trans. Dependable Secure Comput. 9, 526–540 (2012)CrossRef
33.
go back to reference Zimmermann, F., Eschbach, R., Kloos, J., Bauer, T.: Risk-based statistical testing: a refinement-based approach to the reliability analysis of safety-critical systems. In: Proceeding of the 12th European Workshop on Dependable Computing (EWDC 2009), pp. 1–8 (2009) Zimmermann, F., Eschbach, R., Kloos, J., Bauer, T.: Risk-based statistical testing: a refinement-based approach to the reliability analysis of safety-critical systems. In: Proceeding of the 12th European Workshop on Dependable Computing (EWDC 2009), pp. 1–8 (2009)
34.
go back to reference Chen, Y., Probert, R.L.: A risk-based regression test selection strategy. In: Proceeding of the 14th IEEE International Symposium on Software Reliability Engineering (ISSRE 2003), Fast Abstract, pp. 305–306. Chillarege Press (2003) Chen, Y., Probert, R.L.: A risk-based regression test selection strategy. In: Proceeding of the 14th IEEE International Symposium on Software Reliability Engineering (ISSRE 2003), Fast Abstract, pp. 305–306. Chillarege Press (2003)
35.
go back to reference Chen, Y., Probert, R.L., Sims, D.P.: Specification-based regression test selection with risk analysis. In: Proceeding of the 2002 Conference of the Centre for Advanced Studies on Collaborative Research (CASCON 2002), pp. 1–14. IBM Press, New York (2002) Chen, Y., Probert, R.L., Sims, D.P.: Specification-based regression test selection with risk analysis. In: Proceeding of the 2002 Conference of the Centre for Advanced Studies on Collaborative Research (CASCON 2002), pp. 1–14. IBM Press, New York (2002)
36.
go back to reference Entin, V., Winder, M., Zhang, B., Christmann, S.: Introducing model-based testing in an industrial scrum project. In: Proceeding of the Seventh International Workshop on Automation of Software Test (AST 2012), pp. 43–49. IEEE, New York (2012) Entin, V., Winder, M., Zhang, B., Christmann, S.: Introducing model-based testing in an industrial scrum project. In: Proceeding of the Seventh International Workshop on Automation of Software Test (AST 2012), pp. 43–49. IEEE, New York (2012)
37.
go back to reference Stallbaum, H., Metzger, A., Pohl, K.: An automated technique for risk-based test case generation and prioritization. In: Proceeding of the Third International Workshop on Automation of Software Test (AST 2008), pp. 67–70. ACM, New York (2008) Stallbaum, H., Metzger, A., Pohl, K.: An automated technique for risk-based test case generation and prioritization. In: Proceeding of the Third International Workshop on Automation of Software Test (AST 2008), pp. 67–70. ACM, New York (2008)
38.
go back to reference Hosseingholizadeh, A.: A source-based risk analysis approach for software test optimization. In: Proceeding of the Second International Conference on Computer Engineering and Technology (ICCET 2010), vol. 2, pp. 601–604. IEEE, New York (2010) Hosseingholizadeh, A.: A source-based risk analysis approach for software test optimization. In: Proceeding of the Second International Conference on Computer Engineering and Technology (ICCET 2010), vol. 2, pp. 601–604. IEEE, New York (2010)
39.
go back to reference Wong, W.E., Qi, Y., Cooper, K.: Source code-based software risk assessing. In: Proceeding of the 2005 ACM Symposium on Applied Computing (SAC 2005), pp. 1485–1490. ACM, New York (2005) Wong, W.E., Qi, Y., Cooper, K.: Source code-based software risk assessing. In: Proceeding of the 2005 ACM Symposium on Applied Computing (SAC 2005), pp. 1485–1490. ACM, New York (2005)
40.
go back to reference Kumar, N., Sosale, D., Konuganti, S.N., Rathi, A.: Enabling the adoption of aspects-testing aspects: A risk model, fault model and patterns. In: Proceeding of the Eighth ACM International Conference on Aspect-Oriented Software Development (AOSD 2009), pp. 197–206. ACM, New York (2009) Kumar, N., Sosale, D., Konuganti, S.N., Rathi, A.: Enabling the adoption of aspects-testing aspects: A risk model, fault model and patterns. In: Proceeding of the Eighth ACM International Conference on Aspect-Oriented Software Development (AOSD 2009), pp. 197–206. ACM, New York (2009)
41.
go back to reference Rosenberg, L., Stapko, R., Gallo, A.: Risk-based object oriented testing. In: Proceeding of the 24th Annual Software EngineeringWorkshop, pp. 1–6. NASA, Software Engineering Laboratory (1999) Rosenberg, L., Stapko, R., Gallo, A.: Risk-based object oriented testing. In: Proceeding of the 24th Annual Software EngineeringWorkshop, pp. 1–6. NASA, Software Engineering Laboratory (1999)
42.
go back to reference Bai, X., Kenett, R.S.: Risk-based adaptive group testing of semantic web services. In: Proceeding of the 33rd Annual IEEE International Computer Software and Applications Conference (COMPSAC 2009), vol. 2, pp. 485–490. IEEE, New York (2009) Bai, X., Kenett, R.S.: Risk-based adaptive group testing of semantic web services. In: Proceeding of the 33rd Annual IEEE International Computer Software and Applications Conference (COMPSAC 2009), vol. 2, pp. 485–490. IEEE, New York (2009)
43.
go back to reference Bai, X., Kennett, R.S., Yu, W.: Risk assessment and adaptive group testing of semantic web services. Int. J. Softw. Eng. Knowl. Eng. 22, 595–620 (2012)CrossRef Bai, X., Kennett, R.S., Yu, W.: Risk assessment and adaptive group testing of semantic web services. Int. J. Softw. Eng. Knowl. Eng. 22, 595–620 (2012)CrossRef
44.
go back to reference Casado, R., Tuya, J., Younas, M.: Testing long-lived web services transactions using a risk-based approach. In: Proceeding of the 10th International Conference on Quality Software (QSIC 2010), pp. 337–340. IEEE, New York (2010) Casado, R., Tuya, J., Younas, M.: Testing long-lived web services transactions using a risk-based approach. In: Proceeding of the 10th International Conference on Quality Software (QSIC 2010), pp. 337–340. IEEE, New York (2010)
45.
go back to reference Casado, R., Tuya, J., Younas, M.: A framework to test advanced web services transactions. In: Proceeding of the 4th International Conference on Software Testing, Verification and Validation (ICST 2011), pp. 443–446. IEEE, New York (2011) Casado, R., Tuya, J., Younas, M.: A framework to test advanced web services transactions. In: Proceeding of the 4th International Conference on Software Testing, Verification and Validation (ICST 2011), pp. 443–446. IEEE, New York (2011)
46.
go back to reference Murthy, K.K., Thakkar, K.R., Laxminarayan, S.: Leveraging risk based testing in enterprise systems security validation. In: Proceeding of the First International Conference on Emerging Network Intelligence (EMERGING 2009), pp. 111–116. IEEE, New York (2009) Murthy, K.K., Thakkar, K.R., Laxminarayan, S.: Leveraging risk based testing in enterprise systems security validation. In: Proceeding of the First International Conference on Emerging Network Intelligence (EMERGING 2009), pp. 111–116. IEEE, New York (2009)
47.
go back to reference Zech, P.: Risk-based security testing in cloud computing environments. In: Proceeding of the Fourth International Conference on Software Testing, Verification and Validation (ICST 2011), pp. 411– 414. IEEE, New York (2011) Zech, P.: Risk-based security testing in cloud computing environments. In: Proceeding of the Fourth International Conference on Software Testing, Verification and Validation (ICST 2011), pp. 411– 414. IEEE, New York (2011)
48.
go back to reference Zech, P., Felderer, M., Breu, R.: Towards risk-driven security testing of service centric systems. In: 2012 12th International Conference on Quality Software (QSIC). IEEE (2012) Zech, P., Felderer, M., Breu, R.: Towards risk-driven security testing of service centric systems. In: 2012 12th International Conference on Quality Software (QSIC). IEEE (2012)
49.
go back to reference Schneidewind, N.F.: Risk-driven software testing and reliability. Int. J. Reliab. Qual. Saf. Eng. 14, 99–132 (2007)CrossRef Schneidewind, N.F.: Risk-driven software testing and reliability. Int. J. Reliab. Qual. Saf. Eng. 14, 99–132 (2007)CrossRef
50.
go back to reference Souza, E., Gusmão, C., Venâncio, J.: Risk-based testing: a case study. In: Proceeding of the Seventh International Conference on Information Technology: New Generations (ITNG 2010), pp. 1032–1037. IEEE, New York (2010) Souza, E., Gusmão, C., Venâncio, J.: Risk-based testing: a case study. In: Proceeding of the Seventh International Conference on Information Technology: New Generations (ITNG 2010), pp. 1032–1037. IEEE, New York (2010)
51.
go back to reference Bach, J.: Heuristic Risk-Based Testing. Software Testing and Quality Engineering Magazine, November 1999 Bach, J.: Heuristic Risk-Based Testing. Software Testing and Quality Engineering Magazine, November 1999
52.
go back to reference Paul, G.: Risk-Based E-Business Testing, pp. 3–29, 51–80 (2002). ISBN: 1580533140 Paul, G.: Risk-Based E-Business Testing, pp. 3–29, 51–80 (2002). ISBN: 1580533140
53.
go back to reference Hartman, A.: The AGEDIS tools for model based testing. In: ISSTA 2004 Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis (2004) Hartman, A.: The AGEDIS tools for model based testing. In: ISSTA 2004 Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis (2004)
54.
go back to reference Stålhane, T.: Risk Analysis as a Prioritizing Mechanism in EuroSPI (2003) Stålhane, T.: Risk Analysis as a Prioritizing Mechanism in EuroSPI (2003)
56.
go back to reference Tretmans, J., Brinksma, E.: Côte de Resyste – automated model based testing. In: Progress 2002 – 3rd Workshop on Embedded Systems (2002) Tretmans, J., Brinksma, E.: Côte de Resyste – automated model based testing. In: Progress 2002 – 3rd Workshop on Embedded Systems (2002)
57.
go back to reference Bouquet, F., Legeard, B., Peureux, F., Torreborre, E.: Mastering test generation from smart card software formal models. In: Proceedings of International Workshop on Construction and Analysis of Safe, Secure and Interoperable Smart devices (2004) Bouquet, F., Legeard, B., Peureux, F., Torreborre, E.: Mastering test generation from smart card software formal models. In: Proceedings of International Workshop on Construction and Analysis of Safe, Secure and Interoperable Smart devices (2004)
58.
go back to reference Anand, S., Burke, E.K., Chen, T.Y., Clark, J., Cohen, M.B., Grieskamp, W., Harman, M., Harrold, M.J., McMinn, P.: An orchestrated survey of methodologies for automated software test case generation. J. Syst. Softw. 86, 1978–2001 (2013)CrossRef Anand, S., Burke, E.K., Chen, T.Y., Clark, J., Cohen, M.B., Grieskamp, W., Harman, M., Harrold, M.J., McMinn, P.: An orchestrated survey of methodologies for automated software test case generation. J. Syst. Softw. 86, 1978–2001 (2013)CrossRef
Metadata
Title
A Comparative Study of Software Testing Techniques
Authors
Meriem Atifi
Abdelaziz Mamouni
Abdelaziz Marzak
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-59647-1_27

Premium Partner