Skip to main content
Erschienen in:
Buchtitelbild

2019 | OriginalPaper | Buchkapitel

Using Semantic Metrics to Predict Mutation Equivalence

verfasst von : Amani Ayad, Imen Marsit, Nazih Mohamed Omri, JiMeng Loh, Ali Mili

Erschienen in: Software Technologies

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Equivalent mutants are a major nuisance in mutation testing because they introduce a significant amount of bias. But weeding them out is difficult because it requires a detailed analysis of the source code of the base program and the mutant. In this paper we argue that for most applications, it is not necessary to identify equivalent mutants individually; rather it suffices to estimate their number. Also, we explore how we can estimate their number by a cursory/automatable analysis of the base program and the mutant generation policy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Trans. Softw. Eng. 37(5), 649–678 (2011)CrossRef Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Trans. Softw. Eng. 37(5), 649–678 (2011)CrossRef
2.
Zurück zum Zitat Just, R., Jalali, D., Inozemtseva, L., Ernst, M.D., Holmes, R., Fraser, G.: Are mutants a valid substitute for real faults in software testing. In: Foundations of Software Engineering, Hong Kong, China (2014) Just, R., Jalali, D., Inozemtseva, L., Ernst, M.D., Holmes, R., Fraser, G.: Are mutants a valid substitute for real faults in software testing. In: Foundations of Software Engineering, Hong Kong, China (2014)
3.
Zurück zum Zitat Andrews, J.H., Briand, L.C., Labiche, I.: Is mutation an appropriate tool for testing experiments. In: International Conference on Software Testing, St. Louis, MO, USA (2005) Andrews, J.H., Briand, L.C., Labiche, I.: Is mutation an appropriate tool for testing experiments. In: International Conference on Software Testing, St. Louis, MO, USA (2005)
4.
Zurück zum Zitat Namin, A.S., Kakarla, S.: The Use of mutation in testing experiments and its sensitivity to external threats. In: ISSTA 2011, Toronto, Ontario, Canada (2011) Namin, A.S., Kakarla, S.: The Use of mutation in testing experiments and its sensitivity to external threats. In: ISSTA 2011, Toronto, Ontario, Canada (2011)
5.
Zurück zum Zitat Yao, X., Harman, M., Jia, Y.: A study of equivalent and stubborn mutation operators using human analysis of equivalence. In: Proceedings, International Conference on Software Engineering, Hyderabad, India (2014) Yao, X., Harman, M., Jia, Y.: A study of equivalent and stubborn mutation operators using human analysis of equivalence. In: Proceedings, International Conference on Software Engineering, Hyderabad, India (2014)
6.
Zurück zum Zitat Schuler, D., Zeller, A.: Covering and uncovering equivalent mutants. J. Softw. Test. Verification Reliab. 23(5), 353–374 (2012)CrossRef Schuler, D., Zeller, A.: Covering and uncovering equivalent mutants. J. Softw. Test. Verification Reliab. 23(5), 353–374 (2012)CrossRef
7.
Zurück zum Zitat Gruen, B.J., Schuler, D., Zeller, A.: The impact of equivalent mutants. In: MUTATION 2009. Denver CO., USA (2009) Gruen, B.J., Schuler, D., Zeller, A.: The impact of equivalent mutants. In: MUTATION 2009. Denver CO., USA (2009)
8.
Zurück zum Zitat Just, R., Ernst, M.D., Fraser, G.: Using state infection conditions to detect equivalent mutants and speed up mutation analysis. In: Dagstuhl Seminar 13021: Symbolic Methods in Testing, Wadern, Germany (2013) Just, R., Ernst, M.D., Fraser, G.: Using state infection conditions to detect equivalent mutants and speed up mutation analysis. In: Dagstuhl Seminar 13021: Symbolic Methods in Testing, Wadern, Germany (2013)
9.
Zurück zum Zitat Just, R., Ernst, M.D., Fraser, G.: Efficient mutation analysis by propagating and partitioning infected execution states. In: ISSTA 2014, San Jose, CA, USA (2014) Just, R., Ernst, M.D., Fraser, G.: Efficient mutation analysis by propagating and partitioning infected execution states. In: ISSTA 2014, San Jose, CA, USA (2014)
10.
Zurück zum Zitat Wang, B., Xiong, Y., Shi, Y., Zhang, L., Hao, D.: Faster mutation analysis via equivalence modulo states. In: ISSTA 2017, Santa Barbara, CA, USA (2017) Wang, B., Xiong, Y., Shi, Y., Zhang, L., Hao, D.: Faster mutation analysis via equivalence modulo states. In: ISSTA 2017, Santa Barbara, CA, USA (2017)
11.
Zurück zum Zitat Papadakis, M., Delamaro, M., Le Traon, Y.: Mitigating the effects of equivalent mutants with mutant classification strategies. Sci. Comput. Program. 95(12), 298–319 (2014)CrossRef Papadakis, M., Delamaro, M., Le Traon, Y.: Mitigating the effects of equivalent mutants with mutant classification strategies. Sci. Comput. Program. 95(12), 298–319 (2014)CrossRef
12.
Zurück zum Zitat Papadakis, M., Kintis, M., Zhang, J., Jia, Y., Le Traon, Y., Harman, M.: Mutation testing advances: an analysis and survey. In: Advances in Computers (2019) Papadakis, M., Kintis, M., Zhang, J., Jia, Y., Le Traon, Y., Harman, M.: Mutation testing advances: an analysis and survey. In: Advances in Computers (2019)
13.
Zurück zum Zitat Budd, T.A., Angluin, D.: Two notions of correctness and their relation to testing. Acta Informatica 18(1), 31–45 (1982)MathSciNetCrossRef Budd, T.A., Angluin, D.: Two notions of correctness and their relation to testing. Acta Informatica 18(1), 31–45 (1982)MathSciNetCrossRef
14.
Zurück zum Zitat Offutt, J.A., Pan, J.: Automatically detecting equivalent mutants and infeasible paths. J. Softw. Test. Verification Reliab. 7(3), 164–192 (1997) Offutt, J.A., Pan, J.: Automatically detecting equivalent mutants and infeasible paths. J. Softw. Test. Verification Reliab. 7(3), 164–192 (1997)
15.
Zurück zum Zitat Voas, J., McGraw, G.: Software Fault Injection: Inoculating Programs Against Errors. Wiley, New York (1997) Voas, J., McGraw, G.: Software Fault Injection: Inoculating Programs Against Errors. Wiley, New York (1997)
16.
Zurück zum Zitat Harman, M., Hierons, R., Danicic, S.: The relationship between program dependence and mutation analysis. In: MUTATION 2000, San Jose, CA, USA (2000) Harman, M., Hierons, R., Danicic, S.: The relationship between program dependence and mutation analysis. In: MUTATION 2000, San Jose, CA, USA (2000)
17.
Zurück zum Zitat Hierons, R.M., Harman, M., Danicic, S.: Using program slicing to assist in the detection of equivalent mutants. J. Softw. Test. Verification Reliab. 9(4), 233–262 (1999)CrossRef Hierons, R.M., Harman, M., Danicic, S.: Using program slicing to assist in the detection of equivalent mutants. J. Softw. Test. Verification Reliab. 9(4), 233–262 (1999)CrossRef
18.
Zurück zum Zitat Ellims, M., Ince, D.C., Petre, M.: The Csaw C mutation tool: initial results. In: MUTATION 2007, Windsor, UK (2007) Ellims, M., Ince, D.C., Petre, M.: The Csaw C mutation tool: initial results. In: MUTATION 2007, Windsor, UK (2007)
19.
Zurück zum Zitat Howden, W.E.: Weak mutation testing and completeness of test sets. IEEE Trans. Softw. Eng. 8(4), 371–379 (1982)CrossRef Howden, W.E.: Weak mutation testing and completeness of test sets. IEEE Trans. Softw. Eng. 8(4), 371–379 (1982)CrossRef
20.
Zurück zum Zitat Schuler, D., Dallmaier, V., Zeller, A.: Efficient mutation testing by checking invariant violations. In: ISSTA 2009, Chicago, IL, USA (2009) Schuler, D., Dallmaier, V., Zeller, A.: Efficient mutation testing by checking invariant violations. In: ISSTA 2009, Chicago, IL, USA (2009)
21.
Zurück zum Zitat Ernst, M.D., Cockrell, J., Griswold, W.G., Notkin, D.: Dynamically discovering likely program invariants to support program evolution. IEEE Trans. Softw. Eng. 27(2), 99–123 (2001)CrossRef Ernst, M.D., Cockrell, J., Griswold, W.G., Notkin, D.: Dynamically discovering likely program invariants to support program evolution. IEEE Trans. Softw. Eng. 27(2), 99–123 (2001)CrossRef
22.
Zurück zum Zitat Nica, S., Wotawa, F.: Using constraints for equivalent mutant detection. In: Workshop on Formal Methods in the Development of Software (2012) Nica, S., Wotawa, F.: Using constraints for equivalent mutant detection. In: Workshop on Formal Methods in the Development of Software (2012)
23.
Zurück zum Zitat Carvalho, L., Guimaraes, M.A., Fernandes, L., Al Hajjaji, M., Gheyi, R., Thuem, T.: Equivalent mutants in configurable systems: an empirical study. In: VAMOS 2018, Madrid, Spain (2018) Carvalho, L., Guimaraes, M.A., Fernandes, L., Al Hajjaji, M., Gheyi, R., Thuem, T.: Equivalent mutants in configurable systems: an empirical study. In: VAMOS 2018, Madrid, Spain (2018)
24.
Zurück zum Zitat Kintis, M., Papadakis, M., Jia, Y., Malevris, N., Le Traon, Y., Harman, M.: Detecting trivial mutant equivalences via compiler optimizations. IEEE Trans. Softw. Eng. 44(4), 308–333 (2018)CrossRef Kintis, M., Papadakis, M., Jia, Y., Malevris, N., Le Traon, Y., Harman, M.: Detecting trivial mutant equivalences via compiler optimizations. IEEE Trans. Softw. Eng. 44(4), 308–333 (2018)CrossRef
25.
Zurück zum Zitat Marsit, I., Omri, M.N., Loh, J.M., Mili, A.: Impact of mutation operators on mutant equivalence. In: ICSOFT, Madrid, Spain (2018) Marsit, I., Omri, M.N., Loh, J.M., Mili, A.: Impact of mutation operators on mutant equivalence. In: ICSOFT, Madrid, Spain (2018)
27.
Zurück zum Zitat Laurent, T., Papadakis, M., Kintis, M., Henard, C., Le Traon, Y., Ventresque, A.: Assessing and improving the mutation testing practice of PIT. In: ICST, Vasteras, Sweden (2018) Laurent, T., Papadakis, M., Kintis, M., Henard, C., Le Traon, Y., Ventresque, A.: Assessing and improving the mutation testing practice of PIT. In: ICST, Vasteras, Sweden (2018)
Metadaten
Titel
Using Semantic Metrics to Predict Mutation Equivalence
verfasst von
Amani Ayad
Imen Marsit
Nazih Mohamed Omri
JiMeng Loh
Ali Mili
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-29157-0_1