Skip to main content
Top

2024 | OriginalPaper | Chapter

Closing the Loop: Towards a Complete Metamorphic Testing Pipeline

Authors : Alejandra Duque-Torres, Dietmar Pfahl

Published in: Product-Focused Software Process Improvement

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Metamorphic Testing (MT) address the test oracle problem, which arises when there are no practical means to verify the outputs of the System Under Test (SUT). Instead of just verifying individual input-output combinations, MT assesses the relations between pairs of these combinations during consecutive SUT executions; these relations are known as Metamorphic Relations (MRs). MRs delineate how outputs should adapt based on input changes. Automating MR generation is challenging because of the intrinsic connection between MRs and the SUT’s domain. Furthermore, the relevance of MRs can be contingent upon specific data. Motivated by this, our research focuses on facilitating the generation and selection of MRs, defining their applicability by establishing constraints and shedding light on the factors influencing MR outcomes. Our goal is to equip testers with methods and tools that optimise the application of the MT approach.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Blasi, A., Gorla, A., Ernst, M.D., Pezzè, M., Carzaniga, A.: MeMo: automatically identifying metamorphic relations in Javadoc comments for test automation. J. Syst. Softw. 181, 111041 (2021)CrossRef Blasi, A., Gorla, A., Ernst, M.D., Pezzè, M., Carzaniga, A.: MeMo: automatically identifying metamorphic relations in Javadoc comments for test automation. J. Syst. Softw. 181, 111041 (2021)CrossRef
2.
go back to reference Chaleshtari, N.B., Pastore, F., Goknil, A., Briand, L.C.: Metamorphic testing for web system security. IEEE Trans. Software Eng. 49(6), 3430–3471 (2023) Chaleshtari, N.B., Pastore, F., Goknil, A., Briand, L.C.: Metamorphic testing for web system security. IEEE Trans. Software Eng. 49(6), 3430–3471 (2023)
3.
go back to reference Duque-Torres, A., Pfahl, D.: Inferring metamorphic relations from JavaDocs: a deep dive into the memo approach. In: Taibi, D., Kuhrmann, M., Mikkonen, T., Klünder, J., Abrahamsson, P. (eds.) Product-Focused Software Process Improvement, vol. 13709, pp. 418–432, Springer, Cham (2022). https://doi.org/10.1007/978-3-031-21388-5_29 Duque-Torres, A., Pfahl, D.: Inferring metamorphic relations from JavaDocs: a deep dive into the memo approach. In: Taibi, D., Kuhrmann, M., Mikkonen, T., Klünder, J., Abrahamsson, P. (eds.) Product-Focused Software Process Improvement, vol. 13709, pp. 418–432, Springer, Cham (2022). https://​doi.​org/​10.​1007/​978-3-031-21388-5_​29
4.
go back to reference Duque-Torres, A., Pfahl, D., Claus, K., Ramler, R.: A replication study on predicting metamorphic relations at unit testing level. In: 2022 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), pp. 1–11 (2022) Duque-Torres, A., Pfahl, D., Claus, K., Ramler, R.: A replication study on predicting metamorphic relations at unit testing level. In: 2022 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), pp. 1–11 (2022)
5.
go back to reference Duque-Torres, A., Pfahl, D., Klammer, C., Fischer, S.: Bug or not bug? Analysing the reasons behind metamorphic relation violations. In: IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), pp. 905–912 (2023) Duque-Torres, A., Pfahl, D., Klammer, C., Fischer, S.: Bug or not bug? Analysing the reasons behind metamorphic relation violations. In: IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), pp. 905–912 (2023)
6.
go back to reference Duque-Torres, A., Pfahl, D., Klammer, C., Fischer, S.: Exploring a test data-driven method for selecting and constraining metamorphic relations. arXiv preprint arXiv:2307.15522 (2023) Duque-Torres, A., Pfahl, D., Klammer, C., Fischer, S.: Exploring a test data-driven method for selecting and constraining metamorphic relations. arXiv preprint arXiv:​2307.​15522 (2023)
7.
go back to reference Duque-Torres, A., Pfahl, D., Klammer, C., Fisher, S.: Using source code metrics for predicting metamorphic relations at method level. In: 5th Workshop on Validation, Analysis and Evolution of Software Tests (2022) Duque-Torres, A., Pfahl, D., Klammer, C., Fisher, S.: Using source code metrics for predicting metamorphic relations at method level. In: 5th Workshop on Validation, Analysis and Evolution of Software Tests (2022)
8.
go back to reference Kanewala, U., Bieman, J.M.: Using machine learning techniques to detect metamorphic relations for programs without test oracles. In: IEEE 24th International Symposium on Software Reliability Engineering (ISSRE) (2013) Kanewala, U., Bieman, J.M.: Using machine learning techniques to detect metamorphic relations for programs without test oracles. In: IEEE 24th International Symposium on Software Reliability Engineering (ISSRE) (2013)
9.
go back to reference Kanewala, U., Bieman, J.M., Ben-Hur, A.: Predicting metamorphic relations for testing scientific software: a machine learning approach using graph kernels. Softw. Test. Verification Reliab. 26(3), 245–269 (2016)CrossRef Kanewala, U., Bieman, J.M., Ben-Hur, A.: Predicting metamorphic relations for testing scientific software: a machine learning approach using graph kernels. Softw. Test. Verification Reliab. 26(3), 245–269 (2016)CrossRef
10.
go back to reference Mai, P.X., Goknil, A., Pastore, F., Briand, L.C.: SMRL: a metamorphic security testing tool for web systems. In: 2020 IEEE/ACM 42nd International Conference on Software Engineering: Companion Proceedings (ICSE-Companion), pp. 9–12 (2020) Mai, P.X., Goknil, A., Pastore, F., Briand, L.C.: SMRL: a metamorphic security testing tool for web systems. In: 2020 IEEE/ACM 42nd International Conference on Software Engineering: Companion Proceedings (ICSE-Companion), pp. 9–12 (2020)
11.
go back to reference Mai, P.X., Pastore, F., Goknil, A., Briand, L.: Metamorphic security testing for web systems. In: 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST), pp. 186–197 (2020) Mai, P.X., Pastore, F., Goknil, A., Briand, L.: Metamorphic security testing for web systems. In: 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST), pp. 186–197 (2020)
12.
go back to reference Segura, S., Fraser, G., Sanchez, A.B., Ruiz-Cortés, A.: A survey on metamorphic testing. IEEE Trans. Softw. Eng. 42(9) (2016) Segura, S., Fraser, G., Sanchez, A.B., Ruiz-Cortés, A.: A survey on metamorphic testing. IEEE Trans. Softw. Eng. 42(9) (2016)
13.
go back to reference Xie, X., Li, J., Wang, C., Chen, T.Y.: Looking for an MR? Try METWiki today. In: 2016 IEEE/ACM 1st International Workshop on Metamorphic Testing (MET), pp. 1–4 (2016) Xie, X., Li, J., Wang, C., Chen, T.Y.: Looking for an MR? Try METWiki today. In: 2016 IEEE/ACM 1st International Workshop on Metamorphic Testing (MET), pp. 1–4 (2016)
Metadata
Title
Closing the Loop: Towards a Complete Metamorphic Testing Pipeline
Authors
Alejandra Duque-Torres
Dietmar Pfahl
Copyright Year
2024
DOI
https://doi.org/10.1007/978-3-031-49269-3_16

Premium Partner