Skip to main content

2020 | OriginalPaper | Buchkapitel

Metamorphic Testing in Fault Localization of Model Transformations

verfasst von : Keke Du, Mingyue Jiang, Zuohua Ding, Hongyun Huang, Ting Shu

Erschienen in: Structured Object-Oriented Formal Language and Method

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Model transformations are cornerstone elements of Model Driven Engineering (MDE), and their quality directly affects the successful application of MDE in practice. However, due to the characteristics of model transformation programs, the debugging of model transformations faces the oracle problem. In this paper, we propose an approach of debugging model transformations by using the technique of metamorphic testing (MT). Our approach leverages MT to alleviate the oracle problem, and integrates MT with spectrum-based fault localization technique to locating faulty rules of model transformations. We conduct experiments to evaluate our approach by using open-source model transformation programs, and compare the effectiveness of our approach with that of a fault localization technique using constraint-based oracles. Both of the experimental analysis and the comparison study show that our approach is of promising effectiveness, suggesting that MT can be a good support for debugging model transformations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Rahim, L.A., Whittle, J.: A survey of approaches for verifying model transformations. Softw. Syst. Model. 14(2), 1003–1028 (2015)CrossRef Rahim, L.A., Whittle, J.: A survey of approaches for verifying model transformations. Softw. Syst. Model. 14(2), 1003–1028 (2015)CrossRef
3.
Zurück zum Zitat Abreu, R., Zoeteweij, P., Golsteijn, R., van Gemund, A.J.C.: A practical evaluation of spectrum-based fault localization. J. Syst. Softw. 82(11), 1780–1792 (2009)CrossRef Abreu, R., Zoeteweij, P., Golsteijn, R., van Gemund, A.J.C.: A practical evaluation of spectrum-based fault localization. J. Syst. Softw. 82(11), 1780–1792 (2009)CrossRef
4.
Zurück zum Zitat Le, T.D.B., Lo, D., Le Goues, C., Grunske, L.: A learning-to-rank based fault localization approach using likely invariants. In: Proceedings of the 25th International Symposium on Software Testing and Analysis, ISSTA 2016, pp. 177–188. ACM (2016) Le, T.D.B., Lo, D., Le Goues, C., Grunske, L.: A learning-to-rank based fault localization approach using likely invariants. In: Proceedings of the 25th International Symposium on Software Testing and Analysis, ISSTA 2016, pp. 177–188. ACM (2016)
5.
Zurück zum Zitat Baudry, B., Ghosh, S., Fleurey, F., France, R., Le Traon, Y., Mottu, J.M.: Barriers to systematic model transformation testing. Commun. ACM 53(6), 139–143 (2010)CrossRef Baudry, B., Ghosh, S., Fleurey, F., France, R., Le Traon, Y., Mottu, J.M.: Barriers to systematic model transformation testing. Commun. ACM 53(6), 139–143 (2010)CrossRef
6.
Zurück zum Zitat Burgueño, L., Troya, J., Wimmer, M., Vallecillo, A.: Static fault localization in model transformations. IEEE Trans. Softw. Eng. 41(5), 490–506 (2015)CrossRef Burgueño, L., Troya, J., Wimmer, M., Vallecillo, A.: Static fault localization in model transformations. IEEE Trans. Softw. Eng. 41(5), 490–506 (2015)CrossRef
7.
Zurück zum Zitat Chen, T.Y., Cheung, S.C., Yiu, S.M.: Metamorphic testing: a new approach for generating next test cases. Technical report HKUST-CS98-01, Department of Computer Science, Hong Kong University of Science and Technology (1998) Chen, T.Y., Cheung, S.C., Yiu, S.M.: Metamorphic testing: a new approach for generating next test cases. Technical report HKUST-CS98-01, Department of Computer Science, Hong Kong University of Science and Technology (1998)
8.
Zurück zum Zitat Chen, T.Y., et al.: Metamorphic testing: a review of challenges and opportunities. ACM Comput. Surv. 51(1), 4:1–4:27 (2018)CrossRef Chen, T.Y., et al.: Metamorphic testing: a review of challenges and opportunities. ACM Comput. Surv. 51(1), 4:1–4:27 (2018)CrossRef
9.
Zurück zum Zitat Field, A.: Discovering Statistics Using IBM SPSS Statistics, 4th edn. Sage Publications, Thousand Oaks (2003) Field, A.: Discovering Statistics Using IBM SPSS Statistics, 4th edn. Sage Publications, Thousand Oaks (2003)
10.
Zurück zum Zitat He, X., Chen, X., Cai, S., Zhang, Y., Huang, G.: Testing bidirectional model transformation using metamorphic testing. Inform. Softw. Techol. 104, 109–129 (2018)CrossRef He, X., Chen, X., Cai, S., Zhang, Y., Huang, G.: Testing bidirectional model transformation using metamorphic testing. Inform. Softw. Techol. 104, 109–129 (2018)CrossRef
12.
Zurück zum Zitat Jiang, M., Chen, T.Y., Kuo, F.C., Ding, Z.: Testing central processing unit scheduling algorithms using metamorphic testing. In: Proceedings of the 4th IEEE International Conference on Software Engineering and Service Science, pp. 530–536 (2014) Jiang, M., Chen, T.Y., Kuo, F.C., Ding, Z.: Testing central processing unit scheduling algorithms using metamorphic testing. In: Proceedings of the 4th IEEE International Conference on Software Engineering and Service Science, pp. 530–536 (2014)
13.
Zurück zum Zitat Jones, J.A., Harrold, M.J., Stasko, J.: Visualization of test information to assist fault localization. In: Proceedings of the 24th International Conference on Software Engineering, ICSE 2002, pp. 467–477 (2002) Jones, J.A., Harrold, M.J., Stasko, J.: Visualization of test information to assist fault localization. In: Proceedings of the 24th International Conference on Software Engineering, ICSE 2002, pp. 467–477 (2002)
14.
Zurück zum Zitat Le, T.D.B., Oentaryo, R.J., Lo, D.: Information retrieval and spectrum based bug localization: better together. In: Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, ESEC/FSE 2015, pp. 579–590 (2015) Le, T.D.B., Oentaryo, R.J., Lo, D.: Information retrieval and spectrum based bug localization: better together. In: Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, ESEC/FSE 2015, pp. 579–590 (2015)
15.
Zurück zum Zitat Lucia, D.L., Lingxiao Jiang, F.T., Budi, A.: Extended comprehensive study of association measures for fault localization. J. Softw.: Evol. Process 26(2), 172–219 (2014) Lucia, D.L., Lingxiao Jiang, F.T., Budi, A.: Extended comprehensive study of association measures for fault localization. J. Softw.: Evol. Process 26(2), 172–219 (2014)
16.
Zurück zum Zitat Lúcio, L., et al.: Model transformation intents and their properties. Softw. Syst. Model. 15(3), 647–684 (2016)CrossRef Lúcio, L., et al.: Model transformation intents and their properties. Softw. Syst. Model. 15(3), 647–684 (2016)CrossRef
17.
Zurück zum Zitat Troya, J., Bergmayr, A., Burgueño, L., Wimmer, M.: Towards systematic mutations for and with ATL model transformations. In: 2015 IEEE Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 1–10 (2015) Troya, J., Bergmayr, A., Burgueño, L., Wimmer, M.: Towards systematic mutations for and with ATL model transformations. In: 2015 IEEE Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 1–10 (2015)
18.
Zurück zum Zitat Troya, J., Segura, S., Parejo, J.A., Ruiz-Cortés, A.: Spectrum-based fault localization in model transformations. ACM Trans. Softw. Eng. Methodol. 27(3), 1–50 (2018)CrossRef Troya, J., Segura, S., Parejo, J.A., Ruiz-Cortés, A.: Spectrum-based fault localization in model transformations. ACM Trans. Softw. Eng. Methodol. 27(3), 1–50 (2018)CrossRef
19.
Zurück zum Zitat Troya, J., Segura, S., Ruiz-Corts, A.: Automated inference of likely metamorphic relations for model transformations. J. Syst. Softw. 136(C), 188–208 (2018)CrossRef Troya, J., Segura, S., Ruiz-Corts, A.: Automated inference of likely metamorphic relations for model transformations. J. Syst. Softw. 136(C), 188–208 (2018)CrossRef
20.
Zurück zum Zitat Vargha, A., Delaney, H.D.: A critique and improvement of the cl common language effect size statistics of mcgraw and wong. J. Educ. Behav. Stat. 25(2), 101–132 (2000) Vargha, A., Delaney, H.D.: A critique and improvement of the cl common language effect size statistics of mcgraw and wong. J. Educ. Behav. Stat. 25(2), 101–132 (2000)
21.
Zurück zum Zitat Xie, X., Chen, T.Y., Kuo, F.C., Xu, B.: A theoretical analysis of the risk evaluation formulas for spectrum-based fault localization. ACM Trans. Softw. Eng. Methodol. 22(4), 31:1–31:40 (2013)CrossRef Xie, X., Chen, T.Y., Kuo, F.C., Xu, B.: A theoretical analysis of the risk evaluation formulas for spectrum-based fault localization. ACM Trans. Softw. Eng. Methodol. 22(4), 31:1–31:40 (2013)CrossRef
22.
Zurück zum Zitat Xie, X., Wong, W.E., Chen, T.Y., Xu, B.: Metamorphic slice: an application in spectrum-based fault localization. Inf. Softw. Technol. 55(5), 866–879 (2013)CrossRef Xie, X., Wong, W.E., Chen, T.Y., Xu, B.: Metamorphic slice: an application in spectrum-based fault localization. Inf. Softw. Technol. 55(5), 866–879 (2013)CrossRef
23.
Zurück zum Zitat Zhang, M., Li, X., Zhang, L., Khurshid, S.: Boosting spectrum-based fault localization using PageRank. In: Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2017, pp. 261–272. ACM (2017) Zhang, M., Li, X., Zhang, L., Khurshid, S.: Boosting spectrum-based fault localization using PageRank. In: Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2017, pp. 261–272. ACM (2017)
Metadaten
Titel
Metamorphic Testing in Fault Localization of Model Transformations
verfasst von
Keke Du
Mingyue Jiang
Zuohua Ding
Hongyun Huang
Ting Shu
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-41418-4_20