skip to main content
survey

Model Transformation Testing and Debugging: A Survey

Authors Info & Claims
Published:21 November 2022Publication History
Skip Abstract Section

Abstract

Model transformations are the key technique in Model-Driven Engineering (MDE) to manipulate and construct models. As a consequence, the correctness of software systems built with MDE approaches relies mainly on the correctness of model transformations, and thus, detecting and locating bugs in model transformations have been popular research topics in recent years. This surge of work has led to a vast literature on model transformation testing and debugging, which makes it challenging to gain a comprehensive view of the current state-of-the-art. This is an obstacle for newcomers to this topic and MDE practitioners to apply these approaches. This article presents a survey on testing and debugging model transformations based on the analysis of 140 papers on the topics. We explore the trends, advances, and evolution over the years, bringing together previously disparate streams of work and providing a comprehensive view of these thriving areas. In addition, we present a conceptual framework to understand and categorize the different proposals. Finally, we identify several open research challenges and propose specific action points for the model transformation community.

Skip Supplemental Material Section

Supplemental Material

REFERENCES

  1. [1] Al-Sibahi A. S., Dimovski A. S., and Wąsowski A.. 2016. Symbolic execution of high-level transformations. In Proceedings of the SLE. 207220.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. [2] Alkhazi B., Abid C., Kessentini M., Leroy D., and Wimmer M.. 2020. Multi-criteria test cases selection for model transformations. Autom. Softw. Eng. (2020), 91118.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. [3] Almendros-Jiménez J. M. and Becerra-Terón A.. 2016. Automatic generation of Ecore models for testing ATL transformations. In Proceedings of the MEDI. 1630.Google ScholarGoogle ScholarCross RefCross Ref
  4. [4] Anastasakis K., Bordbar B., and Küster J.. 2007. Analysis of model transformations via Alloy. In Proceedings of the MoDeVVA. 4756.Google ScholarGoogle Scholar
  5. [5] Aranega V., Mottu J.-M., Etien A., Degueule T., Baudry B., and Dekeyser J.-L.. 2015. Towards an automation of the mutation analysis dedicated to model transformation. Softw. Test. Verif. Reliab. (2015), 653683.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. [6] Aranega V., Mottu J.-M., Etien A., and Dekeyser J.. 2009. Traceability mechanism for error localization in model transformation. In Proceedings of the ICSOFT. 6673.Google ScholarGoogle Scholar
  7. [7] Aranega V., Mottu J.-M., Etien A., and Dekeyser J.. 2009. Using Trace to situate errors in model transformations. In Proceedings of the ICSOFT. 137149.Google ScholarGoogle Scholar
  8. [8] Aranega V., Mottu J.-M., Etien A., and Dekeyser J.. 2010. Using traceability to enhance mutation analysis dedicated to model transformation. In Proceedings of the MoDeVVA. 16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. [9] Aranega V., Mottu J.-M., Etien A., and Dekeyser J.. 2011. Traceability for mutation analysis in model transformation. In Proceedings of the MODELS. 259273.Google ScholarGoogle ScholarCross RefCross Ref
  10. [10] Arifulina S., Soltenborn C., and Engels G.. 2012. Coverage criteria for testing DMM specifications. In Proceedings of the GTVMT.Google ScholarGoogle Scholar
  11. [11] Batot E. and Sahraoui H.. 2016. A generic framework for model-set selection for the unification of testing and learning MDE tasks. In Proceedings of the MODELS. 374384.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. [12] Bauer E. and Küster J. M.. 2011. Combining specification-based and code-based coverage for model transformation chains. In Proceedings of the ICMT. 7892.Google ScholarGoogle ScholarCross RefCross Ref
  13. [13] Bauer E., Küster J. M., and Engels G.. 2011. Test suite quality for model transformation chains. In Proceedings of the TOOLS. 319.Google ScholarGoogle ScholarCross RefCross Ref
  14. [14] Bonfanti S., Gargantini A., and Mashkoor A.. 2020. Design and validation of a C++ code generator from abstract state machines specifications. J. Softw.: Evolut. Process 32 (2020), 127.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. [15] Braga C., Menezes R., Comicio T., Santos C., and Landim E.. 2011. On the specification, verification and implementation of model transformations with transformation contracts. In Proceedings of the SBMF. 108123.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. [16] Braga C., Menezes R., Comicio T., Santos C., and Landim E.. 2012. Transformation contracts in practice. IET Softw. (2012), 1632.Google ScholarGoogle ScholarCross RefCross Ref
  17. [17] Brottier E., Fleurey F., Steel J., Baudry B., and Traon Y. L.. 2006. Metamodel-based test generation for model transformations: An algorithm and a tool. In Proceedings of the ISSRE. 8594.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. [18] Burgueño L., Troya J., Wimmer M., and Vallecillo A.. 2015. Static fault localization in model transformations. IEEE Trans. Softw. Eng. (2015), 490506.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. [19] Burgueño L., Wimmer M., and Vallecillo A.. 2012. Towards tracking “guilty” transformation rules: A requirements perspective. In Proceedings of the AMT. 2732.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. [20] Burgueño L., Cabot J., Clarisó R., and Gogolla M.. 2019. A systematic approach to generate diverse instantiations for conceptual schemas. In Proceedings of the ER. 513521.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. [21] Burgueño L., Hilken F., Vallecillo A., and Gogolla M.. 2016. Generating effective test suites for model transformations using classifying terms. In Proceedings of the PAME/VOLT. 4857.Google ScholarGoogle Scholar
  22. [22] Burgueño L., Hilken F., Vallecillo A., and Gogolla M.. 2017. Testing transformation models using classifying terms. In Proceedings of the ICMT. 6985.Google ScholarGoogle ScholarCross RefCross Ref
  23. [23] Calegari D. and Delgado A.. 2013. Rule chains coverage for testing QVT-Relations transformations. In Proceedings of the AMT. 110.Google ScholarGoogle Scholar
  24. [24] Cariou E., Belloir N., Barbier F., and Djemam N.. 2009. OCL contracts for the verification of model transformations. In Proceedings of the OCL, Vol. 24. 115.Google ScholarGoogle Scholar
  25. [25] Cariou E., Marvie R., Seinturier L., and Duchien L.. 2004. OCL for the specification of model transformation contracts. In Proceedings of the OCL-MDE. 115.Google ScholarGoogle Scholar
  26. [26] Cheng Z. and Tisi M.. 2017. A deductive approach for fault localization in ATL model transformations. In Proceedings of the FASE. 300317.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. [27] Cheng Z. and Tisi M.. 2018. Slicing ATL model transformations for scalable deductive verification and fault localization. Int. J. Softw. Tools Technol. Transf. (2018), 645663.Google ScholarGoogle ScholarCross RefCross Ref
  28. [28] Ciancone A., Filieri A., and Mirandola R.. 2010. MANTra: Towards model transformation testing. In Proceedings of the QUATIC. 97105.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. [29] Ciancone A., Filieri A., and Mirandola R.. 2014. Testing operational transformations in model-driven engineering. Innov. Syst. Softw. Eng. (2014), 1932.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. [30] Corley J.. 2014. Exploring omniscient debugging for model transformations. In Proceedings of the PSRC. 6368.Google ScholarGoogle Scholar
  31. [31] Corley J., Eddy B. P., Syriani E., and Gray J.. 2017. Efficient and scalable omniscient debugging for model transformations. Softw. Qual. J. (2017), 748.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. [32] Darabos A., Pataricza A., and Varró D.. 2008. Towards testing the implementation of graph transformations. In Proceedings of the GT-VMT. 7585.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. [33] Dhoolia P., Mani S., Sinha V. S., and Sinha S.. 2010. Debugging model-transformation failures using dynamic tainting. In Proceedings of the ECOOP. 2651.Google ScholarGoogle ScholarCross RefCross Ref
  34. [34] Du K., Jiang M., Ding Z., Huang H., and Shu T.. 2020. Metamorphic testing in fault localization of model transformations. In Proceedings of the SOFL+MSVL. 299314.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. [35] Ege F. and Tichy M.. 2019. A proposal of features to support analysis and debugging of declarative model transformations with graphical syntax by embedded visualizations. In Proceedings of the MODELS Companion. 326330.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. [36] Ehrig K., Kuester J. M., and Taentzer G.. 2009. Generating instance models from meta models. Softw. Syst. Model. (2009), 479500.Google ScholarGoogle ScholarCross RefCross Ref
  37. [37] Ehrig K., Küster J. M., Taentzer G., and Winkelmann J.. 2006. Generating instance models from meta models. In Proceedings of the FMOODS. 156170.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. [38] Finot O., Mottu J.-M., Sunyé G., and Attiogbé C.. 2013. Partial test oracle in model transformation testing. In Proceedings of the ICMT. 189204.Google ScholarGoogle ScholarCross RefCross Ref
  39. [39] Finot O., Mottu J.-M., Sunyé G., and Degueule T.. 2013. Using meta-model coverage to qualify test oracles. In Proceedings of the AMT. 110.Google ScholarGoogle Scholar
  40. [40] Fiorentini C., Momigliano A., Ornaghi M., and Poernomo I.. 2010. A constructive approach to testing model transformations. In Proceedings of the ICMT. 7792.Google ScholarGoogle ScholarCross RefCross Ref
  41. [41] Fleurey F., Baudry B., Muller P., and Traon Y. Le. 2009. Qualifying input test data for model transformations. Softw. Syst. Model. (2009), 185203.Google ScholarGoogle ScholarCross RefCross Ref
  42. [42] Garcia J., Azanza M., Irastorza A., and Diaz O.. 2014. Testing MOFScript transformations with HandyMOF. In Proceedings of the ICMT. 4256.Google ScholarGoogle ScholarCross RefCross Ref
  43. [43] Gogolla M., Bohling J., and Richters M.. 2005. Validating UML and OCL models in USE by automatic snapshot generation. Softw. Syst. Model. (2005), 386398.Google ScholarGoogle ScholarCross RefCross Ref
  44. [44] Gogolla M. and Vallecillo A.. 2011. Tractable model transformation testing. In Proceedings of the ECMFA. 221235.Google ScholarGoogle ScholarCross RefCross Ref
  45. [45] Gogolla M., Vallecillo A., Burgueño L., and Hilken F.. 2017. Employing classifying terms for testing model transformations. In Proceedings of the MODELS. 312321.Google ScholarGoogle Scholar
  46. [46] Gómez-Abajo P., Guerra E., and Lara J. de. 2016. WODEL: A domain-specific language for model mutation. In Proceedings of the SAC. 19681973.Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. [47] González C. A. and Cabot J.. 2012. ATLTest: A white-box test generation approach for ATL transformations. In Proceedings of the MODELS. 449464.Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. [48] Guerra E.. 2012. Specification-d test generation for model transformations. In Proceedings of the ICMT. 4055.Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. [49] Guerra E., Lara J. de, Kolovos D., and Paige R.. 2010. A visual specification language for model-to-model transformations. In Proceedings of the VLHCC. 119126.Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. [50] Guerra E., Lara J. de, Kolovos D. S., Paige R. F., and Santos O. M. dos. 2010. transML: A family of languages to model model transformations. In Proceedings of the MODELS. 106120.Google ScholarGoogle ScholarCross RefCross Ref
  51. [51] Guerra E., Lara J. de, Wimmer M., Kappel G., Kusel A., Retschitzegger W., Schoenboeck J., and Schwinger W.. 2013. Automated verification of model transformations based on visual contracts. Autom. Softw. Eng. (2013), 546.Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. [52] Guerra E. and Soeken M.. 2015. Specification-driven model transformation testing. Softw. Syst. Model. (2015), 623644.Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. [53] Guerra E., Sánchez-Cuadrado J., and Lara J. de. 2019. Towards effective mutation testing for ATL. In Proceedings of the MODELS. 7888.Google ScholarGoogle ScholarCross RefCross Ref
  54. [54] Gómez-Abajo P., Guerra E., and Lara J. de. 2017. A domain-specific language for model mutation and its application to the automated generation of exercises. Comput. Lang. Syst. Struct. (2017), 152173.Google ScholarGoogle Scholar
  55. [55] He X., Chen X., Cai S., Zhang Y., and Huang G.. 2018. Testing bidirectional model transformation using metamorphic testing. Inf. Softw. Technol. (2018), 109129.Google ScholarGoogle ScholarCross RefCross Ref
  56. [56] He X., Li W., Zhang T., and Liu Y.. 2016. Towards parallel model generation for random performance testing of model-oriented operations. In Proceedings of the TASE. 5764.Google ScholarGoogle ScholarCross RefCross Ref
  57. [57] He X., Zhang T., Hu C., Ma Z., and Shao W.. 2016. An MDE performance testing framework based on random model generation. J. Syst. Softw. (2016), 247264.Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. [58] He X., Zhang T., Pan M., Ma Z., and Hu C.. 2019. Template-based model generation. Softw. Syst. Model. (2019), 20512092.Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. [59] Heckel R., Khan T. A., and Machado R.. 2011. Towards test coverage criteria for visual contracts. In Proceedings of the GTVMT.Google ScholarGoogle Scholar
  60. [60] Hibberd M., Lawley M., and Raymond K.. 2007. Forensic debugging of model transformations. In Proceedings of the MODELS. 589604.Google ScholarGoogle ScholarCross RefCross Ref
  61. [61] Hilken F., Gogolla M., Burgueño L., and Vallecillo A.. 2018. Testing models and model transformations using classifying terms. Softw. Syst. Model. (2018), 885912.Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. [62] Hue C. T. M., Hanh D. D., and Binh N. N.. 2018. A transformation-based method for test Case automatic generation from use cases. In Proceedings of the KSE. 252257.Google ScholarGoogle ScholarCross RefCross Ref
  63. [63] Jahanbin S. and Zamani B.. 2018. Test model generation using equivalence partitioning. In Proceedings of the ICCKE. 98103.Google ScholarGoogle ScholarCross RefCross Ref
  64. [64] Jiang M., Chen T. Y., Kuo F., Zhou Z., and Ding Z.. 2014. Testing model transformation programs using metamorphic testing. In Proceedings of the SEKE. 9499.Google ScholarGoogle Scholar
  65. [65] Jilani A. A., Iqbal M. Z., and Khan M. U.. 2014. A search-based test data generation approach for model transformations. In Proceedings of the ICMT. 1724.Google ScholarGoogle ScholarCross RefCross Ref
  66. [66] Jörges S. and Steffen B.. 2014. Back-to-back testing of model-based code generators. In Proceedings of the ISoLA. 425444.Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. [67] Jukss M., Verbrugge C., and Vangheluwe H.. 2017. Transformations debugging transformations. In Proceedings of the MODELS. 449454.Google ScholarGoogle Scholar
  68. [68] Kessentini M., Sahraoui H., and Boukadoum M.. 2010. Sequence diagram to colored petri nets transformation Testing: An immune system metaphor. In Proceedings of the CASCON. 7285.Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. [69] Kessentini M., Sahraoui H., and Boukadoum M.. 2011. Example-based model-transformation testing. Autom. Softw. Eng. (2011), 199224.Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. [70] Khan Y. and Hassine J.. 2013. Mutation operators for the Atlas transformation language. In Proceedings of the ICSTW Workshops. 4352.Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. [71] Kolovos D. S.. 2009. Establishing correspondences between models with the Epsilon comparison language. In Proceedings of the ECMDA-FA. 146157.Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. [72] Lahrouni M., Cariou E., and Fazziki A. E.. 2019. A black-box and contract-based verification of model transformations. Int. Arab J. Inf. Technol. (2019), 651660.Google ScholarGoogle Scholar
  73. [73] Lamari M.. 2007. Towards an automated test generation for the verification of model transformations. In Proceedings of the SAC. 9981005.Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. [74] Lengyel L. and Charaf H.. 2015. Test-driven verification/validation of model transformations. Front. Inf. Technol. Electron. Eng. (2015), 8597.Google ScholarGoogle ScholarCross RefCross Ref
  75. [75] Li P., Jiang M., and Ding Z.. 2020. Fault localization with weighted test model in model transformations. IEEE Access (2020), 1405414064.Google ScholarGoogle ScholarCross RefCross Ref
  76. [76] Lin Y., Zhang J., and Gray J.. 2005. A testing framework for model transformations. In Model Driven Software Development. 219236.Google ScholarGoogle ScholarCross RefCross Ref
  77. [77] Matragkas N. D., Kolovos D. S., Paige R. F., and Zolotas A.. 2013. A traceability-driven approach to model transformation testing. In Proceedings of the AMT. 110.Google ScholarGoogle Scholar
  78. [78] Mazanek S. and Rutetzki C.. 2011. On the importance of model comparison tools for the automatic evaluation of the correctness of model transformations. In Proceedings of the IWMCP. 1215.Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. [79] McQuillan J. A. and Power J.. 2009. White-box coverage criteria for model transformations. In Proceedings of the AMT. 6377.Google ScholarGoogle Scholar
  80. [80] Mottu J.-M., Baudry B., and Traon Y. Le. 2006. Mutation analysis testing for model transformations. In Proceedings of the ECMDA-FA. 376390.Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. [81] Mottu J.-M., Baudry B., and Traon Y. L.. 2008. Model transformation testing: Oracle issue. In Proceedings of the MoDeVVA. 105112.Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. [82] Mottu J.-M., Sen S., Cadavid J., and Baudry B.. 2015. Discovering model transformation pre-conditions using automatically generated test models. In Proceedings of the ISSRE. 8899.Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. [83] Mottu J.-M., Sen S., Tisi M., and Cabot J.. 2012. Static analysis of model transformations for effective test generation. In Proceedings of the ISSRE. 291300.Google ScholarGoogle ScholarDigital LibraryDigital Library
  84. [84] Mészáros T., Fehér P., and Lengyel L.. 2013. Visual debugging support for graph rewriting-based model transformations. In Proceedings of the EUROCON. 482488.Google ScholarGoogle ScholarCross RefCross Ref
  85. [85] Narayanan A. and Karsai G.. 2008. Verifying model transformations by structural correspondence. In Proceedings of the GT-VMT, Vol. 10. 115.Google ScholarGoogle Scholar
  86. [86] Nassar N., Kosiol J., Kehrer T., and Taentzer G.. 2020. Generating large EMF models efficiently: A rule-based, configurable approach. In Proceedings of the FASE. 224244.Google ScholarGoogle ScholarDigital LibraryDigital Library
  87. [87] Nguyen T. and Dang D.. 2018. An approach for testing model transformations. In Proceedings of the KSE. 264269.Google ScholarGoogle ScholarCross RefCross Ref
  88. [88] Nguyen T. H., Dang D. H., and Nguyen Q. T.. 2019. On analyzing rule dependencies to generate test cases for model transformations. In Proceedings of the KSE. 181186.Google ScholarGoogle ScholarCross RefCross Ref
  89. [89] Oakes B. J., Lucio L., Verbrugge C., and Vangheluwe H.. 2018. Debugging of model transformations and contracts in SyVOLT. In Proceedings of the MODELS Workshops. 532537.Google ScholarGoogle Scholar
  90. [90] Popoola S., Kolovos D. S., and Rodriguez H. H.. 2016. EMG: A domain-specific transformation language for synthetic model generation. In Proceedings of the ICMT. 3651.Google ScholarGoogle ScholarDigital LibraryDigital Library
  91. [91] Rajeev A. C., Sampath P., Shashidhar K. C., and Ramesh S.. 2010. CoGenTe: A tool for code generator testing. In Proceedings of the ASE. 349350.Google ScholarGoogle ScholarDigital LibraryDigital Library
  92. [92] Rodríguez-Echeverría R., Macías F., and Rutle A.. 2016. On reducing model transformation testing overhead. In Proceedings of the PAME/VOLT. 5867.Google ScholarGoogle Scholar
  93. [93] Rose L. M. and Poulding S.. 2013. Efficient probabilistic testing of model transformations using search. In Proceedings of the CMSBSE. 1621.Google ScholarGoogle ScholarCross RefCross Ref
  94. [94] Runge O., Khan T. A., and Heckel R.. 2013. Test case generation using visual contracts. In Proceedings of the GTVMT.Google ScholarGoogle Scholar
  95. [95] Sahin D., Kessentini M., Wimmer M., and Deb K.. 2015. Model transformation testing: A bi-level search-based software engineering approach. J. Softw.: Evolut. Process (2015), 821837.Google ScholarGoogle ScholarDigital LibraryDigital Library
  96. [96] Sampath P., Rajeev A. C., Ramesh S., and Shashidhar K. C.. 2008. Behaviour directed testing of auto-code generators. In Proceedings of the SEFM. 191200.Google ScholarGoogle ScholarDigital LibraryDigital Library
  97. [97] Sánchez-Cuadrado J.. 2020. Towards interactive, test-driven development of model transformations. J. Object Technol. 19, 3 (2020), 112.Google ScholarGoogle Scholar
  98. [98] Sánchez-Cuadrado J., Guerra E., and Lara J. de. 2015. Quick fixing ATL model transformations. In Proceedings of the MODELS. 146155.Google ScholarGoogle ScholarCross RefCross Ref
  99. [99] Sánchez-Cuadrado J., Guerra E., and Lara J. de. 2017. Static analysis of model transformations. IEEE Trans. Softw. Eng. (2017), 868897.Google ScholarGoogle ScholarDigital LibraryDigital Library
  100. [100] Sánchez-Cuadrado J., Guerra E., and Lara J. de. 2018. Quick fixing ATL transformations with speculative analysis. Softw. Syst. Model. (2018), 779813.Google ScholarGoogle ScholarDigital LibraryDigital Library
  101. [101] Scheidgen M.. 2015. Generation of large random models for benchmarking. In Proceedings of the BigMDE. 110.Google ScholarGoogle Scholar
  102. [102] Schoenboeck J., Kappel G., Kusel A., Retschitzegger W., Schwinger W., and Wimmer M.. 2010. Catch me if you can—Debugging support for model transformations. In Proceedings of the MODELS. 520.Google ScholarGoogle ScholarDigital LibraryDigital Library
  103. [103] Schonbock J., Kappel G., Wimmer M., Kusel A., Retschitzegger W., and Schwinger W.. 2013. TETRABox—A generic white-box testing framework for model transformations. In Proceedings of the APSEC. 7582.Google ScholarGoogle ScholarDigital LibraryDigital Library
  104. [104] Schönböck J., Kappel G., Wimmer M., Kusel A., Retschitzegger W., and Schwinger W.. 2012. Debugging model-to-model transformations. In Proceedings of the APSEC. 164173.Google ScholarGoogle ScholarDigital LibraryDigital Library
  105. [105] Selim G. M. K., Büttner F., Cordy J. R., Dingel J., and Wang S.. 2013. Automated verification of model transformations in the automotive industry. In Proceedings of the MODELS. 690706.Google ScholarGoogle ScholarDigital LibraryDigital Library
  106. [106] Semeráth O., Babikian A. A., Li A., Marussy K., and Varró D.. 2020. Automated generation of consistent models with structural and attribute constraints. In Proceedings of the MODELS. 187199.Google ScholarGoogle ScholarDigital LibraryDigital Library
  107. [107] Semeráth O., Nagy A. S., and Varró D.. 2018. A graph solver for the automated generation of consistent domain-specific models. In Proceedings of the ICSE. 969980.Google ScholarGoogle ScholarDigital LibraryDigital Library
  108. [108] Sen S. and Baudry B.. 2006. Mutation-based model synthesis in model driven engineering. In Proceedings of the Mutation Workshop. 110.Google ScholarGoogle ScholarDigital LibraryDigital Library
  109. [109] Sen S., Baudry B., and Mottu J.-M.. 2008. On combining multi-formalism knowledge to select models for model transformation testing. In Proceedings of the ICSE. 328337.Google ScholarGoogle ScholarDigital LibraryDigital Library
  110. [110] Sen S., Baudry B., and Mottu J.-M.. 2009. Automatic model generation strategies for model transformation testing. In Proceedings of the ICMT. 148164.Google ScholarGoogle ScholarDigital LibraryDigital Library
  111. [111] Sen S., Mottu J.-M., Tisi M., and Cabot J.. 2012. Using models of partial knowledge to test model transformations. In Proceedings of the ICMT. 2439.Google ScholarGoogle ScholarDigital LibraryDigital Library
  112. [112] Shelburg J., Kessentini M., and Tauritz D. R.. 2013. Regression testing for model transformations: A multi-objective approach. In Proceedings of the SSBSE. 209223.Google ScholarGoogle ScholarDigital LibraryDigital Library
  113. [113] Stuermer I., Conrad M., Doerr H., and Pepper P.. 2007. Systematic testing of model-based code generators. IEEE Trans. Softw. Eng. 33, 9 (2007), 622634.Google ScholarGoogle ScholarDigital LibraryDigital Library
  114. [114] Sánchez-Cuadrado J., Guerra E., and Lara J. de. 2014. Uncovering errors in ATL model transformations using static analysis and constraint solving. In Proceedings of the ISSRE. 3444.Google ScholarGoogle Scholar
  115. [115] Sánchez-Cuadrado J., Guerra E., and Lara J. de. 2018. AnATLyzer: An advanced IDE for ATL model transformations. In Proceedings of the ICSE Companion. 8588.Google ScholarGoogle Scholar
  116. [116] Sánchez-Cuadrado J., Guerra E., Lara J. de, Clarisó R., and Cabot J.. 2017. Translating target to source constraints in model-to-model transformations. In Proceedings of the MODELS. 1222.Google ScholarGoogle Scholar
  117. [117] Tiso A., Reggio G., and Leotta M.. 2012. Early experiences on model transformation testing. In Proceedings of the AMT. 1520.Google ScholarGoogle ScholarDigital LibraryDigital Library
  118. [118] Tiso A., Reggio G., and Leotta M.. 2013. A method for testing model to text transformations. In Proceedings of the AMT, Vol. 1077. 110.Google ScholarGoogle Scholar
  119. [119] Tiso A., Reggio G., and Leotta M.. 2014. Unit testing of model to text transformations. In Proceedings of the AMT. 1423.Google ScholarGoogle Scholar
  120. [120] Troya J., Bergmayr A., Burgueño L., and Wimmer M.. 2015. Towards systematic mutations for and with ATL model transformations. In Proceedings of the ICSTW Workshops. 110.Google ScholarGoogle ScholarCross RefCross Ref
  121. [121] Troya J., Segura S., Parejo J., and Ruiz-Cortés A.. 2017. An approach for debugging model transformations applying spectrum-based fault localization. In Proceedings of the JISBD. 14.Google ScholarGoogle Scholar
  122. [122] Troya J., Segura S., Parejo J., and Ruiz-Cortés A.. 2018. Spectrum-based fault localization in model transformations. ACM Trans. Softw. Eng. Methodol. (2018), 150.Google ScholarGoogle ScholarDigital LibraryDigital Library
  123. [123] Troya J., Segura S., and Ruiz-Cortés A.. 2016. Towards the automation of metamorphic testing in model transformations. In Proceedings of the JISBD. 281284.Google ScholarGoogle Scholar
  124. [124] Troya J., Segura S., and Ruiz-Cortés A.. 2018. Automated inference of likely metamorphic relations for model transformations. J. Syst. Softw. (2018), 188208.Google ScholarGoogle ScholarDigital LibraryDigital Library
  125. [125] Ujhelyi Z., Horváth, and Varró D.. 2011. Towards dynamic backward slicing of model transformations. In Proceedings of the ASE. 404407.Google ScholarGoogle ScholarDigital LibraryDigital Library
  126. [126] Ujhelyi Z., Horváth, and Varró D.. 2012. Dynamic backward slicing of model transformations. In Proceedings of the ICST. 110.Google ScholarGoogle ScholarDigital LibraryDigital Library
  127. [127] Vallecillo A., Gogolla M., Burgueño L., Wimmer M., and Hamann L.. 2012. Formal specification and testing of model transformations. In Proceedings of the SMF. 399437.Google ScholarGoogle ScholarDigital LibraryDigital Library
  128. [128] Wang J., Kim S., and Carrington D.. 2006. Verifying metamodel coverage of model transformations. In Proceedings of the ASWEC. 270282.Google ScholarGoogle ScholarDigital LibraryDigital Library
  129. [129] Wang J., Kim S., and Carrington D.. 2008. Automatic generation of test models for model transformations. In Proceedings of the ASWEC. 432440.Google ScholarGoogle ScholarCross RefCross Ref
  130. [130] Wang W., Kessentini M., and Jiang W.. 2013. Test cases generation for model transformations from structural information. In Proceedings of the MDEBE. 4251.Google ScholarGoogle Scholar
  131. [131] Wieber M., Anjorin A., and Schürr A.. 2014. On the usage of TGGs for automated model transformation testing. In Proceedings of the ICMT. 116.Google ScholarGoogle ScholarCross RefCross Ref
  132. [132] Wieber M. and Schürr A.. 2012. Gray box coverage criteria for testing graph pattern matching. In Proceedings of the GraBaTs, Vol. 52. 112.Google ScholarGoogle Scholar
  133. [133] Wieber M. and Schürr A.. 2013. Systematic testing of graph transformations: A practical approach based on graph patterns. In Proceedings of the ICMT. 205220.Google ScholarGoogle ScholarCross RefCross Ref
  134. [134] Wimmer M. and Burgueño L.. 2013. Testing M2T/T2M transformations. In Proceedings of the MODELS. 203219.Google ScholarGoogle ScholarDigital LibraryDigital Library
  135. [135] Wimmer M., Kappel G., Schoenboeck J., Kusel A., Retschitzegger W., and Schwinger W.. 2009. A petri net based debugging environment for QVT relations. In Proceedings of the ASE. 314.Google ScholarGoogle ScholarDigital LibraryDigital Library
  136. [136] Wimmer M., Kusel A., Reiter T., Retschitzegger W., Schwinger W., and Kappel G.. 2009. Lost in translation? Transformation nets to the rescue! In Proceedings of the UNISCON. 315327.Google ScholarGoogle ScholarCross RefCross Ref
  137. [137] Wimmer M., Kusel A., Schoenboeck J., Kappel G., Retschitzegger W., and Schwinger W.. 2009. Reviving QVT relations: Model-based debugging using colored petri nets. In Proceedings of the MODELS. 727732.Google ScholarGoogle ScholarDigital LibraryDigital Library
  138. [138] Wu H.. 2016. Generating metamodel instances satisfying coverage criteria via SMT solving. In Proceedings of the MODELSWARD. 4051.Google ScholarGoogle ScholarCross RefCross Ref
  139. [139] Wu H., Monahan R., and Power J. F.. 2013. Exploiting attributed type graphs to generate metamodel instances using an SMT solver. In Proceedings of the TASE. 175182.Google ScholarGoogle ScholarDigital LibraryDigital Library
  140. [140] Xiao H., Tian Z., Zhiyi M., and Weizhong S.. 2014. Randomized model generation for performance testing of model transformations. In Proceedings of the COMPSAC. 1120.Google ScholarGoogle ScholarDigital LibraryDigital Library
  141. [141] [n.d.]. AnATLyzer. Retrieved from https://anatlyzer.github.io/.Google ScholarGoogle Scholar
  142. [142] [n.d.]. ATL Zoo. Retrieved from http://www.eclipse.org/atl/atlTransformations.Google ScholarGoogle Scholar
  143. [143] [n.d.]. DSLTrans. Retrieved from https://github.com/mbeddr/language_verification.Google ScholarGoogle Scholar
  144. [144] [n.d.]. Eclipse Epsilon. Retrieved from https://www.eclipse.org/epsilon/.Google ScholarGoogle Scholar
  145. [145] [n.d.]. EMF Model Generator. Retrieved from https://github.com/RuleBasedApproach/EMFModelGenerator.Google ScholarGoogle Scholar
  146. [146] [n.d.]. EMFtoCSP. Retrieved from https://github.com/atlanmod/EMFtoCSP.Google ScholarGoogle Scholar
  147. [147] [n.d.]. GEMOC Initiative. Retrieved from http://gemoc.org/.Google ScholarGoogle Scholar
  148. [148] [n.d.]. MDE Testing. Retrieved from https://github.com/jdelara/MDETesting.Google ScholarGoogle Scholar
  149. [149] [n.d.]. MRs4MTgenerator. Retrieved from https://gestionproyectos.us.es/projects/curso-ice-2016-rest-fp-coordinacioo/wiki.Google ScholarGoogle Scholar
  150. [150] [n.d.]. PaMoMo. Retrieved from http://miso.es/tools/transML/main.htm.Google ScholarGoogle Scholar
  151. [151] [n.d.]. PRAMANA. Retrieved from https://www.irisa.fr/triskell/Software/pramana/index.html.Google ScholarGoogle Scholar
  152. [152] [n.d.]. RandomEMF. Retrieved from http://github.com/markus1978/RandomEMF.Google ScholarGoogle Scholar
  153. [153] [n.d.]. SBFL_MT. Retrieved from https://github.com/javitroya/SBFL_MT.Google ScholarGoogle Scholar
  154. [154] [n.d.]. SymexTRON. Retrieved from https://github.com/models-team/SymexTRON.Google ScholarGoogle Scholar
  155. [155] [n.d.]. TracsTool. Retrieved from http://atenea.lcc.uma.es/projects/FaultLocMT.html.Google ScholarGoogle Scholar
  156. [156] [n.d.]. Unnamed tool. Retrieved from http://atenea.lcc.uma.es/index.php/Main_Page/Resources/Mutations.Google ScholarGoogle Scholar
  157. [157] [n.d.]. Unnamed tool. Retrieved from https://github.com/SOM-Research/constraint-mutation.Google ScholarGoogle Scholar
  158. [158] [n.d.]. Unnamed tool. Retrieved from https://bitbucket.org/ustbmde/model-generation/wiki/Home.Google ScholarGoogle Scholar
  159. [159] [n.d.]. USE. Retrieved from https://sourceforge.net/projects/useocl/.Google ScholarGoogle Scholar
  160. [160] [n.d.]. VIATRA Generator. Retrieved from https://github.com/viatra/VIATRA-Generator.Google ScholarGoogle Scholar
  161. [161] [n.d.]. WODEL. Retrieved from http://gomezabajo.github.io/Wodel/.Google ScholarGoogle Scholar
  162. [162] Abade A., Ferrari F., and Lucrédio. D.2015. Testing M2T transformations—A systematic literature review. In Proceedings of the ICEIS. 177187.Google ScholarGoogle ScholarDigital LibraryDigital Library
  163. [163] Addazi L., Cicchetti A., Rocco J. D., Ruscio D. D., Iovino L., and Pierantonio A.. 2016. Semantic-based model matching with EMFCompare. In Proceedings of the ME. 4049.Google ScholarGoogle Scholar
  164. [164] Amrani M., Combemale B., Lúcio L., Selim G., Dingel J., Traon Y. Le, Vangheluwe H., and Cordy J. R.. 2015. Formal verification techniques for model transformations: A tridimensional classification. J. Obj. Technol. (2015), 1:1–43.Google ScholarGoogle Scholar
  165. [165] Arendt T., Biermann E., Jurack S., Krause C., and Taentzer G.. 2010. Henshin: Advanced concepts and tools for in-place EMF model transformations. In Proceedings of the MODELS. 121135.Google ScholarGoogle ScholarCross RefCross Ref
  166. [166] Barr E. T., Harman M., McMinn P., Shahbaz M., and Yoo S.. 2015. The oracle problem in software testing: A survey. IEEE Trans. Softw. Eng. 41, 5 (2015), 507525.Google ScholarGoogle ScholarDigital LibraryDigital Library
  167. [167] Baudry B., Dinh-Trong T., Mottu J.-M., Simmonds D., France R., Ghosh S., Fleurey F., and Traon Y. Le. 2006. Model transformation testing challenges. In Proceedings of the IMDT. 110.Google ScholarGoogle Scholar
  168. [168] Baudry B., Ghosh S., Fleurey F., France R., Traon Y. Le, and Mottu J.-M.. 2010. Barriers to systematic model transformation testing. Commun. ACM (2010), 139143.Google ScholarGoogle ScholarDigital LibraryDigital Library
  169. [169] Benavides D., Segura S., and Cortés A. R.. 2010. Automated analysis of feature models 20 years later: A literature review. Inf. Syst. 35, 6 (2010), 615636.Google ScholarGoogle ScholarDigital LibraryDigital Library
  170. [170] Benouda H., Azizi M., Esbai R., and Moussaoui M.. 2016. Code generation approach for mobile application using acceleo. Int. Rev. Comput. Softw. (2016), 160166.Google ScholarGoogle Scholar
  171. [171] Bézivin J., Rumpe B., Schürr A., and Tratt L.. 2005. Model transformations in practice workshop. In Proceedings of the MODELS Satellite Events. 120127.Google ScholarGoogle Scholar
  172. [172] Birken K.. 2014. Building code generators for DSLs using a partial evaluator for the Xtend language. In Proceedings of the ISOLA. 407424.Google ScholarGoogle ScholarDigital LibraryDigital Library
  173. [173] Bousse E., Wimmer M., Schwinger W., and Kapsammer E.. 2016. On leveraging executable language engineering for domain-specific transformation languages. In Proceedings of the EM. 4143.Google ScholarGoogle Scholar
  174. [174] Brambilla M., Cabot J., and Wimmer M.. 2017. Model-Driven Software Engineering in Practice (2nd edition).Google ScholarGoogle ScholarDigital LibraryDigital Library
  175. [175] Bruneliere H., Cabot J., Jouault F., and Madiot F.. 2010. MoDisco: A generic and extensible framework for model driven reverse engineering. In Proceedings of the ASE. 173174.Google ScholarGoogle ScholarDigital LibraryDigital Library
  176. [176] Burgueño L., Cabot J., and Gérard S.. 2019. The future of model transformation languages: An open community discussion. J. Obj. Technol.7 (2019), 111.Google ScholarGoogle Scholar
  177. [177] Büttner F., Egea M., Cabot J., and Gogolla M.. 2012. Verification of ATL transformations using transformation models and model finders. In Proceedings of the ICFEM. 198213.Google ScholarGoogle ScholarDigital LibraryDigital Library
  178. [178] Bézivin J., Rumpe B., Schürr A., and Tratt L.. 2005. Model transformations in practice workshop. In Proceedings of the MODELS Satellite Events. 120127.Google ScholarGoogle Scholar
  179. [179] Cabot J., Clarisó R., and Riera D.. 2014. On the verification of UML/OCL class diagrams using constraint programming. J. Syst. Softw. 93 (2014), 123.Google ScholarGoogle ScholarCross RefCross Ref
  180. [180] Cabot J. and Gogolla M.. 2012. Object constraint language (OCL): A definitive guide. In Proceedings of the SFM. 5890.Google ScholarGoogle ScholarDigital LibraryDigital Library
  181. [181] Cadavid J. J., Combemale B., and Baudry B.. 2015. An analysis of metamodeling practices for MOF and OCL. Comput. Lang., Syst. Struct. (2015), 4265.Google ScholarGoogle Scholar
  182. [182] Calegari D. and Szasz N.. 2013. Verification of model transformations: A survey of the state-of-the-art. Electron. Notes Theoret. Comput. Sci. 292 (2013), 525.Google ScholarGoogle ScholarDigital LibraryDigital Library
  183. [183] Chen J., Patra J., Pradel M., Xiong Y., Zhang H., Hao D., and Zhang L.. 2020. A survey of compiler testing. ACM Comput. Surv. 53, 1 (2020), 4:1–4:36.Google ScholarGoogle Scholar
  184. [184] Chen T. Y., Kuo F., Liu H., Poon P., Towey D., Tse T. H., and Zhou Z. Q.. 2018. Metamorphic testing: A review of challenges and opportunities. Comput. Surv. 51, 1 (2018), 4:1–4:27.Google ScholarGoogle Scholar
  185. [185] Cicchetti A., Ruscio D. Di, Eramo R., and Pierantonio A.. 2011. JTL: A bidirectional and change propagating transformation language. In Proceedings of the SLE. 183202.Google ScholarGoogle ScholarCross RefCross Ref
  186. [186] Ciccozzi F., Malavolta I., and Selic B.. 2019. Execution of UML models: A systematic review of research and practice. Softw. Syst. Model. (2019), 23132360.Google ScholarGoogle ScholarDigital LibraryDigital Library
  187. [187] Clavel M., Durán F., Eker S., Lincoln P., Martí-Oliet N., Meseguer J., and Talcott C.. 2007. All About Maude—A High-Performance Logical Framework.Google ScholarGoogle ScholarCross RefCross Ref
  188. [188] Csertán G., Huszerl G., Majzik I., Pap Z., Pataricza A., and Varró D.. 2002. VIATRA—Visual automated transformations for formal verification and validation of UML models. In Proceedings of the ASE. 267270.Google ScholarGoogle ScholarCross RefCross Ref
  189. [189] Czarnecki K. and Helsen S.. 2006. Feature-based survey of model transformation approaches. IBM Syst. J. (2006), 621646.Google ScholarGoogle ScholarDigital LibraryDigital Library
  190. [190] Silva A. R. da. 2015. Model-driven engineering: A survey supported by the unified conceptual model. Comput. Lang., Syst. Struct. (2015), 139155.Google ScholarGoogle Scholar
  191. [191] Lara J. de and Vangheluwe H.. 2002. AToM3: A tool for multi-formalism and meta-modelling. In Proceedings of the FASE, Vol. 2306. 174188.Google ScholarGoogle ScholarCross RefCross Ref
  192. [192] Moura L. de and Bjørner N.. 2008. Z3: An efficient SMT solver. In Proceedings of the TACAS. 337340.Google ScholarGoogle ScholarCross RefCross Ref
  193. [193] Deb K., Pratap A., Agarwal S., and Meyarivan T.. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evolut. Computat. (2002), 182197.Google ScholarGoogle ScholarDigital LibraryDigital Library
  194. [194] Ehrig H., Ehrig K., Lara J. de, Taentzer G., Varró D., and Varró-Gyapay S.. 2005. Termination criteria for model transformation. In Proceedings of the FASE. 4963.Google ScholarGoogle ScholarDigital LibraryDigital Library
  195. [195] Ehrig H., Engels G., Kreowski H.-J., and Rozenberg G. (Eds.). 1999. Handbook of Graph Grammars and Computing by Graph Transformation: Vol. 2: Applications, Languages, and Tools.Google ScholarGoogle Scholar
  196. [196] Fleck M., Troya J., and Wimmer M.. 2015. Marrying search-based optimization and model transformation technology. In Proceedings of the NasBASE. 116.Google ScholarGoogle Scholar
  197. [197] Fleck M., Troya J., and Wimmer M.. 2016. Search-based model transformations. J. Softw.: Evolut. Process (2016), 10811117.Google ScholarGoogle ScholarDigital LibraryDigital Library
  198. [198] Fraser G. and Rojas J. M.. 2019. Software testing. In Handbook of Software Engineering. 123192.Google ScholarGoogle ScholarCross RefCross Ref
  199. [199] Gammaitoni L., Kelsen P., and Ma Q.. 2018. Agile validation of model transformations using compound F-Alloy specifications. Sci. Comput. Program. (2018), 5575.Google ScholarGoogle ScholarCross RefCross Ref
  200. [200] Garousi V., Felderer M., and Mäntylä M. V.. 2019. Guidelines for including grey literature and conducting multivocal literature reviews in software engineering. Inf. Softw. Technol. 106 (2019), 101121.Google ScholarGoogle ScholarCross RefCross Ref
  201. [201] Gogolla M., Büttner F., and Richters M.. 2007. USE: A UML-based specification environment for validating UML and OCL. Sci. Comput. Program. (2007), 2734.Google ScholarGoogle ScholarDigital LibraryDigital Library
  202. [202] González C. A. and Cabot J.. 2014. Formal verification of static software models in MDE: A systematic review. Inf. Softw. Technol. (2014), 821838.Google ScholarGoogle ScholarCross RefCross Ref
  203. [203] Greenyer J. and Kindler E.. 2010. Comparing relational model transformation technologies: Implementing query/view/transformation with triple graph grammars. Softw. Syst. Model. (2010), 2146.Google ScholarGoogle ScholarCross RefCross Ref
  204. [204] Groner R., Beaucamp L., Tichy M., and Becker S.. 2020. An exploratory study on performance engineering in model transformations. In Proceedings of the MODELS. 308319.Google ScholarGoogle ScholarDigital LibraryDigital Library
  205. [205] Groner R., Gylstorff S., and Tichy M.. 2020. A Profiler for the Matching Process of Henshin.Google ScholarGoogle ScholarDigital LibraryDigital Library
  206. [206] Guerra E., Lara J. de, Kolovos D., and Paige R.. 2010. A visual specification language for model-to-model transformations. In Proceedings of the VLHCC. 119126.Google ScholarGoogle ScholarDigital LibraryDigital Library
  207. [207] Heckel R. and Taentzer G.. 2020. Graph Transformation for Software Engineers—With Applications to Model-Based Development and Domain-Specific Language Engineering.Google ScholarGoogle ScholarCross RefCross Ref
  208. [208] Hettab A., Kerkouche E., and Chaoui A.. 2015. A graph transformation approach for automatic test cases generation from UML activity diagrams. In Proceedings of the C3S2E. 8897.Google ScholarGoogle Scholar
  209. [209] Ishibuchi H., Tsukamoto N., and Nojima Y.. 2008. Evolutionary many-objective optimization. In Proceedings of the GEFS. 4752.Google ScholarGoogle ScholarCross RefCross Ref
  210. [210] ISO 29119-4 2015. ISO/IEC/IEEE International Standard - Software and systems engineering–Software testing–Part 1: Concepts and Definitions. Standard.Google ScholarGoogle Scholar
  211. [211] ISO/IEC/IEEE. 2013. ISO/IEC/IEEE international standard - software and systems engineering –software testing –part 1:Concepts and definitions. ISO/IEC/IEEE 29119-1:2013(E) (2013), 164. DOI:Google ScholarGoogle ScholarCross RefCross Ref
  212. [212] Jackson D.. 2002. Alloy: A lightweight object modelling notation. ACM Trans. Softw. Eng. and Methodology (2002), 256290.Google ScholarGoogle ScholarDigital LibraryDigital Library
  213. [213] Javed A. Z., Strooper P. A., and Watson G. N.. 2007. Automated Generation of Test Cases Using Model-Driven Architecture. In Proceedings of the AST. 33.Google ScholarGoogle ScholarDigital LibraryDigital Library
  214. [214] Jézéquel J., Barais O., and Fleurey F.. 2011. Model driven language engineering with Kermeta. In Proceedings of the GTTSE. 201221.Google ScholarGoogle Scholar
  215. [215] Jia Y. and Harman M.. 2011. An analysis and survey of the development of mutation testing. IEEE Trans. Softw. Eng. (2011), 649678.Google ScholarGoogle ScholarDigital LibraryDigital Library
  216. [216] Jouault F., Allilaire F., Bézivin J., Kurtev I., and Valduriez P.. 2006. ATL: A QVT-like transformation language. In Proceedings of the OOPSLA Companion. 719720.Google ScholarGoogle ScholarDigital LibraryDigital Library
  217. [217] Kahani N., Bagherzadeh M., Cordy J. R., Dingel J., and Varró D.. 2019. Survey and classification of model transformation tools. Softw. Syst. Model. (2019), 23612397.Google ScholarGoogle ScholarDigital LibraryDigital Library
  218. [218] Kalaee A. and Rafe V.. 2019. Model-based test suite generation for graph transformation system using model simulation and search-based techniques. Inf. Softw. Technol. (2019), 129.Google ScholarGoogle ScholarCross RefCross Ref
  219. [219] Khorram F., Bousse E., Mottu J., and Sunyé G.. 2021. Adapting TDL to provide testing support for executable DSLs. J. Obj. Technol. 20, 3 (2021), 6:1–15.Google ScholarGoogle Scholar
  220. [220] Kitchenham B.. 2004. Procedures for Performing Systematic Reviews.Joint Technical Report, Keele University TR/SE-0401 and NICTA 0400011T.1.Google ScholarGoogle Scholar
  221. [221] Kleppe A., Warmer J., and Cook S.. 1999. Informal formality? The object constraint language and its application in the UML metamodel. In Proceedings of the UML. 148161.Google ScholarGoogle ScholarCross RefCross Ref
  222. [222] Kühne T.. 2006. Matters of (meta-) modeling. Softw. Syst. Model. (2006), 369385.Google ScholarGoogle ScholarCross RefCross Ref
  223. [223] Lano K., Kolahdouz-Rahimi S., Yassipour-Tehrani S., and Sharbaf M.. 2018. A survey of model transformation design patterns in practice. J. Syst. Softw. (2018), 4873.Google ScholarGoogle ScholarCross RefCross Ref
  224. [224] Lawley M., Duddy K., Gerber A., and Raymond K.. 2004. Language features for re-use and maintainability of MDA transformations. In Proceedings of the OOPSLA Workshops.Google ScholarGoogle Scholar
  225. [225] Lúcio L., Amrani M., Dingel J., Lambers L., Salay R., Selim G., Syriani E., and Wimmer M.. 2014. Model transformation intents and their properties. Softw. Syst. Model. (2014), 135.Google ScholarGoogle Scholar
  226. [226] Ludewig J.. 2003. Models in software engineering—An introduction. Softw. Syst. Model. (2003), 514.Google ScholarGoogle ScholarCross RefCross Ref
  227. [227] Mannadiar R.. 2012. A Multi-paradigm Modelling Approach to the Foundations of Domain-specific Modelling. Ph.D. Dissertation. MgGill University.Google ScholarGoogle Scholar
  228. [228] McMinn P.. 2004. Search-based software test data generation: A survey. Softw. Test., Verif. Reliab. 14, 2 (2004), 105156.Google ScholarGoogle ScholarCross RefCross Ref
  229. [229] Mellor S. J., Scott K., Uhl A., Weise D., and Soley R. M.. 2004. MDA Distilled: Principles of Model-driven Architecture.Google ScholarGoogle ScholarDigital LibraryDigital Library
  230. [230] Mens T. and Gorp P. V.. 2006. A taxonomy of model transformation. Electron. Notes Theoret. Comput. Sci. (2006), 125142.Google ScholarGoogle ScholarDigital LibraryDigital Library
  231. [231] Oakes B. J., Troya J., Lúcio L., and Wimmer M.. 2018. Full contract verification for ATL using symbolic execution. Softw. Syst. Model. (2018), 815849.Google ScholarGoogle ScholarDigital LibraryDigital Library
  232. [232] Offutt J. and Xu W.. 2004. Generating test cases for web services using data perturbation. SIGSOFT Softw. Eng. Notes 29, 5 (2004), 110. Google ScholarGoogle ScholarDigital LibraryDigital Library
  233. [233] Oldevik J., Neple T., Grønmo R., Aagedal J., and Berre A.. 2005. Toward standardised model to text transformations. In Proceedings of the ECMFA. 239253.Google ScholarGoogle ScholarDigital LibraryDigital Library
  234. [234] Poulding S. and Clark J. A.. 2010. Efficient software verification: Statistical testing using automated search. IEEE Trans. Softw. Eng. (2010), 763777.Google ScholarGoogle ScholarDigital LibraryDigital Library
  235. [235] Rahim L. A. and Whittle J.. 2015. A survey of approaches for verifying model transformations. Softw. Syst. Model. (2015), 10031028.Google ScholarGoogle ScholarDigital LibraryDigital Library
  236. [236] Rivera J. E., Duran F., and Vallecillo A.. 2009. A graphical approach for modeling time-dependent behavior of DSLs. In Proceedings of the VL/HCC. 5155.Google ScholarGoogle ScholarDigital LibraryDigital Library
  237. [237] Rose L. M., Matragkas N., Kolovos D. S., and Paige R. F.. 2012. A feature model for model-to-text transformation languages. In Proceedings of the MiSE. 5763.Google ScholarGoogle ScholarCross RefCross Ref
  238. [238] Rose L. M., Paige R. F., Kolovos D. S., and Polack F. A.. 2008. The Epsilon Generation Language. In Proceedings of the ECMFA. 116.Google ScholarGoogle ScholarDigital LibraryDigital Library
  239. [239] Sahin D., Kessentini M., Bechikh S., and Deb K.. 2014. Code-smell detection as a bilevel problem. ACM Trans. Softw. Eng. Methodol. 24, 6 (2014), 144. Issue 1.Google ScholarGoogle ScholarDigital LibraryDigital Library
  240. [240] Cuadrado J. Sanchez, Burgueno L., Wimmer M., and Vallecillo A.. 2020. Efficient execution of ATL model transformations using static analysis and parallelism. IEEE Trans. Softw. Eng. (2020).Google ScholarGoogle Scholar
  241. [241] Schürr A.. 1995. Specification of graph translators with triple graph grammars. In Proceedings of the WG. 151163.Google ScholarGoogle ScholarCross RefCross Ref
  242. [242] Segura S., Fraser G., Sánchez A., and Ruiz-Cortes A.. 2016. A survey on metamorphic testing. IEEE Trans. Softw. Eng. (2016), 805824.Google ScholarGoogle ScholarCross RefCross Ref
  243. [243] Segura S., Towey D., Zhou Z. Q., and Chen T. Y.. 2020. Metamorphic testing: Testing the untestable. IEEE Softw. (2020), 4653.Google ScholarGoogle ScholarCross RefCross Ref
  244. [244] Selim G. M. K., Cordy J. R., and Dingel J.. 2012. Model transformation testing: The state of the art. In Proceedings of the AMT. 2126.Google ScholarGoogle ScholarDigital LibraryDigital Library
  245. [245] Selim G. M. K., Cordy J. R., Dingel J., Lucio L., and Oakes B. J.. 2015. Finding and fixing bugs in model transformations with formal verification: An experience report. In Proceedings of the AMT. 2635.Google ScholarGoogle Scholar
  246. [246] Sendall S. and Kozaczynski W.. 2003. Model transformation: The heart and soul of model-driven software development. IEEE Softw. (2003), 4245.Google ScholarGoogle ScholarDigital LibraryDigital Library
  247. [247] Shan L. and Zhu H.. 2009. Generating structurally complex test cases by data mutation: A case study of testing an automated modelling tool. Comput. J. 52, 5 (2009), 571588.Google ScholarGoogle ScholarDigital LibraryDigital Library
  248. [248] Stevens P.. 2007. A landscape of bidirectional model transformations. In Proceedings of the GTTSE. 408424.Google ScholarGoogle Scholar
  249. [249] Taentzer G.. 2003. AGG: A graph transformation environment for modeling and validation of software. In Proceedings of the AGTIVE. 446453.Google ScholarGoogle Scholar
  250. [250] Tisi M., Jouault F., Fraternali P., Ceri S., and Bézivin J.. 2009. On the use of higher-order model transformations. In Proceedings of the ECMDA-FA. 1833.Google ScholarGoogle ScholarDigital LibraryDigital Library
  251. [251] Tisi M., Perez S. M., and Choura H.. 2013. Parallel execution of ATL transformation rules. In Proceedings of the MODELS. 656672.Google ScholarGoogle ScholarDigital LibraryDigital Library
  252. [252] Torlak E. and Jackson D.. 2007. Kodkod: A relational model finder. In Proceedings of the TACAS. 632647.Google ScholarGoogle ScholarCross RefCross Ref
  253. [253] Troya J., Moreno N., Bertoa M. F., and Vallecillo A.. 2021. Uncertainty representation in software models: A survey. Softw. Syst. Model. (2021), 131.Google ScholarGoogle Scholar
  254. [254] Troya J., Segura S., Burgueño L., and Wimmer M.. 2021. Model transformation testing and debugging: A survey. Retrieved from http://atenea.lcc.uma.es/projects/MTTestingDebuggingSurvey.html.Google ScholarGoogle Scholar
  255. [255] Troya J. and Vallecillo A.. 2011. A rewriting logic semantics for ATL. J. Obj. Technol. (2011), 5:1–29.Google ScholarGoogle Scholar
  256. [256] Varró D. and Pataricza A.. 2003. Automated formal verification of model transformations. In Proceedings of the CSDUML. 6378.Google ScholarGoogle Scholar
  257. [257] Webster J. and Watson R. T.. 2002. Analyzing the past to prepare for the future: Writing a literature review. MIS Quart. 26, 2 (2002).Google ScholarGoogle Scholar
  258. [258] Weyuker E. J.. 1982. On testing non-testable programs. Comput. J. (1982), 465470.Google ScholarGoogle ScholarCross RefCross Ref
  259. [259] Wohlin C.. 2014. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the EASE.Google ScholarGoogle ScholarDigital LibraryDigital Library
  260. [260] Wong W. E., Gao R., Li Y., Abreu R., and Wotawa F.. 2016. A survey on software fault localization. IEEE Trans. Softw. Eng. 42, 8 (2016), 707740.Google ScholarGoogle ScholarDigital LibraryDigital Library
  261. [261] Yoo S. and Harman M.. 2012. Regression testing minimization, selection and prioritization: A survey. Softw. Test., Verif. Reliab. (2012), 67120.Google ScholarGoogle ScholarDigital LibraryDigital Library
  262. [262] Yousefian R., Rafe V., and Rahmani M.. 2014. A heuristic solution for model checking graph transformation systems. Appl. Softw. Comput. (2014), 169180.Google ScholarGoogle ScholarDigital LibraryDigital Library
  263. [263] Zhu H., Hall P. A. V., and May J. H. R.. 1997. Software unit test coverage and adequacy. Comput. Surv. 29, 4 (1997), 366427.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Model Transformation Testing and Debugging: A Survey

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Computing Surveys
          ACM Computing Surveys  Volume 55, Issue 4
          April 2023
          871 pages
          ISSN:0360-0300
          EISSN:1557-7341
          DOI:10.1145/3567469
          Issue’s Table of Contents

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 21 November 2022
          • Online AM: 16 March 2022
          • Accepted: 28 February 2022
          • Revised: 24 February 2022
          • Received: 31 May 2021
          Published in csur Volume 55, Issue 4

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • survey
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Full Text

        View this article in Full Text.

        View Full Text

        HTML Format

        View this article in HTML Format .

        View HTML Format