Skip to main content

2015 | OriginalPaper | Buchkapitel

Lattice-Based Semantics for Combinatorial Model Evolution

verfasst von : Rachel Tzoref-Brill, Shahar Maoz

Erschienen in: Automated Technology for Verification and Analysis

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Combinatorial test design (CTD) is an effective test design technique, considered to be a testing best practice. CTD provides automatic test plan generation, but it requires a manual definition of the test space in the form of a combinatorial model. As the system under test evolves, e.g., due to iterative development processes and bug fixing, so does the test space, and thus, in the context of CTD, evolution translates into frequent manual model definition updates.
In this work, we show that the Boolean semantics currently in use by CTD tools to interpret the model is inadequate for combinatorial model evolution, and propose to replace it with a new lattice-based semantics that (1) provides a consistent interpretation of atomic changes to the model via Galois connections, and (2) exposes which additional parts of the model must change following an atomic change, in order to restore validity. We further use the new lattice-based semantics to define new higher-level atomic operations for combinatorial model evolution. Finally, we identify recurring abstraction and refinement patterns in the evolution of 42 real-world industrial models, and use the new lattice-based semantics to define new higher-level atomic constructs that encapsulate these patterns.
The proposed lattice-based semantics and related new modeling constructs advance the state-of-the-art in CTD with a new foundation for model evolution and with better tools for change comprehension and management.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Unfortunately, all models are confidential and cannot be shared since they were created for IBM or for its clients. We are in the process of checking the option of sharing most of them after obfuscation.
 
Literatur
1.
Zurück zum Zitat Burroughs, K., Jain, A., Erickson, R.L.: Improved quality of protocol testing through techniques of experimental design. In: SUPERCOMM/ICC (1994) Burroughs, K., Jain, A., Erickson, R.L.: Improved quality of protocol testing through techniques of experimental design. In: SUPERCOMM/ICC (1994)
2.
Zurück zum Zitat Cohen, M.B., Snyder, J., Rothermel, G.: Testing across configurations: implications for combinatorial testing. SIGSOFT Softw. Eng. Notes 31(6), 1–9 (2006)CrossRef Cohen, M.B., Snyder, J., Rothermel, G.: Testing across configurations: implications for combinatorial testing. SIGSOFT Softw. Eng. Notes 31(6), 1–9 (2006)CrossRef
3.
Zurück zum Zitat Cousot, P., Cousot, R.: Abstract interpretation: a unified lattice model for static analysis of programs by construction or approximation of fixpoints. In: POPL (1977) Cousot, P., Cousot, R.: Abstract interpretation: a unified lattice model for static analysis of programs by construction or approximation of fixpoints. In: POPL (1977)
4.
Zurück zum Zitat Czerwonka, J.: Pairwise Testing in Real World. In: PNSQC (2006) Czerwonka, J.: Pairwise Testing in Real World. In: PNSQC (2006)
5.
Zurück zum Zitat Dalal, S.R., Jain, A., Karunanithi, N., Leaton, J.M., Lott, C.M., Patton, G.C., Horowitz, B.M.: Model-based testing in practice. In: ICSE (1999) Dalal, S.R., Jain, A., Karunanithi, N., Leaton, J.M., Lott, C.M., Patton, G.C., Horowitz, B.M.: Model-based testing in practice. In: ICSE (1999)
6.
Zurück zum Zitat Dams, D., Gerth, R., Grumberg, O.: Abstract interpretation of reactive systems. ACM Trans. Program. Lang. Syst. 19(2), 253–291 (1997)CrossRef Dams, D., Gerth, R., Grumberg, O.: Abstract interpretation of reactive systems. ACM Trans. Program. Lang. Syst. 19(2), 253–291 (1997)CrossRef
7.
Zurück zum Zitat Davey, B.A., Priestley, H.A.: Introduction To Lattices and Order. Cambridge University Press, Cambridge (1990)MATH Davey, B.A., Priestley, H.A.: Introduction To Lattices and Order. Cambridge University Press, Cambridge (1990)MATH
8.
Zurück zum Zitat Grindal, M., Lindström, B., Offutt, J., Andler, S.F.: An evaluation of combination strategies for test case selection. Softw. Eng. Empirical 11(4), 583–611 (2006)CrossRef Grindal, M., Lindström, B., Offutt, J., Andler, S.F.: An evaluation of combination strategies for test case selection. Softw. Eng. Empirical 11(4), 583–611 (2006)CrossRef
9.
Zurück zum Zitat Grumberg, O., Lange, M., Leucker, M., Shoham, S.: Don’t know in the \({\mu }\)-Calculus. In: Cousot, R. (ed.) VMCAI 2005. LNCS, vol. 3385, pp. 233–249. Springer, Heidelberg (2005) CrossRef Grumberg, O., Lange, M., Leucker, M., Shoham, S.: Don’t know in the \({\mu }\)-Calculus. In: Cousot, R. (ed.) VMCAI 2005. LNCS, vol. 3385, pp. 233–249. Springer, Heidelberg (2005) CrossRef
11.
Zurück zum Zitat Katoen, J.-P., Klink, D., Leucker, M., Wolf, V.: Three-valued abstraction for probabilistic systems. In: JLAP (2012) Katoen, J.-P., Klink, D., Leucker, M., Wolf, V.: Three-valued abstraction for probabilistic systems. In: JLAP (2012)
12.
Zurück zum Zitat Kuhn, D.R., Wallace, D.R., Gallo, A.M.: Software fault interactions and implications for software testing. IEEE Trans. Softw. Eng. 30(6), 418–421 (2004)CrossRef Kuhn, D.R., Wallace, D.R., Gallo, A.M.: Software fault interactions and implications for software testing. IEEE Trans. Softw. Eng. 30(6), 418–421 (2004)CrossRef
13.
Zurück zum Zitat Maoz, S., Ringert, J.O., Rumpe, B.: ADDiff: semantic differencing for activity diagrams. In: ESEC/FSE (2011) Maoz, S., Ringert, J.O., Rumpe, B.: ADDiff: semantic differencing for activity diagrams. In: ESEC/FSE (2011)
14.
Zurück zum Zitat Maoz, S., Ringert, J.O., Rumpe, B.: CDDiff: semantic differencing for class diagrams. In: Mezini, M. (ed.) ECOOP 2011. LNCS, vol. 6813, pp. 230–254. Springer, Heidelberg (2011) CrossRef Maoz, S., Ringert, J.O., Rumpe, B.: CDDiff: semantic differencing for class diagrams. In: Mezini, M. (ed.) ECOOP 2011. LNCS, vol. 6813, pp. 230–254. Springer, Heidelberg (2011) CrossRef
15.
Zurück zum Zitat Meller, Y., Grumberg, O., Shoham, S.: A framework for compositional verification of multi-valued systems via abstraction-refinement. In: Liu, Z., Ravn, A.P. (eds.) ATVA 2009. LNCS, vol. 5799, pp. 271–288. Springer, Heidelberg (2009) CrossRef Meller, Y., Grumberg, O., Shoham, S.: A framework for compositional verification of multi-valued systems via abstraction-refinement. In: Liu, Z., Ravn, A.P. (eds.) ATVA 2009. LNCS, vol. 5799, pp. 271–288. Springer, Heidelberg (2009) CrossRef
16.
Zurück zum Zitat Nie, C., Leung, H.: A survey of combinatorial testing. ACM Comput. Surv. 43(2), 11 (2011)CrossRefMATH Nie, C., Leung, H.: A survey of combinatorial testing. ACM Comput. Surv. 43(2), 11 (2011)CrossRefMATH
17.
Zurück zum Zitat Nielson, F., Nielson, H.R., Hankin, C.: Principles of Program Analysis. Springer, New York (1999)CrossRefMATH Nielson, F., Nielson, H.R., Hankin, C.: Principles of Program Analysis. Springer, New York (1999)CrossRefMATH
19.
Zurück zum Zitat Partush, N., Yahav, E.: Abstract semantic differencing via speculative correlation. In: OOPSLA (2014) Partush, N., Yahav, E.: Abstract semantic differencing via speculative correlation. In: OOPSLA (2014)
20.
Zurück zum Zitat Qu, X., Cohen, M.B., Woolf, K.M.: Combinatorial interaction regression testing: a study of test case generation and prioritization. In: ICSM (2007) Qu, X., Cohen, M.B., Woolf, K.M.: Combinatorial interaction regression testing: a study of test case generation and prioritization. In: ICSM (2007)
21.
Zurück zum Zitat Lei, Y., Kuhn, R., Kacker, R.: Practical combinatorial testing beyond pairwise. IT Prof. 10(3), 19–23 (2008)CrossRef Lei, Y., Kuhn, R., Kacker, R.: Practical combinatorial testing beyond pairwise. IT Prof. 10(3), 19–23 (2008)CrossRef
22.
Zurück zum Zitat Segall, I., Tzoref-Brill, R., Farchi, E.: Using binary decision diagrams for combinatorial test design. In: ISSTA (2011) Segall, I., Tzoref-Brill, R., Farchi, E.: Using binary decision diagrams for combinatorial test design. In: ISSTA (2011)
23.
24.
Zurück zum Zitat Tai, K.C., Lie, Y.: A test generation strategy for pairwise testing. IEEE Trans. Softw. Eng. 1, 109–111 (2002) Tai, K.C., Lie, Y.: A test generation strategy for pairwise testing. IEEE Trans. Softw. Eng. 1, 109–111 (2002)
25.
Zurück zum Zitat Tzoref-Brill, R., Maoz, S.: Lattice-based semantics for combinatorial model evolution. Technical report H-0323, IBM Research (2015) Tzoref-Brill, R., Maoz, S.: Lattice-based semantics for combinatorial model evolution. Technical report H-0323, IBM Research (2015)
26.
Zurück zum Zitat Wojciak, P., Tzoref-Brill, R.: System level combinatorial testing in practice - the concurrent maintenance case study. In: ICST (2014) Wojciak, P., Tzoref-Brill, R.: System level combinatorial testing in practice - the concurrent maintenance case study. In: ICST (2014)
Metadaten
Titel
Lattice-Based Semantics for Combinatorial Model Evolution
verfasst von
Rachel Tzoref-Brill
Shahar Maoz
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-24953-7_22