Skip to main content

2016 | OriginalPaper | Buchkapitel

Set-Based Algorithms for Combinatorial Test Set Generation

verfasst von : Ludwig Kampel, Dimitris E. Simos

Erschienen in: Testing Software and Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Testing is an important and expensive part of software and hardware development. Over the recent years, the construction of combinatorial interaction tests rose to play an important role towards making the cost of testing more efficient. Covering arrays are the key element of combinatorial interaction testing and a means to provide abstract test sets. In this paper, we present a family of set-based algorithms for generating covering arrays and thus combinatorial test sets. Our algorithms build upon an existing mathematical method for constructing independent families of sets, which we extend sufficiently in terms of algorithmic design in this paper. We compare our algorithms against commonly used greedy methods for producing 3-way combinatorial test sets, and these initial evaluation results favor our approach in terms of generating smaller test sets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat The economic impacts of inadequate infrastructure for software testing. U.S. Department of Commerce, National Institute of Standards and Technology (2002) The economic impacts of inadequate infrastructure for software testing. U.S. Department of Commerce, National Institute of Standards and Technology (2002)
2.
Zurück zum Zitat Cohen, D.M., Dalal, S.R., Fredman, M.L., Patton, G.C.: The AETG system: an approach to testing based on combinatorial design. IEEE Trans. Softw. Eng. 23(7), 437–444 (1997)CrossRef Cohen, D.M., Dalal, S.R., Fredman, M.L., Patton, G.C.: The AETG system: an approach to testing based on combinatorial design. IEEE Trans. Softw. Eng. 23(7), 437–444 (1997)CrossRef
4.
Zurück zum Zitat Colbourn, C.J.: Combinatorial aspects of covering arrays. Le Matematiche (Catania) 58, 121–167 (2004)MathSciNetMATH Colbourn, C.J.: Combinatorial aspects of covering arrays. Le Matematiche (Catania) 58, 121–167 (2004)MathSciNetMATH
5.
Zurück zum Zitat Colbourn, C.J., Dinitz, J.H.: Handbook of Combinatorial Designs. CRC Press, Boca Raton (2006)CrossRefMATH Colbourn, C.J., Dinitz, J.H.: Handbook of Combinatorial Designs. CRC Press, Boca Raton (2006)CrossRefMATH
6.
Zurück zum Zitat Forbes, M., Lawrence, J., Lei, Y., Kacker, R., Kuhn, D.R.: Refining the in-parameter-order strategy for constructing covering arrays. J. Res. Nat. Inst. Stand. Technol. 113, 287–297 (2008)CrossRef Forbes, M., Lawrence, J., Lei, Y., Kacker, R., Kuhn, D.R.: Refining the in-parameter-order strategy for constructing covering arrays. J. Res. Nat. Inst. Stand. Technol. 113, 287–297 (2008)CrossRef
7.
Zurück zum Zitat Freiman, G., Lipkin, E., Levitin, L.: A polynomial algorithm for constructing families of k-independent sets. Discret. Math. 70(2), 137–147 (1988)MathSciNetCrossRefMATH Freiman, G., Lipkin, E., Levitin, L.: A polynomial algorithm for constructing families of k-independent sets. Discret. Math. 70(2), 137–147 (1988)MathSciNetCrossRefMATH
8.
Zurück zum Zitat Gao, S.W., Lv, J.H., Du, B.L., Colbourn, C.J., Ma, S.L.: Balancing frequencies and fault detection in the in-parameter-order algorithm. J. Comput. Sci. Technol. 30(5), 957–968 (2015)CrossRef Gao, S.W., Lv, J.H., Du, B.L., Colbourn, C.J., Ma, S.L.: Balancing frequencies and fault detection in the in-parameter-order algorithm. J. Comput. Sci. Technol. 30(5), 957–968 (2015)CrossRef
11.
Zurück zum Zitat Kuhn, D., Kacker, R., Lei, Y.: Practical combinatorial testing. In: NIST Special Publication pp. 800–142 (2010) Kuhn, D., Kacker, R., Lei, Y.: Practical combinatorial testing. In: NIST Special Publication pp. 800–142 (2010)
12.
Zurück zum Zitat Kuhn, D., Kacker, R., Lei, Y.: Introduction to Combinatorial Testing. Chapman & Hall/CRC Innovations in Software Engineering and Software Development Series. Taylor & Francis, New York (2013)MATH Kuhn, D., Kacker, R., Lei, Y.: Introduction to Combinatorial Testing. Chapman & Hall/CRC Innovations in Software Engineering and Software Development Series. Taylor & Francis, New York (2013)MATH
13.
Zurück zum Zitat Lawrence, J., Kacker, R.N., Lei, Y., Kuhn, D.R., Forbes, M.: A survey of binary covering arrays. Electron. J. Comb. 18(1), P84 (2011)MathSciNetMATH Lawrence, J., Kacker, R.N., Lei, Y., Kuhn, D.R., Forbes, M.: A survey of binary covering arrays. Electron. J. Comb. 18(1), P84 (2011)MathSciNetMATH
14.
Zurück zum Zitat Lei, Y., Kacker, R., Kuhn, D.R., Okun, V., Lawrence, J.: IPOG-IPOG-D: efficient test generation for multi-way combinatorial testing. Softw. Test. Verif. Reliab. 18(3), 125–148 (2008)CrossRef Lei, Y., Kacker, R., Kuhn, D.R., Okun, V., Lawrence, J.: IPOG-IPOG-D: efficient test generation for multi-way combinatorial testing. Softw. Test. Verif. Reliab. 18(3), 125–148 (2008)CrossRef
15.
Zurück zum Zitat Lei, Y., Tai, K.C.: In-parameter-order: a test generation strategy for pairwise testing. In: 1998 3rd IEEE International Proceedings of High-Assurance Systems Engineering Symposium, pp. 254–261. IEEE (1998) Lei, Y., Tai, K.C.: In-parameter-order: a test generation strategy for pairwise testing. In: 1998 3rd IEEE International Proceedings of High-Assurance Systems Engineering Symposium, pp. 254–261. IEEE (1998)
17.
Zurück zum Zitat Seroussi, G., Bshouty, N.H.: Vector sets for exhaustive testing of logic circuits. IEEE Trans. Inf. Theor. 34(3), 513–522 (1988)MathSciNetCrossRefMATH Seroussi, G., Bshouty, N.H.: Vector sets for exhaustive testing of logic circuits. IEEE Trans. Inf. Theor. 34(3), 513–522 (1988)MathSciNetCrossRefMATH
18.
Zurück zum Zitat Torres-Jimenez, J., Izquierdo-Marquez, I.: Survey of covering arrays. In: 2013 15th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), pp. 20–27. IEEE (2013) Torres-Jimenez, J., Izquierdo-Marquez, I.: Survey of covering arrays. In: 2013 15th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), pp. 20–27. IEEE (2013)
19.
Zurück zum Zitat Yu, L., Lei, Y., Kacker, R.N., Kuhn, D.R.: Acts: a combinatorial test generation tool. In: 2013 IEEE 6th International Conference on Software Testing, Verification and Validation (ICST), pp. 370–375. IEEE (2013) Yu, L., Lei, Y., Kacker, R.N., Kuhn, D.R.: Acts: a combinatorial test generation tool. In: 2013 IEEE 6th International Conference on Software Testing, Verification and Validation (ICST), pp. 370–375. IEEE (2013)
Metadaten
Titel
Set-Based Algorithms for Combinatorial Test Set Generation
verfasst von
Ludwig Kampel
Dimitris E. Simos
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-47443-4_16

Premium Partner