Skip to main content
Erschienen in: Journal of Electronic Testing 1/2013

01.02.2013

Evaluating Different Strategies for Testing Software Product Lines

verfasst von: Thelma Elita Colanzi, Wesley Klewerton Guez Assunção, Daniela de Freitas Guilhermino Trindade, Carlos Alberto Zorzo, Silvia Regina Vergilio

Erschienen in: Journal of Electronic Testing | Ausgabe 1/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The Software Product Line (SPL) approach is associated with many benefits, and with some challenges too. In the SPL testing, a great challenge is the integration of test methods and techniques with the SPL engineering. To do this, some strategies have been proposed, however, they have not been properly evaluated and compared. In this paper a case study is described comparing three different test strategies: the product by product strategy that tests each product individually; an incremental strategy that tests the products reusing test cases from products previously tested; and a strategy that instantiates test data derived in the domain engineering, considering SPL commonalities and variabilities. In the study an SPL from the games domain was used, and the test data were generated from use cases. The results show that SPL oriented strategies are associated to greater percentages of reuse, and consequently, with lower effort to write test cases.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Assunção WKG, Trindade DFG, Colanzi TE, Vergilio SR (2011) Evaluating test reuse of a software product line strategies. In: Latin-American test workshop (LATW) Assunção WKG, Trindade DFG, Colanzi TE, Vergilio SR (2011) Evaluating test reuse of a software product line strategies. In: Latin-American test workshop (LATW)
2.
Zurück zum Zitat Bertolino A, Gnesi S (2003) Use case-based testing of product lines. In: 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on foundations of software engineering, Helsinki, Finland, pp 355–358 Bertolino A, Gnesi S (2003) Use case-based testing of product lines. In: 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on foundations of software engineering, Helsinki, Finland, pp 355–358
3.
Zurück zum Zitat Bertolino A, Gnesi S (2004) Pluto: a test methodology for product families. Lect Notes Comput Sci 3014:181–197CrossRef Bertolino A, Gnesi S (2004) Pluto: a test methodology for product families. Lect Notes Comput Sci 3014:181–197CrossRef
4.
Zurück zum Zitat Clements PC, Jones LG, Northrop LM, McGregor JD (2005) Project management in a software product line organization. IEEE Softw 22(5):54–62CrossRef Clements PC, Jones LG, Northrop LM, McGregor JD (2005) Project management in a software product line organization. IEEE Softw 22(5):54–62CrossRef
5.
Zurück zum Zitat Clements PC, Jones LG, Mcgregor JD, Northrop LM (2006) Getting there from here: a roadmap for software product line adoption. Commun ACM 49(12):33–36CrossRef Clements PC, Jones LG, Mcgregor JD, Northrop LM (2006) Getting there from here: a roadmap for software product line adoption. Commun ACM 49(12):33–36CrossRef
6.
Zurück zum Zitat Cockburn A (2001) Writing effective use cases. Addison Wesley, Reading Cockburn A (2001) Writing effective use cases. Addison Wesley, Reading
7.
Zurück zum Zitat Deus GD, Vincenzi AMR, Lucena FN, Delamaro ME (2009) Quality evaluation of J2ME products by using experimentation packages. In: Simpósio Brasileiro de qualidade de software, SBQS’2009, pp 264–278 (in Portuguese) Deus GD, Vincenzi AMR, Lucena FN, Delamaro ME (2009) Quality evaluation of J2ME products by using experimentation packages. In: Simpósio Brasileiro de qualidade de software, SBQS’2009, pp 264–278 (in Portuguese)
8.
Zurück zum Zitat Edwin OO (2007) Testing in software product lines. Master thesis, School of Engineering, Blekinge Institute of Technology, Sweden Edwin OO (2007) Testing in software product lines. Master thesis, School of Engineering, Blekinge Institute of Technology, Sweden
10.
Zurück zum Zitat Jaaksi A (2002) Developing mobile browsers in a product line. IEEE Softw 19:73–80CrossRef Jaaksi A (2002) Developing mobile browsers in a product line. IEEE Softw 19:73–80CrossRef
11.
Zurück zum Zitat Jazayeri M, Ran A, Linden F (2000) Software architecture for product families. Addison Wesley, Reading Jazayeri M, Ran A, Linden F (2000) Software architecture for product families. Addison Wesley, Reading
12.
Zurück zum Zitat Krueger C (2002) Eliminating the adoption barrier. IEEE Softw (Special issue on Iniciating Software Product Lines) 19(4):28–31 Krueger C (2002) Eliminating the adoption barrier. IEEE Softw (Special issue on Iniciating Software Product Lines) 19(4):28–31
13.
Zurück zum Zitat Lamancha BP, Usaola M (2010) Testing product generation in software product lines using pairwise for features coverage. In: Petrenko A, Simão A, Maldonado J (eds) Testing software and systems. Lecture notes in computer science, vol 6435, pp 111–125 Lamancha BP, Usaola M (2010) Testing product generation in software product lines using pairwise for features coverage. In: Petrenko A, Simão A, Maldonado J (eds) Testing software and systems. Lecture notes in computer science, vol 6435, pp 111–125
14.
Zurück zum Zitat Lamancha BP, Usaola M, Piattini M (2009). In: International conference on software, vol 49, pp 78–81 Lamancha BP, Usaola M, Piattini M (2009). In: International conference on software, vol 49, pp 78–81
15.
Zurück zum Zitat McGregor JD (2001) Testing a software product line. Technical report, Software Engineering Institute, Carnegie Mellon University, Technical Report CMU/SEI-2001-TR-022 McGregor JD (2001) Testing a software product line. Technical report, Software Engineering Institute, Carnegie Mellon University, Technical Report CMU/SEI-2001-TR-022
16.
Zurück zum Zitat Morin B, Klein J, Barais O, Jézéquel J (2008) A generic weaver for supporting product lines. In: International conference on software engineering (ICSE). Proceedings of the 13th international workshop on early aspects, Leipzig, Germany, pp 11–18 Morin B, Klein J, Barais O, Jézéquel J (2008) A generic weaver for supporting product lines. In: International conference on software engineering (ICSE). Proceedings of the 13th international workshop on early aspects, Leipzig, Germany, pp 11–18
17.
Zurück zum Zitat Nebut C, Fleurey F, Le Traon Y, Jezequel J-M (2006) Automatic test generation: a use case driven approach. IEEE Trans Softw Eng 32(3):140–155CrossRef Nebut C, Fleurey F, Le Traon Y, Jezequel J-M (2006) Automatic test generation: a use case driven approach. IEEE Trans Softw Eng 32(3):140–155CrossRef
18.
Zurück zum Zitat Oliveira Jr E, Gimenes I, Maldonado J (2010) Systematic management of variability in UML-based software product lines. J Univers Comput Sci 16(17):2374–2393 Oliveira Jr E, Gimenes I, Maldonado J (2010) Systematic management of variability in UML-based software product lines. J Univers Comput Sci 16(17):2374–2393
19.
Zurück zum Zitat Oster S, Markert F, Ritter P (2010) Automated incremental pair-wise testing of software product lines. In: Bosch J, Lee J (eds) Software product lines: going beyond. Lecture notes in computer science, vol 6287, pp 196–210 Oster S, Markert F, Ritter P (2010) Automated incremental pair-wise testing of software product lines. In: Bosch J, Lee J (eds) Software product lines: going beyond. Lecture notes in computer science, vol 6287, pp 196–210
20.
Zurück zum Zitat Perrouin G, Sen S, Klein J, Baudry B, Traon YL (2010) Automated and scalable t-wise test case generation strategies for software product lines. In: Proceedings of the 2010 third international conference on software testing, verification and validation, ICST ’10. IEEE Computer Society, Washington, DC, pp 459–468 Perrouin G, Sen S, Klein J, Baudry B, Traon YL (2010) Automated and scalable t-wise test case generation strategies for software product lines. In: Proceedings of the 2010 third international conference on software testing, verification and validation, ICST ’10. IEEE Computer Society, Washington, DC, pp 459–468
21.
Zurück zum Zitat Pohl K,Metzger A (2006) Software product line testing: exploring principles and potential solutions. Commun ACM 49(12):78–81CrossRef Pohl K,Metzger A (2006) Software product line testing: exploring principles and potential solutions. Commun ACM 49(12):78–81CrossRef
22.
Zurück zum Zitat Reuys A, Kamsties E, Pohl K, Reis S (2005) Model-based system testing of software product families. In: Conference on advanced information systems engineering (CAISE), pp 519–534 Reuys A, Kamsties E, Pohl K, Reis S (2005) Model-based system testing of software product families. In: Conference on advanced information systems engineering (CAISE), pp 519–534
23.
Zurück zum Zitat Segura S, Hierons RM, Benavides D, Ruiz-Cortés A (2010) Automated test data generation on the analyses of feature models: a metamorphic testing approach. In: Third international conference on software testing, verification and validation, ICST ’10, pp 35–44 Segura S, Hierons RM, Benavides D, Ruiz-Cortés A (2010) Automated test data generation on the analyses of feature models: a metamorphic testing approach. In: Third international conference on software testing, verification and validation, ICST ’10, pp 35–44
25.
Zurück zum Zitat Tevanlinna A, Taina J, Kauppinen R (2004) Product family testing: a survey. ACM SIGSOFT Softw Eng Notes 29(2):1–6CrossRef Tevanlinna A, Taina J, Kauppinen R (2004) Product family testing: a survey. ACM SIGSOFT Softw Eng Notes 29(2):1–6CrossRef
26.
Zurück zum Zitat Trew T (2005) Enabling the smooth integration of core assets: defining and packaging architectural rules for a family of embedded products. In: Software product line conference (SPLC), pp 137–149 Trew T (2005) Enabling the smooth integration of core assets: defining and packaging architectural rules for a family of embedded products. In: Software product line conference (SPLC), pp 137–149
27.
Zurück zum Zitat Uzuncaova E, Khurshid S, Batory DF (2010) Incremental test generation for software product lines. IEEE Trans Softw Eng 36(3):309–322CrossRef Uzuncaova E, Khurshid S, Batory DF (2010) Incremental test generation for software product lines. IEEE Trans Softw Eng 36(3):309–322CrossRef
28.
Zurück zum Zitat van der Linden F, Schimd K, Rommes E (2007) Software product lines in action—the best industrial practice in product line engineering. Springer, New York van der Linden F, Schimd K, Rommes E (2007) Software product lines in action—the best industrial practice in product line engineering. Springer, New York
Metadaten
Titel
Evaluating Different Strategies for Testing Software Product Lines
verfasst von
Thelma Elita Colanzi
Wesley Klewerton Guez Assunção
Daniela de Freitas Guilhermino Trindade
Carlos Alberto Zorzo
Silvia Regina Vergilio
Publikationsdatum
01.02.2013
Verlag
Springer US
Erschienen in
Journal of Electronic Testing / Ausgabe 1/2013
Print ISSN: 0923-8174
Elektronische ISSN: 1573-0727
DOI
https://doi.org/10.1007/s10836-012-5343-y

Weitere Artikel der Ausgabe 1/2013

Journal of Electronic Testing 1/2013 Zur Ausgabe

EditorialNotes

Editorial

Announcement

New Editors, 2013

Neuer Inhalt