Skip to main content
Erschienen in: Software and Systems Modeling 1/2017

19.04.2015 | Theme Section Paper

Variability testing in the wild: the Drupal case study

verfasst von: Ana B. Sánchez, Sergio Segura, José A. Parejo, Antonio Ruiz-Cortés

Erschienen in: Software and Systems Modeling | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Variability testing techniques search for effective and manageable test suites that lead to the rapid detection of faults in systems with high variability. Evaluating the effectiveness of these techniques in realistic settings is a must, but challenging due to the lack of variability-intensive systems with available code, automated tests and fault reports. In this article, we propose using the Drupal framework as a case study to evaluate variability testing techniques. First, we represent the framework variability using a feature model. Then, we report on extensive non-functional data extracted from the Drupal Git repository and the Drupal issue tracking system. Among other results, we identified 3392 faults in single features and 160 faults triggered by the interaction of up to four features in Drupal v7.23. We also found positive correlations relating the number of bugs in Drupal features to their size, cyclomatic complexity, number of changes and fault history. To show the feasibility of our work, we evaluated the effectiveness of non-functional data for test case prioritization in Drupal. Results show that non-functional attributes are effective at accelerating the detection of faults, outperforming related prioritization criteria as test case similarity.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
5
A monotonic relationship implies that as the value of one variable increases, so does the value of the other variable; or as the value of one variable increases, the other variable value decreases.
 
Literatur
1.
Zurück zum Zitat Abal, I., Brabrand, C., Wasowski, A.: 42 variability bugs in the linux kernel: a qualitative analysis. In: International Conference on Automated Software Engineering, pp. 421–432 (2014) Abal, I., Brabrand, C., Wasowski, A.: 42 variability bugs in the linux kernel: a qualitative analysis. In: International Conference on Automated Software Engineering, pp. 421–432 (2014)
2.
Zurück zum Zitat Al-Hajjaji, M., Thum, T., Meinicke, J., Lochau, M., Saake, G.: Similarity-based prioritization in software product-line testing. In: Software Product Line Conference, pp. 197–206 (2014) Al-Hajjaji, M., Thum, T., Meinicke, J., Lochau, M., Saake, G.: Similarity-based prioritization in software product-line testing. In: Software Product Line Conference, pp. 197–206 (2014)
3.
Zurück zum Zitat Artho, C., Suzaki, K., Di Cosmo, R., Treinen, R., Zacchiroli, S.: Why do software packages conflict? In: Conference on Mining Software Repositories, pp. 141–150, IEEE (2012) Artho, C., Suzaki, K., Di Cosmo, R., Treinen, R., Zacchiroli, S.: Why do software packages conflict? In: Conference on Mining Software Repositories, pp. 141–150, IEEE (2012)
4.
Zurück zum Zitat Bagheri, E., Ensan, F., Gasevic, D.: Grammar-based test generation for software product line feature models. In: Conference of the Centre for Advanced Studies on Collaborative Research, pp. 87–101 (2012) Bagheri, E., Ensan, F., Gasevic, D.: Grammar-based test generation for software product line feature models. In: Conference of the Centre for Advanced Studies on Collaborative Research, pp. 87–101 (2012)
5.
Zurück zum Zitat Bagheri, E., Gasevic, D.: Assessing the maintainability of software product line feature models using structural metrics. Softw. Qual. Control. 19(3), 579–612 (2011) Bagheri, E., Gasevic, D.: Assessing the maintainability of software product line feature models using structural metrics. Softw. Qual. Control. 19(3), 579–612 (2011)
6.
Zurück zum Zitat Baller, H., Lity, S., Lochau, M., Schaefer, I.: Multi-objective test suite optimization for incremental product family testing. In: International Conference on Software Testing, Verification, and Validation (2014) Baller, H., Lity, S., Lochau, M., Schaefer, I.: Multi-objective test suite optimization for incremental product family testing. In: International Conference on Software Testing, Verification, and Validation (2014)
7.
Zurück zum Zitat Batory, D.: Feature models, grammars, and propositional formulas. In: Software Product Line Conference (2005) Batory, D.: Feature models, grammars, and propositional formulas. In: Software Product Line Conference (2005)
8.
Zurück zum Zitat Benavides, D., Segura, S., Ruiz-Cortés, A.: Automated analyses of feature models 20 years later: a literature review. Inf. Syst. 35(6), 615–636 (2010)CrossRef Benavides, D., Segura, S., Ruiz-Cortés, A.: Automated analyses of feature models 20 years later: a literature review. Inf. Syst. 35(6), 615–636 (2010)CrossRef
9.
Zurück zum Zitat Berger, T., She, S., Lotufo, R., Wasowski, A., Czarnecki, K.: Variability modeling in the real: a perspective from the operating systems domain. In: Proceedings of the IEEE/ACM International Conference on Automated Software Engineering, pp. 73–82. ACM (2010) Berger, T., She, S., Lotufo, R., Wasowski, A., Czarnecki, K.: Variability modeling in the real: a perspective from the operating systems domain. In: Proceedings of the IEEE/ACM International Conference on Automated Software Engineering, pp. 73–82. ACM (2010)
10.
Zurück zum Zitat Berger, T., She, S., Lotufo, R., Wasowski, A., Czarnecki, K.: A study of variability models and languages in the systems software domain. IEEE Trans. Softw. Eng. 39(12), 1611–1640 (2013)CrossRef Berger, T., She, S., Lotufo, R., Wasowski, A., Czarnecki, K.: A study of variability models and languages in the systems software domain. IEEE Trans. Softw. Eng. 39(12), 1611–1640 (2013)CrossRef
14.
Zurück zum Zitat Demuth, A., Lopez-Herrejon, R.E., Egyed, A.: Automatic and incremental product optimization for software product lines. In: International Conference on Software Testing, pp. 31–40, IEEE (2014) Demuth, A., Lopez-Herrejon, R.E., Egyed, A.: Automatic and incremental product optimization for software product lines. In: International Conference on Software Testing, pp. 31–40, IEEE (2014)
15.
Zurück zum Zitat Devroey, X., Perrouin, G., Cordy, M., Schobbens, P., Legay, A., Heymans, P.: Towards statistical prioritization for software product lines testing. In: Eighth International Workshop on Variability Modelling of Software-Intensive Systems, Number 10 (2014) Devroey, X., Perrouin, G., Cordy, M., Schobbens, P., Legay, A., Heymans, P.: Towards statistical prioritization for software product lines testing. In: Eighth International Workshop on Variability Modelling of Software-Intensive Systems, Number 10 (2014)
16.
Zurück zum Zitat Devroey, X., Perrouin, G., Schobbens, P.: Abstract test case generation for behavioural testing of software product lines. In: Software Product Line Conference, vol. 2, pp. 86–93. ACM (2014) Devroey, X., Perrouin, G., Schobbens, P.: Abstract test case generation for behavioural testing of software product lines. In: Software Product Line Conference, vol. 2, pp. 86–93. ACM (2014)
18.
Zurück zum Zitat Elbaum, S., Malishevsky, A.G., Rothermel, G.: Test case prioritization: a family of empirical studies. Trans. Softw. Eng. 28(2), 159–182 (2002)CrossRef Elbaum, S., Malishevsky, A.G., Rothermel, G.: Test case prioritization: a family of empirical studies. Trans. Softw. Eng. 28(2), 159–182 (2002)CrossRef
19.
Zurück zum Zitat Elbaum, S., Rothermel, G., Kanduri, S., Malishevsky, A.G.: Selecting a cost-effective test case prioritization technique. Softw. Qual. J. 12(3), 185–210 (2004)CrossRef Elbaum, S., Rothermel, G., Kanduri, S., Malishevsky, A.G.: Selecting a cost-effective test case prioritization technique. Softw. Qual. J. 12(3), 185–210 (2004)CrossRef
20.
Zurück zum Zitat Ensan, A., Bagheri, E., Asadi, M., Gasevic, D., Biletskiy, Y.: Goal-oriented test case selection and prioritization for product line feature models. In: Conference Information Technology: New Generations, pp. 291–298. IEEE (2011) Ensan, A., Bagheri, E., Asadi, M., Gasevic, D., Biletskiy, Y.: Goal-oriented test case selection and prioritization for product line feature models. In: Conference Information Technology: New Generations, pp. 291–298. IEEE (2011)
21.
Zurück zum Zitat Ensan, F., Bagheri, E., Gasevic. D.: Evolutionary search-based test generation for software product line feature models. In: Conference on Advanced Information Systems Engineering, pp. 613–628 (2012) Ensan, F., Bagheri, E., Gasevic. D.: Evolutionary search-based test generation for software product line feature models. In: Conference on Advanced Information Systems Engineering, pp. 613–628 (2012)
22.
Zurück zum Zitat Ferrer, J., Kruse, P., Chicano, F., Alba, E.: Evolutionary algorithm for prioritized pairwise test data generation. In: Genetic and Evolutionary Computation Conference, pp. 1213–1220 (2012) Ferrer, J., Kruse, P., Chicano, F., Alba, E.: Evolutionary algorithm for prioritized pairwise test data generation. In: Genetic and Evolutionary Computation Conference, pp. 1213–1220 (2012)
23.
Zurück zum Zitat Galindo, J.A., Alferez, M., Acher, M., Baudry, B., Benavides, D.: A variability-based testing approach for synthesizing video sequences. In: International Symposium on Software Testing and Analysis, pp. 293–303 (2014) Galindo, J.A., Alferez, M., Acher, M., Baudry, B., Benavides, D.: A variability-based testing approach for synthesizing video sequences. In: International Symposium on Software Testing and Analysis, pp. 293–303 (2014)
24.
Zurück zum Zitat Galindo, J.A., Benavides, D., Segura, S.: Debian packages repositories as software product line models, towards automated analysis. In: Automated Configuration and Tailoring of Applications, pp. 29–34 (2010) Galindo, J.A., Benavides, D., Segura, S.: Debian packages repositories as software product line models, towards automated analysis. In: Automated Configuration and Tailoring of Applications, pp. 29–34 (2010)
25.
Zurück zum Zitat García-Galán, J., Rana, O., Trinidad, P., Ruiz-Cortés, A.: Migrating to the cloud: a software product line based analysis. In: 3rd International Conference on Cloud Computing and Services Science, pp. 416–426 (2013) García-Galán, J., Rana, O., Trinidad, P., Ruiz-Cortés, A.: Migrating to the cloud: a software product line based analysis. In: 3rd International Conference on Cloud Computing and Services Science, pp. 416–426 (2013)
26.
Zurück zum Zitat Garvin, B.J., Cohen, M.B.: Feature interaction faults revisited: an exploratory study. In: International Symposium on Software Reliability Engineering, pp. 90–99 (2011) Garvin, B.J., Cohen, M.B.: Feature interaction faults revisited: an exploratory study. In: International Symposium on Software Reliability Engineering, pp. 90–99 (2011)
27.
Zurück zum Zitat Garvin, B.J., Cohen, M.B., Dwyer, M.B.: An improved meta-heuristic search for constrained interaction testing. In: International Symposium on Search Based Software Engineering, pp. 13–22 (2009) Garvin, B.J., Cohen, M.B., Dwyer, M.B.: An improved meta-heuristic search for constrained interaction testing. In: International Symposium on Search Based Software Engineering, pp. 13–22 (2009)
28.
Zurück zum Zitat Graves, T.L., Karr, A.F., Marron, J.S., Siy, H.: Predicting fault incidence using software change history. Technical report, National Institute of Statistical Sciences, pp. 653–661 (1998) Graves, T.L., Karr, A.F., Marron, J.S., Siy, H.: Predicting fault incidence using software change history. Technical report, National Institute of Statistical Sciences, pp. 653–661 (1998)
29.
Zurück zum Zitat Guo, J., White, J., Wang, G., Li, J., Wang, Y.: A genetic algorithm for optimized feature selection with resource constraints in software product lines. J. Syst. Softw. 84(12), 2208–2221 (2011) Guo, J., White, J., Wang, G., Li, J., Wang, Y.: A genetic algorithm for optimized feature selection with resource constraints in software product lines. J. Syst. Softw. 84(12), 2208–2221 (2011)
30.
Zurück zum Zitat Hassan, A.E.: Predicting faults using the complexity of code changes. In: International Conference on Software Engineering, pp. 78–88 (2009) Hassan, A.E.: Predicting faults using the complexity of code changes. In: International Conference on Software Engineering, pp. 78–88 (2009)
31.
Zurück zum Zitat Henard, C., Papadakis, M., Perrouin, G., Klein, J., Heymans, P., Le Traon, Y.: Bypassing the combinatorial explosion: using similarity to generate and prioritize t-wise test configurations for software product lines. IEEE Trans. Softw. Eng. 40, 1 (2014)CrossRef Henard, C., Papadakis, M., Perrouin, G., Klein, J., Heymans, P., Le Traon, Y.: Bypassing the combinatorial explosion: using similarity to generate and prioritize t-wise test configurations for software product lines. IEEE Trans. Softw. Eng. 40, 1 (2014)CrossRef
32.
Zurück zum Zitat Henard, C., Papadakis, M., Perrouin, G., Klein, J., Le Traon, Y.: Multi-objective test generation for software product lines. In: International Software Product Line Conference, pp. 62–71 (2013) Henard, C., Papadakis, M., Perrouin, G., Klein, J., Le Traon, Y.: Multi-objective test generation for software product lines. In: International Software Product Line Conference, pp. 62–71 (2013)
33.
Zurück zum Zitat Herzig, K., Just, S., Rau, A., Zeller, A.: Predicting defects using change genealogies. In: International Symposium on Software Reliability Engineering, pp. 118–127 (2013) Herzig, K., Just, S., Rau, A., Zeller, A.: Predicting defects using change genealogies. In: International Symposium on Software Reliability Engineering, pp. 118–127 (2013)
34.
Zurück zum Zitat Johansen, M.F., Haugen, O., Fleurey, F.: An algorithm for generating t-wise covering arrays from large feature models. Softw. Prod. Line Conf. 1, 46–55 (2012)CrossRef Johansen, M.F., Haugen, O., Fleurey, F.: An algorithm for generating t-wise covering arrays from large feature models. Softw. Prod. Line Conf. 1, 46–55 (2012)CrossRef
35.
Zurück zum Zitat Johansen, M.F., Haugen, O., Fleurey, F., Eldegard, A.G., Syversen, T.: Generating better partial covering arrays by modeling weights on sub-product lines. In: International Conference on Model Driven Engineering Languages and Systems, pp. 269–284 (2012) Johansen, M.F., Haugen, O., Fleurey, F., Eldegard, A.G., Syversen, T.: Generating better partial covering arrays by modeling weights on sub-product lines. In: International Conference on Model Driven Engineering Languages and Systems, pp. 269–284 (2012)
36.
Zurück zum Zitat Kang, K., Cohen, S., Hess, J., Novak, W., Peterson, S.: Feature-oriented domain analysis (foda) feasibility study. In: Software Engineering Institute (1990) Kang, K., Cohen, S., Hess, J., Novak, W., Peterson, S.: Feature-oriented domain analysis (foda) feasibility study. In: Software Engineering Institute (1990)
37.
Zurück zum Zitat Pérez Lamancha, B., Polo Usaola, M.: Testing product generation in software product lines using pairwise for feature coverage. In: International conference on Testing Software and Systems, pp. 111–125 (2010) Pérez Lamancha, B., Polo Usaola, M.: Testing product generation in software product lines using pairwise for feature coverage. In: International conference on Testing Software and Systems, pp. 111–125 (2010)
38.
Zurück zum Zitat Lew, K.S., Dillon, T.S., Forward, K.E.: Software complexity and its impact on software reliability. Trans. Softw. Eng. 14, 1645–1655 (1988)CrossRef Lew, K.S., Dillon, T.S., Forward, K.E.: Software complexity and its impact on software reliability. Trans. Softw. Eng. 14, 1645–1655 (1988)CrossRef
39.
Zurück zum Zitat Lopez-Herrejon, R.E., Chicano, F., Ferrer, J., Egyed, A., Alba, E.: Multi-objective optimal test suite computation for software product line pairwise testing. In: IEEE International Conference on Software Maintenance, pp. 404–407 (2013) Lopez-Herrejon, R.E., Chicano, F., Ferrer, J., Egyed, A., Alba, E.: Multi-objective optimal test suite computation for software product line pairwise testing. In: IEEE International Conference on Software Maintenance, pp. 404–407 (2013)
40.
Zurück zum Zitat Lopez-Herrejon, R.E., Ferrer, J., Chicano, F., Egyed, A., Alba, E.: Comparative analysis of classical multi-objective evolutionary algorithms and seeding strategies for pairwise testing of software product lines. In: IEEE Congress on Evolutionary Computation, pp. 387–396 (2014) Lopez-Herrejon, R.E., Ferrer, J., Chicano, F., Egyed, A., Alba, E.: Comparative analysis of classical multi-objective evolutionary algorithms and seeding strategies for pairwise testing of software product lines. In: IEEE Congress on Evolutionary Computation, pp. 387–396 (2014)
41.
Zurück zum Zitat Lotufo, R., She, S., Berger, T., Czarnecki, K., Wasowski, A.: Evolution of the linux kernel variability model. In: Software Product Line Conference, pp. 136–150 (2010) Lotufo, R., She, S., Berger, T., Czarnecki, K., Wasowski, A.: Evolution of the linux kernel variability model. In: Software Product Line Conference, pp. 136–150 (2010)
42.
Zurück zum Zitat Marijan, D., Gotlieb, A., Sen, S., Hervieu, A.: Practical pairwise testing for software product lines. In: International Software Product Line Conference, pp. 227–235. ACM, New York, NY, USA (2013) Marijan, D., Gotlieb, A., Sen, S., Hervieu, A.: Practical pairwise testing for software product lines. In: International Software Product Line Conference, pp. 227–235. ACM, New York, NY, USA (2013)
43.
Zurück zum Zitat Matsumoto, S., kamei, Y., Monden, A., Matsumoto, K., Nakamura, M.: An analyses of developer metrics for fault prediction. In: International Conference on Predictive Models in Software Engineering, Number 18 (2010) Matsumoto, S., kamei, Y., Monden, A., Matsumoto, K., Nakamura, M.: An analyses of developer metrics for fault prediction. In: International Conference on Predictive Models in Software Engineering, Number 18 (2010)
44.
Zurück zum Zitat Mendonca, M., Branco, M., Cowan, D.: S.p.l.o.t.—software product lines online tools. In: Conference Companion on Object Oriented Programming Systems Languages and Applications, pp. 761–762 (2009) Mendonca, M., Branco, M., Cowan, D.: S.p.l.o.t.—software product lines online tools. In: Conference Companion on Object Oriented Programming Systems Languages and Applications, pp. 761–762 (2009)
45.
Zurück zum Zitat Mohanty, S., Abhinna Acharya, A., Prasad Mohapatra, D.: A survey on model based test case prioritization. Comput. Sci. Inf. Technol. 2, 1042–1047 (2011) Mohanty, S., Abhinna Acharya, A., Prasad Mohapatra, D.: A survey on model based test case prioritization. Comput. Sci. Inf. Technol. 2, 1042–1047 (2011)
46.
Zurück zum Zitat Nagappan, N., Zeller, A., Zimmermann, T., Herzig, K., Murphy, B.: Change bursts as defect predictors. In: International Symposium on Software Reliability Engineering, pp. 309–318 (2010) Nagappan, N., Zeller, A., Zimmermann, T., Herzig, K., Murphy, B.: Change bursts as defect predictors. In: International Symposium on Software Reliability Engineering, pp. 309–318 (2010)
47.
Zurück zum Zitat Nguyen, H.V., Kästner, C., Nguyen, T.N.: Exploring variability-aware execution for testing plugin-based web applications. In: International Conference on Software Engineering, vol. 6, pp. 907–918 (2014) Nguyen, H.V., Kästner, C., Nguyen, T.N.: Exploring variability-aware execution for testing plugin-based web applications. In: International Conference on Software Engineering, vol. 6, pp. 907–918 (2014)
48.
Zurück zum Zitat Oster, S., Markert, F., Ritter, P.: Automated incremental pairwise testing of software product lines. In: Software Product Line Conference (2010) Oster, S., Markert, F., Ritter, P.: Automated incremental pairwise testing of software product lines. In: Software Product Line Conference (2010)
49.
Zurück zum Zitat Ostrand, T.J., Weyuker, E.J., Bell, R.M.: Where the bugs are. In: International Symposium on Software Testing and Analysis, pp. 86–96 (2004) Ostrand, T.J., Weyuker, E.J., Bell, R.M.: Where the bugs are. In: International Symposium on Software Testing and Analysis, pp. 86–96 (2004)
50.
Zurück zum Zitat Pressmen, S.R.: Software Engineering: A Practitioners Approach. International Edition-5. McGraw Hill, New York (2001) Pressmen, S.R.: Software Engineering: A Practitioners Approach. International Edition-5. McGraw Hill, New York (2001)
51.
Zurück zum Zitat R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2014) R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2014)
52.
Zurück zum Zitat Rothermel, G., Untch, R., Chu, C., Harrold, M.J.: Prioritizing test cases for regression testing. IEEE Trans. Softw. Eng. 27, 929–948 (2001)CrossRef Rothermel, G., Untch, R., Chu, C., Harrold, M.J.: Prioritizing test cases for regression testing. IEEE Trans. Softw. Eng. 27, 929–948 (2001)CrossRef
53.
Zurück zum Zitat Sánchez, A.B., Segura, S.: Automated testing on the analysis of variability-intensive artifacts: an exploratory study with sat solvers. In: XVII Jornadas de Ingeniería del Software y de Bases de Datos (2012) Sánchez, A.B., Segura, S.: Automated testing on the analysis of variability-intensive artifacts: an exploratory study with sat solvers. In: XVII Jornadas de Ingeniería del Software y de Bases de Datos (2012)
54.
Zurück zum Zitat Sánchez, A.B., Segura, S., Ruiz-Cortés, A.: A comparison of test case prioritization criteria for software product lines. In: IEEE International Conference on Software Testing, Verification, and Validation, pp. 41–50, Cleveland, OH (2014) Sánchez, A.B., Segura, S., Ruiz-Cortés, A.: A comparison of test case prioritization criteria for software product lines. In: IEEE International Conference on Software Testing, Verification, and Validation, pp. 41–50, Cleveland, OH (2014)
55.
Zurück zum Zitat Salam Sayyad, A., Menzies, T., Ammar, H.: On the value of user preferences in search-based software engineering: A case study in software product lines. In: International Conference on Software Engineering, pp. 492–501 (2013) Salam Sayyad, A., Menzies, T., Ammar, H.: On the value of user preferences in search-based software engineering: A case study in software product lines. In: International Conference on Software Engineering, pp. 492–501 (2013)
56.
Zurück zum Zitat Segura, S., Ruiz-Cortés, A.: Benchmarking on the automated analyses of feature models: A preliminary roadmap. In: International Workshop on Variability Modeling of Software-Intensive Systems, pp. 137–143 (2009) Segura, S., Ruiz-Cortés, A.: Benchmarking on the automated analyses of feature models: A preliminary roadmap. In: International Workshop on Variability Modeling of Software-Intensive Systems, pp. 137–143 (2009)
57.
Zurück zum Zitat Segura, S., Sánchez, A.B., Ruiz-Cortés, A.: Automated variability analysis and testing of an e-commerce site: an experience report. In: International Conference on Automated Software Engineering, pp. 139–150. ACM (2014) Segura, S., Sánchez, A.B., Ruiz-Cortés, A.: Automated variability analysis and testing of an e-commerce site: an experience report. In: International Conference on Automated Software Engineering, pp. 139–150. ACM (2014)
58.
Zurück zum Zitat She, S., Lotufo, R., Berger, T., Wasowski, A., Czarnecki, K.: The variability model of the linux kernel. In: International Workshop on Variability Modelling of Software-Intensive Systems (2010) She, S., Lotufo, R., Berger, T., Wasowski, A., Czarnecki, K.: The variability model of the linux kernel. In: International Workshop on Variability Modelling of Software-Intensive Systems (2010)
61.
Zurück zum Zitat Srikanth, H., Cohen, M.B., Qu, X.: Reducing field failures in system configurable software: cost-based prioritization. In: International Symposium on Software Reliability Engineering, pp. 61–70 (2009) Srikanth, H., Cohen, M.B., Qu, X.: Reducing field failures in system configurable software: cost-based prioritization. In: International Symposium on Software Reliability Engineering, pp. 61–70 (2009)
62.
Zurück zum Zitat Svahnberg, M., van Gurp, L., Bosch, J.: A taxonomy of variability realization techniques: research articles. Softw. Pract. Exp. 35, 705–754 (2005)CrossRef Svahnberg, M., van Gurp, L., Bosch, J.: A taxonomy of variability realization techniques: research articles. Softw. Pract. Exp. 35, 705–754 (2005)CrossRef
63.
Zurück zum Zitat Tan, P.N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Addison Wesley, Boston (2006) Tan, P.N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Addison Wesley, Boston (2006)
64.
Zurück zum Zitat Tiwari, U., Kumar, S.: Cyclomatic complexity metric for component based software. Softw. Eng. Notes 39, 1–6 (2014) Tiwari, U., Kumar, S.: Cyclomatic complexity metric for component based software. Softw. Eng. Notes 39, 1–6 (2014)
65.
Zurück zum Zitat Tomlinson, T., VanDyk, J.K.: Pro Drupal 7 Development, 3rd edn (2010) Tomlinson, T., VanDyk, J.K.: Pro Drupal 7 Development, 3rd edn (2010)
66.
Zurück zum Zitat Wang, S., Ali, S., Gotlieb, A.: Minimizing test suites in software product lines using weight-based genetic algorithms. In: The Genetic and Evolutionary Computation Conference, pp. 1493–1500 (2013) Wang, S., Ali, S., Gotlieb, A.: Minimizing test suites in software product lines using weight-based genetic algorithms. In: The Genetic and Evolutionary Computation Conference, pp. 1493–1500 (2013)
67.
Zurück zum Zitat Wang, S., Buchmann, D., Ali, S., Gotlieb, A., Pradhan, D., Liaaen, M.: Multi-objective test prioritization in software product line testing: an industrial case study. In: Software Product Line Conference, pp. 32–41 (2014) Wang, S., Buchmann, D., Ali, S., Gotlieb, A., Pradhan, D., Liaaen, M.: Multi-objective test prioritization in software product line testing: an industrial case study. In: Software Product Line Conference, pp. 32–41 (2014)
68.
Zurück zum Zitat Yoo, S., Harman, M.: Regression testing minimisation, selection and prioritisation: a survey. In: Software Testing, Verification and Reliability, pp. 67–120 (2012) Yoo, S., Harman, M.: Regression testing minimisation, selection and prioritisation: a survey. In: Software Testing, Verification and Reliability, pp. 67–120 (2012)
Metadaten
Titel
Variability testing in the wild: the Drupal case study
verfasst von
Ana B. Sánchez
Sergio Segura
José A. Parejo
Antonio Ruiz-Cortés
Publikationsdatum
19.04.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Software and Systems Modeling / Ausgabe 1/2017
Print ISSN: 1619-1366
Elektronische ISSN: 1619-1374
DOI
https://doi.org/10.1007/s10270-015-0459-z

Weitere Artikel der Ausgabe 1/2017

Software and Systems Modeling 1/2017 Zur Ausgabe