Skip to main content
Erschienen in: International Journal on Software Tools for Technology Transfer 3/2019

08.05.2018 | Regular Paper

A reasoning-based approach to dynamic domain reduction in test data generation

verfasst von: Esmaeel Nikravan, Saeed Parsa

Erschienen in: International Journal on Software Tools for Technology Transfer | Ausgabe 3/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this article, a new criterion, domain coverage, for white box testing is introduced. In search of the biggest subdomains for input variables exercising a given path, the variable domains are broken down into overlapping subregions in such a way that the resultant subregions either exercise or deviate from the path. To this aim, an incremental method is applied to detect the subregions, covering the longest subpaths from the start of the given path. The detected subdomain is further subdivided, and this process is repeated as far as the path is fully covered. If no subdomain is detected, the method is backtracked. The backtrack begins with the subdomain covering the longest subpath at the beginning of the given path, but this time the subdomain is divided into relatively smaller subregions, compared with the last time. A directed acyclic graph representation of each input variable domain is used to ignore re-examination of those subdomains which deviate from the path. Conducted experiments reveal that our proposed domain-oriented algorithm outperforms the existing path-oriented test data generation algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hermadi, I., Lokan, C., Sarker, R.: Dynamic stopping criteria for search-based test data generation for path testing. Inf. Softw. Technol. 56(4), 395–407 (2014)CrossRef Hermadi, I., Lokan, C., Sarker, R.: Dynamic stopping criteria for search-based test data generation for path testing. Inf. Softw. Technol. 56(4), 395–407 (2014)CrossRef
2.
Zurück zum Zitat Alshahwan, N., Harman, M.: Coverage and fault detection of the output-uniqueness test selection criteria. In: Proceedings of the 2014 International Symposium on Software Testing and Analysis. ACM (2014) Alshahwan, N., Harman, M.: Coverage and fault detection of the output-uniqueness test selection criteria. In: Proceedings of the 2014 International Symposium on Software Testing and Analysis. ACM (2014)
3.
Zurück zum Zitat Varshney, S., Mehrotra, M.: A differential evolution based approach to generate test data for data-flow coverage. In: Computing, Communication and Automation (ICCCA), 2016 International Conference on. IEEE (2016) Varshney, S., Mehrotra, M.: A differential evolution based approach to generate test data for data-flow coverage. In: Computing, Communication and Automation (ICCCA), 2016 International Conference on. IEEE (2016)
4.
Zurück zum Zitat Feyzi, F., Parsa, S.: Incorporating static fault-proneness analysis into statistical fault localization. J. Syst. Softw. 136, 39–58 (2018)CrossRef Feyzi, F., Parsa, S.: Incorporating static fault-proneness analysis into statistical fault localization. J. Syst. Softw. 136, 39–58 (2018)CrossRef
7.
Zurück zum Zitat Offutt, A.J., Jin, Z., Pan, J.: The dynamic domain reduction procedure for test data generation. Softw. Pract. Exp. 29(2), 167–93 (1999)CrossRef Offutt, A.J., Jin, Z., Pan, J.: The dynamic domain reduction procedure for test data generation. Softw. Pract. Exp. 29(2), 167–93 (1999)CrossRef
8.
Zurück zum Zitat Baldoni, R., Coppa, E., D’Elia, D.C., Demetrescu, C., Finocchi, I.: A survey of symbolic execution techniques. ArXiv preprint arXiv:1610.00502 (2016) Baldoni, R., Coppa, E., D’Elia, D.C., Demetrescu, C., Finocchi, I.: A survey of symbolic execution techniques. ArXiv preprint arXiv:​1610.​00502 (2016)
9.
Zurück zum Zitat Gotlieb, A., Petit, M.: Constraint reasoning in path-oriented random testing. In: Computer Software and Applications, 2008. COMPSAC’08. 32nd Annual IEEE International. IEEE (2008) Gotlieb, A., Petit, M.: Constraint reasoning in path-oriented random testing. In: Computer Software and Applications, 2008. COMPSAC’08. 32nd Annual IEEE International. IEEE (2008)
10.
Zurück zum Zitat Gotlieb, A., Petit, M.: Path-oriented random testing. In: Proceedings of the 1st International Workshop on Random Testing. ACM (2006) Gotlieb, A., Petit, M.: Path-oriented random testing. In: Proceedings of the 1st International Workshop on Random Testing. ACM (2006)
11.
Zurück zum Zitat Gotlieb, A., Petit, M.: A uniform random test data generator for path testing. J. Syst. Softw. 83(12), 2618–2626 (2010)CrossRef Gotlieb, A., Petit, M.: A uniform random test data generator for path testing. J. Syst. Softw. 83(12), 2618–2626 (2010)CrossRef
12.
Zurück zum Zitat Stapleton, G.: A survey of reasoning systems based on Euler diagrams. Electron. Notes Theor. Comput. Sci. 134, 127–151 (2005)CrossRefMATH Stapleton, G.: A survey of reasoning systems based on Euler diagrams. Electron. Notes Theor. Comput. Sci. 134, 127–151 (2005)CrossRefMATH
13.
Zurück zum Zitat Chow, S., Ruskey, F.: Drawing area-proportional Venn and Euler diagrams. In: International Symposium on Graph Drawing, vol. 2912 (2003) Chow, S., Ruskey, F.: Drawing area-proportional Venn and Euler diagrams. In: International Symposium on Graph Drawing, vol. 2912 (2003)
14.
Zurück zum Zitat Swoboda, N., Allwein, G.: Using DAG transformations to verify Euler/Venn homogeneous and Euler/Venn FOL heterogeneous rules of inference. Softw. Syst. Model 3(2), 136–149 (2004)CrossRef Swoboda, N., Allwein, G.: Using DAG transformations to verify Euler/Venn homogeneous and Euler/Venn FOL heterogeneous rules of inference. Softw. Syst. Model 3(2), 136–149 (2004)CrossRef
15.
Zurück zum Zitat Swoboda, N.: Implementing Euler/Venn reasoning systems. In: Diagrammatic Representation and Reasoning, pp. 371–386. Springer, London (2002) Swoboda, N.: Implementing Euler/Venn reasoning systems. In: Diagrammatic Representation and Reasoning, pp. 371–386. Springer, London (2002)
16.
Zurück zum Zitat Su, T., et al.: A survey on data-flow testing. ACM Comput. Surv. (CSUR) 50(1), 5 (2017)CrossRef Su, T., et al.: A survey on data-flow testing. ACM Comput. Surv. (CSUR) 50(1), 5 (2017)CrossRef
17.
Zurück zum Zitat Galeotti, J.P., Fraser, G., Arcuri, A.: Improving search-based test suite generation with dynamic symbolic execution. In: Software Reliability Engineering (ISSRE), 2013 IEEE 24th International Symposium on. IEEE (2013) Galeotti, J.P., Fraser, G., Arcuri, A.: Improving search-based test suite generation with dynamic symbolic execution. In: Software Reliability Engineering (ISSRE), 2013 IEEE 24th International Symposium on. IEEE (2013)
18.
Zurück zum Zitat Zhang, Z., et al.: An empirical study on constraint optimization techniques for test generation. Sci. China Inf. Sci. 60(1), 012105 (2017)CrossRef Zhang, Z., et al.: An empirical study on constraint optimization techniques for test generation. Sci. China Inf. Sci. 60(1), 012105 (2017)CrossRef
19.
Zurück zum Zitat Ali, S., et al.: Improving the performance of OCL constraint solving with novel heuristics for logical operations: a search-based approach. Empir. Softw. Eng. 21(6), 2459–2502 (2016)CrossRef Ali, S., et al.: Improving the performance of OCL constraint solving with novel heuristics for logical operations: a search-based approach. Empir. Softw. Eng. 21(6), 2459–2502 (2016)CrossRef
20.
Zurück zum Zitat Kempka, J., McMinn, P., Sudholt, D.: Design and analysis of different alternating variable searches for search-based software testing. Theor. Comput. Sci. 605, 1–20 (2015)MathSciNetCrossRefMATH Kempka, J., McMinn, P., Sudholt, D.: Design and analysis of different alternating variable searches for search-based software testing. Theor. Comput. Sci. 605, 1–20 (2015)MathSciNetCrossRefMATH
21.
Zurück zum Zitat Korel, B.: Automated software test data generation. IEEE Trans. Softw. Eng. 16(8), 870–879 (1990)CrossRef Korel, B.: Automated software test data generation. IEEE Trans. Softw. Eng. 16(8), 870–879 (1990)CrossRef
22.
Zurück zum Zitat Malhotra, R., et al.: Comparison of search based techniques for automated test data generation. Int. J. Comput. Appl. 95(23), 4–8 (2014) Malhotra, R., et al.: Comparison of search based techniques for automated test data generation. Int. J. Comput. Appl. 95(23), 4–8 (2014)
23.
Zurück zum Zitat Suresh, Y., Rath, S.K.: A genetic algorithm based approach for test data generation in basis path testing. ArXiv preprint arXiv:1401.5165 (2014) Suresh, Y., Rath, S.K.: A genetic algorithm based approach for test data generation in basis path testing. ArXiv preprint arXiv:​1401.​5165 (2014)
24.
Zurück zum Zitat Bueno, P.M.S., Jino, M., Wong, W.E.: Diversity oriented test data generation using metaheuristic search techniques. Inf. Sci. 259, 490–509 (2014)CrossRef Bueno, P.M.S., Jino, M., Wong, W.E.: Diversity oriented test data generation using metaheuristic search techniques. Inf. Sci. 259, 490–509 (2014)CrossRef
25.
Zurück zum Zitat Varshney, S., Mehrotra, M.: Search based software test data generation for structural testing: a perspective. ACM SIGSOFT Softw. Eng. Notes 38(4), 1–6 (2013)CrossRef Varshney, S., Mehrotra, M.: Search based software test data generation for structural testing: a perspective. ACM SIGSOFT Softw. Eng. Notes 38(4), 1–6 (2013)CrossRef
27.
Zurück zum Zitat Nikravan, E., Feyzi, F., Parsa, S.: Enhancing path-oriented test data generation using adaptive random testing techniques. In: Knowledge-Based Engineering and Innovation (KBEI), 2015 2nd International Conference on. IEEE (2015) Nikravan, E., Feyzi, F., Parsa, S.: Enhancing path-oriented test data generation using adaptive random testing techniques. In: Knowledge-Based Engineering and Innovation (KBEI), 2015 2nd International Conference on. IEEE (2015)
28.
Zurück zum Zitat Ferguson, R., Korel, B.: The chaining approach for software test data generation. ACM Trans. Softw. Eng. Methodol. 5(1), 63–86 (1996)CrossRef Ferguson, R., Korel, B.: The chaining approach for software test data generation. ACM Trans. Softw. Eng. Methodol. 5(1), 63–86 (1996)CrossRef
29.
Zurück zum Zitat Korel, B.: Dynamic method for software test data generation. Softw. Test. Verif. Reliab. 2(4), 203–213 (1992)CrossRef Korel, B.: Dynamic method for software test data generation. Softw. Test. Verif. Reliab. 2(4), 203–213 (1992)CrossRef
30.
Zurück zum Zitat Godefroid P., Klarlund N., Sen K.: DART: directed automated random testing. In: ACM Sigplan Notices, vol. 40. No. 6. ACM (2005) Godefroid P., Klarlund N., Sen K.: DART: directed automated random testing. In: ACM Sigplan Notices, vol. 40. No. 6. ACM (2005)
31.
Zurück zum Zitat Sen, K., Marinov, D., Agha, G.: CUTE: a concolic unit testing engine for C. In: ACM SIGSOFT Software Engineering Notes, vol. 30, no. 5. ACM (2005) Sen, K., Marinov, D., Agha, G.: CUTE: a concolic unit testing engine for C. In: ACM SIGSOFT Software Engineering Notes, vol. 30, no. 5. ACM (2005)
32.
Zurück zum Zitat Tillmann, N., De Halleux, J.: Pex–white box test generation for. net. In: Tests and Proofs, pp. 134–153 (2008) Tillmann, N., De Halleux, J.: Pex–white box test generation for. net. In: Tests and Proofs, pp. 134–153 (2008)
33.
Zurück zum Zitat Bottaci, L.: Instrumenting programs with flag variables for test data search by genetic algorithm. In: Proceedings of the 4th Annual Conference on Genetic and Evolutionary Computation. Morgan Kaufmann Publishers Inc. (2002) Bottaci, L.: Instrumenting programs with flag variables for test data search by genetic algorithm. In: Proceedings of the 4th Annual Conference on Genetic and Evolutionary Computation. Morgan Kaufmann Publishers Inc. (2002)
34.
Zurück zum Zitat Harman, M., Jones, B.F.: Search-based software engineering. Inf. Softw. Technol. 43(14), 833–839 (2001)CrossRef Harman, M., Jones, B.F.: Search-based software engineering. Inf. Softw. Technol. 43(14), 833–839 (2001)CrossRef
35.
Zurück zum Zitat Huang, J.C.: Detection of data flow anomaly through program instrumentation. IEEE Trans. Softw. Eng. 5(3), 226–236 (1979)CrossRefMATH Huang, J.C.: Detection of data flow anomaly through program instrumentation. IEEE Trans. Softw. Eng. 5(3), 226–236 (1979)CrossRefMATH
36.
Zurück zum Zitat Fraser, G., Arcuri, A.: Evolutionary generation of whole test suites. In: Quality Software (QSIC), 2011 11th International Conference on. IEEE (2011) Fraser, G., Arcuri, A.: Evolutionary generation of whole test suites. In: Quality Software (QSIC), 2011 11th International Conference on. IEEE (2011)
37.
Zurück zum Zitat Anand, S., P̆as̆areanu, C.S., Visser, W.: JPF-SE: A symbolic execution extension to Java PathFinder. In: Proceedings of the 13th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS’07), pp. 134–138. Springer, Berlin (2007) Anand, S., P̆as̆areanu, C.S., Visser, W.: JPF-SE: A symbolic execution extension to Java PathFinder. In: Proceedings of the 13th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS’07), pp. 134–138. Springer, Berlin (2007)
38.
Zurück zum Zitat Jussien, N., Rochart, G., Lorca, X.: Choco: an open source java constraint programming library. In: CPAIOR’08 Workshop on Open-Source Software for Integer and Contraint Programming (OSSICP’08) (2008) Jussien, N., Rochart, G., Lorca, X.: Choco: an open source java constraint programming library. In: CPAIOR’08 Workshop on Open-Source Software for Integer and Contraint Programming (OSSICP’08) (2008)
39.
Zurück zum Zitat Zhao, R., Lyu, M.R., Min, Y.: Automatic string test data generation for detecting domain errors. Softw. Test. Verif. Reliab. 20(3), 209–236 (2010)CrossRef Zhao, R., Lyu, M.R., Min, Y.: Automatic string test data generation for detecting domain errors. Softw. Test. Verif. Reliab. 20(3), 209–236 (2010)CrossRef
Metadaten
Titel
A reasoning-based approach to dynamic domain reduction in test data generation
verfasst von
Esmaeel Nikravan
Saeed Parsa
Publikationsdatum
08.05.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal on Software Tools for Technology Transfer / Ausgabe 3/2019
Print ISSN: 1433-2779
Elektronische ISSN: 1433-2787
DOI
https://doi.org/10.1007/s10009-018-0493-6

Weitere Artikel der Ausgabe 3/2019

International Journal on Software Tools for Technology Transfer 3/2019 Zur Ausgabe