Skip to main content
Top

2019 | OriginalPaper | Chapter

A Methodology for Generating Tests for Evaluating User-Centric Performance of Mobile Streaming Applications

Authors : Mustafa Al-tekreeti, Kshirasagar Naik, Atef Abdrabou, Marzia Zaman, Pradeep Srivastava

Published in: Model-Driven Engineering and Software Development

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Compared to other platforms, mobile apps’ quality assurance is more challenging, since their functionality is affected by the surrounding environment. In literature, a considerable volume of research has been devoted to develop frameworks that facilitate conducting performance analysis during the development life cycle. However, less attention has been given to test generation and test selection criteria for performance evaluation. In this work, a model based test generation methodology is proposed to evaluate the impact of the interaction of the environment, the wireless network, and the app configurations on the performance of a mobile streaming app and thereby on the experience of the end user. The methodology steps, inputs, and outputs are explained using an app example. The methodology assumes that the app has a network access through a WiFi access point. We evaluate the effectiveness of the methodology by comparing the time cost to design a test suite with random testing. The obtained results are very promising.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Abbors, F., Ahmad, T., Truscan, D., Porres, I.: Model-based performance testing in the cloud using the mbpet tool. In: Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering, pp. 423–424. ACM (2013) Abbors, F., Ahmad, T., Truscan, D., Porres, I.: Model-based performance testing in the cloud using the mbpet tool. In: Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering, pp. 423–424. ACM (2013)
3.
go back to reference Abbors, F., Can, D.T.: Approaching performance testing from a model-based testing perspective. In: 2010 Second International Conference on Advances in System Testing and Validation Lifecycle (VALID), pp. 125–128. IEEE (2010) Abbors, F., Can, D.T.: Approaching performance testing from a model-based testing perspective. In: 2010 Second International Conference on Advances in System Testing and Validation Lifecycle (VALID), pp. 125–128. IEEE (2010)
4.
go back to reference Adan, I., Resing, J.: Queueing Theory. Department of Mathematics and Computing Science, Eindhoven University of Technology, Eindhoven (2001) Adan, I., Resing, J.: Queueing Theory. Department of Mathematics and Computing Science, Eindhoven University of Technology, Eindhoven (2001)
5.
go back to reference Al-tekreeti, M., Naik, K., Abdrabou, A., Zaman, M., Srivastava, P.: Test generation for performance evaluation of mobile multimedia streaming applications. In: Proceedings of the 6th International Conference on Model-Driven Engineering and Software Development, vol. 1, pp. 225–236. SciTePress (2018) Al-tekreeti, M., Naik, K., Abdrabou, A., Zaman, M., Srivastava, P.: Test generation for performance evaluation of mobile multimedia streaming applications. In: Proceedings of the 6th International Conference on Model-Driven Engineering and Software Development, vol. 1, pp. 225–236. SciTePress (2018)
6.
go back to reference Avritzer, A., Kondek, J., Liu, D., Weyuker, E.J.: Software performance testing based on workload characterization. In: Proceedings of the 3rd International Workshop on Software and Performance, pp. 17–24. ACM (2002) Avritzer, A., Kondek, J., Liu, D., Weyuker, E.J.: Software performance testing based on workload characterization. In: Proceedings of the 3rd International Workshop on Software and Performance, pp. 17–24. ACM (2002)
7.
go back to reference Balsamo, S., Marco, A.D., Inverardi, P., Simeoni, M.: Model-based performance prediction in software development: a survey. IEEE Trans. Softw. Eng. 30(5), 295–310 (2004)CrossRef Balsamo, S., Marco, A.D., Inverardi, P., Simeoni, M.: Model-based performance prediction in software development: a survey. IEEE Trans. Softw. Eng. 30(5), 295–310 (2004)CrossRef
8.
go back to reference Balsamo, S., Marzolla, M.: A simulation-based approach to software performance modeling. In: ACM SIGSOFT Software Engineering Notes, vol. 28, pp. 363–366. ACM (2003) Balsamo, S., Marzolla, M.: A simulation-based approach to software performance modeling. In: ACM SIGSOFT Software Engineering Notes, vol. 28, pp. 363–366. ACM (2003)
9.
go back to reference Barna, C., Litoiu, M., Ghanbari, H.: Autonomic load-testing framework. In: Proceedings of the 8th ACM International Conference on Autonomic Computing, pp. 91–100. ACM (2011) Barna, C., Litoiu, M., Ghanbari, H.: Autonomic load-testing framework. In: Proceedings of the 8th ACM International Conference on Autonomic Computing, pp. 91–100. ACM (2011)
10.
go back to reference Barna, C., Litoiu, M., Ghanbari, H.: Model-based performance testing (NIER track). In: Proceedings of the 33rd International Conference on Software Engineering, pp. 872–875. ACM (2011) Barna, C., Litoiu, M., Ghanbari, H.: Model-based performance testing (NIER track). In: Proceedings of the 33rd International Conference on Software Engineering, pp. 872–875. ACM (2011)
11.
go back to reference Briand, L., Nejati, S., Sabetzadeh, M., Bianculli, D.: Testing the untestable: model testing of complex software-intensive systems. In: Proceedings of the 38th International Conference on Software Engineering Companion, pp. 789–792. ACM (2016) Briand, L., Nejati, S., Sabetzadeh, M., Bianculli, D.: Testing the untestable: model testing of complex software-intensive systems. In: Proceedings of the 38th International Conference on Software Engineering Companion, pp. 789–792. ACM (2016)
12.
go back to reference Brosig, F., Meier, P., Becker, S., et al.: Quantitative evaluation of model-driven performance analysis and simulation of component-based architectures. IEEE Trans. Softw. Eng. 41(2), 157–175 (2015)CrossRef Brosig, F., Meier, P., Becker, S., et al.: Quantitative evaluation of model-driven performance analysis and simulation of component-based architectures. IEEE Trans. Softw. Eng. 41(2), 157–175 (2015)CrossRef
13.
go back to reference Canfora, G., Mercaldo, F., Visaggio, C.A., DAngelo, M., Furno, A., Manganelli, C.: A case study of automating user experience-oriented performance testing on smartphones. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation, pp. 66–69. IEEE (2013) Canfora, G., Mercaldo, F., Visaggio, C.A., DAngelo, M., Furno, A., Manganelli, C.: A case study of automating user experience-oriented performance testing on smartphones. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation, pp. 66–69. IEEE (2013)
14.
go back to reference Charnes, J.M.: Analyzing multivariate output. In: Proceedings of the 27th Conference on Winter Simulation, pp. 201–208. IEEE Computer Society (1995) Charnes, J.M.: Analyzing multivariate output. In: Proceedings of the 27th Conference on Winter Simulation, pp. 201–208. IEEE Computer Society (1995)
16.
go back to reference Costa, L.T., Czekster, R.M., de Oliveira, F.M., Rodrigues, E.d.M., da Silveira, M.B., Zorzo, A.F.: Generating performance test scripts and scenarios based on abstract intermediate models. In: SEKE, pp. 112–117 (2012) Costa, L.T., Czekster, R.M., de Oliveira, F.M., Rodrigues, E.d.M., da Silveira, M.B., Zorzo, A.F.: Generating performance test scripts and scenarios based on abstract intermediate models. In: SEKE, pp. 112–117 (2012)
17.
go back to reference Cox, D.R.: The analysis of non-Markovian stochastic processes by the inclusion of supplementary variables. In: Mathematical Proceedings of the Cambridge Philosophical Society, vol. 51, pp. 433–441. Cambridge University Press (1955) Cox, D.R.: The analysis of non-Markovian stochastic processes by the inclusion of supplementary variables. In: Mathematical Proceedings of the Cambridge Philosophical Society, vol. 51, pp. 433–441. Cambridge University Press (1955)
18.
go back to reference Cox, D.R., Miller, H.D.: The Theory of Stochastic Processes. CRC Press, Boca Raton (1977)MATH Cox, D.R., Miller, H.D.: The Theory of Stochastic Processes. CRC Press, Boca Raton (1977)MATH
19.
go back to reference Da Silveira, M.B., Rodrigues, E.d.M., Zorzo, A.F., Costa, L.T., Vieira, H.V., De Oliveira, F.M.: Generation of scripts for performance testing based on UML models. In: SEKE, pp. 258–263 (2011) Da Silveira, M.B., Rodrigues, E.d.M., Zorzo, A.F., Costa, L.T., Vieira, H.V., De Oliveira, F.M.: Generation of scripts for performance testing based on UML models. In: SEKE, pp. 258–263 (2011)
20.
go back to reference Dantas, V.L.L., Marinho, F.G., da Costa, A.L., Andrade, R.M.: Testing requirements for mobile applications. In: 24th International Symposium on Computer and Information Sciences, ISCIS 2009, pp. 555–560. IEEE (2009) Dantas, V.L.L., Marinho, F.G., da Costa, A.L., Andrade, R.M.: Testing requirements for mobile applications. In: 24th International Symposium on Computer and Information Sciences, ISCIS 2009, pp. 555–560. IEEE (2009)
21.
go back to reference Di Penta, M., Canfora, G., Esposito, G., Mazza, V., Bruno, M.: Search-based testing of service level agreements. In: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, pp. 1090–1097. ACM (2007) Di Penta, M., Canfora, G., Esposito, G., Mazza, V., Bruno, M.: Search-based testing of service level agreements. In: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, pp. 1090–1097. ACM (2007)
22.
go back to reference Diaz, A., Merino, P., Rivas, F.J.: Mobile application profiling for connected mobile devices. IEEE Pervasive Comput. 9(1), 54–61 (2010)CrossRef Diaz, A., Merino, P., Rivas, F.J.: Mobile application profiling for connected mobile devices. IEEE Pervasive Comput. 9(1), 54–61 (2010)CrossRef
24.
go back to reference Fiedler, M., Hossfeld, T., Tran-Gia, P.: A generic quantitative relationship between quality of experience and quality of service. IEEE Netw. 24(2), 36–41 (2010)CrossRef Fiedler, M., Hossfeld, T., Tran-Gia, P.: A generic quantitative relationship between quality of experience and quality of service. IEEE Netw. 24(2), 36–41 (2010)CrossRef
25.
go back to reference German, R.: Performance Analysis of Communication Systems with Non-Markovian Stochastic Petri Nets. Wiley, Hoboken (2000)MATH German, R.: Performance Analysis of Communication Systems with Non-Markovian Stochastic Petri Nets. Wiley, Hoboken (2000)MATH
26.
go back to reference Gias, A.U., Sakib, K.: An adaptive Bayesian approach for URL selection to test performance of large scale web-based systems. In: Companion Proceedings of the 36th International Conference on Software Engineering, pp. 608–609. ACM (2014) Gias, A.U., Sakib, K.: An adaptive Bayesian approach for URL selection to test performance of large scale web-based systems. In: Companion Proceedings of the 36th International Conference on Software Engineering, pp. 608–609. ACM (2014)
28.
go back to reference Grechanik, M., Fu, C., Xie, Q.: Automatically finding performance problems with feedback-directed learning software testing. In: 2012 34th International Conference on Software Engineering (ICSE), pp. 156–166. IEEE (2012) Grechanik, M., Fu, C., Xie, Q.: Automatically finding performance problems with feedback-directed learning software testing. In: 2012 34th International Conference on Software Engineering (ICSE), pp. 156–166. IEEE (2012)
29.
go back to reference Grindal, M., Offutt, J., Andler, S.F.: Combination testing strategies: a survey. Softw. Test. Verif. Reliab. 15(3), 167–199 (2005)CrossRef Grindal, M., Offutt, J., Andler, S.F.: Combination testing strategies: a survey. Softw. Test. Verif. Reliab. 15(3), 167–199 (2005)CrossRef
30.
go back to reference Gu, Y., Ge, Y.: Search-based performance testing of applications with composite services. In: International Conference on Web Information Systems and Mining, WISM 2009, pp. 320–324. IEEE (2009) Gu, Y., Ge, Y.: Search-based performance testing of applications with composite services. In: International Conference on Web Information Systems and Mining, WISM 2009, pp. 320–324. IEEE (2009)
31.
go back to reference Guderlei, R., Mayer, J.: Statistical metamorphic testing: testing programs with random output by means of statistical hypothesis tests and metamorphic testing. In: 7th International Conference on Quality Software (QSIC), pp. 404–409. IEEE (2007) Guderlei, R., Mayer, J.: Statistical metamorphic testing: testing programs with random output by means of statistical hypothesis tests and metamorphic testing. In: 7th International Conference on Quality Software (QSIC), pp. 404–409. IEEE (2007)
32.
go back to reference Guderlei, R., Mayer, J., Schneckenburger, C., Fleischer, F.: Testing randomized software by means of statistical hypothesis tests. In: Fourth International Workshop on Software Quality Assurance: in Conjunction with the 6th ESEC/FSE Joint Meeting, pp. 46–54. ACM (2007) Guderlei, R., Mayer, J., Schneckenburger, C., Fleischer, F.: Testing randomized software by means of statistical hypothesis tests. In: Fourth International Workshop on Software Quality Assurance: in Conjunction with the 6th ESEC/FSE Joint Meeting, pp. 46–54. ACM (2007)
33.
go back to reference Ivanovici, M., Beuran, R.: Correlating quality of experience and quality of service for network applications, chap. 15. In: Adibi, S. (ed.) Quality of Service Architectures for Wireless Networks: Performance Metrics and Management, pp. 326–351. IGI Global, Hershey (2010)CrossRef Ivanovici, M., Beuran, R.: Correlating quality of experience and quality of service for network applications, chap. 15. In: Adibi, S. (ed.) Quality of Service Architectures for Wireless Networks: Performance Metrics and Management, pp. 326–351. IGI Global, Hershey (2010)CrossRef
34.
go back to reference Jiang, Z., Hassan, A.: A survey on load testing of large-scale software systems. IEEE Trans. Softw. Eng. 41(11), 1091–1118 (2015)CrossRef Jiang, Z., Hassan, A.: A survey on load testing of large-scale software systems. IEEE Trans. Softw. Eng. 41(11), 1091–1118 (2015)CrossRef
35.
go back to reference Joorabchi, M.E., Mesbah, A., Kruchten, P.: Real challenges in mobile app development. In: 2013 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, pp. 15–24. IEEE (2013) Joorabchi, M.E., Mesbah, A., Kruchten, P.: Real challenges in mobile app development. In: 2013 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, pp. 15–24. IEEE (2013)
36.
go back to reference Kim, Y., Choi, O., Kim, M., Baik, J., Kim, T.H.: Validating software reliability early through statistical model checking. IEEE Softw. 30(3), 35–41 (2013)CrossRef Kim, Y., Choi, O., Kim, M., Baik, J., Kim, T.H.: Validating software reliability early through statistical model checking. IEEE Softw. 30(3), 35–41 (2013)CrossRef
37.
go back to reference Koziolek, H.: Performance evaluation of component-based software systems: a survey. Perform. Eval. 67(8), 634–658 (2010)CrossRef Koziolek, H.: Performance evaluation of component-based software systems: a survey. Perform. Eval. 67(8), 634–658 (2010)CrossRef
38.
go back to reference Kumar, R., Tomkins, A., Vassilvitskii, S., Vee, E.: Inverting a steady-state. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp. 359–368. ACM (2015) Kumar, R., Tomkins, A., Vassilvitskii, S., Vee, E.: Inverting a steady-state. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp. 359–368. ACM (2015)
39.
go back to reference Law, A.M.: Simulation Modeling and Analysis, 5th edn. McGraw-Hill, New York (2015) Law, A.M.: Simulation Modeling and Analysis, 5th edn. McGraw-Hill, New York (2015)
40.
go back to reference Li, M., Claypool, M., Kinicki, R.: Playout buffer and rate optimization for streaming over IEEE 802.11 wireless networks. ACM Trans. Multimed. Comput. Commun. Appl. (TOMM) 5(3), 26 (2009) Li, M., Claypool, M., Kinicki, R.: Playout buffer and rate optimization for streaming over IEEE 802.11 wireless networks. ACM Trans. Multimed. Comput. Commun. Appl. (TOMM) 5(3), 26 (2009)
41.
go back to reference Liu, Y., Xu, C., Cheung, S.C.: Diagnosing energy efficiency and performance for mobile internetware applications. IEEE Softw. 32(1), 67–75 (2015)CrossRef Liu, Y., Xu, C., Cheung, S.C.: Diagnosing energy efficiency and performance for mobile internetware applications. IEEE Softw. 32(1), 67–75 (2015)CrossRef
42.
go back to reference Ma, K.J., Bartos, R., Bhatia, S., Nair, R.: Mobile video delivery with HTTP. IEEE Commun. Mag. 49(4), 166–175 (2011)CrossRef Ma, K.J., Bartos, R., Bhatia, S., Nair, R.: Mobile video delivery with HTTP. IEEE Commun. Mag. 49(4), 166–175 (2011)CrossRef
43.
go back to reference Matinnejad, R., Nejati, S., Briand, L.C., Bruckmann, T.: Automated test suite generation for time-continuous Simulink models. In: Proceedings of the 38th International Conference on Software Engineering, pp. 595–606. ACM (2016) Matinnejad, R., Nejati, S., Briand, L.C., Bruckmann, T.: Automated test suite generation for time-continuous Simulink models. In: Proceedings of the 38th International Conference on Software Engineering, pp. 595–606. ACM (2016)
44.
go back to reference Mok, R.K., Chan, E.W., Chang, R.K.: Measuring the quality of experience of HTTP video streaming. In: 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops, pp. 485–492. IEEE (2011) Mok, R.K., Chan, E.W., Chang, R.K.: Measuring the quality of experience of HTTP video streaming. In: 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops, pp. 485–492. IEEE (2011)
45.
go back to reference Nayebi, F., Desharnais, J.M., Abran, A.: The state of the art of mobile application usability evaluation. In: CCECE, pp. 1–4 (2012) Nayebi, F., Desharnais, J.M., Abran, A.: The state of the art of mobile application usability evaluation. In: CCECE, pp. 1–4 (2012)
46.
go back to reference Nie, C., Leung, H.: A survey of combinatorial testing. ACM Comput. Surv. (CSUR) 43(2), 11 (2011)CrossRef Nie, C., Leung, H.: A survey of combinatorial testing. ACM Comput. Surv. (CSUR) 43(2), 11 (2011)CrossRef
47.
go back to reference Prowell, S.J.: Using Markov chain usage models to test complex systems. In: Proceedings of the 38th Annual Hawaii International Conference on System Sciences, HICSS 2005, p. 318c. IEEE (2005) Prowell, S.J.: Using Markov chain usage models to test complex systems. In: Proceedings of the 38th Annual Hawaii International Conference on System Sciences, HICSS 2005, p. 318c. IEEE (2005)
48.
go back to reference Rios, L.M., Sahinidis, N.V.: Derivative-free optimization: a review of algorithms and comparison of software implementations. J. Glob. Optim. 56(3), 1247–1293 (2013)MathSciNetCrossRef Rios, L.M., Sahinidis, N.V.: Derivative-free optimization: a review of algorithms and comparison of software implementations. J. Glob. Optim. 56(3), 1247–1293 (2013)MathSciNetCrossRef
49.
go back to reference Satoh, I.: Software testing for wireless mobile computing. IEEE Wirel. Commun. 11(5), 58–64 (2004)CrossRef Satoh, I.: Software testing for wireless mobile computing. IEEE Wirel. Commun. 11(5), 58–64 (2004)CrossRef
50.
go back to reference Sebih, N., Weitl, F., Artho, C., Hagiya, M., Tanabe, Y., Yamamoto, M.: Software model checking of UDP-based distributed applications. In: 2014 Second International Symposium on Computing and Networking, pp. 96–105. IEEE (2014) Sebih, N., Weitl, F., Artho, C., Hagiya, M., Tanabe, Y., Yamamoto, M.: Software model checking of UDP-based distributed applications. In: 2014 Second International Symposium on Computing and Networking, pp. 96–105. IEEE (2014)
51.
go back to reference Siavashi, F., Truscan, D.: Environment modeling in model-based testing: concepts, prospects and research challenges: a systematic literature review. In: Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering, p. 30. ACM (2015) Siavashi, F., Truscan, D.: Environment modeling in model-based testing: concepts, prospects and research challenges: a systematic literature review. In: Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering, p. 30. ACM (2015)
52.
go back to reference Utting, M., Pretschner, A., Legeard, B.: A taxonomy of model-based testing approaches. Softw. Test. Verif. Reliab. 22(5), 297–312 (2012)CrossRef Utting, M., Pretschner, A., Legeard, B.: A taxonomy of model-based testing approaches. Softw. Test. Verif. Reliab. 22(5), 297–312 (2012)CrossRef
53.
go back to reference Walls, R.J., Brun, Y., Liberatore, M., Levine, B.N.: Discovering specification violations in networked software systems. In: 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE), pp. 496–506. IEEE (2015) Walls, R.J., Brun, Y., Liberatore, M., Levine, B.N.: Discovering specification violations in networked software systems. In: 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE), pp. 496–506. IEEE (2015)
54.
go back to reference Walton, G.H., Poore, J.H.: Generating transition probabilities to support model-based software testing. Softw.: Pract. Exp 30(10), 1095–1106 (2000) Walton, G.H., Poore, J.H.: Generating transition probabilities to support model-based software testing. Softw.: Pract. Exp 30(10), 1095–1106 (2000)
55.
go back to reference Weyuker, E.J., Vokolos, F.I.: Experience with performance testing of software systems: issues, an approach, and case study. IEEE Trans. Softw. Eng. 12, 1147–1156 (2000)CrossRef Weyuker, E.J., Vokolos, F.I.: Experience with performance testing of software systems: issues, an approach, and case study. IEEE Trans. Softw. Eng. 12, 1147–1156 (2000)CrossRef
56.
go back to reference Xu, Q., Mehrotra, S., Mao, Z., Li, J.: PROTEUS: network performance forecast for real-time, interactive mobile applications. In: Proceedings of the 11th Annual International Conference on Mobile Systems, Applications, and Services, pp. 347–360. ACM (2013) Xu, Q., Mehrotra, S., Mao, Z., Li, J.: PROTEUS: network performance forecast for real-time, interactive mobile applications. In: Proceedings of the 11th Annual International Conference on Mobile Systems, Applications, and Services, pp. 347–360. ACM (2013)
57.
go back to reference Yang, C.S.D., Pollock, L.L.: Towards a structural load testing tool. In: ACM SIGSOFT Software Engineering Notes, vol. 21, pp. 201–208. ACM (1996) Yang, C.S.D., Pollock, L.L.: Towards a structural load testing tool. In: ACM SIGSOFT Software Engineering Notes, vol. 21, pp. 201–208. ACM (1996)
58.
go back to reference Yılmaz, C., Fouche, S., Cohen, M.B., Porter, A., Demiröz, G., Koç, U.: Moving forward with combinatorial interaction testing. Computer 47(2), 37–45 (2014)CrossRef Yılmaz, C., Fouche, S., Cohen, M.B., Porter, A., Demiröz, G., Koç, U.: Moving forward with combinatorial interaction testing. Computer 47(2), 37–45 (2014)CrossRef
59.
go back to reference Zhang, J., Cheung, S.C.: Automated test case generation for the stress testing of multimedia systems. Softw.: Pract. Exp. 32(15), 1411–1435 (2002)MATH Zhang, J., Cheung, S.C.: Automated test case generation for the stress testing of multimedia systems. Softw.: Pract. Exp. 32(15), 1411–1435 (2002)MATH
60.
go back to reference Zhang, J., Cheung, S.C., Chanson, S.T.: Stress testing of distributed multimedia software systems. In: Proceedings of the IFIP TC6 WG6.1 Joint International Conference on Formal Description Techniques for Distributed Systems and Communication Protocols and Protocol Specification, Testing and Verification, pp. 119–133. Kluwer, BV (1999) Zhang, J., Cheung, S.C., Chanson, S.T.: Stress testing of distributed multimedia software systems. In: Proceedings of the IFIP TC6 WG6.1 Joint International Conference on Formal Description Techniques for Distributed Systems and Communication Protocols and Protocol Specification, Testing and Verification, pp. 119–133. Kluwer, BV (1999)
61.
go back to reference Zhang, P., Elbaum, S., Dwyer, M.B.: Automatic generation of load tests. In: Proceedings of the 2011 26th IEEE/ACM International Conference on Automated Software Engineering, pp. 43–52. IEEE Computer Society (2011) Zhang, P., Elbaum, S., Dwyer, M.B.: Automatic generation of load tests. In: Proceedings of the 2011 26th IEEE/ACM International Conference on Automated Software Engineering, pp. 43–52. IEEE Computer Society (2011)
62.
go back to reference Zhang, P., Elbaum, S., Dwyer, M.B.: Compositional load test generation for software pipelines. In: Proceedings of the 2012 International Symposium on Software Testing and Analysis, pp. 89–99. ACM (2012) Zhang, P., Elbaum, S., Dwyer, M.B.: Compositional load test generation for software pipelines. In: Proceedings of the 2012 International Symposium on Software Testing and Analysis, pp. 89–99. ACM (2012)
Metadata
Title
A Methodology for Generating Tests for Evaluating User-Centric Performance of Mobile Streaming Applications
Authors
Mustafa Al-tekreeti
Kshirasagar Naik
Atef Abdrabou
Marzia Zaman
Pradeep Srivastava
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-11030-7_18

Premium Partner