Skip to main content
Top

2018 | OriginalPaper | Chapter

Search-Based Stress Testing the Elastic Resource Provisioning for Cloud-Based Applications

Authors : Abdullah Alourani, Md. Abu Naser Bikas, Mark Grechanik

Published in: Search-Based Software Engineering

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

One of the main benefits of cloud computing is to enable customers to deploy their applications on a cloud infrastructure that provisions resources (e.g., memory) to these applications on as-needed basis. Unfortunately, certain workloads can cause customers to pay for resources that are provisioned to, but not fully used by their applications, and as a result their performances then deteriorate beyond some acceptable thresholds and the benefits of cloud computing may be significantly reduced or even completely obliterated. We propose a novel approach to automatically discover these workloads to stress test elastic resource provisioning for cloud-based applications. We experimented with four non-trivial applications on the Microsoft Azure cloud to determine how effectively and efficiently our approach explores a very large space of the workload parameters’ values. The results show that our approach discovers the first irregular workload faster in the search space of over \(10^{40}\) input combinations compared to the random approach, and it discovers more irregular workloads that result in much higher costs and performance degradations for applications in the cloud.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Albonico, M., Mottu, J.M., Sunyé, G.: Controlling the elasticity of web applications on cloud computing. In: Proceedings of the 31st Annual ACM Symposium on Applied Computing, SAC 2016, pp. 816–819. ACM, New York (2016) Albonico, M., Mottu, J.M., Sunyé, G.: Controlling the elasticity of web applications on cloud computing. In: Proceedings of the 31st Annual ACM Symposium on Applied Computing, SAC 2016, pp. 816–819. ACM, New York (2016)
4.
go back to reference Beizer, B.: Software Testing Techniques. Dreamtech Press, New Delhi (2003)MATH Beizer, B.: Software Testing Techniques. Dreamtech Press, New Delhi (2003)MATH
6.
go back to reference Bodik, P., Fox, A., Franklin, M.J., Jordan, M.I., Patterson, D.A.: Characterizing, modeling, and generating workload spikes for stateful services. In: Proceedings of the 1st ACM Symposium on Cloud Computing, pp. 241–252. ACM (2010) Bodik, P., Fox, A., Franklin, M.J., Jordan, M.I., Patterson, D.A.: Characterizing, modeling, and generating workload spikes for stateful services. In: Proceedings of the 1st ACM Symposium on Cloud Computing, pp. 241–252. ACM (2010)
7.
go back to reference Chen, F., Grundy, J., Schneider, J.G., Yang, Y., He, Q.: StressCloud: a tool for analysing performance and energy consumption of cloud applications. In: Proceedings of the 37th International Conference on Software Engineering, vol. 2, pp. 721–724. IEEE Press (2015) Chen, F., Grundy, J., Schneider, J.G., Yang, Y., He, Q.: StressCloud: a tool for analysing performance and energy consumption of cloud applications. In: Proceedings of the 37th International Conference on Software Engineering, vol. 2, pp. 721–724. IEEE Press (2015)
9.
go back to reference Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. Trans. Evol. Comput. 6(2), 182–197 (2002)CrossRef Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. Trans. Evol. Comput. 6(2), 182–197 (2002)CrossRef
10.
go back to reference DeCandia, G., et al.: Dynamo: Amazon’s highly available key-value store. In: ACM SIGOPS Operating Systems Review, vol. 41, pp. 205–220. ACM (2007) DeCandia, G., et al.: Dynamo: Amazon’s highly available key-value store. In: ACM SIGOPS Operating Systems Review, vol. 41, pp. 205–220. ACM (2007)
11.
go back to reference Durillo, J.J., Nebro, A.J.: jMetal: a Java framework for multi-objective optimization. Adv. Eng. Softw. 42(10), 760–771 (2011)CrossRef Durillo, J.J., Nebro, A.J.: jMetal: a Java framework for multi-objective optimization. Adv. Eng. Softw. 42(10), 760–771 (2011)CrossRef
12.
go back to reference Gambi, A., Hummer, W., Dustdar, S.: Automated testing of cloud-based elastic systems with AUToCLES. In: 2013 IEEE/ACM 28th International Conference on Automated Software Engineering, ASE, pp. 714–717. IEEE (2013) Gambi, A., Hummer, W., Dustdar, S.: Automated testing of cloud-based elastic systems with AUToCLES. In: 2013 IEEE/ACM 28th International Conference on Automated Software Engineering, ASE, pp. 714–717. IEEE (2013)
14.
go back to reference Grechanik, M., Luo, Q., Poshyvanyk, D., Porter, A.: Enhancing rules for cloud resource provisioning via learned software performance models. In: Proceedings of the 7th ACM/SPEC International Conference on Performance Engineering, ICPE 2016, Delft, The Netherlands, 12–16 March 2016, pp. 209–214 (2016). https://doi.org/10.1145/2851553.2851568 Grechanik, M., Luo, Q., Poshyvanyk, D., Porter, A.: Enhancing rules for cloud resource provisioning via learned software performance models. In: Proceedings of the 7th ACM/SPEC International Conference on Performance Engineering, ICPE 2016, Delft, The Netherlands, 12–16 March 2016, pp. 209–214 (2016). https://​doi.​org/​10.​1145/​2851553.​2851568
15.
go back to reference Halili, E.: Apache JMeter. Packt Publishing, Birmingham (2008) Halili, E.: Apache JMeter. Packt Publishing, Birmingham (2008)
16.
go back to reference Herbst, N.R., Kounev, S., Reussner, R.: Elasticity in cloud computing: what it is, and what it is not. In: Proceedings of the 10th International Conference on Autonomic Computing, ICAC 2013, pp. 23–27. USENIX, San Jose (2013) Herbst, N.R., Kounev, S., Reussner, R.: Elasticity in cloud computing: what it is, and what it is not. In: Proceedings of the 10th International Conference on Autonomic Computing, ICAC 2013, pp. 23–27. USENIX, San Jose (2013)
17.
go back to reference Holland, J.H.: Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. U Michigan Press, Ann Arbor (1975)MATH Holland, J.H.: Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. U Michigan Press, Ann Arbor (1975)MATH
18.
go back to reference Islam, S., Lee, K., Fekete, A., Liu, A.: How a consumer can measure elasticity for cloud platforms. In: Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering, ICPE 2012, pp. 85–96. ACM, New York (2012) Islam, S., Lee, K., Fekete, A., Liu, A.: How a consumer can measure elasticity for cloud platforms. In: Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering, ICPE 2012, pp. 85–96. ACM, New York (2012)
19.
go back to reference Lientz, B.P., Swanson, E.B.: Software Maintenance Management. Addison-Wesley, Boston (1980) Lientz, B.P., Swanson, E.B.: Software Maintenance Management. Addison-Wesley, Boston (1980)
20.
go back to reference Liu, Z., Cho, S.: Characterizing machines and workloads on a Google cluster. In: Proceedings of the 2012 41st International Conference on Parallel Processing Workshops, ICPPW 2012, pp. 397–403. IEEE Computer Society, Washington (2012) Liu, Z., Cho, S.: Characterizing machines and workloads on a Google cluster. In: Proceedings of the 2012 41st International Conference on Parallel Processing Workshops, ICPPW 2012, pp. 397–403. IEEE Computer Society, Washington (2012)
21.
go back to reference Mao, M., Humphrey, M.: A performance study on the VM startup time in the cloud. In: Proceedings of the 2012 IEEE Fifth International Conference on Cloud Computing, CLOUD 2012, pp. 423–430. IEEE Computer Society, Washington (2012) Mao, M., Humphrey, M.: A performance study on the VM startup time in the cloud. In: Proceedings of the 2012 IEEE Fifth International Conference on Cloud Computing, CLOUD 2012, pp. 423–430. IEEE Computer Society, Washington (2012)
22.
go back to reference Mendelson, H.: Economies of scale in computing: Grosch’s law revisited. Commun. ACM 30(12), 1066–1072 (1987)CrossRef Mendelson, H.: Economies of scale in computing: Grosch’s law revisited. Commun. ACM 30(12), 1066–1072 (1987)CrossRef
23.
go back to reference Mian, R., Martin, P., Zulkernine, F., Vazquez-Poletti, J.L.: Towards building performance models for data-intensive workloads in public clouds. In: Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering, ICPE 2013, pp. 259–270. ACM, New York (2013) Mian, R., Martin, P., Zulkernine, F., Vazquez-Poletti, J.L.: Towards building performance models for data-intensive workloads in public clouds. In: Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering, ICPE 2013, pp. 259–270. ACM, New York (2013)
25.
go back to reference Perez-Palacin, D., Mirandola, R., Scoppetta, M.: Simulation of techniques to improve the utilization of cloud elasticity in workload-aware adaptive software. In: Companion Publication for ACM/SPEC on International Conference on Performance Engineering, ICPE 2016 Companion, pp. 51–56. ACM, New York (2016) Perez-Palacin, D., Mirandola, R., Scoppetta, M.: Simulation of techniques to improve the utilization of cloud elasticity in workload-aware adaptive software. In: Companion Publication for ACM/SPEC on International Conference on Performance Engineering, ICPE 2016 Companion, pp. 51–56. ACM, New York (2016)
27.
go back to reference Shen, D., Luo, Q., Poshyvanyk, D., Grechanik, M.: Automating performance bottleneck detection using search-based application profiling. In: Proceedings of the 2015 International Symposium on Software Testing and Analysis, pp. 270–281. ACM (2015) Shen, D., Luo, Q., Poshyvanyk, D., Grechanik, M.: Automating performance bottleneck detection using search-based application profiling. In: Proceedings of the 2015 International Symposium on Software Testing and Analysis, pp. 270–281. ACM (2015)
28.
go back to reference Snellman, N., Ashraf, A., Porres, I.: Towards automatic performance and scalability testing of rich internet applications in the cloud. In: SEAA 2011, pp. 161–169. IEEE (2011) Snellman, N., Ashraf, A., Porres, I.: Towards automatic performance and scalability testing of rich internet applications in the cloud. In: SEAA 2011, pp. 161–169. IEEE (2011)
30.
go back to reference Xiao, X., Han, S., Zhang, D., Xie, T.: Context-sensitive delta inference for identifying workload-dependent performance bottlenecks. In: ISSTA 2013, pp. 90–100 (2013) Xiao, X., Han, S., Zhang, D., Xie, T.: Context-sensitive delta inference for identifying workload-dependent performance bottlenecks. In: ISSTA 2013, pp. 90–100 (2013)
Metadata
Title
Search-Based Stress Testing the Elastic Resource Provisioning for Cloud-Based Applications
Authors
Abdullah Alourani
Md. Abu Naser Bikas
Mark Grechanik
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-99241-9_7

Premium Partner