Skip to main content
Top

2018 | OriginalPaper | Chapter

A Survey of Machine Learning-Based Resource Scheduling Algorithms in Cloud Computing Environment

Authors : Qi Liu, YingHang Jiang

Published in: Cloud Computing and Security

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

As a new type of computing resource, cloud computing attracts more and more users because it is convenient and quick service. The cloud server is used by a large number of users, which brings about the problem of how to reasonably schedule resources to ensure the load balance of the cloud environment. With the development of research, scholars have found that the simple job scheduling of physical resources cannot meet the utilization of resources. Connecting the characteristic of resource scheduling in cloud environment and machine learning, researchers gradually abstract a resource scheduling problem into a mathematical problem, and then combine machine learning with group algorithm to put forward the intelligent algorithm which can optimize the resource structure and the improve the resource utilization. In this survey, we discuss several algorithms that use machine learning to solve resource scheduling problems in a cloud environment. Experiments show that machine learning can assist the cloud environment to achieve load balancing.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Mell, P., Grance, T.: The NIST definition of cloud computing. Commun. ACM 53(6), 50 (2011) Mell, P., Grance, T.: The NIST definition of cloud computing. Commun. ACM 53(6), 50 (2011)
2.
go back to reference Lin, W., Qi, D.: Survey of resource scheduling in cloud computing. Comput. Sci. 39(10), 1–6 (2012) Lin, W., Qi, D.: Survey of resource scheduling in cloud computing. Comput. Sci. 39(10), 1–6 (2012)
3.
go back to reference Jiang, X.W., Fan, M.A.: Middleware and distributed computing. Comput. Appl. 22(004), 5–8 (2002) Jiang, X.W., Fan, M.A.: Middleware and distributed computing. Comput. Appl. 22(004), 5–8 (2002)
4.
go back to reference Arslan, M.Y., Singh, I., Singh, S., et al.: CWC: a distributed computing infrastructure using smartphones. IEEE Trans. Mobile Comput. 14(8), 1587–1600 (2015)CrossRef Arslan, M.Y., Singh, I., Singh, S., et al.: CWC: a distributed computing infrastructure using smartphones. IEEE Trans. Mobile Comput. 14(8), 1587–1600 (2015)CrossRef
5.
go back to reference Xiang, J.J.: Research on the key technologies of resource dynamic management in cloud computing environment. Adv. Mater. Res. 926–930, 2618–2621 (2014)CrossRef Xiang, J.J.: Research on the key technologies of resource dynamic management in cloud computing environment. Adv. Mater. Res. 926–930, 2618–2621 (2014)CrossRef
6.
go back to reference Kim, B.G., Zhang, Y., et al.: Dynamic pricing and energy consumption scheduling with reinforcement learning. IEEE Trans. Smart Grid 7(5), 2187–2198 (2016)CrossRef Kim, B.G., Zhang, Y., et al.: Dynamic pricing and energy consumption scheduling with reinforcement learning. IEEE Trans. Smart Grid 7(5), 2187–2198 (2016)CrossRef
7.
go back to reference Feng, Y., Zheng, B., Li, Z.: Exploratory study of sorting particle swarm optimizer for multiobjective design optimization. Math. Comput. Model. 52(11), 1966–1975 (2010)CrossRef Feng, Y., Zheng, B., Li, Z.: Exploratory study of sorting particle swarm optimizer for multiobjective design optimization. Math. Comput. Model. 52(11), 1966–1975 (2010)CrossRef
8.
go back to reference Hou, Y., Lu, L., et al.: Enhanced particle swarm optimization algorithm and its application on economic dispatch of power systems. Proc. CSEE 24(7), 69–70 (2007) Hou, Y., Lu, L., et al.: Enhanced particle swarm optimization algorithm and its application on economic dispatch of power systems. Proc. CSEE 24(7), 69–70 (2007)
9.
go back to reference Liu, J., Fan, X., et al.: A new particle swarm optimization algorithm with dynamic adjustment of inertia weights. Comput. Eng. Appl. 43(7), 69–70 (2007) Liu, J., Fan, X., et al.: A new particle swarm optimization algorithm with dynamic adjustment of inertia weights. Comput. Eng. Appl. 43(7), 69–70 (2007)
10.
go back to reference Shi, H., Bai, G., Tang, Z.: ACO algorithm-based parallel job scheduling investigation on Hadoop. Int. J. Digit. Content Technol. Appl. 5(7), 283–289 (2011)CrossRef Shi, H., Bai, G., Tang, Z.: ACO algorithm-based parallel job scheduling investigation on Hadoop. Int. J. Digit. Content Technol. Appl. 5(7), 283–289 (2011)CrossRef
11.
go back to reference Jin, Y., Wu, J., et al.: Fairness-considered shortest job first strategy for memory scheduling. Comput. Eng. 38(20), 243–246 (2012) Jin, Y., Wu, J., et al.: Fairness-considered shortest job first strategy for memory scheduling. Comput. Eng. 38(20), 243–246 (2012)
12.
go back to reference Liao, J., Zhang, L., et al.: Efficient and fair scheduler of multiple resources for MapReduce system. IET Softw. 10(6), 182–188 (2016) Liao, J., Zhang, L., et al.: Efficient and fair scheduler of multiple resources for MapReduce system. IET Softw. 10(6), 182–188 (2016)
13.
go back to reference Berral, J., Poggi, N., Carrera, D., et al.: ALOJA: a framework for benchmarking and predictive analytics in Hadoop deployments. IEEE Trans. Emerg. Top. Comput. PP(99), 1 (2015) Berral, J., Poggi, N., Carrera, D., et al.: ALOJA: a framework for benchmarking and predictive analytics in Hadoop deployments. IEEE Trans. Emerg. Top. Comput. PP(99), 1 (2015)
14.
go back to reference Luo, X., Yue, L., et al.: Research on job scheduling algorithm on wind farms data center cloud platform based on Hadoop. Comput. Eng. Appl. 51(15), 266–270 (2015) Luo, X., Yue, L., et al.: Research on job scheduling algorithm on wind farms data center cloud platform based on Hadoop. Comput. Eng. Appl. 51(15), 266–270 (2015)
15.
go back to reference Zhu, L., Li, Q., et al.: Study on cloud computing resource scheduling strategy based on the ant colony optimization algorithm. Int. J. Comput. Sci. Issues 9(5), 54–58 (2012) Zhu, L., Li, Q., et al.: Study on cloud computing resource scheduling strategy based on the ant colony optimization algorithm. Int. J. Comput. Sci. Issues 9(5), 54–58 (2012)
16.
go back to reference Guo, L., Zhao, S., et al.: Task scheduling optimization in cloud computing based on heuristic algorithm. J. Netw. 7(3), 1–4 (2012) Guo, L., Zhao, S., et al.: Task scheduling optimization in cloud computing based on heuristic algorithm. J. Netw. 7(3), 1–4 (2012)
17.
go back to reference Tsai, P.W., Pan, J.S., et al.: Parallel cat swarm optimization. In: International Conference on Machine Learning and Cybernetics, vol. 6, pp. 854–858. IEEE (2008) Tsai, P.W., Pan, J.S., et al.: Parallel cat swarm optimization. In: International Conference on Machine Learning and Cybernetics, vol. 6, pp. 854–858. IEEE (2008)
18.
go back to reference Luo, Y., Yuan, X., et al.: An improved PSO algorithm for solving non-convex NLP/MINLP problems with equality constraints. Comput. Chem. Eng. 31(3), 153–162 (2007)CrossRef Luo, Y., Yuan, X., et al.: An improved PSO algorithm for solving non-convex NLP/MINLP problems with equality constraints. Comput. Chem. Eng. 31(3), 153–162 (2007)CrossRef
19.
go back to reference Bonyadi, M.R., Michalewicz, Z.: Particle swarm optimization for single objective continuous space problems: a review. Evol. Comput. 25(1), 1–54 (2017)CrossRef Bonyadi, M.R., Michalewicz, Z.: Particle swarm optimization for single objective continuous space problems: a review. Evol. Comput. 25(1), 1–54 (2017)CrossRef
20.
go back to reference Gomathi, B., Krishnasamy, K.: Task scheduling algorithm based on hybrid particle swarm optimization in cloud computing environment. J. Theor. Appl. Inf. Technol. 7(1), 575 (2013) Gomathi, B., Krishnasamy, K.: Task scheduling algorithm based on hybrid particle swarm optimization in cloud computing environment. J. Theor. Appl. Inf. Technol. 7(1), 575 (2013)
21.
go back to reference Jun, W., Zhang, M., et al.: Cloud computing resource schedule strategy based on MPSO algorithm. Comput. Eng. 37(11), 43–44 (2011) Jun, W., Zhang, M., et al.: Cloud computing resource schedule strategy based on MPSO algorithm. Comput. Eng. 37(11), 43–44 (2011)
22.
go back to reference Yuan, H., Li, C., et al.: Optimal virtual machine resources scheduling based on improved particle swarm optimization in cloud computing. J. Softw. 9(3), 705–708 (2014)MathSciNet Yuan, H., Li, C., et al.: Optimal virtual machine resources scheduling based on improved particle swarm optimization in cloud computing. J. Softw. 9(3), 705–708 (2014)MathSciNet
23.
go back to reference Peng, Z., Cui, D., et al.: Random task scheduling scheme based on reinforcement learning in cloud computing. Clust. Comput. 18(4), 1595–1607 (2015)CrossRef Peng, Z., Cui, D., et al.: Random task scheduling scheme based on reinforcement learning in cloud computing. Clust. Comput. 18(4), 1595–1607 (2015)CrossRef
24.
go back to reference Kumar, N., Swain, S.N., Murthy, C.S.R.: A novel distributed Q-learning based resource reservation framework for facilitating D2D content access requests in LTE-A networks. IEEE Trans. Netw. Serv. Manag. PP(99), 1 (2018) Kumar, N., Swain, S.N., Murthy, C.S.R.: A novel distributed Q-learning based resource reservation framework for facilitating D2D content access requests in LTE-A networks. IEEE Trans. Netw. Serv. Manag. PP(99), 1 (2018)
Metadata
Title
A Survey of Machine Learning-Based Resource Scheduling Algorithms in Cloud Computing Environment
Authors
Qi Liu
YingHang Jiang
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-00006-6_21

Premium Partner