Skip to main content
Top
Published in: The Journal of Supercomputing 8/2019

07-02-2019

An efficient job management of computing service using integrated idle VM resources for high-performance computing based on OpenStack

Authors: Seok-Hyeon Han, Hyun-Woo Kim, Young-Sik Jeong

Published in: The Journal of Supercomputing | Issue 8/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In recent years, various studies on OpenStack-based high-performance computing have been conducted. OpenStack combines off-the-shelf physical computing devices and creates a resource pool of logical computing. The configuration of the logical computing resource pool provides computing infrastructure according to the user’s request and can be applied to the infrastructure as a service (laaS), which is a cloud computing service model. The OpenStack-based cloud computing can provide various computing services for users using a virtual machine (VM). However, intensive computing service requests from a large number of users during large-scale computing jobs may delay the job execution. Moreover, idle VM resources may occur and computing resources are wasted if users do not employ the cloud computing resources. To resolve the computing job delay and waste of computing resources, a variety of studies are required including computing task allocation, job scheduling, utilization of idle VM resource, and improvements in overall job’s execution speed according to the increase in computing service requests. Thus, this paper proposes an efficient job management of computing service (EJM-CS) by which idle VM resources are utilized in OpenStack and user’s computing services are processed in a distributed manner. EJM-CS logically integrates idle VM resources, which have different performances, for computing services. EJM-CS improves resource wastes by utilizing idle VM resources. EJM-CS takes multiple computing services rather than single computing service into consideration. EJM-CS determines the job execution order considering workloads and waiting time according to job priority of computing service requester and computing service type, thereby providing improved performance of overall job execution when computing service requests increase.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Liua J, Ahmeda E, Shiraza M, Gania A, Buyyab R, Qureshia A (2015) Application partitioning algorithms in mobile cloud computing: taxonomy, review and future directions. J Netw Comput Appl 48:99–117CrossRef Liua J, Ahmeda E, Shiraza M, Gania A, Buyyab R, Qureshia A (2015) Application partitioning algorithms in mobile cloud computing: taxonomy, review and future directions. J Netw Comput Appl 48:99–117CrossRef
2.
go back to reference Madni SHH, Latiff MSA, Coulibaly Y, Abdulhamid SM (2016) Resource scheduling for infrastructure as a service (IaaS) in cloud computing: challenges and opportunities. J Netw Comput Appl 68:173–200CrossRef Madni SHH, Latiff MSA, Coulibaly Y, Abdulhamid SM (2016) Resource scheduling for infrastructure as a service (IaaS) in cloud computing: challenges and opportunities. J Netw Comput Appl 68:173–200CrossRef
3.
go back to reference Singh S, Chana I (2016) A survey on resource scheduling in cloud computing: issues and challenges. J Grid Comput 14(2):217–264CrossRef Singh S, Chana I (2016) A survey on resource scheduling in cloud computing: issues and challenges. J Grid Comput 14(2):217–264CrossRef
4.
go back to reference Varrette S, Plugaru V, Guzek M, Besseron X, Bouvry P (2014) HPC performance and energy-efficiency of the openstack cloud middleware. In: 43rd International Conference on Parallel Processing Workshops, Minneapolis, MN, USA, pp 419–428 Varrette S, Plugaru V, Guzek M, Besseron X, Bouvry P (2014) HPC performance and energy-efficiency of the openstack cloud middleware. In: 43rd International Conference on Parallel Processing Workshops, Minneapolis, MN, USA, pp 419–428
5.
go back to reference Gangadharan GR (2017) Open source solutions for cloud computing. IEEE Comput 50(1):60–70CrossRef Gangadharan GR (2017) Open source solutions for cloud computing. IEEE Comput 50(1):60–70CrossRef
6.
go back to reference Agrawal V, Kotia D, Moshirian K, Kim M (2018) Log-based cloud monitoring system for OpenStack. In: 2018 IEEE Fourth International Conference on Big Data Computing Service and Applications, Bamberg, Germany, pp 276–281 Agrawal V, Kotia D, Moshirian K, Kim M (2018) Log-based cloud monitoring system for OpenStack. In: 2018 IEEE Fourth International Conference on Big Data Computing Service and Applications, Bamberg, Germany, pp 276–281
7.
go back to reference Sefraoui O, Aissaoui M, Eleuldj M (2012) OpenStack: toward an Open-source solution for cloud computing. Int J Comput Appl 55(3):38–42 Sefraoui O, Aissaoui M, Eleuldj M (2012) OpenStack: toward an Open-source solution for cloud computing. Int J Comput Appl 55(3):38–42
8.
go back to reference Corradi A, Fanelli M, Foschini L (2014) VM consolidation: a real case based on OpenStack cloud. Future Gener Comput Syst 32:118–127CrossRef Corradi A, Fanelli M, Foschini L (2014) VM consolidation: a real case based on OpenStack cloud. Future Gener Comput Syst 32:118–127CrossRef
9.
go back to reference Mesbahi MR, Rahmani AM, Hosseinzadeh M (2018) Reliability and high availability in cloud computing environments: a reference roadmap. Hum Centric Comput Inf Sci 8(20):1–31 Mesbahi MR, Rahmani AM, Hosseinzadeh M (2018) Reliability and high availability in cloud computing environments: a reference roadmap. Hum Centric Comput Inf Sci 8(20):1–31
10.
go back to reference Xi S, Li C, Lu C, Gill CD, Xu M, Phan LTX, Lee I, Sokolsky O (2015) RT-OpenStack: CPU resource management for real-time cloud computing. In: 2015 IEEE 8th International Conference on Cloud Computing (IEEE CLOUD 2015), New York, USA, pp 1–10 Xi S, Li C, Lu C, Gill CD, Xu M, Phan LTX, Lee I, Sokolsky O (2015) RT-OpenStack: CPU resource management for real-time cloud computing. In: 2015 IEEE 8th International Conference on Cloud Computing (IEEE CLOUD 2015), New York, USA, pp 1–10
11.
go back to reference Yang G, Zhang W (2015) Research of resource allocation based on OpenStack. In: 2015 12th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China, pp 400–403 Yang G, Zhang W (2015) Research of resource allocation based on OpenStack. In: 2015 12th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China, pp 400–403
12.
go back to reference Lim J, Yu HC, Gil J-M (2018) An intelligent residual resource monitoring scheme in cloud computing environments. J Inf Process Syst 14(6):1480–1493 Lim J, Yu HC, Gil J-M (2018) An intelligent residual resource monitoring scheme in cloud computing environments. J Inf Process Syst 14(6):1480–1493
13.
go back to reference Bychkov I, Feoktistov A, Sidorov I, Kostromin R (2017) Job flow management for virtualized resources of heterogeneous distributed computing environment. Proc Eng 201:534–542CrossRef Bychkov I, Feoktistov A, Sidorov I, Kostromin R (2017) Job flow management for virtualized resources of heterogeneous distributed computing environment. Proc Eng 201:534–542CrossRef
14.
go back to reference Zhang P, Zhou M (2018) Dynamic cloud task scheduling based on a two-stage strategy. IEEE Trans Autom Sci Eng 15(2):772–783CrossRef Zhang P, Zhou M (2018) Dynamic cloud task scheduling based on a two-stage strategy. IEEE Trans Autom Sci Eng 15(2):772–783CrossRef
15.
go back to reference Madni SHH, Latiff MSA, Abdullahi M, Abdulhamid SM, Usman MJ (2017) Performance comparison of heuristic algorithms for task scheduling in IaaS cloud computing environment. PLOS ONE 12(5): 1–26 Madni SHH, Latiff MSA, Abdullahi M, Abdulhamid SM, Usman MJ (2017) Performance comparison of heuristic algorithms for task scheduling in IaaS cloud computing environment. PLOS ONE 12(5): 1–26
16.
go back to reference Verma A, Kaushal S (2017) A hybrid multi-objective particle swarm optimization for scientific workflow scheduling. Parallel Comput 62:1–19MathSciNetCrossRef Verma A, Kaushal S (2017) A hybrid multi-objective particle swarm optimization for scientific workflow scheduling. Parallel Comput 62:1–19MathSciNetCrossRef
17.
go back to reference Han S-H, Kim H-W, Jeong Y-S (2016) Resource pooling mechanism for mobile cloud computing service. Lect Notes Electr Eng Adv Comput Sci Ubiquitous Comput 421:160–165 Han S-H, Kim H-W, Jeong Y-S (2016) Resource pooling mechanism for mobile cloud computing service. Lect Notes Electr Eng Adv Comput Sci Ubiquitous Comput 421:160–165
18.
go back to reference Moon Y, Yu HC, Gil J-M, Lim J (2017) A slave ants based ant colony optimization algorithm for task scheduling in cloud computing environments. Hum Centric Comput Inf Sci 7(28):1–10 Moon Y, Yu HC, Gil J-M, Lim J (2017) A slave ants based ant colony optimization algorithm for task scheduling in cloud computing environments. Hum Centric Comput Inf Sci 7(28):1–10
19.
go back to reference Kimmerlin M, Hasselmeyer P, Heikkilä S, Plauth M, Parol P, Sarolahti P (2017) Network expansion in OpenStack cloud federations. In: 2017 European Conference on Networks and Communications, Oulu, Finland, pp 1–5 Kimmerlin M, Hasselmeyer P, Heikkilä S, Plauth M, Parol P, Sarolahti P (2017) Network expansion in OpenStack cloud federations. In: 2017 European Conference on Networks and Communications, Oulu, Finland, pp 1–5
21.
go back to reference Mendonca GSD, Guimaraes BCF, Alves PRO, Pereira FMQ, Pereira MM, Araujo G (2016) Automatic insertion of copy annotation in data-parallel programs. In: 2016 IEEE 28th International Symposium on Computer Architecture and High Performance Computing, Los Angeles, CA, USA, pp 34–41 Mendonca GSD, Guimaraes BCF, Alves PRO, Pereira FMQ, Pereira MM, Araujo G (2016) Automatic insertion of copy annotation in data-parallel programs. In: 2016 IEEE 28th International Symposium on Computer Architecture and High Performance Computing, Los Angeles, CA, USA, pp 34–41
Metadata
Title
An efficient job management of computing service using integrated idle VM resources for high-performance computing based on OpenStack
Authors
Seok-Hyeon Han
Hyun-Woo Kim
Young-Sik Jeong
Publication date
07-02-2019
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 8/2019
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-019-02769-x

Other articles of this Issue 8/2019

The Journal of Supercomputing 8/2019 Go to the issue

Premium Partner