Skip to main content
Top
Published in: The Journal of Supercomputing 6/2020

23-03-2018

Profit and resource availability-constrained optimal handling of high-performance scientific computing tasks

Authors: B. Reshmi, P. Poongodi

Published in: The Journal of Supercomputing | Issue 6/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

High-performance computing becomes the most important field in various industries and organizations, which needs to be concentrated more today due to their massive resource requirements. It is required to provide more resources to accomplish the high-performance tasks which are very difficult to handle. This problem is resolved in the earlier research method, namely similarity aware high-performance scientific application scheduling. This method would group the similar tasks and provide the optimal resource for the similar kinds of tasks together. However, the existing research method doesn’t focus on the resource similarity where it is complex to identify the proper resource for the task execution based on their characteristics. This would lead to increased time complexity and reduced accuracy in optimal resource allocation. To solve this problem, new framework, namely profit and resource availability aware optimal scheduling, is introduced in this work. In this research method, initially resources that contribute to similar characteristics would be identified by constructing the distance matrix and then learning-based optimal scheduling is done to allocate the proper resources for the incoming tasks accurately. Here, support vector machine is utilized to learn the optimal allocation of tasks and hybrid cuckoo genetic algorithm is implemented for the optimal scheduling process. The implementation is done in the CloudSim environment which concludes the proposed work. The proposed method would ensure optimum results than the existing methods in terms of reduced time complexity and improved accuracy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Nan X, He Y, Guan L (2013) Optimization of workload scheduling for multimedia cloud computing. In: Submit to 2013 IEEE International Symposium on Circuits and Systems Nan X, He Y, Guan L (2013) Optimization of workload scheduling for multimedia cloud computing. In: Submit to 2013 IEEE International Symposium on Circuits and Systems
2.
go back to reference Zhu W, Luo C, Wang J, Li S (2011) Multimedia cloud computing. IEEE Signal Process Mag 28(3):59–69CrossRef Zhu W, Luo C, Wang J, Li S (2011) Multimedia cloud computing. IEEE Signal Process Mag 28(3):59–69CrossRef
3.
go back to reference Nan X, He Y, Guan L (2011) Optimal resource allocation for multimedia cloud based on queuing model. In: Proceeding of IEEE International Workshop on Multimedia Signal Processing (MMSP) Nan X, He Y, Guan L (2011) Optimal resource allocation for multimedia cloud based on queuing model. In: Proceeding of IEEE International Workshop on Multimedia Signal Processing (MMSP)
4.
go back to reference Wu Y, Wu C, Li B, Qiu X, Lau FC (2011) Cloud media: when cloud on demand meets video on demand. In: Proceeding of IEEE International Conference on Distributed Computing Systems (ICDCS), pp 268–277 Wu Y, Wu C, Li B, Qiu X, Lau FC (2011) Cloud media: when cloud on demand meets video on demand. In: Proceeding of IEEE International Conference on Distributed Computing Systems (ICDCS), pp 268–277
5.
go back to reference Balasangameshwara J, Raju N (2012) A hybrid policy for fault tolerant load balancing in grid computing environments. J Netw Comput Appl 35:412–422CrossRef Balasangameshwara J, Raju N (2012) A hybrid policy for fault tolerant load balancing in grid computing environments. J Netw Comput Appl 35:412–422CrossRef
6.
go back to reference Tai J, Zhang J, Li J, Meleis W, Mi N (2011) ARA: adaptive resource allocation for cloud computing environments under bursty workloads. In: Proceeding of IEEE Conference on Performance Computing and Communications Tai J, Zhang J, Li J, Meleis W, Mi N (2011) ARA: adaptive resource allocation for cloud computing environments under bursty workloads. In: Proceeding of IEEE Conference on Performance Computing and Communications
7.
go back to reference Silberstein M, Geiger D, Schuster A, Livny M (2006) Scheduling mixed workloads in multi-grids: the grid execution hierarchy. In: Proceeding of IEEE Symposium on High Performance Distributed Computing, pp 291–302 Silberstein M, Geiger D, Schuster A, Livny M (2006) Scheduling mixed workloads in multi-grids: the grid execution hierarchy. In: Proceeding of IEEE Symposium on High Performance Distributed Computing, pp 291–302
8.
go back to reference Tan M, Siegel HJ, Antonio JK, Li YA (1997) Minimizing the application execution time through scheduling of subtasks and communication traffic in a heterogeneous computing system. IEEE Trans Parallel Distrib Syst 8(8):857–871CrossRef Tan M, Siegel HJ, Antonio JK, Li YA (1997) Minimizing the application execution time through scheduling of subtasks and communication traffic in a heterogeneous computing system. IEEE Trans Parallel Distrib Syst 8(8):857–871CrossRef
9.
go back to reference Yu J, Buyya R (2005) A taxonomy of scientific workflow systems for grid computing. Sigmod Record 34(3):44–49CrossRef Yu J, Buyya R (2005) A taxonomy of scientific workflow systems for grid computing. Sigmod Record 34(3):44–49CrossRef
10.
go back to reference Foster I, Zhao Y, Raicu I, Lu S (2008) Cloud computing and grid computing 360-degree compared. In: Proceeding of IEEE Grid Computing Environments Workshop Foster I, Zhao Y, Raicu I, Lu S (2008) Cloud computing and grid computing 360-degree compared. In: Proceeding of IEEE Grid Computing Environments Workshop
11.
go back to reference Muñoz P, Barco R, De la Bandera I (2013) Optimization of load balancing using fuzzy Q-learning for next generation wireless networks. J Proc Expert Syst Appl 8(11):1469–1479 Muñoz P, Barco R, De la Bandera I (2013) Optimization of load balancing using fuzzy Q-learning for next generation wireless networks. J Proc Expert Syst Appl 8(11):1469–1479
12.
go back to reference Wang Y, Zhou Z, Liu L, Wu W (2013) Replica-aided load balancing in overlay networks. J Netw Comput Appl 36(1):388–401CrossRef Wang Y, Zhou Z, Liu L, Wu W (2013) Replica-aided load balancing in overlay networks. J Netw Comput Appl 36(1):388–401CrossRef
13.
go back to reference Qaisar S, Khawaja K (2012) Cloud computing: network/security threats and countermeasures. Interdiscip J Contemp Res Bus 3(9):1323–1329 Qaisar S, Khawaja K (2012) Cloud computing: network/security threats and countermeasures. Interdiscip J Contemp Res Bus 3(9):1323–1329
14.
go back to reference Somani U, Lakhani K, Mundra M (2010) Implementing digital signature with RSA encryption algorithm to enhance the data security of cloud in cloud computing. In: 2010 IEEE 1st International Conference on Parallel, Distributed and Grid Computing (PDGC—2010) Somani U, Lakhani K, Mundra M (2010) Implementing digital signature with RSA encryption algorithm to enhance the data security of cloud in cloud computing. In: 2010 IEEE 1st International Conference on Parallel, Distributed and Grid Computing (PDGC—2010)
15.
go back to reference Lin W, Qi D (2010) Research on resource self-organizing model for cloud computing. In: Proceeding of IEEE International Conference on Internet Technology and Applications, pp 1–5 Lin W, Qi D (2010) Research on resource self-organizing model for cloud computing. In: Proceeding of IEEE International Conference on Internet Technology and Applications, pp 1–5
16.
go back to reference Shi H, Zhan Z (2009) An optimal infrastructure design method of cloud computing services from the BDIM perspective. In: Proceeding of IEEE Computational Intelligence and Industrial Applications, vol 1, pp 393–396 Shi H, Zhan Z (2009) An optimal infrastructure design method of cloud computing services from the BDIM perspective. In: Proceeding of IEEE Computational Intelligence and Industrial Applications, vol 1, pp 393–396
17.
go back to reference Teng F, Magoules F (2010) Resource pricing and equilibrium allocation policy in cloud computing. In: Proceeding of IEEE International Conference on Computer and Information Technology (CIT 2010), pp 195–202 Teng F, Magoules F (2010) Resource pricing and equilibrium allocation policy in cloud computing. In: Proceeding of IEEE International Conference on Computer and Information Technology (CIT 2010), pp 195–202
18.
go back to reference Yang XS, Deb S (2009) Cuckoo search via Lévy flights. In: World Congress on Nature and Biologically Inspired Computing, NaBIC 2009, pp 210–214 Yang XS, Deb S (2009) Cuckoo search via Lévy flights. In: World Congress on Nature and Biologically Inspired Computing, NaBIC 2009, pp 210–214
19.
20.
go back to reference Zhao Y, Luo S, Wang Y, Wang S (2017) Cotask scheduling in cloud computing. In: IEEE 25th International Conference on Network Protocols (ICNP), pp 1–6 Zhao Y, Luo S, Wang Y, Wang S (2017) Cotask scheduling in cloud computing. In: IEEE 25th International Conference on Network Protocols (ICNP), pp 1–6
21.
go back to reference Panda SK, Jana PK (2017) SLA-based task scheduling algorithms for heterogeneous multi-cloud environment. J Supercomput 73(6):2730–2762CrossRef Panda SK, Jana PK (2017) SLA-based task scheduling algorithms for heterogeneous multi-cloud environment. J Supercomput 73(6):2730–2762CrossRef
Metadata
Title
Profit and resource availability-constrained optimal handling of high-performance scientific computing tasks
Authors
B. Reshmi
P. Poongodi
Publication date
23-03-2018
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 6/2020
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-018-2332-7

Other articles of this Issue 6/2020

The Journal of Supercomputing 6/2020 Go to the issue

Premium Partner