Skip to main content
Erschienen in: The Journal of Supercomputing 5/2019

17.11.2018

Payload fragmentation framework for high-performance computing in cloud environment

verfasst von: V. Vivek, R. Srinivasan, R. Elijah Blessing, R. Dhanasekaran

Erschienen in: The Journal of Supercomputing | Ausgabe 5/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cloud computing environment delivers resources such as CPU cycles, storage, network service and memory through a web-based model. Users run their applications on remote infrastructure and get benefited more at a lesser cost. Compiling large-scale applications such as compiling GCC and compiling Clang in C and C++ environments where applications involve encryption breaking tools require extensive analysis. Lack of CPU cycles in consumer-grade computing will be detrimental to such applications. Fragmenting and distributing payloads across multiple clusters for such applications in a cloud-like environment is a challenging task. We have proposed a novel approach to perform payload distribution for users who want to run their computationally expensive tasks efficiently. The proposed framework has performed well compared to the ‘traditional’ payload execution policy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Garg SK, Vecchiola C, Buyya R (2013) Mandi: a market exchange for trading utility and cloud computing services. J Supercomput 64(3):1153–1174CrossRef Garg SK, Vecchiola C, Buyya R (2013) Mandi: a market exchange for trading utility and cloud computing services. J Supercomput 64(3):1153–1174CrossRef
4.
Zurück zum Zitat Sunilkumar SM, Gopal KS (2014) Resource management for Infrastructure as a Service (IaaS) in cloud computing: a survey review article. J Netw Comput Appl 41:424–440CrossRef Sunilkumar SM, Gopal KS (2014) Resource management for Infrastructure as a Service (IaaS) in cloud computing: a survey review article. J Netw Comput Appl 41:424–440CrossRef
5.
Zurück zum Zitat Di Modica G, Tomarchio O (2016) Matchmaking semantic security policies in heterogeneous clouds. Future Gener Comput Syst 55:176–185CrossRef Di Modica G, Tomarchio O (2016) Matchmaking semantic security policies in heterogeneous clouds. Future Gener Comput Syst 55:176–185CrossRef
6.
Zurück zum Zitat Magoules F, Pan J, Teng F (2013) Cloud computing: data-intensive computing and scheduling. Chapman and Hall/CRC Numerical Analysis and Scientific Computing, London Magoules F, Pan J, Teng F (2013) Cloud computing: data-intensive computing and scheduling. Chapman and Hall/CRC Numerical Analysis and Scientific Computing, London
9.
Zurück zum Zitat Chlipala A (2015) An optimizing compiler for a purely functional web-application language. In: Proceedings of the 20th ACM SIGPLAN International Conference On Functional Programming (ICFP 2015). ACM, New York, NY, USA, pp 10–21 Chlipala A (2015) An optimizing compiler for a purely functional web-application language. In: Proceedings of the 20th ACM SIGPLAN International Conference On Functional Programming (ICFP 2015). ACM, New York, NY, USA, pp 10–21
10.
Zurück zum Zitat Chebolu NABS, Wankar R (2015) A novel scheme for compiler optimization framework. In: 2015 International Conference on Advances in Computing, Communications, and Informatics (ICACCI), Kochi, 2015, pp 2374–2380 Chebolu NABS, Wankar R (2015) A novel scheme for compiler optimization framework. In: 2015 International Conference on Advances in Computing, Communications, and Informatics (ICACCI), Kochi, 2015, pp 2374–2380
11.
Zurück zum Zitat Buyya R, Cortes T, Jin H (2001) Single system image. Int J High Perform Comput Appl 15(2):124–135CrossRef Buyya R, Cortes T, Jin H (2001) Single system image. Int J High Perform Comput Appl 15(2):124–135CrossRef
12.
Zurück zum Zitat Hendriks E (2002) BProc: the Beowulf distributed process space. In: ACM Proceedings of ICS, 2002 Hendriks E (2002) BProc: the Beowulf distributed process space. In: ACM Proceedings of ICS, 2002
13.
Zurück zum Zitat Wang K, Zhou X, Qiao K, Lang M, McClelland B, Raicu I (2015) Towards scalable distributed workload manager with monitoring-based weakly consistent resource stealing. In: Proceedings of the 24th international symposium on high-performance parallel and distributed computing (HPDC’15). ACM, New York, NY, USA, pp 219–222 Wang K, Zhou X, Qiao K, Lang M, McClelland B, Raicu I (2015) Towards scalable distributed workload manager with monitoring-based weakly consistent resource stealing. In: Proceedings of the 24th international symposium on high-performance parallel and distributed computing (HPDC’15). ACM, New York, NY, USA, pp 219–222
15.
16.
Zurück zum Zitat de Robles MYB, Arnejo ZO, Pabico JP (2015) On web-grid implementation using single system image. Computer science—distributed, parallel, and cluster computing. arXiv:1507.01067 de Robles MYB, Arnejo ZO, Pabico JP (2015) On web-grid implementation using single system image. Computer science—distributed, parallel, and cluster computing. arXiv:​1507.​01067
18.
Zurück zum Zitat Vallee G, Scott SL, Morin C, Berthou JY, Prisker H (2005) SSI-OSCAR: a cluster distribution for high-performance computing using a single system image. In: 19th International symposium on high-performance computing systems and applications (HPCS’05), 2005, pp 319–325 Vallee G, Scott SL, Morin C, Berthou JY, Prisker H (2005) SSI-OSCAR: a cluster distribution for high-performance computing using a single system image. In: 19th International symposium on high-performance computing systems and applications (HPCS’05), 2005, pp 319–325
20.
Zurück zum Zitat Vivek V, Srinivasan R, Rajsingh EB (2013) Resource provisioning methodologies: an approach of producer and consumer favorable in cloud environment. Int J Emerg Technol Adv Eng 3(4):8–13 Vivek V, Srinivasan R, Rajsingh EB (2013) Resource provisioning methodologies: an approach of producer and consumer favorable in cloud environment. Int J Emerg Technol Adv Eng 3(4):8–13
21.
Zurück zum Zitat Li J, Qiu M, Niu J-W, Chen Y, Ming Z (2010) Adaptive resource allocation for preemptable jobs in cloud systems. In: IEEE 2010 10th International Conference on Intelligent Systems Design and Applications (ISDA), Nov 29 2010–Dec 1 2010, pp 31–36 Li J, Qiu M, Niu J-W, Chen Y, Ming Z (2010) Adaptive resource allocation for preemptable jobs in cloud systems. In: IEEE 2010 10th International Conference on Intelligent Systems Design and Applications (ISDA), Nov 29 2010–Dec 1 2010, pp 31–36
22.
Zurück zum Zitat Baker TP (1990) A stack-based resource allocation policy for real-time processes. In: Real-time systems symposium, 1990. IEEE Proceedings, 11th, 5–7 Dec 1990, pp 191–200 Baker TP (1990) A stack-based resource allocation policy for real-time processes. In: Real-time systems symposium, 1990. IEEE Proceedings, 11th, 5–7 Dec 1990, pp 191–200
23.
Zurück zum Zitat Kim T-H, Adeli H, Cho H-S, Gervasi O, Yau SS, Kang B-H, Villalba JG (2011) A dynamic resource allocation model for virtual machine management on cloud. Springer, Berlin Kim T-H, Adeli H, Cho H-S, Gervasi O, Yau SS, Kang B-H, Villalba JG (2011) A dynamic resource allocation model for virtual machine management on cloud. Springer, Berlin
24.
Zurück zum Zitat Clark C, Fraser K, Hand S, Hansen JG, Jul E, Limpach C, Pratt I, Warfield A (2005) Live migration of virtual machines. In: Proceedings of the 2nd Conference On Symposium on Networked Systems Design and Implementation (NSDI’05), vol 2. USENIX Association, Berkeley, CA, USA, pp 273–286 Clark C, Fraser K, Hand S, Hansen JG, Jul E, Limpach C, Pratt I, Warfield A (2005) Live migration of virtual machines. In: Proceedings of the 2nd Conference On Symposium on Networked Systems Design and Implementation (NSDI’05), vol 2. USENIX Association, Berkeley, CA, USA, pp 273–286
25.
Zurück zum Zitat Voorsluys W, Broberg J, Venugopal S, Buyya R (2009) Cost of virtual machine live migration in clouds: a performance evaluation. In: Gilje Jaatun M, Zhao G, Rong C (eds) Proceedings of the 1st International Conference on Cloud Computing (CloudCom’09). Springer, Berlin, pp 254–265 Voorsluys W, Broberg J, Venugopal S, Buyya R (2009) Cost of virtual machine live migration in clouds: a performance evaluation. In: Gilje Jaatun M, Zhao G, Rong C (eds) Proceedings of the 1st International Conference on Cloud Computing (CloudCom’09). Springer, Berlin, pp 254–265
Metadaten
Titel
Payload fragmentation framework for high-performance computing in cloud environment
verfasst von
V. Vivek
R. Srinivasan
R. Elijah Blessing
R. Dhanasekaran
Publikationsdatum
17.11.2018
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 5/2019
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-018-2660-7

Weitere Artikel der Ausgabe 5/2019

The Journal of Supercomputing 5/2019 Zur Ausgabe