Skip to main content
Erschienen in: Wireless Personal Communications 1/2020

23.04.2020

Optimization of Metascheduler for Cloud Machine Learning Services

verfasst von: A. Suresh, P. Ganesh Kumar

Erschienen in: Wireless Personal Communications | Ausgabe 1/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cloud meta scheduler act as a global resource manager that discover the resource mapping, job submission and monitoring services in a distributed environment. Machine learning services are offered as pay-per-use by the leading cloud providers such as Amazon, Microsoft and IBM etc., Most of the cloud machine learning service architecture had a constraint that cloud users are allowed to choose the predefined listed algorithms for their experimentation and architecture like Amazon uses a single classification or regression algorithm irrespective of the input dataset. The resource utilization by cloud service user (CSU) is too low with respect to time. Here we proposed and construct the economic metascheduler in cloud machine learning architecture using a decision tree algorithm that selects the suitable classification or prediction algorithm based on the users need and achieve maximum profit for both cloud machine learning service providers (CMLSP) and cloud service user (CSU). The experimentation is carried out using Amazon AWS, Microsoft Azure, WEKA and the number results show that the proposed metascheduler architecture is superior to the real time CMLSP.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Kumrai, T., Ota, K., Dong, M., Kishigami, J., & Sung, D. K. (2016). Multiobjective optimization in cloud brokering systems for connected Internet of Things. IEEE Internet of Things Journal, 4(2), 404–413.CrossRef Kumrai, T., Ota, K., Dong, M., Kishigami, J., & Sung, D. K. (2016). Multiobjective optimization in cloud brokering systems for connected Internet of Things. IEEE Internet of Things Journal, 4(2), 404–413.CrossRef
2.
Zurück zum Zitat Junior, O. A. C., Bruschi, S. M., Santana, R. H. C., & Santana, M. J. (2016). Green Cloud Meta-Scheduling: A flexible and automatic approach. Journal of Grid Computing, 1(14), 109–126.CrossRef Junior, O. A. C., Bruschi, S. M., Santana, R. H. C., & Santana, M. J. (2016). Green Cloud Meta-Scheduling: A flexible and automatic approach. Journal of Grid Computing, 1(14), 109–126.CrossRef
3.
Zurück zum Zitat Nesmachnow, S., Iturriaga, S., & Dorronsoro, B. (2015). Efficient heuristics for profit optimization of virtual cloud brokers. IEEE Computational Intelligence Magazine, 10(1), 33–43.CrossRef Nesmachnow, S., Iturriaga, S., & Dorronsoro, B. (2015). Efficient heuristics for profit optimization of virtual cloud brokers. IEEE Computational Intelligence Magazine, 10(1), 33–43.CrossRef
4.
Zurück zum Zitat Kim, S. H., Kang, D. K., Kim, W. J., Chen, M., & Youn, C. H. (2016). A science gateway cloud with cost-adaptive VM management for computational science and applications. IEEE Systems Journal, 11(1), 173–185.CrossRef Kim, S. H., Kang, D. K., Kim, W. J., Chen, M., & Youn, C. H. (2016). A science gateway cloud with cost-adaptive VM management for computational science and applications. IEEE Systems Journal, 11(1), 173–185.CrossRef
5.
Zurück zum Zitat Karthick, A. V., Ramaraj, E., & Kannan, R. (2013, December). An efficient Tri Queue job Scheduling using dynamic quantum time for cloud environment. In 2013 International Conference on Green Computing, Communication and Conservation of Energy (ICGCE) (pp. 871–876). IEEE. Karthick, A. V., Ramaraj, E., & Kannan, R. (2013, December). An efficient Tri Queue job Scheduling using dynamic quantum time for cloud environment. In 2013 International Conference on Green Computing, Communication and Conservation of Energy (ICGCE) (pp. 871–876). IEEE.
6.
Zurück zum Zitat Peixoto, M. L., Santana, M. J., Estrella, J. C., Tavares, T. C., Kuehne, B. T., & Santana, R. H. (2010, April). A metascheduler architecture to provide QoS on the cloud computing. In 2010 17th International Conference on Telecommunications (pp. 650–657). IEEE. Peixoto, M. L., Santana, M. J., Estrella, J. C., Tavares, T. C., Kuehne, B. T., & Santana, R. H. (2010, April). A metascheduler architecture to provide QoS on the cloud computing. In 2010 17th International Conference on Telecommunications (pp. 650–657). IEEE.
7.
Zurück zum Zitat Li, X., Ma, H., Zhou, F., & Gui, X. (2014). Service operator-aware trust scheme for resource matchmaking across multiple clouds. IEEE Transactions on Parallel and Distributed Systems, 26(5), 1419–1429.CrossRef Li, X., Ma, H., Zhou, F., & Gui, X. (2014). Service operator-aware trust scheme for resource matchmaking across multiple clouds. IEEE Transactions on Parallel and Distributed Systems, 26(5), 1419–1429.CrossRef
8.
Zurück zum Zitat Prasad, A. S., & Rao, S. (2013). A mechanism design approach to resource procurement in cloud computing. IEEE Transactions on Computers, 63(1), 17–30.MathSciNetMATHCrossRef Prasad, A. S., & Rao, S. (2013). A mechanism design approach to resource procurement in cloud computing. IEEE Transactions on Computers, 63(1), 17–30.MathSciNetMATHCrossRef
9.
Zurück zum Zitat Guzek, M., Gniewek, A., Bouvry, P., Musial, J., & Blazewicz, J. (2015). Cloud brokering: Current practices and upcoming challenges. IEEE Cloud Computing, 2(2), 40–47.CrossRef Guzek, M., Gniewek, A., Bouvry, P., Musial, J., & Blazewicz, J. (2015). Cloud brokering: Current practices and upcoming challenges. IEEE Cloud Computing, 2(2), 40–47.CrossRef
10.
Zurück zum Zitat Chard, K., & Bubendorfer, K. (2009). Using secure auctions to build a distributed meta-scheduler for the grid. New York: Wiley. Chard, K., & Bubendorfer, K. (2009). Using secure auctions to build a distributed meta-scheduler for the grid. New York: Wiley.
11.
Zurück zum Zitat Zhang, R., Wu, K., Li, M., & Wang, J. (2015). Online resource scheduling under concave pricing for cloud computing. IEEE Transactions on Parallel and Distributed Systems, 27(4), 1131–1145.CrossRef Zhang, R., Wu, K., Li, M., & Wang, J. (2015). Online resource scheduling under concave pricing for cloud computing. IEEE Transactions on Parallel and Distributed Systems, 27(4), 1131–1145.CrossRef
12.
Zurück zum Zitat Tang, L., He, S., & Li, Q. (2017). Double-sided bidding mechanism for resource sharing in mobile cloud. IEEE Transactions on Vehicular Technology, 66(2), 1798–1809.CrossRef Tang, L., He, S., & Li, Q. (2017). Double-sided bidding mechanism for resource sharing in mobile cloud. IEEE Transactions on Vehicular Technology, 66(2), 1798–1809.CrossRef
13.
Zurück zum Zitat Moltó, G., Hernández, V., & Alonso, J. M. (2008). A service-oriented WSRF-based architecture for metascheduling on computational Grids. Future Generation Computer Systems, 24(4), 317–328.CrossRef Moltó, G., Hernández, V., & Alonso, J. M. (2008). A service-oriented WSRF-based architecture for metascheduling on computational Grids. Future Generation Computer Systems, 24(4), 317–328.CrossRef
14.
Zurück zum Zitat Zhang, J., Gu, C., Wang, X., & Huang, H. (2013, March). A unified metascheduler architecture for telecom grade cloud computing. In 2013 IEEE Third International Conference on Information Science and Technology (ICIST) (pp. 354–360). IEEE. Zhang, J., Gu, C., Wang, X., & Huang, H. (2013, March). A unified metascheduler architecture for telecom grade cloud computing. In 2013 IEEE Third International Conference on Information Science and Technology (ICIST) (pp. 354–360). IEEE.
15.
Zurück zum Zitat Jackson, K. R., Ramakrishnan, L., Muriki, K., Canon, S., Cholia, S., Shalf, J., et al. (2010, November). Performance analysis of high performance computing applications on the amazon web services cloud. In 2010 IEEE second international conference on cloud computing technology and science (pp. 159–168). IEEE. Jackson, K. R., Ramakrishnan, L., Muriki, K., Canon, S., Cholia, S., Shalf, J., et al. (2010, November). Performance analysis of high performance computing applications on the amazon web services cloud. In 2010 IEEE second international conference on cloud computing technology and science (pp. 159–168). IEEE.
16.
Zurück zum Zitat Grivas, S. G., Kumar, T. U., & Wache, H. (2010, July). Cloud broker: Bringing intelligence into the cloud. In 2010 IEEE 3rd International Conference on Cloud Computing (pp. 544–545). IEEE. Grivas, S. G., Kumar, T. U., & Wache, H. (2010, July). Cloud broker: Bringing intelligence into the cloud. In 2010 IEEE 3rd International Conference on Cloud Computing (pp. 544–545). IEEE.
17.
Zurück zum Zitat Mahalle, H. S., Tayde, S., & Kaveri, P. R. (2015, November). Implementing service broker policies in cloud computing environment. In 2015 International Conference on Communication Networks (ICCN) (pp. 186–190). IEEE. Mahalle, H. S., Tayde, S., & Kaveri, P. R. (2015, November). Implementing service broker policies in cloud computing environment. In 2015 International Conference on Communication Networks (ICCN) (pp. 186–190). IEEE.
18.
Zurück zum Zitat Aazam, M., Huh, E. N., St-Hilaire, M., Lung, C. H., & Lambadaris, I. (2015). Cloud customer’s historical record based resource pricing. IEEE Transactions on Parallel and Distributed Systems, 27(7), 1929–1940.CrossRef Aazam, M., Huh, E. N., St-Hilaire, M., Lung, C. H., & Lambadaris, I. (2015). Cloud customer’s historical record based resource pricing. IEEE Transactions on Parallel and Distributed Systems, 27(7), 1929–1940.CrossRef
19.
Zurück zum Zitat Bihis, M., & Roychowdhury, S. (2015, October). A generalized flow for multi-class and binary classification tasks: An Azure ML approach. In 2015 IEEE International Conference on Big Data (Big Data) (pp. 1728–1737). IEEE. Bihis, M., & Roychowdhury, S. (2015, October). A generalized flow for multi-class and binary classification tasks: An Azure ML approach. In 2015 IEEE International Conference on Big Data (Big Data) (pp. 1728–1737). IEEE.
20.
Zurück zum Zitat Kaplunovich, A., & Yesha, Y. (2017, December). Cloud big data decision support system for machine learning on AWS: Analytics of analytics. In 2017 IEEE International Conference on Big Data (Big Data) (pp. 3508–3516). IEEE. Kaplunovich, A., & Yesha, Y. (2017, December). Cloud big data decision support system for machine learning on AWS: Analytics of analytics. In 2017 IEEE International Conference on Big Data (Big Data) (pp. 3508–3516). IEEE.
21.
Zurück zum Zitat Đorđević, B. S., Jovanović, S. P., & Timčenko, V. V. (2014, November). Cloud Computing in Amazon and Microsoft Azure platforms: Performance and service comparison. In 2014 22nd Telecommunications Forum Telfor (TELFOR) (pp. 931–934). IEEE. Đorđević, B. S., Jovanović, S. P., & Timčenko, V. V. (2014, November). Cloud Computing in Amazon and Microsoft Azure platforms: Performance and service comparison. In 2014 22nd Telecommunications Forum Telfor (TELFOR) (pp. 931–934). IEEE.
22.
Zurück zum Zitat Amato, A., Di Martino, B., & Venticinque, S. (2013, October). Cloud brokering as a service. In 2013 Eighth International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (pp. 9–16). IEEE. Amato, A., Di Martino, B., & Venticinque, S. (2013, October). Cloud brokering as a service. In 2013 Eighth International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (pp. 9–16). IEEE.
23.
Zurück zum Zitat Leng, L., & Wang, L. (2012, August). Research on cloud computing and key technologies. In 2012 International Conference on Computer Science and Information Processing (CSIP) (pp. 863–866). IEEE. Leng, L., & Wang, L. (2012, August). Research on cloud computing and key technologies. In 2012 International Conference on Computer Science and Information Processing (CSIP) (pp. 863–866). IEEE.
24.
Zurück zum Zitat Abderrahim, W., & Choukair, Z. (2015, August). Trust assurance in cloud services with the cloud broker architecture for dependability. In 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems (pp. 778–781). IEEE. Abderrahim, W., & Choukair, Z. (2015, August). Trust assurance in cloud services with the cloud broker architecture for dependability. In 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems (pp. 778–781). IEEE.
25.
Zurück zum Zitat Di Martino, B., Cretella, G., Esposito, A., & Sperandeo, R. G. (2014, September). Semantic representation of cloud services: a case study for microsoft windows azure. In 2014 International Conference on Intelligent Networking and Collaborative Systems (pp. 647–652). IEEE. Di Martino, B., Cretella, G., Esposito, A., & Sperandeo, R. G. (2014, September). Semantic representation of cloud services: a case study for microsoft windows azure. In 2014 International Conference on Intelligent Networking and Collaborative Systems (pp. 647–652). IEEE.
26.
Zurück zum Zitat Czajkowski, K., Foster, I., Karonis, N., Kesselman, C., Martin, S., Smith, W., & Tuecke, S. (1998, March). A resource management architecture for metacomputing systems. In Workshop on Job Scheduling Strategies for Parallel Processing (pp. 62–82). Berlin, Heidelberg: Springer. Czajkowski, K., Foster, I., Karonis, N., Kesselman, C., Martin, S., Smith, W., & Tuecke, S. (1998, March). A resource management architecture for metacomputing systems. In Workshop on Job Scheduling Strategies for Parallel Processing (pp. 62–82). Berlin, Heidelberg: Springer.
27.
Zurück zum Zitat Maheshwari, P., Singhal, A., & Qadeer, M. A. (2017, September). Data analytics using cloud computing. In 2017 9th International Conference on Computational Intelligence and Communication Networks (CICN) (pp. 82–87). IEEE. Maheshwari, P., Singhal, A., & Qadeer, M. A. (2017, September). Data analytics using cloud computing. In 2017 9th International Conference on Computational Intelligence and Communication Networks (CICN) (pp. 82–87). IEEE.
28.
Zurück zum Zitat Garg, S. K., Venugopal, S., & Buyya, R. (2008, December). A meta-scheduler with auction based resource allocation for global grids. In 2008 14th IEEE International Conference on Parallel and Distributed Systems (pp. 187–194). IEEE. Garg, S. K., Venugopal, S., & Buyya, R. (2008, December). A meta-scheduler with auction based resource allocation for global grids. In 2008 14th IEEE International Conference on Parallel and Distributed Systems (pp. 187–194). IEEE.
29.
Zurück zum Zitat Kotas, C., Naughton, T., & Imam, N. (2018, January). A comparison of Amazon Web Services and Microsoft Azure cloud platforms for high performance computing. In 2018 IEEE International Conference on Consumer Electronics (ICCE) (pp. 1–4). IEEE. Kotas, C., Naughton, T., & Imam, N. (2018, January). A comparison of Amazon Web Services and Microsoft Azure cloud platforms for high performance computing. In 2018 IEEE International Conference on Consumer Electronics (ICCE) (pp. 1–4). IEEE.
30.
Zurück zum Zitat Herger, L., Fonseca, C., Rippon, B., & Bodarky, M. (2017, October). Ibm research cloud evolution & efficiencies. In 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON) (pp. 352–355). IEEE. Herger, L., Fonseca, C., Rippon, B., & Bodarky, M. (2017, October). Ibm research cloud evolution & efficiencies. In 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON) (pp. 352–355). IEEE.
Metadaten
Titel
Optimization of Metascheduler for Cloud Machine Learning Services
verfasst von
A. Suresh
P. Ganesh Kumar
Publikationsdatum
23.04.2020
Verlag
Springer US
Erschienen in
Wireless Personal Communications / Ausgabe 1/2020
Print ISSN: 0929-6212
Elektronische ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-020-07367-2

Weitere Artikel der Ausgabe 1/2020

Wireless Personal Communications 1/2020 Zur Ausgabe

Neuer Inhalt