Skip to main content
Erschienen in: Wireless Networks 3/2023

30.11.2018

SDN enabled BDSP in public cloud for resource optimization

verfasst von: Ahmed Al-Mansoori, Jemal Abawajy, Morshed Chowdhury

Erschienen in: Wireless Networks | Ausgabe 3/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Novel computing paradigm realized by cloud computing and virtualization technologies paved the way for commoditization of computing resources. Clouds and their federation made inexhaustible computing resources leveraging ample scope in producing opportunities and productivity with provision for on-demand resources in pay as you go fashion. With the wealth of resources, big data and big data stream processing (BDSP), big data analytics became a reality now. Two stakeholders such as cloud service providers and cloud users are mainly affected if the cloud infrastructure fails to deliver intended services to the satisfaction end users. Resource optimization has been an active research topic in cloud computing to overcome this problem. It is more so with the emergence of Software Defined Networking (SDN). Resource reservation and dynamic resource allocation are two approaches found in the literature. Dynamic resource allocation is highly preferred optimization problem considered in this paper. BDSP needs highly reliable and automated resource optimization in the context of increased big data streaming workloads to be processed by real-world applications. In this paper, we proposed a methodology for SDN enabled BDSP in public cloud for resource optimization. We defined a mathematical model and proposed an algorithm to achieve it. CloudSimSDN is used to build a prototype application that demonstrates proof of the concept. Our experimental results reveal the utility of SDN based approach for resource optimization in a cloud in the presence of BDSP by decoupling data forwarding and network controlling.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Beloglazov, A., & Buyya, R. (2012). Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurrency and Computation: Practice and Experience, 24(13), 1397–1420.CrossRef Beloglazov, A., & Buyya, R. (2012). Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurrency and Computation: Practice and Experience, 24(13), 1397–1420.CrossRef
2.
Zurück zum Zitat Al-Mansoori, A., Yu, S., Xiang, Y., & Sood, K. (2018). A survey on big data stream processing in sdn supported cloud environment. In Proceedings of the Australasian computer science week multiconference (p. 12). ACM. Al-Mansoori, A., Yu, S., Xiang, Y., & Sood, K. (2018). A survey on big data stream processing in sdn supported cloud environment. In Proceedings of the Australasian computer science week multiconference (p. 12). ACM.
3.
Zurück zum Zitat Vakilinia, S., Zhang, X., & Qiu, D. (2016). Analysis and optimization of big-data stream processing. In 2016 IEEE global communications conference (GLOBECOM) (pp. 1–6). IEEE. Vakilinia, S., Zhang, X., & Qiu, D. (2016). Analysis and optimization of big-data stream processing. In 2016 IEEE global communications conference (GLOBECOM) (pp. 1–6). IEEE.
4.
Zurück zum Zitat Sideris, K., Nejabati, R., & Simeonidou, D. (2016) Seer: Empowering software defined networking with data analytics, In International conference on ubiquitous computing and communications and 2016 international symposium on cyberspace and security (IUCC-CSS) (pp. 181–188). IEEE. Sideris, K., Nejabati, R., & Simeonidou, D. (2016) Seer: Empowering software defined networking with data analytics, In International conference on ubiquitous computing and communications and 2016 international symposium on cyberspace and security (IUCC-CSS) (pp. 181–188). IEEE.
5.
Zurück zum Zitat Calheiros, R. N., Ranjan, R., Beloglazov, A., De Rose, C. A., & Buyya, R. (2011). CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software: Practice and experience, 41(1), 23–50. Calheiros, R. N., Ranjan, R., Beloglazov, A., De Rose, C. A., & Buyya, R. (2011). CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software: Practice and experience, 41(1), 23–50.
6.
Zurück zum Zitat Beloglazov, A. (2016). CloudSim: A Framework for Modeling and Simulation of Cloud Computing Infrastructures and Services. Cloud Computing and Distributed Systems (CLOUDS) Laboratory, Department of Computer Science and Software Engineering, The University of Melbourne, Australia. Beloglazov, A. (2016). CloudSim: A Framework for Modeling and Simulation of Cloud Computing Infrastructures and Services. Cloud Computing and Distributed Systems (CLOUDS) Laboratory, Department of Computer Science and Software Engineering, The University of Melbourne, Australia.
7.
Zurück zum Zitat Cziva, R., Jouët, S., Stapleton, D., Tso, F. P., & Pezaros, D. P. (2016). Sdn-based virtual machine management for cloud data centers. IEEE Transactions on Network and Service Management, 13(2), 212–225.CrossRef Cziva, R., Jouët, S., Stapleton, D., Tso, F. P., & Pezaros, D. P. (2016). Sdn-based virtual machine management for cloud data centers. IEEE Transactions on Network and Service Management, 13(2), 212–225.CrossRef
8.
Zurück zum Zitat Calheiros, R. N., Ranjan, R., Beloglazov, A., De Rose, C. A., & Buyya, R. (2011). Cloudsim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software: Practice and experience, 41(1), 23–50. Calheiros, R. N., Ranjan, R., Beloglazov, A., De Rose, C. A., & Buyya, R. (2011). Cloudsim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software: Practice and experience, 41(1), 23–50.
9.
Zurück zum Zitat Son, J., Dastjerdi, A. V., Calheiros, R., & Buyya, R. (2017). Sla-aware and energy-efficient dynamic overbooking in sdn-based cloud data centers. IEEE Transactions on Sustainable Computing, 2, 76–89.CrossRef Son, J., Dastjerdi, A. V., Calheiros, R., & Buyya, R. (2017). Sla-aware and energy-efficient dynamic overbooking in sdn-based cloud data centers. IEEE Transactions on Sustainable Computing, 2, 76–89.CrossRef
10.
Zurück zum Zitat Gu, J., Katramatos, D., Liu, X., Natarajan, V., Shoshani, A., Sim, A., Yu, D., Bradley, S., & McKee, S. (2011). Stornet: Co-scheduling of end-to-end bandwidth reservation on storage and network systems for high-performance data transfers. In 2011 IEEE conference on computer communications workshops (INFOCOM WKSHPS) (pp. 121–126). IEEE. Gu, J., Katramatos, D., Liu, X., Natarajan, V., Shoshani, A., Sim, A., Yu, D., Bradley, S., & McKee, S. (2011). Stornet: Co-scheduling of end-to-end bandwidth reservation on storage and network systems for high-performance data transfers. In 2011 IEEE conference on computer communications workshops (INFOCOM WKSHPS) (pp. 121–126). IEEE.
11.
Zurück zum Zitat Asensio, A., Velasco, L., Ruiz, M., & Junyent, G. (2014). Carrier sdn to control flexgrid-based inter-datacenter connectivity. In 2014 international conference on optical network design and modeling (pp. 43–48). IEEE. Asensio, A., Velasco, L., Ruiz, M., & Junyent, G. (2014). Carrier sdn to control flexgrid-based inter-datacenter connectivity. In 2014 international conference on optical network design and modeling (pp. 43–48). IEEE.
12.
Zurück zum Zitat Moshref, M., Yu, M., Govindan, R., & Vahdat, A. (2015). Dream: Dynamic resource allocation for software-defined measurement. ACM SIGCOMM Computer Communication Review, 44(4), 419–430.CrossRef Moshref, M., Yu, M., Govindan, R., & Vahdat, A. (2015). Dream: Dynamic resource allocation for software-defined measurement. ACM SIGCOMM Computer Communication Review, 44(4), 419–430.CrossRef
13.
Zurück zum Zitat Buyya, R., Calheiros, R. N., Son, J., Dastjerdi, A. V., & Yoon, Y. (2014). Software-defined cloud computing: Architectural elements and open challenges. In 2014 International conference on advances in computing, communications and informatics (ICACCI) (pp. 1–12). IEEE. Buyya, R., Calheiros, R. N., Son, J., Dastjerdi, A. V., & Yoon, Y. (2014). Software-defined cloud computing: Architectural elements and open challenges. In 2014 International conference on advances in computing, communications and informatics (ICACCI) (pp. 1–12). IEEE.
14.
Zurück zum Zitat Yuan, H., Bi, J., Tan, W., & Li, B. H. (2016). Cawsac: Cost-aware workload scheduling and admission control for distributed cloud data centers. IEEE Transactions on Automation Science and Engineering, 13(2), 976–985.CrossRef Yuan, H., Bi, J., Tan, W., & Li, B. H. (2016). Cawsac: Cost-aware workload scheduling and admission control for distributed cloud data centers. IEEE Transactions on Automation Science and Engineering, 13(2), 976–985.CrossRef
16.
Zurück zum Zitat Guérout, T., Medjiah, S., Da Costa, G., & Monteil, T. (2014). Quality of service modeling for green scheduling in clouds. Sustainable Computing: Informatics and Systems, 4(4), 225–240. Guérout, T., Medjiah, S., Da Costa, G., & Monteil, T. (2014). Quality of service modeling for green scheduling in clouds. Sustainable Computing: Informatics and Systems, 4(4), 225–240.
17.
Zurück zum Zitat Xavier, R., Moens, H., Volckaert, B., & De Turck, F. (2016). Adaptive virtual machine allocation algorithms for cloud-hosted elastic media services. In 2016 IEEE/IFIP network operations and management symposium (NOMS) (pp. 564–570). IEEE. Xavier, R., Moens, H., Volckaert, B., & De Turck, F. (2016). Adaptive virtual machine allocation algorithms for cloud-hosted elastic media services. In 2016 IEEE/IFIP network operations and management symposium (NOMS) (pp. 564–570). IEEE.
18.
Zurück zum Zitat Sharkh, M. A., Kanso, A., Shami, A., & Öhlén, P. (2016). Building a cloud on earth: A study of cloud computing data center simulators. Computer Networks, 108, 78–96.CrossRef Sharkh, M. A., Kanso, A., Shami, A., & Öhlén, P. (2016). Building a cloud on earth: A study of cloud computing data center simulators. Computer Networks, 108, 78–96.CrossRef
19.
Zurück zum Zitat Abase, A. H., Khafagy, M. H., Omara, F. A. (2017). Locality sim: Cloud simulator with data locality. arXiv preprint arXiv:1701.01648. Abase, A. H., Khafagy, M. H., Omara, F. A. (2017). Locality sim: Cloud simulator with data locality. arXiv preprint arXiv:​1701.​01648.
20.
Zurück zum Zitat Wazir, U., Khan, F. G., & Shah, S. (2016). Service level agreement in cloud computing: A survey. International Journal of Computer Science and Information Security, 14(6), 324. Wazir, U., Khan, F. G., & Shah, S. (2016). Service level agreement in cloud computing: A survey. International Journal of Computer Science and Information Security, 14(6), 324.
21.
Zurück zum Zitat Fakhfakh, F., Kacem, H. H., & Kacem, A. H. (2017). Simulation tools for cloud computing: A survey and comparative study. In 2017 IEEE/ACIS 16th international conference on computer and information science (ICIS) (pp. 221–226). IEEE. Fakhfakh, F., Kacem, H. H., & Kacem, A. H. (2017). Simulation tools for cloud computing: A survey and comparative study. In 2017 IEEE/ACIS 16th international conference on computer and information science (ICIS) (pp. 221–226). IEEE.
22.
Zurück zum Zitat Wang, M., & Handurukande, S. (2016). A streaming data anomaly detection analytic engine for mobile network management. In 2016 Intl IEEE conferences on ubiquitous intelligence & computing, advanced and trusted computing, scalable computing and communications, cloud and big data computing, internet of people, and smart world congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld) (pp. 722–729). IEEE. Wang, M., & Handurukande, S. (2016). A streaming data anomaly detection analytic engine for mobile network management. In 2016 Intl IEEE conferences on ubiquitous intelligence & computing, advanced and trusted computing, scalable computing and communications, cloud and big data computing, internet of people, and smart world congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld) (pp. 722–729). IEEE.
24.
Zurück zum Zitat Hu, Z., Zhu, Y., Xu, J., & Yang, Y. (2015). Bregman-based inexact excessive gap method for multiservice resource allocation. IEEE Transactions on Wireless Communications, 14(2), 1115–1130.CrossRef Hu, Z., Zhu, Y., Xu, J., & Yang, Y. (2015). Bregman-based inexact excessive gap method for multiservice resource allocation. IEEE Transactions on Wireless Communications, 14(2), 1115–1130.CrossRef
25.
Zurück zum Zitat Gu, L., Zhou, M., Zhang, Z., Shan, M.-C., Zhou, A., & Winslett, M. (2015). Chronos: An elastic parallel framework for stream benchmark generation and simulation. In 2015 IEEE 31st international conference on data engineering (ICDE) (pp. 101–112). IEEE. Gu, L., Zhou, M., Zhang, Z., Shan, M.-C., Zhou, A., & Winslett, M. (2015). Chronos: An elastic parallel framework for stream benchmark generation and simulation. In 2015 IEEE 31st international conference on data engineering (ICDE) (pp. 101–112). IEEE.
26.
Zurück zum Zitat Yin, B., Shen, W., Cheng, Y., Cai, L. X., & Li, Q. (2017). Distributed resource sharing in fog-assisted big data streaming. In 2017 IEEE international conference on communications (ICC) (pp. 1–6). IEEE. Yin, B., Shen, W., Cheng, Y., Cai, L. X., & Li, Q. (2017). Distributed resource sharing in fog-assisted big data streaming. In 2017 IEEE international conference on communications (ICC) (pp. 1–6). IEEE.
27.
Zurück zum Zitat Mechtri, M. (2014). Virtual networked infrastructure provisioning in distributed cloud environments. Ph.D. dissertation, Institut National des Télécommunications Mechtri, M. (2014). Virtual networked infrastructure provisioning in distributed cloud environments. Ph.D. dissertation, Institut National des Télécommunications
28.
Zurück zum Zitat Islam, M. M., Razzaque, M. A., Hassan, M. M., Nagy, W., & Song, B. (2017). Mobile cloud-based big healthcare data processing in smart cities. IEEE Access, 5, 11887–11899.CrossRef Islam, M. M., Razzaque, M. A., Hassan, M. M., Nagy, W., & Song, B. (2017). Mobile cloud-based big healthcare data processing in smart cities. IEEE Access, 5, 11887–11899.CrossRef
29.
Zurück zum Zitat Zhang, L., Wu, C., Li, Z., Guo, C., Chen, M., & Lau, F. C. (2013). Moving big data to the cloud: An online cost-minimizing approach. IEEE Journal on Selected Areas in Communications, 31(12), 2710–2721.CrossRef Zhang, L., Wu, C., Li, Z., Guo, C., Chen, M., & Lau, F. C. (2013). Moving big data to the cloud: An online cost-minimizing approach. IEEE Journal on Selected Areas in Communications, 31(12), 2710–2721.CrossRef
30.
Zurück zum Zitat Xu, H., & Lau, W. C. (2017). Optimization for speculative execution in big data processing clusters. IEEE Transactions on Parallel and Distributed Systems, 28(2), 530–545. Xu, H., & Lau, W. C. (2017). Optimization for speculative execution in big data processing clusters. IEEE Transactions on Parallel and Distributed Systems, 28(2), 530–545.
32.
Zurück zum Zitat Bellavista, P., Corradi, A., Reale, A., & Ticca, N. (2014). Priority-based resource scheduling in distributed stream processing systems for big data applications. In Proceedings of the 2014 IEEE/ACM 7th international conference on utility and cloud computing (pp. 363–370). IEEE Computer Society. Bellavista, P., Corradi, A., Reale, A., & Ticca, N. (2014). Priority-based resource scheduling in distributed stream processing systems for big data applications. In Proceedings of the 2014 IEEE/ACM 7th international conference on utility and cloud computing (pp. 363–370). IEEE Computer Society.
33.
Zurück zum Zitat Berthet, Q., & Chandrasekaran, V. (2016). Resource allocation for statistical estimation. Proceedings of the IEEE, 104(1), 111–125.CrossRef Berthet, Q., & Chandrasekaran, V. (2016). Resource allocation for statistical estimation. Proceedings of the IEEE, 104(1), 111–125.CrossRef
36.
Zurück zum Zitat Garg, S. K., & Buyya, R. (2011). Networkcloudsim: Modelling parallel applications in cloud simulations. In 2011 Fourth IEEE international conference on utility and cloud computing (UCC) (pp. 105–113). IEEE. Garg, S. K., & Buyya, R. (2011). Networkcloudsim: Modelling parallel applications in cloud simulations. In 2011 Fourth IEEE international conference on utility and cloud computing (UCC) (pp. 105–113). IEEE.
37.
Zurück zum Zitat Wickremasinghe, B., Calheiros, R. N., & Buyya, R. (2010). Cloudanalyst: A cloudsim-based visual modeller for analysing cloud computing environments and applications. In 2010 24th IEEE international conference on advanced information networking and applications (AINA) (pp. 446–452). IEEE. Wickremasinghe, B., Calheiros, R. N., & Buyya, R. (2010). Cloudanalyst: A cloudsim-based visual modeller for analysing cloud computing environments and applications. In 2010 24th IEEE international conference on advanced information networking and applications (AINA) (pp. 446–452). IEEE.
Metadaten
Titel
SDN enabled BDSP in public cloud for resource optimization
verfasst von
Ahmed Al-Mansoori
Jemal Abawajy
Morshed Chowdhury
Publikationsdatum
30.11.2018
Verlag
Springer US
Erschienen in
Wireless Networks / Ausgabe 3/2023
Print ISSN: 1022-0038
Elektronische ISSN: 1572-8196
DOI
https://doi.org/10.1007/s11276-018-1887-9

Weitere Artikel der Ausgabe 3/2023

Wireless Networks 3/2023 Zur Ausgabe

Neuer Inhalt