nach oben

Cluster Computing

Erschienen in:

01.12.2014

Data center energy efficient resource scheduling

verfasst von: Junaid Shuja, Kashif Bilal, Sajjad Ahmad Madani, Samee U. Khan

Erschienen in: Cluster Computing | Ausgabe 4/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

The information and communication technology (ICT) sector has grown exponentially in the recent years. An essential component of the ICT organizations is constituted by the data centers that are densely populated with redundant servers and communicational links to ensure the provision of 99.99 % availability of services; a fact responsible for the heavy energy consumption by data centers. For energy economy, the redundant elements can be powered off based on the current workload within the data center. We propose a Data Center-wide Energy-Efficient Resource Scheduling framework (DCEERS) that schedules data center resources according to the current workload of the data center. Minimum subset of resources to service the current workload are calculated by solving the Minimum Cost Multi Commodity Flow (MCMCF) using the Benders decomposition algorithm. The Benders decomposition algorithm is scalable: it solves the MCMCF problem in linear time for large data center environments. Our simulated results depict that DCEERS achieves better energy efficiency than the previous data center resource scheduling methodologies.

Vorheriger Artikel Scalable and efficient workload hotspot detection in virtualized environment

Nächster Artikel Empirical and analytical approaches for web server power modeling

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

http://www.ilog.com

http://www.isi.edu/nsnam/ns/

Masanet, E., Brown, R., Shehabi, A., Koomey, J., Nordman, B.: Estimating the energy use and efficiency potential of u.s. data centers. Proc. IEEE 99(8), 1440–1453 (2011)CrossRef

Brown, R.: Report to congress on server and data center energy efficiency public law 109–431. Environ. Prot. 109, 431 (2007)

Bolla, R., Davoli, F., Bruschi, R., Christensen, K., Cucchietti, F., Singh, S.: The potential impact of green technologies in next-generation wireline networks: Is there room for energy saving optimization? Commun. Mag. IEEE 49(8), 80–86 (2011)CrossRef

Webb, M.: SMART 2020: Enabling the low carbon economy in the information age. Tech. rep, Climate Group on behalf of the Global eSustainability Initiative (GeSI) (2008)

Koomey, J.G.: Worldwide electricity used in data centers. Environ. Res. Lett., IOPscience 3(3), 1–8 (2008).

Wang, L., Khan, S.U.: Review of performance metrics for green data centers: a taxonomy study. J. Supercomput. 63(3), 639–656 (2013)CrossRefMathSciNet

Kliazovich, D., Bouvry, P., Audzevich, Y., Khan, S.: Greencloud: A packet-level simulator of energy-aware cloud computing data centers. In: GLOBECOM 2010, 2010 IEEE Global Telecommunications Conference, pp. 1–5 (2010).

Despins, C., Labeau, F., Le Ngoc, T., Labelle, R., Cheriet, M., Thibeault, C., Gagnon, F., Leon-Garcia, A., Cherkaoui, O., St Arnaud, B., et al.: Leveraging green communications for carbon emission reductions: Techniques, testbeds, and emerging carbon footprint standards. Communications Magazine, IEEE 49(8), 101–109 (2011).

Khan, S.U., Wang, L., Yang, L.T., Xia, F.: Green computing and communications. J. Supercomput. 63(3), 637–638 (2013)CrossRef

10.

Khargharia, B., Hariri, S., Szidarovszky, F., Houri, M., El-Rewini, H., Khan, S., Ahmad, I., Yousif, M.: Autonomic power performance management for large-scale data centers. In: Parallel and Distributed Processing Symposium, 2007. IPDPS 2007. IEEE, International, pp. 1–8 (2007).

11.

Wang, L., Khan, S.U., Chen, D., Kołodziej, J., Ranjan, R., Xu, Cz, Zomaya, A.: Energy-aware parallel task scheduling in a cluster. Future Gener. Comput. Syst. 29(7), 1661–1670 (2013)CrossRef

12.

Heller, B., Seetharaman, S., Mahadevan, P., Yiakoumis, Y., Sharma, P., Banerjee, S., Mckeown, N.: Elastictree: Saving energy in data center networks. In: IN NSDI (2010).

13.

Da Costa, G., Gelas, J.P., Georgiou, Y., Lefevre, L., Orgerie, A.C., Pierson, J.M., Richard, O., Sharma, K.: The green-net framework: Energy efficiency in large scale distributed systems. In: Parallel Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on, pp. 1–8 (2009).

14.

Garg, M., Smith, J.C.: Models and algorithms for the design of survivable multicommodity flow networks with general failure scenarios. Omega 36(6), 1057–1071 (2008)CrossRef

15.

Kliazovich, D., Bouvry, P., Khan, S.: Dens: Data center energy-efficient network-aware scheduling. In: Green Computing and Communications (GreenCom), 2010 IEEE/ACM Int’l Conference on Int’l Conference on Cyber, Physical and Social Computing (CPSCom), pp. 69–75 (2010).

16.

Cisco: Cisco data center infrastructure 2.5 design guide. Cisco press (2007).

17.

Raiciu, C., Barre, S., Pluntke, C., Greenhalgh, A., Wischik, D., Handley, M.: Improving datacenter performance and robustness with multipath tcp. SIGCOMM Comput. Commun. Rev. 41, 266–277 (2011)CrossRef

18.

Al-Fares, M., Loukissas, A., Vahdat, A.: A scalable, commodity data center network architecture. SIGCOMM Comput. Commun. Rev. 38, 63–74 (2008)CrossRef

19.

Greenberg, A., Hamilton, J.R., Jain, N., Kandula, S., Kim, C., Lahiri, P., Maltz, D.A., Patel, P., Sengupta, S.: Vl2: a scalable and flexible data center network. Proceedings of the ACM SIGCOMM 2009 conference on Data communication. SIGCOMM ’09, pp. 51–62. ACM, New York, NY, USA (2009)

20.

Bilal, K., Khan, S.U., Zhang, L., Li, H., Hayat, K., Madani, S.A., Min-Allah, N., Wang, L., Chen, D., Iqbal, M., et al.: Quantitative comparisons of the state-of-the-art data center architectures. Concurr. Comput.: Pract. Exp. 25(12), 1771–1783 (2013)CrossRef

21.

Al-fares, M., Radhakrishnan, S., Raghavan, B., Huang, N., Vahdat, A.: Hedera: Dynamic flow scheduling for data center networks. In: In Proceedings of Networked Systems Design and Implementation (NSDI) Symposium (2010).

22.

Greenberg, A., Hamilton, J., Maltz, D.A., Patel, P.: The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev. 39, 68–73 (2008)CrossRef

23.

Bilal, K., Malik, S.U.R., Khalid, O., Hameed, A., Alvarez, E., Wijaysekara, V., Irfan, R., Shrestha, S., Dwivedy, D., Ali, M., et al.: A taxonomy and survey on green data center networks. Future Gener. Comput. Syst. (2013).

24.

Valentini, G.L., Lassonde, W., Khan, S.U., Min-Allah, N., Madani, S.A., Li, J., Zhang, L., Wang, L., Ghani, N., Kolodziej, J., et al.: An overview of energy efficiency techniques in cluster computing systems. Clust. Comput. 16(1), 3–15 (2013)CrossRef

25.

Liu, J., Zhao, F., Liu, X., He, W.: Challenges towards elastic power management in internet data centers. In: Distributed Computing Systems Workshops, 2009. ICDCS Workshops ’09. 29th IEEE International Conference on, pp. 65–72 (2009).

26.

Wang, L., von Laszewski, G., Tao, J., Kunze, M.: Grid virtualization engine: design, implementation, and evaluation. Syst. J. IEEE 3(4), 477–488 (2009)CrossRef

27.

Kołodziej, J., Khan, S.U., Wang, L., Byrski, A., Min-Allah, N., Madani, S.A.: Hierarchical genetic-based grid scheduling with energy optimization. Clust. Comput. 16(3), 591–609 (2013)CrossRef

28.

Horvath, T., Abdelzaher, T., Skadron, K., Liu, X.: Dynamic voltage scaling in multitier web servers with end-to-end delay control. Comput. IEEE Trans. 56(4), 444–458 (2007)CrossRefMathSciNet

29.

Bilal, K., Khan, S., Madani, S., Hayat, K., Khan, M., Min-Allah, N., Kolodziej, J., Wang, L., Zeadally, S., Chen, D.: A survey on green communications using adaptive link rate. Clust. Comput. 16(3), 575–589 (2013)CrossRef

30.

Shuja, J., Madani, S.A., Bilal, K., Hayat, K., Khan, S.U., Sarwar, S.: Energy-efficient data centers. Computing 94(12), 973–994 (2012)CrossRefMATH

31.

Cha, M., Kwak, H., Rodriguez, P., Ahn, Y.Y., Moon, S.: I tube, you tube, everybody tubes: analyzing the world’s largest user generated content video system. In: Proceedings of the 7th ACM SIGCOMM conference on Internet measurement. IMC ’07, pp. 1–14. ACM, New York, NY, USA (2007)

32.

Meisner, D., Sadler, C.M., Barroso, L.A., Weber, W.D., Wenisch, T.F.: Power management of online data-intensive services. In: Computer Architecture (ISCA), 2011 38th Annual International Symposium on, pp. 319–330. IEEE (2011).

33.

Wang, L., Tao, J., Ranjan, R., Marten, H., Streit, A., Chen, J., Chen, D.: G-hadoop: Mapreduce across distributed data centers for data-intensive computing. Future Gener. Comput. Syst. 29(3), 739–750 (2013)CrossRef

34.

Wang, L., Tao, J., Marten, H., Streit, A., Khan, S.U., Kolodziej, J., Chen, D.: Mapreduce across distributed clusters for data-intensive applications. In: Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), 2012 IEEE 26th International, pp. 2004–2011. IEEE (2012).

35.

Urgaonkar, R., Kozat, U.C., Igarashi, K., Neely, M.J.: Dynamic resource allocation and power management in virtualized data centers. In: NOMS, pp. 479–486 (2010).

36.

Beloglazov, A., Buyya, R.: Energy efficient resource management in virtualized cloud data centers. In: Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on, pp. 826–831 (2010).

37.

Wang, L., Khan, S., Dayal, J.: Thermal aware workload placement with task-temperature profiles in a data center. J. Supercomput. 61(3), 780–803 (2012)CrossRef

38.

Wang, L., von Laszewski, G., Dayal, J., He, X., Younge, A.J., Furlani, T.R.: Towards thermal aware workload scheduling in a data center. In: Proceedings of the 2009 10th International Symposium on Pervasive Systems. Algorithms, and Networks, ISPAN ’09, pp. 116–122. IEEE Computer Society, Washington, DC, USA (2009)

39.

Wang, L., von Laszewski, G., Huang, F., Dayal, J., Frulani, T., Fox, G.: Task scheduling with ann-based temperature prediction in a data center: a simulation-based study. Eng. Comput. 27(4), 381–391 (2011)CrossRef

40.

Meng, X., Pappas, V., Zhang, L.: Improving the scalability of data center networks with traffic-aware virtual machine placement. In: INFOCOM, 2010 Proceedings IEEE, pp. 1–9 (2010).

41.

Wang, G., Ng, T.S.E.: The impact of virtualization on network performance of amazon ec2 data center. In: Proceedings of the 29th conference on Information communications. INFOCOM’10, pp. 1163–1171. IEEE Press, Piscataway, NJ, USA (2010)

42.

Voorsluys, W., Broberg, J., Venugopal, S., Buyya, R.: Cost of virtual machine live migration in clouds: A performance evaluation. In: Proceedings of the 1st International Conference on Cloud Computing. CloudCom ’09, pp. 254–265. Springer-Verlag, Berlin, Heidelberg (2009)

43.

Banerjee, A., Mukherjee, T., Varsamopoulos, G., Gupta, S.: Cooling-aware and thermal-aware workload placement for green hpc data centers. In: Green Computing Conference, 2010 International, pp. 245–256 (2010).

44.

Parolini, L., Sinopoli, B., Krogh, B.H., Wang, Z.: A cyber-physical systems approach to data center modeling and control for energy efficiency. Proc. IEEE PP(99), 1–15 (2011).

45.

Le, K., Bianchini, R., Martonosi, M., Nguyen, T.: Cost-and energy-aware load distribution across data centers. Proc. HotPower pp. 1–5 (2009).

46.

McKeown, N., Anderson, T., Balakrishnan, H., Parulkar, G., Peterson, L., Rexford, J., Shenker, S., Turner, J.: Openflow: enabling innovation in campus networks. SIGCOMM Comput. Commun. Rev. 38(2), 69–74 (2008)CrossRef

47.

Wang, L., Tao, J., von Laszewski, G., Marten, H.: Multicores in cloud computing: research challenges for applications. J. Comput. 5(6), 958–964 (2010)

48.

Zink, M., Suh, K., Gu, Y., Kurose, J.: Characteristics of youtube network traffic at a campus network-measurements, models, and implications. Comput. Netw. 53(4), 501–514 (2009)CrossRef

49.

Bilal, K., Manzano, M., Khan, S.U., Calle, E., Li, K., Zomaya, A.Y.: On the characterization of the structural robustness of data center networks. IEEE Transaction on Cloud Computing (2013).

50.

Geoffrion, A.M., Graves, G.W.: Multicommodity distribution system design by benders decomposition. Manag. Sci. 20(5), 822–844 (1974)CrossRefMATHMathSciNet

51.

Multicommodity network flow models and algorithms in telecommunications. Handbook of optimization in telecommunications, pp. 163–184. Springer, New York (2006)

52.

Wang, L., Anta, A.F., Zhang, F., Hou, C., Liu, Z.: Routing for energy minimization with discrete cost functions. arXiv, preprint arXiv:1302.0234 (2013).

53.

Costa, A.M.: A survey on benders decomposition applied to fixed-charge network design problems. Comput. Oper. Res. 32(6), 1429–1450 (2005)CrossRefMathSciNet

54.

Chen, G., He, W., Liu, J., Nath, S., Rigas, L., Xiao, L., Zhao, F.: Energy-aware server provisioning and load dispatching for connection-intensive internet services. In: Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation. NSDI’08, pp. 337–350. USENIX Association, Berkeley, CA, USA (2008)

55.

Jiang, N., Parashar, M.: Enabling autonomic power-aware management of instrumented data centers. In: Parallel Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on, pp. 1–8 (2009).

56.

Bianzino, A.P., Chaudet, C., Rossi, D., Rougier, J.L.: A survey of green networking research. CoRR (2010).

Titel: Data center energy efficient resource scheduling
verfasst von: Junaid Shuja
Kashif Bilal
Sajjad Ahmad Madani
Samee U. Khan
Publikationsdatum: 01.12.2014
Verlag: Springer US
Erschienen in: Cluster Computing / Ausgabe 4/2014
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI: https://doi.org/10.1007/s10586-014-0365-0

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Weitere Artikel der Ausgabe 4/2014

Efficient public verification proof of retrievability scheme in cloud

A comparative study on resource allocation and energy efficient job scheduling strategies in large-scale parallel computing systems

Towards an integrated management system based on abstraction of heterogeneous virtual resources

Adaptive Combiner for MapReduce on cloud computing

Predictively booting nodes to minimize performance degradation of a power-aware web cluster

DIRAQ: scalable in situ data- and resource-aware indexing for optimized query performance

Premium Partner