Skip to main content

2018 | OriginalPaper | Buchkapitel

Air Flow Based Failure Model for Data Centers

verfasst von : Hao Feng, Yuhui Deng, Liang Yu

Erschienen in: Algorithms and Architectures for Parallel Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the explosive growth of data, thousands upon thousands servers are contained in data centers. Hence, node failure is unavoidable and it generally brings effects on the performance of the whole data center. On the other hand, data centers with vast nodes will cause plenty of energy consumption. Many existing task scheduling techniques can effectively reduce the power consumption in data centers by considering heat recirculation. However, traditional techniques barely take the situation of node failure into account. This paper proposes an airflow-based failure model for data centers by leveraging heat recirculation. In this model, the spatial distribution and time distribution of failure nodes are considered. Furthermore, the Genetic algorithm (GA) and Simulated Annealing algorithm (SA) are implemented to evaluate the proposed failure model. Because the position of failures has a significant impact on the heat recirculation and the energy consumption of data centers, failure nodes with different positions are analyzed and evaluated. The experimental results demonstrate that the energy consumption of data centers can be significantly reduced by using the GA and SA algorithms for task scheduling based on proposed failure model.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bilal, K., Malik, S.U.R., Khan, S.U., Zomaya, A.Y.: Trends and challenges in cloud datacenters. IEEE Cloud Comput. 1(1), 10–20 (2014)CrossRef Bilal, K., Malik, S.U.R., Khan, S.U., Zomaya, A.Y.: Trends and challenges in cloud datacenters. IEEE Cloud Comput. 1(1), 10–20 (2014)CrossRef
2.
Zurück zum Zitat Cheng, Y., Fiorani, M., Wosinska, L., Chen, J.: Reliable and cost efficient passive optical interconnects for data centers. IEEE Commun. Lett. 19(11), 1913–1916 (2015)CrossRef Cheng, Y., Fiorani, M., Wosinska, L., Chen, J.: Reliable and cost efficient passive optical interconnects for data centers. IEEE Commun. Lett. 19(11), 1913–1916 (2015)CrossRef
3.
Zurück zum Zitat Deng, Y.: What is the future of disk drives, death or rebirth? ACM Comput. Surv. 43(3), 1–27 (2011)CrossRef Deng, Y.: What is the future of disk drives, death or rebirth? ACM Comput. Surv. 43(3), 1–27 (2011)CrossRef
4.
Zurück zum Zitat Deng, Y., Hu, Y., Meng, X., Zhu, Y., Zhang, Z., Han, J.: Predictively booting nodes to minimize performance degradation of a power-aware web cluster. Cluster Comput. 17, 1309–1322 (2014)CrossRef Deng, Y., Hu, Y., Meng, X., Zhu, Y., Zhang, Z., Han, J.: Predictively booting nodes to minimize performance degradation of a power-aware web cluster. Cluster Comput. 17, 1309–1322 (2014)CrossRef
5.
Zurück zum Zitat Deng, Y., Huang, X., Song, L., Zhou, Y., Wang, F.: Memory deduplication: an effective approach to improve the memory system. J. Inf. Sci. Eng. 33, 1103–1120 (2017) Deng, Y., Huang, X., Song, L., Zhou, Y., Wang, F.: Memory deduplication: an effective approach to improve the memory system. J. Inf. Sci. Eng. 33, 1103–1120 (2017)
6.
Zurück zum Zitat Elgelany, A.: Energy efficiency for data centers and cloud computing: a literature review. Energy 3 (2013) Elgelany, A.: Energy efficiency for data centers and cloud computing: a literature review. Energy 3 (2013)
7.
Zurück zum Zitat Fan, X., Weber, W.D., Barroso, L.A.: Power provisioning for a warehouse-sized computer. ACM (2007) Fan, X., Weber, W.D., Barroso, L.A.: Power provisioning for a warehouse-sized computer. ACM (2007)
8.
Zurück zum Zitat Ferreira, A.M., Pernici, B.: Managing the complex data center environment: an integrated energy-aware framework. Compute 98, 709–749 (2016)MathSciNetCrossRef Ferreira, A.M., Pernici, B.: Managing the complex data center environment: an integrated energy-aware framework. Compute 98, 709–749 (2016)MathSciNetCrossRef
9.
Zurück zum Zitat Guitart, J.: Toward sustainable data centers: a comprehensive energy management strategy. Computing 99(6), 597–615 (2017)MathSciNetCrossRef Guitart, J.: Toward sustainable data centers: a comprehensive energy management strategy. Computing 99(6), 597–615 (2017)MathSciNetCrossRef
10.
Zurück zum Zitat Hua, Y., Liu, X., Jiang, H.: Antelope: a semantic-aware data cube scheme for cloud data center networks. IEEE Trans. Comput. 63(9), 2146–2159 (2014)MathSciNetCrossRef Hua, Y., Liu, X., Jiang, H.: Antelope: a semantic-aware data cube scheme for cloud data center networks. IEEE Trans. Comput. 63(9), 2146–2159 (2014)MathSciNetCrossRef
11.
Zurück zum Zitat Lee, Y.C., Zomaya, A.Y.: Energy efficient utilization of resources in cloud computing systems. J. Supercomput. 60(2), 268–280 (2012)CrossRef Lee, Y.C., Zomaya, A.Y.: Energy efficient utilization of resources in cloud computing systems. J. Supercomput. 60(2), 268–280 (2012)CrossRef
12.
Zurück zum Zitat Li, H., Zhu, G., Cui, C., Tang, H., Dou, Y., He, C.: Energy-efficient migration and consolidation algorithm of virtual machines in data centers for cloud computing. Computing 98(3), 303–317 (2016)MathSciNetCrossRef Li, H., Zhu, G., Cui, C., Tang, H., Dou, Y., He, C.: Energy-efficient migration and consolidation algorithm of virtual machines in data centers for cloud computing. Computing 98(3), 303–317 (2016)MathSciNetCrossRef
13.
Zurück zum Zitat Li, L., Ho, D.W.C., Lu, J.: A consensus recovery approach to nonlinear multi-agent system under node failure (2016) Li, L., Ho, D.W.C., Lu, J.: A consensus recovery approach to nonlinear multi-agent system under node failure (2016)
14.
Zurück zum Zitat Lin, R., Deng, Y.: Allocating workload to minimize the power consumption of data centers. Front. Comput. Sci. 11(1), 105–118 (2017)CrossRef Lin, R., Deng, Y.: Allocating workload to minimize the power consumption of data centers. Front. Comput. Sci. 11(1), 105–118 (2017)CrossRef
15.
Zurück zum Zitat Liu, Z., et al.: Renewable and cooling aware workload management for sustainable data centers. In: ACM Sigmetrics/Performance Joint International Conference on Measurement and Modeling of Computer Systems, pp. 175–186 (2012) Liu, Z., et al.: Renewable and cooling aware workload management for sustainable data centers. In: ACM Sigmetrics/Performance Joint International Conference on Measurement and Modeling of Computer Systems, pp. 175–186 (2012)
16.
Zurück zum Zitat Moore, J., Chase, J., Ranganathan, P., Sharma, R.: Making scheduling “cool": temperature-aware workload placement in data centers. In: Usenix Technical Conference, Anaheim, CA, USA, 10–15 April 2005, pp. 61–75 (2008) Moore, J., Chase, J., Ranganathan, P., Sharma, R.: Making scheduling “cool": temperature-aware workload placement in data centers. In: Usenix Technical Conference, Anaheim, CA, USA, 10–15 April 2005, pp. 61–75 (2008)
17.
Zurück zum Zitat Polverini, M., Vasilakos, A.V., Ren, S., Cianfrani, A.: Thermal-aware scheduling of batch jobs in geographically distributed data centers. IEEE Trans. Cloud Comput. 2(1), 71–84 (2014)CrossRef Polverini, M., Vasilakos, A.V., Ren, S., Cianfrani, A.: Thermal-aware scheduling of batch jobs in geographically distributed data centers. IEEE Trans. Cloud Comput. 2(1), 71–84 (2014)CrossRef
18.
Zurück zum Zitat Popoola, O., Pranggono, B.: On energy consumption of switch-centric data center networks. J. Supercomput. 1–36 (2017) Popoola, O., Pranggono, B.: On energy consumption of switch-centric data center networks. J. Supercomput. 1–36 (2017)
19.
Zurück zum Zitat Sahoo, R.K., Sivasubramaniam, A., Squillante, M.S., Zhang, Y.: Failure data analysis of a large-scale heterogeneous server environment, p. 772 (2004) Sahoo, R.K., Sivasubramaniam, A., Squillante, M.S., Zhang, Y.: Failure data analysis of a large-scale heterogeneous server environment, p. 772 (2004)
20.
Zurück zum Zitat Sanjeevi, P., Viswanathan, P.: Nuts scheduling approach for cloud data centers to optimize energy consumption. Computing 11, 1–27 (2017) Sanjeevi, P., Viswanathan, P.: Nuts scheduling approach for cloud data centers to optimize energy consumption. Computing 11, 1–27 (2017)
21.
Zurück zum Zitat Schroeder, B., Gibson, G.A.: A large-scale study of failures in high-performance computing systems. IEEE Trans. Dependable Secure Comput. 7(4), 337–350 (2010)CrossRef Schroeder, B., Gibson, G.A.: A large-scale study of failures in high-performance computing systems. IEEE Trans. Dependable Secure Comput. 7(4), 337–350 (2010)CrossRef
22.
Zurück zum Zitat Tang, Q., Gupta, S.K.S., Stanzione, D., Cayton, P.: Thermal-aware task scheduling to minimize energy usage of blade server based datacenters. In: IEEE International Symposium on Dependable, Autonomic and Secure Computing, pp. 195–202 (2006) Tang, Q., Gupta, S.K.S., Stanzione, D., Cayton, P.: Thermal-aware task scheduling to minimize energy usage of blade server based datacenters. In: IEEE International Symposium on Dependable, Autonomic and Secure Computing, pp. 195–202 (2006)
23.
Zurück zum Zitat Tang, Q., Gupta, S.K.S., Varsamopoulos, G.: Energy-efficient thermal-aware task scheduling for homogeneous high-performance computing data centers: a cyber-physical approach. IEEE Trans. Parallel Distrib. Syst. 19(11), 1458–1472 (2008)CrossRef Tang, Q., Gupta, S.K.S., Varsamopoulos, G.: Energy-efficient thermal-aware task scheduling for homogeneous high-performance computing data centers: a cyber-physical approach. IEEE Trans. Parallel Distrib. Syst. 19(11), 1458–1472 (2008)CrossRef
24.
Zurück zum Zitat Wang, L., Khan, S.U.: Review of performance metrics for green data centers: a taxonomy study. J. Supercomput. 63(3), 639–656 (2013)CrossRef Wang, L., Khan, S.U.: Review of performance metrics for green data centers: a taxonomy study. J. Supercomput. 63(3), 639–656 (2013)CrossRef
25.
Zurück zum Zitat Wang, L., Khan, S.U., Dayal, J.: Thermal aware workload placement with task-temperature profiles in a data center. J. Supercomput. 61(3), 780–803 (2012)CrossRef Wang, L., Khan, S.U., Dayal, J.: Thermal aware workload placement with task-temperature profiles in a data center. J. Supercomput. 61(3), 780–803 (2012)CrossRef
26.
Zurück zum Zitat Wei, J., Jiang, H., Zhou, K., Feng, D.: Efficiently representing membershipfor variable large data sets. IEEE Trans. Parallel Distrib. Syst. 25(4), 960–970 (2014)CrossRef Wei, J., Jiang, H., Zhou, K., Feng, D.: Efficiently representing membershipfor variable large data sets. IEEE Trans. Parallel Distrib. Syst. 25(4), 960–970 (2014)CrossRef
27.
Zurück zum Zitat Wierman, A., Andrew, L.L.H., Thereska, E.: Dynamic right-sizing for power-proportional data centers. IEEE/ACM Trans. Networking 21(5), 1378–1391 (2011) Wierman, A., Andrew, L.L.H., Thereska, E.: Dynamic right-sizing for power-proportional data centers. IEEE/ACM Trans. Networking 21(5), 1378–1391 (2011)
28.
Zurück zum Zitat Xie, J., Deng, Y., Min, G., Zhou, Y.: An incrementally scalable and cost-efficient interconnection structure for data centers. IEEE Trans. Parallel Distrib. Syst. 28(6), 1578–1592 (2017)CrossRef Xie, J., Deng, Y., Min, G., Zhou, Y.: An incrementally scalable and cost-efficient interconnection structure for data centers. IEEE Trans. Parallel Distrib. Syst. 28(6), 1578–1592 (2017)CrossRef
29.
Zurück zum Zitat Yang, L., Deng, Y., Yang, L.T., Lin, R.: Reducing the cooling power of data centers by intelligently assigning tasks. IEEE Internet Things J. 5(3), 1667–1678 (2017)CrossRef Yang, L., Deng, Y., Yang, L.T., Lin, R.: Reducing the cooling power of data centers by intelligently assigning tasks. IEEE Internet Things J. 5(3), 1667–1678 (2017)CrossRef
30.
Zurück zum Zitat Zhan, X., Reda, S.: Power budgeting techniques for data centers. IEEE Trans. Comput. 64(8), 2267–2278 (2015)MathSciNetCrossRef Zhan, X., Reda, S.: Power budgeting techniques for data centers. IEEE Trans. Comput. 64(8), 2267–2278 (2015)MathSciNetCrossRef
31.
Zurück zum Zitat Zhang, L., Deng, Y., Zhu, W., Zhou, J., Wang, F.: Skewly replicating hot data to construct a power-efficient storage cluster. J. Netw. Comput. Appl. 50, 168–179 (2015)CrossRef Zhang, L., Deng, Y., Zhu, W., Zhou, J., Wang, F.: Skewly replicating hot data to construct a power-efficient storage cluster. J. Netw. Comput. Appl. 50, 168–179 (2015)CrossRef
32.
Zurück zum Zitat Zhang, Y., Squillante, M.S., Sivasubramaniam, A., Sahoo, R.K.: Performance implications of failures in large-scale cluster scheduling. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2004. LNCS, vol. 3277, pp. 233–252. Springer, Heidelberg (2005). https://doi.org/10.1007/11407522_13CrossRef Zhang, Y., Squillante, M.S., Sivasubramaniam, A., Sahoo, R.K.: Performance implications of failures in large-scale cluster scheduling. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2004. LNCS, vol. 3277, pp. 233–252. Springer, Heidelberg (2005). https://​doi.​org/​10.​1007/​11407522_​13CrossRef
33.
Zurück zum Zitat Zhou, K., Hu, S., Huang, P.H., Zhao, Y.: LX-SSD : enhancing the lifespan of NAND flash-based memory via recycling invalid pages. In: 33rd International Conference on Massive Storage Systems and Technology (MSST 2017) (2017) Zhou, K., Hu, S., Huang, P.H., Zhao, Y.: LX-SSD : enhancing the lifespan of NAND flash-based memory via recycling invalid pages. In: 33rd International Conference on Massive Storage Systems and Technology (MSST 2017) (2017)
Metadaten
Titel
Air Flow Based Failure Model for Data Centers
verfasst von
Hao Feng
Yuhui Deng
Liang Yu
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-05051-1_14