Skip to main content
Erschienen in: Cluster Computing 4/2019

02.02.2019

Reliability and energy efficient workflow scheduling in cloud environment

verfasst von: Ritu Garg, Mamta Mittal, Le Hoang Son

Erschienen in: Cluster Computing | Ausgabe 4/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cloud data centers consume huge amounts of electrical energy which results in an increased operational cost, decreased system reliability and carbon dioxide footprints. Thus, it is highly important to develop scheduling strategy to reduce energy consumption. Dynamic voltage and frequency scaling (DVFS) has been recognized as an efficient technique for reducing energy consumption. However, there is negative impact of DVFS on the reliability of system as it increases the transient faults during the application execution. Hence, it is essential to address the issue of reliability for mission critical applications. Recent studies on workflow scheduling in distributed environment have not considered reliability while minimizing the energy consumption. In this paper, we propose a new scheduling algorithm called the reliability and energy efficient workflow scheduling algorithm which jointly optimizes lifetime reliability of application and energy consumption and guarantees the user specified QoS constraint. The proposed algorithm works in four phases: priority calculation, clustering of tasks, distribution of target time and assigning the cluster to processing element with appropriate voltage/frequency levels. The simulation results obtained by using randomly generated task graphs and Gaussian Elimination task graphs shows that the proposed approach is effective in joint optimization of lifetime reliability of system and energy consumption compared to existing algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Fut. Gener. Comput. Syst. 25(6), 599–616 (2009)CrossRef Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Fut. Gener. Comput. Syst. 25(6), 599–616 (2009)CrossRef
2.
Zurück zum Zitat Theis, T.N., Wong, H.S.P.: The end of Moore’s law: a new beginning for information technology. Comput. Sci. Eng. 19(2), 41–50 (2017)CrossRef Theis, T.N., Wong, H.S.P.: The end of Moore’s law: a new beginning for information technology. Comput. Sci. Eng. 19(2), 41–50 (2017)CrossRef
5.
Zurück zum Zitat Orgerie, A.C., Lefèvre, L., Gelas, J.P.: Save watts in your grid: green strategies for energy-aware framework in large scale distributed systems. In: 2008 14th IEEE International Conference on Parallel and Distributed Systems (pp. 171–178). IEEE (2008) Orgerie, A.C., Lefèvre, L., Gelas, J.P.: Save watts in your grid: green strategies for energy-aware framework in large scale distributed systems. In: 2008 14th IEEE International Conference on Parallel and Distributed Systems (pp. 171–178). IEEE (2008)
7.
Zurück zum Zitat Garg, R., Singh, A.: Energy-aware workflow scheduling in grid under QoS constraints. Arab. J. Sci. Eng. 41(2), 495–511 (2015)CrossRef Garg, R., Singh, A.: Energy-aware workflow scheduling in grid under QoS constraints. Arab. J. Sci. Eng. 41(2), 495–511 (2015)CrossRef
9.
Zurück zum Zitat Topcuoglu, H., Hariri, S., Wu, M.Y.: Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans. Parallel Distrib. Syst. 13(3), 260–274 (2002)CrossRef Topcuoglu, H., Hariri, S., Wu, M.Y.: Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans. Parallel Distrib. Syst. 13(3), 260–274 (2002)CrossRef
10.
Zurück zum Zitat Maheswaran, M., Ali, S., Siegal, H.J., Hensgen, D., Freund, R.F.: Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems. In: Heterogeneous Computing Workshop, 1999 (HCW’99), Proceedings, pp. 30–44. IEEE (1999) Maheswaran, M., Ali, S., Siegal, H.J., Hensgen, D., Freund, R.F.: Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems. In: Heterogeneous Computing Workshop, 1999 (HCW’99), Proceedings, pp. 30–44. IEEE (1999)
11.
Zurück zum Zitat Wang, L., Lu, Y.: Efficient power management of heterogeneous soft real-time clusters. In: Real-Time Systems Symposium, 2008, pp. 323–332. IEEE (2008) Wang, L., Lu, Y.: Efficient power management of heterogeneous soft real-time clusters. In: Real-Time Systems Symposium, 2008, pp. 323–332. IEEE (2008)
12.
Zurück zum Zitat Kim, K., Buyya, R., Kim, J.: Power aware scheduling of bag-of-tasks applications with deadline constraints on DVS-enabled clusters. In: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, vol. 7, pp. 541–548 (2007) Kim, K., Buyya, R., Kim, J.: Power aware scheduling of bag-of-tasks applications with deadline constraints on DVS-enabled clusters. In: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, vol. 7, pp. 541–548 (2007)
13.
Zurück zum Zitat Dongarra, J.J., Jeannot, E., Saule, E., Shi, Z.: Bi-objective scheduling algorithms for optimizing makespan and reliability on heterogeneous systems. In: Proceedings of the Nineteenth Annual ACM Symposium on Parallel Algorithms and Architectures, pp. 280–288. ACM (2007) Dongarra, J.J., Jeannot, E., Saule, E., Shi, Z.: Bi-objective scheduling algorithms for optimizing makespan and reliability on heterogeneous systems. In: Proceedings of the Nineteenth Annual ACM Symposium on Parallel Algorithms and Architectures, pp. 280–288. ACM (2007)
14.
Zurück zum Zitat Dogan, A., Ozguner, F.: Matching and scheduling algorithms for minimizing execution time and failure probability of applications in heterogeneous computing. IEEE Trans. Parallel Distrib. Syst. 13(3), 308–323 (2002)CrossRef Dogan, A., Ozguner, F.: Matching and scheduling algorithms for minimizing execution time and failure probability of applications in heterogeneous computing. IEEE Trans. Parallel Distrib. Syst. 13(3), 308–323 (2002)CrossRef
15.
Zurück zum Zitat Tang, X., Li, K., Qiu, M., Sha, E.H.M.: A hierarchical reliability-driven scheduling algorithm in grid systems. J. Parallel Distrib. Comput. 72(4), 525–535 (2012)CrossRef Tang, X., Li, K., Qiu, M., Sha, E.H.M.: A hierarchical reliability-driven scheduling algorithm in grid systems. J. Parallel Distrib. Comput. 72(4), 525–535 (2012)CrossRef
16.
Zurück zum Zitat Zhang, Y., Chakrabarty, K.: Energy-aware adaptive checkpointing in embedded real-time systems. In: Proceedings of the Design, Automation & Test in Europe Conference, pp. 918–923 (2003) Zhang, Y., Chakrabarty, K.: Energy-aware adaptive checkpointing in embedded real-time systems. In: Proceedings of the Design, Automation & Test in Europe Conference, pp. 918–923 (2003)
17.
Zurück zum Zitat Zhu, D., Melhem, R., Mosse, D.: The effects of energy management on reliability in real-time embedded systems. In: IEEE/ACM International Conference on Computer Aided Design (ICCAD’04), pp. 35–40 (2004) Zhu, D., Melhem, R., Mosse, D.: The effects of energy management on reliability in real-time embedded systems. In: IEEE/ACM International Conference on Computer Aided Design (ICCAD’04), pp. 35–40 (2004)
18.
Zurück zum Zitat Lee, Y.C., Zomaya, A.Y.: Energy conscious scheduling for distributed computing systems under different operating conditions. IEEE Trans. Parallel Distrib. Syst. 22(8), 1374–1381 (2011)CrossRef Lee, Y.C., Zomaya, A.Y.: Energy conscious scheduling for distributed computing systems under different operating conditions. IEEE Trans. Parallel Distrib. Syst. 22(8), 1374–1381 (2011)CrossRef
19.
Zurück zum Zitat Pruhs, K., Van Stee, R., Uthaisombut, P.: Speed scaling of tasks with precedence constraints. Theory Comput. Syst. 43(1), 67–80 (2008)MathSciNetCrossRef Pruhs, K., Van Stee, R., Uthaisombut, P.: Speed scaling of tasks with precedence constraints. Theory Comput. Syst. 43(1), 67–80 (2008)MathSciNetCrossRef
20.
Zurück zum Zitat Wang, L., Khan, S.U., Chen, D., KołOdziej, J., Ranjan, R., Xu, C.Z., Zomaya, A.: Energy-aware parallel task scheduling in a cluster. Fut. Gener. Comput. Syst. 29(7), 1661–1670 (2013)CrossRef Wang, L., Khan, S.U., Chen, D., KołOdziej, J., Ranjan, R., Xu, C.Z., Zomaya, A.: Energy-aware parallel task scheduling in a cluster. Fut. Gener. Comput. Syst. 29(7), 1661–1670 (2013)CrossRef
21.
Zurück zum Zitat Faragardi, H.R., et al.: An analytical model to evaluate reliability of cloud computing systems in the presence of QoS requirements. In: 2013 IEEE/ACIS 12th International Conference on Computer and Information Science (ICIS). IEEE (2013) Faragardi, H.R., et al.: An analytical model to evaluate reliability of cloud computing systems in the presence of QoS requirements. In: 2013 IEEE/ACIS 12th International Conference on Computer and Information Science (ICIS). IEEE (2013)
22.
Zurück zum Zitat Qin, X., Jiang, H.: A dynamic and reliability-driven scheduling algorithm for parallel real-time jobs executing on heterogeneous clusters. J. Parallel Distrib. Comput. 65(8), 885–900 (2005)CrossRef Qin, X., Jiang, H.: A dynamic and reliability-driven scheduling algorithm for parallel real-time jobs executing on heterogeneous clusters. J. Parallel Distrib. Comput. 65(8), 885–900 (2005)CrossRef
23.
Zurück zum Zitat Boeres, C., Sardiña, I., Drummond, L.: An efficient weighted bi-objective scheduling algorithm for heterogeneous systems. Parallel Comput. 37(8), 349–364 (2011)CrossRef Boeres, C., Sardiña, I., Drummond, L.: An efficient weighted bi-objective scheduling algorithm for heterogeneous systems. Parallel Comput. 37(8), 349–364 (2011)CrossRef
24.
Zurück zum Zitat Girault, Alain, Saule, Erik, Trystram, Denis: Reliability versus performance for critical applications. J. Parallel Distrib. Comput. 69(3), 326–336 (2009)CrossRef Girault, Alain, Saule, Erik, Trystram, Denis: Reliability versus performance for critical applications. J. Parallel Distrib. Comput. 69(3), 326–336 (2009)CrossRef
25.
Zurück zum Zitat Mezmaz, M., Melab, N., Kessaci, Y., Lee, Y.C., Talbi, E.G., Zomaya, A.Y., Tuyttens, D.: A parallel bi-objective hybrid metaheuristic for energy-aware scheduling for cloud computing systems. J. Parallel Distrib. Comput. 71(11), 1497–1508 (2011)CrossRef Mezmaz, M., Melab, N., Kessaci, Y., Lee, Y.C., Talbi, E.G., Zomaya, A.Y., Tuyttens, D.: A parallel bi-objective hybrid metaheuristic for energy-aware scheduling for cloud computing systems. J. Parallel Distrib. Comput. 71(11), 1497–1508 (2011)CrossRef
26.
Zurück zum Zitat Qi, X., Zhu, D., Aydin, H.: Global scheduling based reliability-aware power management for multiprocessor real-time systems. Real Time Syst. 47(2), 109–142 (2011)CrossRef Qi, X., Zhu, D., Aydin, H.: Global scheduling based reliability-aware power management for multiprocessor real-time systems. Real Time Syst. 47(2), 109–142 (2011)CrossRef
27.
Zurück zum Zitat Zhang, L., et al.: Maximizing reliability with energy conservation for parallel task scheduling in a heterogeneous cluster. Inf. Sci. 319, 113 (2015)MathSciNetCrossRef Zhang, L., et al.: Maximizing reliability with energy conservation for parallel task scheduling in a heterogeneous cluster. Inf. Sci. 319, 113 (2015)MathSciNetCrossRef
28.
Zurück zum Zitat Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A., Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw. Pract. Exp. 41(1), 23–50 (2011)CrossRef Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A., Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw. Pract. Exp. 41(1), 23–50 (2011)CrossRef
29.
Zurück zum Zitat Garg, R., Singh, A.K.: Multi-objective workflow grid scheduling using ε-fuzzy dominance sort based discrete particle swarm optimization. J. Supercomput. 68(2), 709–732 (2014)CrossRef Garg, R., Singh, A.K.: Multi-objective workflow grid scheduling using ε-fuzzy dominance sort based discrete particle swarm optimization. J. Supercomput. 68(2), 709–732 (2014)CrossRef
30.
Zurück zum Zitat Guérout, T., Monteil, T., Da Costa, G., Calheiros, R.N., Buyya, R., Alexandru, M.: Energy-aware simulation with DVFS. Simul. Model. Pract. Theory 39, 76–91 (2013)CrossRef Guérout, T., Monteil, T., Da Costa, G., Calheiros, R.N., Buyya, R., Alexandru, M.: Energy-aware simulation with DVFS. Simul. Model. Pract. Theory 39, 76–91 (2013)CrossRef
31.
Zurück zum Zitat Cosnard, M., Marrakchi, M., Robert, Y., Trystram, D.: Parallel Gaussian elimination on an MIMD computer. Parallel Comput. 6(3), 275–296 (1988)MathSciNetCrossRef Cosnard, M., Marrakchi, M., Robert, Y., Trystram, D.: Parallel Gaussian elimination on an MIMD computer. Parallel Comput. 6(3), 275–296 (1988)MathSciNetCrossRef
34.
Zurück zum Zitat Singh, K., Singh, K., Son, H., Aziz, A.: Congestion control in wireless sensor networks by hybrid multi-objective optimization algorithm. Comput. Netw. 138, 90–107 (2018)CrossRef Singh, K., Singh, K., Son, H., Aziz, A.: Congestion control in wireless sensor networks by hybrid multi-objective optimization algorithm. Comput. Netw. 138, 90–107 (2018)CrossRef
35.
Zurück zum Zitat Tam, N.T., Hai, D.T., Son, L.H., Vinh, L.T.: Improving lifetime and network connections of 3D wireless sensor networks based on fuzzy clustering and particle swarm optimization. Wirel. Netw. 24(5), 1477–1490 (2018)CrossRef Tam, N.T., Hai, D.T., Son, L.H., Vinh, L.T.: Improving lifetime and network connections of 3D wireless sensor networks based on fuzzy clustering and particle swarm optimization. Wirel. Netw. 24(5), 1477–1490 (2018)CrossRef
36.
Zurück zum Zitat Hai, D.T., Son, L.H., Le Vinh, T.: Novel fuzzy clustering scheme for 3D wireless sensor networks. Appl. Soft Comput. 54, 141–149 (2017)CrossRef Hai, D.T., Son, L.H., Le Vinh, T.: Novel fuzzy clustering scheme for 3D wireless sensor networks. Appl. Soft Comput. 54, 141–149 (2017)CrossRef
37.
Zurück zum Zitat Tam, N.T., Thanh, H.D., Son, L.H., Le, V.T.: Optimization for the sensor placement problem in 3D environments. In: 2015 IEEE 12th International Conference on Networking, Sensing and Control (ICNSC), pp. 327–333. IEEE (2015) Tam, N.T., Thanh, H.D., Son, L.H., Le, V.T.: Optimization for the sensor placement problem in 3D environments. In: 2015 IEEE 12th International Conference on Networking, Sensing and Control (ICNSC), pp. 327–333. IEEE (2015)
38.
Zurück zum Zitat Son, L.H., Thong, P.H.: Soft computing methods for WiMax network planning on 3D geographical information systems. J. Comput. Syst. Sci. 83(1), 159–179 (2017)MathSciNetCrossRef Son, L.H., Thong, P.H.: Soft computing methods for WiMax network planning on 3D geographical information systems. J. Comput. Syst. Sci. 83(1), 159–179 (2017)MathSciNetCrossRef
39.
Zurück zum Zitat Saravanan, K., Anusuya, E., Kumar, R., Son, L.H.: Real time water quality monitoring using internet of things in SCADA. Environ. Monit. Assess. 190, 556 (2018)CrossRef Saravanan, K., Anusuya, E., Kumar, R., Son, L.H.: Real time water quality monitoring using internet of things in SCADA. Environ. Monit. Assess. 190, 556 (2018)CrossRef
40.
Zurück zum Zitat Kumar, R., Son, L.H., Jha, S., Mittal, M., Goyal, L.M.: Spatial data analysis using association rule mining in distributed environments: a privacy prospect. Spat. Inf. Res. 26, 629–638 (2018)CrossRef Kumar, R., Son, L.H., Jha, S., Mittal, M., Goyal, L.M.: Spatial data analysis using association rule mining in distributed environments: a privacy prospect. Spat. Inf. Res. 26, 629–638 (2018)CrossRef
41.
Zurück zum Zitat Kapoor, R., Gupta, R., Son, L.H., Jha, S., Kumar, R.: Boosting performance of power quality event identification with KL divergence measure and standard deviation. Measurement 126, 134–142 (2018)CrossRef Kapoor, R., Gupta, R., Son, L.H., Jha, S., Kumar, R.: Boosting performance of power quality event identification with KL divergence measure and standard deviation. Measurement 126, 134–142 (2018)CrossRef
42.
Zurück zum Zitat Kapoor, R., Gupta, R., Son, L.H., Jha, S., Kumar, R.: Detection of power quality event using histogram of oriented gradients and support vector machine. Measurement 120, 52–75 (2018)CrossRef Kapoor, R., Gupta, R., Son, L.H., Jha, S., Kumar, R.: Detection of power quality event using histogram of oriented gradients and support vector machine. Measurement 120, 52–75 (2018)CrossRef
Metadaten
Titel
Reliability and energy efficient workflow scheduling in cloud environment
verfasst von
Ritu Garg
Mamta Mittal
Le Hoang Son
Publikationsdatum
02.02.2019
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 4/2019
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-019-02911-7

Weitere Artikel der Ausgabe 4/2019

Cluster Computing 4/2019 Zur Ausgabe