Skip to main content

2022 | OriginalPaper | Buchkapitel

Improved Scientific Workflow Scheduling Algorithm with Distributed Heft Ranking and TBW Scheduling Method

verfasst von : Ramandeep Sandhu, Kamlesh Lakhwani

Erschienen in: IoT and Analytics for Sensor Networks

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Scheduling is a process that manages the workflow tasks during execution on different resources. Virtual infrastructure is a dynamic mapping of system resources to applications in order to maximize its utilization. In today's technological world, cloud has taken a long stride on the success towards maximum throughput as well as highest qualitative services to its consumers. Yet, approaches for maximizing the utilization of cloud resources are at peak demand. Each cloud service provider focuses on maximum utilization with minimum consumption of cloud resources, although managing and providing computational resources to maximum number of users and to execute such huge applications is a challenging one. In this paper, a scheduling algorithm with name TBW (Tabu Bayesian Whale Optimization) has been proposed. Basically, the algorithm is used to target the improvement in scheduling of scientific workflows. The complete framework has firstly used a ranking algorithm named distributed HEFT ranking and then applied TBW algorithm on ranked tasks of input workflows. The work has been executed for five scientific workflows LIGO, MONTAGE, Epigenomics, SIPHT and Cybershake. TBW is using tabu method on workflow tasks for fast local search in cloud system, and Bayesian Optimization is used to find out best possible combinations of resources where tasks are mapped and then whale optimization maps the tasks on the resources in a smart way. In the whole process, total execution time and cost parameters are minimized under deadline constraints.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Deelman, E., Singh, G., Livny, M., Berriman, B., & Good, J. (2008). The cost of doing science on the cloud: The montage example. In SC'08: Proceedings of the 2008 ACM/IEEE Conference on Supercomputing, Austin, TX (pp. 1–12). Deelman, E., Singh, G., Livny, M., Berriman, B., & Good, J. (2008). The cost of doing science on the cloud: The montage example. In SC'08: Proceedings of the 2008 ACM/IEEE Conference on Supercomputing, Austin, TX (pp. 1–12).
2.
Zurück zum Zitat Bölöni, L., & Damla, T. (2017). Value of information based scheduling of cloud computing resources. Future Generation Computer Systems, 71, 212–220.CrossRef Bölöni, L., & Damla, T. (2017). Value of information based scheduling of cloud computing resources. Future Generation Computer Systems, 71, 212–220.CrossRef
3.
Zurück zum Zitat Chirkin, M., Adam, B., Sergey, K., Marc, M., Mikhail, M., Alexander, V., & Denis, A. (2017). Execution time estimation for workflow scheduling. Future Generation Computer Systems, 75, 376–387. Chirkin, M., Adam, B., Sergey, K., Marc, M., Mikhail, M., Alexander, V., & Denis, A. (2017). Execution time estimation for workflow scheduling. Future Generation Computer Systems, 75, 376–387.
4.
Zurück zum Zitat Zhang, L., Kenli, L., Changyun, L., & Keqin, L. (2017). Bi-objective workflow scheduling of the energy consumption and reliability in heterogeneous computing systems. Information Sciences, 379, 241–256.CrossRef Zhang, L., Kenli, L., Changyun, L., & Keqin, L. (2017). Bi-objective workflow scheduling of the energy consumption and reliability in heterogeneous computing systems. Information Sciences, 379, 241–256.CrossRef
5.
Zurück zum Zitat Vöckler, J., Juve, G., Deelman, E., Rynge, M., & Berriman, B. (2011). Experiences using cloud computing for a scientific workflow application. In Proceedings of the 2nd International Workshop on Scientific Cloud Computing (pp. 1–10). ACM. Vöckler, J., Juve, G., Deelman, E., Rynge, M., & Berriman, B. (2011). Experiences using cloud computing for a scientific workflow application. In Proceedings of the 2nd International Workshop on Scientific Cloud Computing (pp. 1–10). ACM.
6.
Zurück zum Zitat Wang, Y., Jiajia, J., Yunni, X., Quanwang, W., Xin, L., & Qingsheng, Z. (2018). A multi-stage dynamic game-theoretic approach for multi-workflow scheduling on heterogeneous virtual machines from multiple infrastructure-as-a-service clouds. International Conference on Services Computing (pp. 137–152). Cham: Springer. Wang, Y., Jiajia, J., Yunni, X., Quanwang, W., Xin, L., & Qingsheng, Z. (2018). A multi-stage dynamic game-theoretic approach for multi-workflow scheduling on heterogeneous virtual machines from multiple infrastructure-as-a-service clouds. International Conference on Services Computing (pp. 137–152). Cham: Springer.
7.
Zurück zum Zitat Zhang, C., & Raouf, B. (2018). Cloud computing: State-of-the-art and research challenges. Journal of Internet Services and Applications, 1(1), 7–18.CrossRef Zhang, C., & Raouf, B. (2018). Cloud computing: State-of-the-art and research challenges. Journal of Internet Services and Applications, 1(1), 7–18.CrossRef
8.
Zurück zum Zitat Vecchiola, C., Suraj, P., & Buyya, R. (2009). High-performance cloud computing: A view of scientific applications. In 2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks (ISPAN) (pp. 1–9). IEEE. Vecchiola, C., Suraj, P., & Buyya, R. (2009). High-performance cloud computing: A view of scientific applications. In 2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks (ISPAN) (pp. 1–9). IEEE.
9.
Zurück zum Zitat Pandey, S., Wu, L., Guru, S.M., & Buyya, R. (2010). A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In 2010 24th IEEE International Conference on Advanced Information Networking and Applications (AINA) (pp. 1–10). IEEE. Pandey, S., Wu, L., Guru, S.M., & Buyya, R. (2010). A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In 2010 24th IEEE International Conference on Advanced Information Networking and Applications (AINA) (pp. 1–10). IEEE.
10.
Zurück zum Zitat Goyal, M., & Mehak, A. (2017). Optimize workflow scheduling using hybrid ant colony optimization (ACO) & particle swarm optimization (PSO) algorithm in cloud environment. International Journal of Advance Research, Ideas and Innovations in Technology, 3(2). Goyal, M., & Mehak, A. (2017). Optimize workflow scheduling using hybrid ant colony optimization (ACO) & particle swarm optimization (PSO) algorithm in cloud environment. International Journal of Advance Research, Ideas and Innovations in Technology, 3(2).
11.
Zurück zum Zitat Alameer, Z., Elaziz, M., Ewees, A., Ye, H., & Jianhua, Z. (2019). Forecasting gold price fluctuations using improved multilayer perceptron neural network and whale optimization algorithm. Resources Policy, 61, 250–260.CrossRef Alameer, Z., Elaziz, M., Ewees, A., Ye, H., & Jianhua, Z. (2019). Forecasting gold price fluctuations using improved multilayer perceptron neural network and whale optimization algorithm. Resources Policy, 61, 250–260.CrossRef
12.
Zurück zum Zitat Alkhanak, E., Lee, S., Rezaei, R., & Parizi, R. (2018). Cost optimization approaches for scientific workflow scheduling in cloud and grid computing: A review, classifications, and open issues. Journal of Systems and Software, 113, 1–26.CrossRef Alkhanak, E., Lee, S., Rezaei, R., & Parizi, R. (2018). Cost optimization approaches for scientific workflow scheduling in cloud and grid computing: A review, classifications, and open issues. Journal of Systems and Software, 113, 1–26.CrossRef
13.
Zurück zum Zitat Israel, C., Javid, T., Rajiv, R., Lizhe, W., & Albert, Z. (2017). A balanced scheduler with data reuse and replication for scientific workflows in cloud computing systems. Future Generation Computer Systems, 74, 168–178.CrossRef Israel, C., Javid, T., Rajiv, R., Lizhe, W., & Albert, Z. (2017). A balanced scheduler with data reuse and replication for scientific workflows in cloud computing systems. Future Generation Computer Systems, 74, 168–178.CrossRef
14.
Zurück zum Zitat Mao, M., & Humprey, M. (2011). Auto-scaling to minimize cost and meet application deadlines in cloud workflows. In SC'11: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, Seatle, WA (pp. 1–12). Mao, M., & Humprey, M. (2011). Auto-scaling to minimize cost and meet application deadlines in cloud workflows. In SC'11: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, Seatle, WA (pp. 1–12).
15.
Zurück zum Zitat Kapoor, N., & Kumar, Y. (2020). The efficient management of renewable energy resources for Vanet-cloud communication. In Nature-Inspired Computing Applications is Advanced Communication Networks (pp. 228–253). Kapoor, N., & Kumar, Y. (2020). The efficient management of renewable energy resources for Vanet-cloud communication. In Nature-Inspired Computing Applications is Advanced Communication Networks (pp. 228–253).
16.
Zurück zum Zitat Kumar, Y., & Kaul, S. (2019). Effective use of the machine learning approaches on different clouds. In International Conference on Sustainable Computing in Science, Technology and Management (pp. 892–897). Kumar, Y., & Kaul, S. (2019). Effective use of the machine learning approaches on different clouds. In International Conference on Sustainable Computing in Science, Technology and Management (pp. 892–897).
17.
Zurück zum Zitat Kumar, Y., & Mahajan, M. (2019). Intelligent behavior of fog computing with IOT for healthcare system. International Journal of Scientific and Technology Research, 8, 674–679. Kumar, Y., & Mahajan, M. (2019). Intelligent behavior of fog computing with IOT for healthcare system. International Journal of Scientific and Technology Research, 8, 674–679.
18.
Zurück zum Zitat Liu, L., Zhang, M., Buyya, R., & Fan, Q. (2016). Deadline-constrained co evolutionary genetic algorithm for scientific workflow scheduling in cloud computing. Concurrency and Computation Practice and Experience, 1–9. Liu, L., Zhang, M., Buyya, R., & Fan, Q. (2016). Deadline-constrained co evolutionary genetic algorithm for scientific workflow scheduling in cloud computing. Concurrency and Computation Practice and Experience, 1–9.
19.
Zurück zum Zitat Masadari, M. (2017). Towards workflow scheduling in cloud computing: A comprehensive analysis. Journal of Network and Computer Applications, 1–27. Masadari, M. (2017). Towards workflow scheduling in cloud computing: A comprehensive analysis. Journal of Network and Computer Applications, 1–27.
20.
Zurück zum Zitat Sagnika, S., Saurabh, B., & Bhabani, S. (2018). Workflow scheduling in cloud computing environment using bat algorithm. In Proceedings of First International Conference on Smart System, Innovations and Computing (pp. 1–13). Springer, Singapore. Sagnika, S., Saurabh, B., & Bhabani, S. (2018). Workflow scheduling in cloud computing environment using bat algorithm. In Proceedings of First International Conference on Smart System, Innovations and Computing (pp. 1–13). Springer, Singapore.
21.
Zurück zum Zitat Vinothina, V., & Sridaran, R. (2018). An approach for workflow scheduling in cloud using ACO. In Big data analytics (pp. 525–531). Springer. Vinothina, V., & Sridaran, R. (2018). An approach for workflow scheduling in cloud using ACO. In Big data analytics (pp. 525–531). Springer.
22.
Zurück zum Zitat Genez, T., Pietri, I., Sakellariou, R., Bittencourt, F., & Madeira, E. (2015). A particle swarm optimization approach for workflow scheduling on cloud resources priced by CPU frequency. In Data Science and Symptoms (pp. 1–9). Genez, T., Pietri, I., Sakellariou, R., Bittencourt, F., & Madeira, E. (2015). A particle swarm optimization approach for workflow scheduling on cloud resources priced by CPU frequency. In Data Science and Symptoms (pp. 1–9).
23.
Zurück zum Zitat Kumar, B., Mala, K., & Poonam, S. (2017). Discrete binary cat swarm optimization for scheduling workflow applications in cloud systems. In 2017 3rd International Conference on Computational Intelligence & Communication Technology (CICT) (pp. 1–6). Kumar, B., Mala, K., & Poonam, S. (2017). Discrete binary cat swarm optimization for scheduling workflow applications in cloud systems. In 2017 3rd International Conference on Computational Intelligence & Communication Technology (CICT) (pp. 1–6).
24.
Zurück zum Zitat Verma, A., & Sakshi, K. (2010). A hybrid multi-objective particle swarm optimization for scientific workflow scheduling. Parallel Computing, 62, 1–19.MathSciNetCrossRef Verma, A., & Sakshi, K. (2010). A hybrid multi-objective particle swarm optimization for scientific workflow scheduling. Parallel Computing, 62, 1–19.MathSciNetCrossRef
25.
Zurück zum Zitat Sandhu, R., & Lakhwani, K. (2020). Optimal cloud system enhancement using improved workflow task ranking system. Test Engineering and Management, 83, 10092–10101. Sandhu, R., & Lakhwani, K. (2020). Optimal cloud system enhancement using improved workflow task ranking system. Test Engineering and Management, 83, 10092–10101.
26.
Zurück zum Zitat Choudhary, A., Gupta, I., Singh, V., & Jana, P.K. (2018). A GSA based hybrid algorithm for bi-objective workflow scheduling in cloud computing. Future Generation Computer Systems, 1–10. Choudhary, A., Gupta, I., Singh, V., & Jana, P.K. (2018). A GSA based hybrid algorithm for bi-objective workflow scheduling in cloud computing. Future Generation Computer Systems, 1–10.
27.
Zurück zum Zitat Dillon, T., Elizabeth, C., & Chen, W. (2010). Cloud computing: Issues and challenge. In 24th IEEE International Conference on Advanced Information Networking and Applications. Dillon, T., Elizabeth, C., & Chen, W. (2010). Cloud computing: Issues and challenge. In 24th IEEE International Conference on Advanced Information Networking and Applications.
28.
Zurück zum Zitat Garg, J., & Gurjit, B. (2017). Research paper on genetic based workflow scheduling algorithm in cloud computing. International Journal of Advanced Research in Computer Science, 8(5), 1–7. Garg, J., & Gurjit, B. (2017). Research paper on genetic based workflow scheduling algorithm in cloud computing. International Journal of Advanced Research in Computer Science, 8(5), 1–7.
29.
Zurück zum Zitat Ghose, M., Verma, P., Karmakar, S., & Sahu, A. (2017). Energy efficient scheduling of scientific workflows in cloud environment. In 2017 IEEE 19th International Conference on High Performance Computing and Communications; IEEE 15th International Conference on Smart City; IEEE 3rd International Conference on Data Science and Systems (HPCC/SmartCity/DSS), Bangkok (pp. 170–177). Ghose, M., Verma, P., Karmakar, S., & Sahu, A. (2017). Energy efficient scheduling of scientific workflows in cloud environment. In 2017 IEEE 19th International Conference on High Performance Computing and Communications; IEEE 15th International Conference on Smart City; IEEE 3rd International Conference on Data Science and Systems (HPCC/SmartCity/DSS), Bangkok (pp. 170–177).
30.
Zurück zum Zitat Iosup, A., Ostermann, S., Yigitbasi, M., Prodan, R., Fahringer, T., & Epema, D. (2011). Performance analysis of cloud computing services for many-tasks scientific computing. IEEE Transactions on Parallel and Distributed Systems, 22(6), 931–945.CrossRef Iosup, A., Ostermann, S., Yigitbasi, M., Prodan, R., Fahringer, T., & Epema, D. (2011). Performance analysis of cloud computing services for many-tasks scientific computing. IEEE Transactions on Parallel and Distributed Systems, 22(6), 931–945.CrossRef
31.
Zurück zum Zitat Jiang, J., Yaping, L., GuoqiXie, L., & Junfeng, Y. (2017). Time and energy optimization algorithms for the static scheduling of multiple workflows in heterogeneous computing system. Journal of Grid Computing, 15(4), 435–456.CrossRef Jiang, J., Yaping, L., GuoqiXie, L., & Junfeng, Y. (2017). Time and energy optimization algorithms for the static scheduling of multiple workflows in heterogeneous computing system. Journal of Grid Computing, 15(4), 435–456.CrossRef
32.
Zurück zum Zitat Quang, H., Nguyen, S., & Nam, T. (2017). Energy-saving virtual machine scheduling in cloud computing with fixed interval constraints. In Transactions on large-scale data-and knowledge-centered systems XXXI (pp. 124–145). Springer. Quang, H., Nguyen, S., & Nam, T. (2017). Energy-saving virtual machine scheduling in cloud computing with fixed interval constraints. In Transactions on large-scale data-and knowledge-centered systems XXXI (pp. 124–145). Springer.
33.
Zurück zum Zitat Scott, C., Ewa, D., Dan, G., Gideon, J., Philip, M., Christopher, B., Karan, V., Kevin, M., Robert, G., Edward, F., David, O., & Thomas, J. (2010). Scaling up workflow-based applications. Journal of Computer and System Sciences, 76, 428–446.MathSciNetCrossRef Scott, C., Ewa, D., Dan, G., Gideon, J., Philip, M., Christopher, B., Karan, V., Kevin, M., Robert, G., Edward, F., David, O., & Thomas, J. (2010). Scaling up workflow-based applications. Journal of Computer and System Sciences, 76, 428–446.MathSciNetCrossRef
34.
Zurück zum Zitat Zhao, Y., et al. (2011). Opportunities and challenges in running scientific workflows on the cloud. In International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC). IEEE. Zhao, Y., et al. (2011). Opportunities and challenges in running scientific workflows on the cloud. In International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC). IEEE.
35.
Zurück zum Zitat Ahmed, M., Houssein, E., Hassanien, A., Taha, A., & Hassanien, E. (2019). Maximizing lifetime of large-scale wireless sensor networks using multi-objective whale optimization algorithm. Telecommunication Systems, 72(2), 243–259. Ahmed, M., Houssein, E., Hassanien, A., Taha, A., & Hassanien, E. (2019). Maximizing lifetime of large-scale wireless sensor networks using multi-objective whale optimization algorithm. Telecommunication Systems, 72(2), 243–259.
36.
Zurück zum Zitat Ben Oualid Medani, K., Sayah, S., & Bekrar A. (2017). Whale optimization algorithm based optimal reactive power dispatch: A case study of the Algerian power system. Electric Power Systems Research, 163, 696–705. Ben Oualid Medani, K., Sayah, S., & Bekrar A. (2017). Whale optimization algorithm based optimal reactive power dispatch: A case study of the Algerian power system. Electric Power Systems Research, 163, 696–705.
Metadaten
Titel
Improved Scientific Workflow Scheduling Algorithm with Distributed Heft Ranking and TBW Scheduling Method
verfasst von
Ramandeep Sandhu
Kamlesh Lakhwani
Copyright-Jahr
2022
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-16-2919-8_23

Neuer Inhalt