Skip to main content

2017 | OriginalPaper | Buchkapitel

7. Workflow Predictions Through Operational Analytics and Machine Learning

verfasst von : G. Kousalya, P. Balakrishnan, C. Pethuru Raj

Erschienen in: Automated Workflow Scheduling in Self-Adaptive Clouds

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Workflow execution employs predictive analytics to extract significant, unidentified as well as precious insights from several stages of execution. Further, the operational analytics integrates these valuable insights directly into decision engine which enables analytical as well as machine learning-driven decision-making for an efficient workflow execution. This chapter highlights several analytical and machine learning approaches that are practiced in workflow predictions. Additionally, it explains the significance of hybrid approach which includes both analytical and machine learning models for workflow prediction. Finally, it describes the hybrid approach employed in PANORAMA architecture using two workflow applications.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Kurowski K, Oleksiak A, Nabrzyski J, Kwiecien A, Wojtkiewicz M, Dyczkowski M, Guim F, Corbalan J, Labarta J (2005) Multi-criteria grid resource management using performance prediction techniques. In: CoreGrid integration workshop, Pisa, Itally Kurowski K, Oleksiak A, Nabrzyski J, Kwiecien A, Wojtkiewicz M, Dyczkowski M, Guim F, Corbalan J, Labarta J (2005) Multi-criteria grid resource management using performance prediction techniques. In: CoreGrid integration workshop, Pisa, Itally
2.
Zurück zum Zitat Nudd GR, Kerbyson DJ, Panaefstathiou E, Perry SC, Harper JS, Wilcox DV (2000) Pace-A toolset for the performance prediction of parallel and distributed systems. High Perform Comput Appl 14:228–252CrossRef Nudd GR, Kerbyson DJ, Panaefstathiou E, Perry SC, Harper JS, Wilcox DV (2000) Pace-A toolset for the performance prediction of parallel and distributed systems. High Perform Comput Appl 14:228–252CrossRef
3.
Zurück zum Zitat Seneviratne S, Levy D (2011) Task profiling model for load profile prediction. Futur Gener Comput Syst 27:245–255CrossRef Seneviratne S, Levy D (2011) Task profiling model for load profile prediction. Futur Gener Comput Syst 27:245–255CrossRef
4.
Zurück zum Zitat Badia RM, Escale F, Gabriel E, Gimenez J, Keller R, Labarta J, Muller MS (2003) Performance prediction in a grid environment. In: Presented at the international conference on grid computing, first European across grids conference, Santiago de Compostela, Spain Badia RM, Escale F, Gabriel E, Gimenez J, Keller R, Labarta J, Muller MS (2003) Performance prediction in a grid environment. In: Presented at the international conference on grid computing, first European across grids conference, Santiago de Compostela, Spain
5.
Zurück zum Zitat Steffenel LA (2005) LaPIe: communications collectives Adaptées aux Grilles de Calcul. PhD, INPG, Grenoble, France Steffenel LA (2005) LaPIe: communications collectives Adaptées aux Grilles de Calcul. PhD, INPG, Grenoble, France
6.
Zurück zum Zitat Fahringer T, Jugravu A, Pllana S, Prodan R, Seragiotto C Jr, Truong HL (2005) ASKALON: a tool set for cluster and grid computing. Concurr Comput Pract Exp 17:143–169CrossRef Fahringer T, Jugravu A, Pllana S, Prodan R, Seragiotto C Jr, Truong HL (2005) ASKALON: a tool set for cluster and grid computing. Concurr Comput Pract Exp 17:143–169CrossRef
7.
Zurück zum Zitat Gruber R, Volgers P, Vita AD, Stengel M, Tran TM (2003) Parameterisation to tailor commodity clusters to applications. Futur Gener Comput Syst 19:111–120CrossRefMATH Gruber R, Volgers P, Vita AD, Stengel M, Tran TM (2003) Parameterisation to tailor commodity clusters to applications. Futur Gener Comput Syst 19:111–120CrossRefMATH
8.
Zurück zum Zitat Glimcher L, Agrawal G (2007) A performance prediction framework for grid-based data mining application. In: Presented at the International Parallel and Distributed Processing Symposium (IPDPS) Glimcher L, Agrawal G (2007) A performance prediction framework for grid-based data mining application. In: Presented at the International Parallel and Distributed Processing Symposium (IPDPS)
9.
Zurück zum Zitat Desprez F, Quinson M, Suter F (2002) Dynamic performance forecasting for network-enabled servers in a heterogeneous environment. In: Presented at the international conference on Parallel & Distributed Processing Techniques & Applications (PDPTA), Las Vegas, USA Desprez F, Quinson M, Suter F (2002) Dynamic performance forecasting for network-enabled servers in a heterogeneous environment. In: Presented at the international conference on Parallel & Distributed Processing Techniques & Applications (PDPTA), Las Vegas, USA
10.
Zurück zum Zitat Carvalho M, Miceli R, Maciel Jr. PD, Brasileiro F, Lopes R (2010) Predicting the quality of service of a peer-to-peer desktop grid. In: 10th IEEE/ACM international conference on Cluster, Cloud and Grid Computing (CCGrid), Melbourne, Australia, pp 649–654 Carvalho M, Miceli R, Maciel Jr. PD, Brasileiro F, Lopes R (2010) Predicting the quality of service of a peer-to-peer desktop grid. In: 10th IEEE/ACM international conference on Cluster, Cloud and Grid Computing (CCGrid), Melbourne, Australia, pp 649–654
11.
Zurück zum Zitat Wolski R, Spring N, Hayes J (1999) The Network weather service: a distributed resource performance forecasting service for metacomputing. Futur Gener Comput Syst 15:757–768CrossRef Wolski R, Spring N, Hayes J (1999) The Network weather service: a distributed resource performance forecasting service for metacomputing. Futur Gener Comput Syst 15:757–768CrossRef
12.
Zurück zum Zitat Dinda PA (2000) Resource signal prediction and its application to real time scheduling advisors. PhD, School of Computer Science, Carnegie Mellon University, USA Dinda PA (2000) Resource signal prediction and its application to real time scheduling advisors. PhD, School of Computer Science, Carnegie Mellon University, USA
13.
Zurück zum Zitat Song B, Ernemann C, Yahyapour R (2004) Parallel computer workload modelling with Markov Chains. In: Presented at the international conference on job scheduling strategies for parallel processing, NY, USA Song B, Ernemann C, Yahyapour R (2004) Parallel computer workload modelling with Markov Chains. In: Presented at the international conference on job scheduling strategies for parallel processing, NY, USA
14.
Zurück zum Zitat Yang L, Schopf J M, Foster I (2003) Homeostatic and tendency-based CPU load predictions. In: 17th International Parallel and Distributed Processing Symposium (IPDPS 2003), Los Alamitos, California, USA, IEEE CD-ROM, p 9 Yang L, Schopf J M, Foster I (2003) Homeostatic and tendency-based CPU load predictions. In: 17th International Parallel and Distributed Processing Symposium (IPDPS 2003), Los Alamitos, California, USA, IEEE CD-ROM, p 9
15.
Zurück zum Zitat Yang L, Schopf J M, Foster I (2003) Conservative scheduling: using predicted variance to improve scheduling decisions in dynamic environments. In ACM/IEEE international conference on Supercomputing (SC2003), Phoenix, Arizona, USA, pp 31–37 Yang L, Schopf J M, Foster I (2003) Conservative scheduling: using predicted variance to improve scheduling decisions in dynamic environments. In ACM/IEEE international conference on Supercomputing (SC2003), Phoenix, Arizona, USA, pp 31–37
16.
Zurück zum Zitat Yang L, Schopf JM, Foster I (2005) Improving parallel data transfer times using predicted variances in shared networks. In: Presented at the fifth IEEE international symposium on Cluster Computing and the Grid (CCGRID05), Washington, DC, USA Yang L, Schopf JM, Foster I (2005) Improving parallel data transfer times using predicted variances in shared networks. In: Presented at the fifth IEEE international symposium on Cluster Computing and the Grid (CCGRID05), Washington, DC, USA
17.
Zurück zum Zitat Wu Y, Hwang K, Yuan Y, Zheng W (2010) Adaptive workload prediction of grid performance in confidence windows. IEEE Trans Parallel Distrib Syst 21:925–938CrossRef Wu Y, Hwang K, Yuan Y, Zheng W (2010) Adaptive workload prediction of grid performance in confidence windows. IEEE Trans Parallel Distrib Syst 21:925–938CrossRef
18.
Zurück zum Zitat Smith W, Taylor V, Foster I (1999) Using runtime predictions to estimate Queue wait times and improve Scheduler performance. In: International workshop on job scheduling strategies for parallel processing, San Juan, Puerto Rico, pp 202–219 Smith W, Taylor V, Foster I (1999) Using runtime predictions to estimate Queue wait times and improve Scheduler performance. In: International workshop on job scheduling strategies for parallel processing, San Juan, Puerto Rico, pp 202–219
19.
Zurück zum Zitat Atkeson CG, Moore AW, Schaal SA (1997) Locally weighted learning. Artif Intell Rev 11:11–73CrossRef Atkeson CG, Moore AW, Schaal SA (1997) Locally weighted learning. Artif Intell Rev 11:11–73CrossRef
20.
Zurück zum Zitat Wilson DR, Martinez TR (1997) Improved heterogeneous distance function. Artif Intell Res 6:1–34MathSciNetMATH Wilson DR, Martinez TR (1997) Improved heterogeneous distance function. Artif Intell Res 6:1–34MathSciNetMATH
21.
Zurück zum Zitat Rodero I, Guim F, Corbalán J, Labarta J (2005) eNANOS: coordinated scheduling in grid environments. In: Presented at the parallel computing: current & future issues of high-end computing, Parco 2005 Rodero I, Guim F, Corbalán J, Labarta J (2005) eNANOS: coordinated scheduling in grid environments. In: Presented at the parallel computing: current & future issues of high-end computing, Parco 2005
22.
Zurück zum Zitat Andrzejak A, Domingues P, Silva L (2006) Predicting machine availabilities in desktop pools. In: IEEE/IFIP Network Operations & Management Symposium (NOMS 2006), Vancouver, Canada Andrzejak A, Domingues P, Silva L (2006) Predicting machine availabilities in desktop pools. In: IEEE/IFIP Network Operations & Management Symposium (NOMS 2006), Vancouver, Canada
23.
Zurück zum Zitat Matsunaga A, Fortes JAB (2010) On the use of machine learning to predict the time and resources consumed by applications. In: Presented at the 10th IEEE/ACM international conference on Cluster, Cloud and Grid Computing (CCGrid), Melbourne, VIC, Australia Matsunaga A, Fortes JAB (2010) On the use of machine learning to predict the time and resources consumed by applications. In: Presented at the 10th IEEE/ACM international conference on Cluster, Cloud and Grid Computing (CCGrid), Melbourne, VIC, Australia
24.
Zurück zum Zitat Minh TN, Wolters L (2010) Using historical data to predict application runtimes on backfilling parallel systems. In: Presented at the 18th Euromicro conference on Parallel, Distributed and Network-based Processing (PDP ’10), Pisa, Italy Minh TN, Wolters L (2010) Using historical data to predict application runtimes on backfilling parallel systems. In: Presented at the 18th Euromicro conference on Parallel, Distributed and Network-based Processing (PDP ’10), Pisa, Italy
25.
Zurück zum Zitat Duan R, Nadeem F, Wang J, Zhang Y, Prodan R, Fahringer T (2009) A hybrid intelligent method for performance modeling and prediction of workflow activities in grids. In: Presented at the 9th IEEE/ACM international symposium on Cluster Computing and the Grid (CCGRID ’09), Shanghai, China Duan R, Nadeem F, Wang J, Zhang Y, Prodan R, Fahringer T (2009) A hybrid intelligent method for performance modeling and prediction of workflow activities in grids. In: Presented at the 9th IEEE/ACM international symposium on Cluster Computing and the Grid (CCGRID ’09), Shanghai, China
26.
Zurück zum Zitat PANORAMA (2015) An approach to performance modeling and diagnosis of extreme scale workflows. Ewa Deelman, Christopher Carothers, Anirban Mandal, Brian Tierney, Jeffrey S. Vetter, Ilya Baldin, Claris Castillo, Gideon Juve, Dariusz Król, Vickie Lynch, Ben Mayer, Jeremy Meredith, Thomas Proffen, Paul Ruth, Rafael Ferreira da Silva. Int J High Perform Comput Appl (in press) PANORAMA (2015) An approach to performance modeling and diagnosis of extreme scale workflows. Ewa Deelman, Christopher Carothers, Anirban Mandal, Brian Tierney, Jeffrey S. Vetter, Ilya Baldin, Claris Castillo, Gideon Juve, Dariusz Król, Vickie Lynch, Ben Mayer, Jeremy Meredith, Thomas Proffen, Paul Ruth, Rafael Ferreira da Silva. Int J High Perform Comput Appl (in press)
Metadaten
Titel
Workflow Predictions Through Operational Analytics and Machine Learning
verfasst von
G. Kousalya
P. Balakrishnan
C. Pethuru Raj
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-56982-6_7