Skip to main content

2019 | OriginalPaper | Buchkapitel

Orlando Tools: Development, Training, and Use of Scalable Applications in Heterogeneous Distributed Computing Environments

verfasst von : Andrei Tchernykh, Alexander Feoktistov, Sergei Gorsky, Ivan Sidorov, Roman Kostromin, Igor Bychkov, Olga Basharina, Vassil Alexandrov, Raul Rivera-Rodriguez

Erschienen in: High Performance Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We address concepts and principles of the development, training, and use of applications in heterogeneous environments that integrate different computational infrastructures including HPC-clusters, grids, and clouds. Existing differences in the Grid and cloud computing models significantly complicate problem-solving processes in such environments for end-users. In this regards, we propose the toolkit named Orlando Tools for creating scalable applications for solving large-scale scientific and applied problems. It provides mechanisms for the subject domain specification, problem formulation, problem-solving time prediction, problem-solving scheme execution, monitoring, etc. The toolkit supports hands-on training skills for end-users. To demonstrate the practicability and benefits of Orlando Tools, we present an example of the development and use of the scalable application for solving practical problems of warehouse logistics.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zhao, Y., Fei, Z., Raicu, I., Lu, S.: Opportunities and challenges in running scientific workflows on the cloud. In: Kumar, A., Xie, B., Lu, D. (eds.) Proceedings of the International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, pp. 455–462. IEEE, Piscataway (2011) Zhao, Y., Fei, Z., Raicu, I., Lu, S.: Opportunities and challenges in running scientific workflows on the cloud. In: Kumar, A., Xie, B., Lu, D. (eds.) Proceedings of the International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, pp. 455–462. IEEE, Piscataway (2011)
2.
Zurück zum Zitat Zhan, Z.H., Liu, X.F., Gong, Y.J., Zhang, J., Chung, H.S.H., Li, Y.: Cloud computing resource scheduling and a survey of its evolutionary approaches. ACM Comput. Surv. 47(4), 1–33 (2015)CrossRef Zhan, Z.H., Liu, X.F., Gong, Y.J., Zhang, J., Chung, H.S.H., Li, Y.: Cloud computing resource scheduling and a survey of its evolutionary approaches. ACM Comput. Surv. 47(4), 1–33 (2015)CrossRef
3.
Zurück zum Zitat Sokolinsky, L.B., Shamakina, A.V.: Methods of resource management in problem-oriented computing environment. Program. Comput. Softw. 42(1), 17–26 (2016)MathSciNetCrossRef Sokolinsky, L.B., Shamakina, A.V.: Methods of resource management in problem-oriented computing environment. Program. Comput. Softw. 42(1), 17–26 (2016)MathSciNetCrossRef
4.
Zurück zum Zitat Hollinsworth, D.: The workflow reference model. In: Zur Muehlen, M., Allen, R. (eds.) Workflow Management Coalition, Document no. TC00-1003 (1995) Hollinsworth, D.: The workflow reference model. In: Zur Muehlen, M., Allen, R. (eds.) Workflow Management Coalition, Document no. TC00-1003 (1995)
5.
Zurück zum Zitat Sowa, J.: Conceptual Structures – Information Processing in Mind and Machine. Addison-Wesley, Boston (1984)MATH Sowa, J.: Conceptual Structures – Information Processing in Mind and Machine. Addison-Wesley, Boston (1984)MATH
6.
Zurück zum Zitat Tyugu, E.: Knowledge-Based Programming. Turing Institute Press, Glasgow (1988)MATH Tyugu, E.: Knowledge-Based Programming. Turing Institute Press, Glasgow (1988)MATH
12.
Zurück zum Zitat Frey, J., Tannenbaum, T., Livny, M.: Condor-G: a computation management agent for multi-institutional grids. Cluster Comput. 5(3), 237–246 (2002)CrossRef Frey, J., Tannenbaum, T., Livny, M.: Condor-G: a computation management agent for multi-institutional grids. Cluster Comput. 5(3), 237–246 (2002)CrossRef
13.
Zurück zum Zitat Tao, J., Kolodziej, J., Ranjan, R., Jayaraman, P., Buyya, R.: A note on new trends in data-aware scheduling and resource provisioning in modern HPC systems. Future Gener. Commun. Syst. 51(C), 45–46 (2015) Tao, J., Kolodziej, J., Ranjan, R., Jayaraman, P., Buyya, R.: A note on new trends in data-aware scheduling and resource provisioning in modern HPC systems. Future Gener. Commun. Syst. 51(C), 45–46 (2015)
14.
Zurück zum Zitat Rings, T., et al.: Grid and cloud computing: opportunities for integration with the next generation network. J. Grid Comput. 7(3), Article no. 375 (2009) Rings, T., et al.: Grid and cloud computing: opportunities for integration with the next generation network. J. Grid Comput. 7(3), Article no. 375 (2009)
15.
Zurück zum Zitat Basili, V.R., et al.: Understanding the high-performance-computing community: a software engineer’s perspective. IEEE Softw. 25(4), 29–36 (2008)CrossRef Basili, V.R., et al.: Understanding the high-performance-computing community: a software engineer’s perspective. IEEE Softw. 25(4), 29–36 (2008)CrossRef
16.
Zurück zum Zitat Joppa, L.N., et al.: Troubling trends in scientific software use. Science 340(6134), 814–815 (2013)CrossRef Joppa, L.N., et al.: Troubling trends in scientific software use. Science 340(6134), 814–815 (2013)CrossRef
17.
Zurück zum Zitat Nunez, A., Merayo, M.G.: A formal framework to analyze cost and performance in map-reduce based applications. J. Comput. Sci. 5(2), 106–118 (2014)CrossRef Nunez, A., Merayo, M.G.: A formal framework to analyze cost and performance in map-reduce based applications. J. Comput. Sci. 5(2), 106–118 (2014)CrossRef
18.
Zurück zum Zitat Pandey, S., Wu, L., Guru, S.M., Buyya, R.: A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In: 24th IEEE International Conference on Advanced Information Networking and Applications, pp. 400–407. IEEE (2010) Pandey, S., Wu, L., Guru, S.M., Buyya, R.: A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In: 24th IEEE International Conference on Advanced Information Networking and Applications, pp. 400–407. IEEE (2010)
19.
Zurück zum Zitat Yu, J., Buyya, R.: A taxonomy of workflow management systems for grid computing. J. Grid Comput. 3(3–4), 171–200 (2005)CrossRef Yu, J., Buyya, R.: A taxonomy of workflow management systems for grid computing. J. Grid Comput. 3(3–4), 171–200 (2005)CrossRef
21.
Zurück zum Zitat Murugan, S., Kumar, S.: A survey of workflow management tools for grid platform. Adv. Inform. Technol. Manage. 1(1), 1–3 (2012) Murugan, S., Kumar, S.: A survey of workflow management tools for grid platform. Adv. Inform. Technol. Manage. 1(1), 1–3 (2012)
22.
Zurück zum Zitat Smirnov, P.A., Kovalchuk, S.V., Boukhanovsky, A.V.: Knowledge-based support for complex systems exploration in distributed problem solving environments. Commun. Comput. Inf. Sci. 394, 147–161 (2013) Smirnov, P.A., Kovalchuk, S.V., Boukhanovsky, A.V.: Knowledge-based support for complex systems exploration in distributed problem solving environments. Commun. Comput. Inf. Sci. 394, 147–161 (2013)
23.
Zurück zum Zitat Kliazovich, D., Pecero, J.E., Tchernykh, A., Bouvry, P., Khan, S.U., Zomaya, A.Y.: CA-DAG: modeling communication-aware applications for scheduling in cloud computing. J. Grid Comput. 14(1), 22–39 (2016)CrossRef Kliazovich, D., Pecero, J.E., Tchernykh, A., Bouvry, P., Khan, S.U., Zomaya, A.Y.: CA-DAG: modeling communication-aware applications for scheduling in cloud computing. J. Grid Comput. 14(1), 22–39 (2016)CrossRef
24.
Zurück zum Zitat Talia, D.: Workflow systems for science: concepts and tools. ISRN Softw. Eng. 2013, 15 (2013). Article ID 404525CrossRef Talia, D.: Workflow systems for science: concepts and tools. ISRN Softw. Eng. 2013, 15 (2013). Article ID 404525CrossRef
25.
Zurück zum Zitat Rodriguez, A., Tchernykh, A., Ecker, K.: Algorithms for dynamic scheduling of unit execution time tasks. Eur. J. Oper. Res. 146(2), 403–416 (2003)MathSciNetCrossRef Rodriguez, A., Tchernykh, A., Ecker, K.: Algorithms for dynamic scheduling of unit execution time tasks. Eur. J. Oper. Res. 146(2), 403–416 (2003)MathSciNetCrossRef
26.
Zurück zum Zitat Nesmachnow, S., Iturriaga, S., Dorronsoro, B., Tchernykh, A.: Multiobjective energy-aware workflow scheduling in distributed datacenters. Commun. Comput. Inf. Sci. 595, 79–93 (2016) Nesmachnow, S., Iturriaga, S., Dorronsoro, B., Tchernykh, A.: Multiobjective energy-aware workflow scheduling in distributed datacenters. Commun. Comput. Inf. Sci. 595, 79–93 (2016)
27.
Zurück zum Zitat Cristobal, A., Tchernykh, A., Gaudiot, J.-L., Lin, W.-Y.: Non-strict execution in parallel and distributed computing. Int. J. Parallel Prog. 31(2), 77–105 (2003)CrossRef Cristobal, A., Tchernykh, A., Gaudiot, J.-L., Lin, W.-Y.: Non-strict execution in parallel and distributed computing. Int. J. Parallel Prog. 31(2), 77–105 (2003)CrossRef
28.
Zurück zum Zitat Tchernykh, A., Schwiegelsohn, U., Alexandrov, V., Talbi, E.G.: Towards understanding uncertainty in cloud computing resource provisioning. Procedia Comput. Sci. 51, 1772–1781 (2015)CrossRef Tchernykh, A., Schwiegelsohn, U., Alexandrov, V., Talbi, E.G.: Towards understanding uncertainty in cloud computing resource provisioning. Procedia Comput. Sci. 51, 1772–1781 (2015)CrossRef
29.
Zurück zum Zitat Bychkov, I., Oparin, G., Tchernykh, A., Feoktistov, A., Bogdanova, V., Gorsky, S.: Conceptual model of problem-oriented heterogeneous distributed computing environment with multi-agent management. Procedia Comput. Sci. 103, 162–167 (2017)CrossRef Bychkov, I., Oparin, G., Tchernykh, A., Feoktistov, A., Bogdanova, V., Gorsky, S.: Conceptual model of problem-oriented heterogeneous distributed computing environment with multi-agent management. Procedia Comput. Sci. 103, 162–167 (2017)CrossRef
31.
Zurück zum Zitat Bychkov, I.V., Oparin, G.A., Feoktistov, A.G., Sidorov, I.A., Bogdanova, V.G., Gorsky, S.A.: Multiagent control of computational systems on the basis of meta-monitoring and imitational simulation. Optoelectron. Instrum. Data Process. 52(2), 107–112 (2016)CrossRef Bychkov, I.V., Oparin, G.A., Feoktistov, A.G., Sidorov, I.A., Bogdanova, V.G., Gorsky, S.A.: Multiagent control of computational systems on the basis of meta-monitoring and imitational simulation. Optoelectron. Instrum. Data Process. 52(2), 107–112 (2016)CrossRef
32.
Zurück zum Zitat Giarratano, J.C., Riley, G.D.: Expert Systems: Principles and Programming. Thomson, Boston (2005) Giarratano, J.C., Riley, G.D.: Expert Systems: Principles and Programming. Thomson, Boston (2005)
33.
Zurück zum Zitat Feoktistov, A.G., Sidorov, I.A.: Logical-probabilistic analysis of distributed computing reliability. 39th International Convention on Information and Communication Technology, Electronics and Microelectronics, pp. 247–252. IEEE, Riejka (2016) Feoktistov, A.G., Sidorov, I.A.: Logical-probabilistic analysis of distributed computing reliability. 39th International Convention on Information and Communication Technology, Electronics and Microelectronics, pp. 247–252. IEEE, Riejka (2016)
Metadaten
Titel
Orlando Tools: Development, Training, and Use of Scalable Applications in Heterogeneous Distributed Computing Environments
verfasst von
Andrei Tchernykh
Alexander Feoktistov
Sergei Gorsky
Ivan Sidorov
Roman Kostromin
Igor Bychkov
Olga Basharina
Vassil Alexandrov
Raul Rivera-Rodriguez
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-16205-4_20