Skip to main content

2019 | OriginalPaper | Buchkapitel

Orlando Tools: Energy Research Application Development Through Convergence of Grid and Cloud Computing

verfasst von : Alexander Feoktistov, Sergei Gorsky, Ivan Sidorov, Roman Kostromin, Alexei Edelev, Lyudmila Massel

Erschienen in: Supercomputing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The paper addresses the relevant problem related to the development of scientific applications (applied software packages) to solve large-scale problems in heterogeneous distributed computing environments that can include various infrastructures (clusters, Grid systems, clouds) and provide their integrated use. We propose a new approach to the development of applications for such environments. It is based on the integration of conceptual and modular programming. The application development is implemented with a special framework named Orlando Tools. In comparison to the known tools, used for the development and execution of distributed applications in the current practice, Orlando Tools provides executing application jobs in the integrated environment of virtual machines that include both the dedicated and non-dedicated resources. The distributed computing efficiency is improved through the multi-agent management. Experiments of solving the large-scale practical problems of energy security research show the effectiveness of the developed application for solving the aforementioned problem in the environment that supports the hybrid computational model including Grid and cloud computing.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Toporkov, V., Yemelyanov, D., Toporkova, A.: Anticipation scheduling in grid with stakeholders preferences. Commun. Comput. Inf. Sci. 793, 482–493 (2017) Toporkov, V., Yemelyanov, D., Toporkova, A.: Anticipation scheduling in grid with stakeholders preferences. Commun. Comput. Inf. Sci. 793, 482–493 (2017)
2.
Zurück zum Zitat Sokolinsky, L.B., Shamakina, A.V.: Methods of resource management in problem-oriented computing environment. Program. Comput. Soft. 42(1), 17–26 (2016)MathSciNetCrossRef Sokolinsky, L.B., Shamakina, A.V.: Methods of resource management in problem-oriented computing environment. Program. Comput. Soft. 42(1), 17–26 (2016)MathSciNetCrossRef
3.
Zurück zum Zitat Singh, A., Juneja, D., Malhotra, M.: A novel agent based autonomous and service composition framework for cost optimization of resource provisioning in cloud computing. J. King Saud Univ. Comput. Inf. Sci. 29(1), 19–28 (2015) Singh, A., Juneja, D., Malhotra, M.: A novel agent based autonomous and service composition framework for cost optimization of resource provisioning in cloud computing. J. King Saud Univ. Comput. Inf. Sci. 29(1), 19–28 (2015)
4.
Zurück zum Zitat Singh, S., Chana, I.: QoS-aware autonomic resource management in cloud computing: a systematic review. ACM Comput. Surv. 48(3) (2016). Article no. 42 Singh, S., Chana, I.: QoS-aware autonomic resource management in cloud computing: a systematic review. ACM Comput. Surv. 48(3) (2016). Article no. 42
5.
Zurück zum Zitat Qin, H., Zhu, L.: Subject oriented autonomic cloud data center networks model. J. Data Anal. Inform. Process. 5(3), 87–95 (2017)CrossRef Qin, H., Zhu, L.: Subject oriented autonomic cloud data center networks model. J. Data Anal. Inform. Process. 5(3), 87–95 (2017)CrossRef
6.
Zurück zum Zitat Talia, D.: Cloud computing and software agents: towards cloud intelligent services. In: Proceedings of the 12th Workshop on Objects and Agents. CEUR Workshop Proceedings, vol. 741, pp. 2–6 (2011) Talia, D.: Cloud computing and software agents: towards cloud intelligent services. In: Proceedings of the 12th Workshop on Objects and Agents. CEUR Workshop Proceedings, vol. 741, pp. 2–6 (2011)
7.
Zurück zum Zitat Madni, S.H.H., Latiff, M.S.A., Coulibaly, Y.: Recent advancements in resource allocation techniques for cloud computing environment: a systematic review. Cluster Comput. 20(3), 2489–2533 (2017)CrossRef Madni, S.H.H., Latiff, M.S.A., Coulibaly, Y.: Recent advancements in resource allocation techniques for cloud computing environment: a systematic review. Cluster Comput. 20(3), 2489–2533 (2017)CrossRef
8.
Zurück zum Zitat Farahani, A., Nazemi, E., Cabri, G., Capodieci, N.: Enabling autonomic computing support for the JADE agent platform. Scalable Comput. Pract. Exp. 18(1), 91–103 (2017) Farahani, A., Nazemi, E., Cabri, G., Capodieci, N.: Enabling autonomic computing support for the JADE agent platform. Scalable Comput. Pract. Exp. 18(1), 91–103 (2017)
9.
Zurück zum Zitat Ilin, V.P., Skopin, I.N.: Computational programming technologies. Program. Comput. Soft. 37(4), 210–222 (2011)CrossRef Ilin, V.P., Skopin, I.N.: Computational programming technologies. Program. Comput. Soft. 37(4), 210–222 (2011)CrossRef
10.
Zurück zum Zitat Foster, I., Kesselman, C.: Globus: a metacomputing infrastructure toolkit. Int. J. High Perform. Comput. Appl. 11(2), 115–128 (1997) Foster, I., Kesselman, C.: Globus: a metacomputing infrastructure toolkit. Int. J. High Perform. Comput. Appl. 11(2), 115–128 (1997)
12.
Zurück zum Zitat Anderson, D.: Boinc: a system for public-resource computing and storage. In: Buyya, R. (ed.) Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, pp. 4–10. IEEE (2004) Anderson, D.: Boinc: a system for public-resource computing and storage. In: Buyya, R. (ed.) Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, pp. 4–10. IEEE (2004)
13.
Zurück zum Zitat Voevodin, V.V.: The solution of large problems in distributed computational media. Automat. Remote Control 68(5), 773–786 (2007)MathSciNetCrossRef Voevodin, V.V.: The solution of large problems in distributed computational media. Automat. Remote Control 68(5), 773–786 (2007)MathSciNetCrossRef
14.
Zurück zum Zitat Talia, D.: Workflow systems for science: concepts and tools. ISRN Soft. Eng. 2013 (2013). Article ID 404525 Talia, D.: Workflow systems for science: concepts and tools. ISRN Soft. Eng. 2013 (2013). Article ID 404525
15.
Zurück zum Zitat Tao, J., Kolodziej, J., Ranjan, R., Jayaraman, P., Buyya, R.: A note on new trends in data-aware scheduling and resource provisioning in modern HPC systems. Future Gener. Comput. Syst. 51(C), 45–46 (2015)CrossRef Tao, J., Kolodziej, J., Ranjan, R., Jayaraman, P., Buyya, R.: A note on new trends in data-aware scheduling and resource provisioning in modern HPC systems. Future Gener. Comput. Syst. 51(C), 45–46 (2015)CrossRef
16.
Zurück zum Zitat Rings, T., et al.: Grid and cloud computing: opportunities for integration with the next generation network. J. Grid Comput. 7(3) (2009). Article no. 375 Rings, T., et al.: Grid and cloud computing: opportunities for integration with the next generation network. J. Grid Comput. 7(3) (2009). Article no. 375
17.
Zurück zum Zitat Kim, H., el-Khamra, Y., Jha, S., Parashar, M.: Exploring application and infrastructure adaptation on hybrid grid-cloud infrastructure. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, pp. 402–412. ACM (2010) Kim, H., el-Khamra, Y., Jha, S., Parashar, M.: Exploring application and infrastructure adaptation on hybrid grid-cloud infrastructure. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, pp. 402–412. ACM (2010)
18.
Zurück zum Zitat Mateescu, G., Gentzsch, W., Ribbens, C.J.: Hybrid computing – where HPC meets grid and cloud computing. Future Gener. Comput. Syst. 27(5), 440–453 (2011)CrossRef Mateescu, G., Gentzsch, W., Ribbens, C.J.: Hybrid computing – where HPC meets grid and cloud computing. Future Gener. Comput. Syst. 27(5), 440–453 (2011)CrossRef
19.
Zurück zum Zitat Vecchiola, C., Calheiros, R.N., Karunamoorthy, D., Buyya, R.: Deadline-driven provisioning of resources for scientific applications in hybrid clouds with Aneka. Future Gener. Comput. Syst. 28(1), 58–65 (2012)CrossRef Vecchiola, C., Calheiros, R.N., Karunamoorthy, D., Buyya, R.: Deadline-driven provisioning of resources for scientific applications in hybrid clouds with Aneka. Future Gener. Comput. Syst. 28(1), 58–65 (2012)CrossRef
20.
Zurück zum Zitat Goecks, J., Nekrutenko, A., Taylor, J.: Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol. 11(8), 1–13 (2010)CrossRef Goecks, J., Nekrutenko, A., Taylor, J.: Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol. 11(8), 1–13 (2010)CrossRef
21.
Zurück zum Zitat Allen, B., et al.: Globus: a case study in software as a service for scientists. In: Proceedings of the 8th Workshop on Scientific Cloud Computing, pp. 25–32. ACM (2017) Allen, B., et al.: Globus: a case study in software as a service for scientists. In: Proceedings of the 8th Workshop on Scientific Cloud Computing, pp. 25–32. ACM (2017)
23.
Zurück zum Zitat Feoktistov, A., Sidorov, I., Sergeev, V., Kostromin, R., Bogdanova, V.: Virtualization of heterogeneous HPC-clusters based on OpenStack platform. Bull. S. Ural State Univ. Ser. Comput. Math. Soft. Eng. 6(2), 37–48 (2017) Feoktistov, A., Sidorov, I., Sergeev, V., Kostromin, R., Bogdanova, V.: Virtualization of heterogeneous HPC-clusters based on OpenStack platform. Bull. S. Ural State Univ. Ser. Comput. Math. Soft. Eng. 6(2), 37–48 (2017)
24.
Zurück zum Zitat Edelev, A., Zorkaltsev, V., Gorsky, S., Doan, V.B., Nguyen, H.N.: The combinatorial modelling approach to study sustainable energy development of Vietnam. Commun. Comput. Inf. Sci. 793, 207–218 (2017) Edelev, A., Zorkaltsev, V., Gorsky, S., Doan, V.B., Nguyen, H.N.: The combinatorial modelling approach to study sustainable energy development of Vietnam. Commun. Comput. Inf. Sci. 793, 207–218 (2017)
25.
Zurück zum Zitat Jonsson, H., Johansson, J., Johansson, H.: Identifying critical components in technical infrastructure networks. Proc. Inst. Mech. Eng. O J. Risk Reliab. 222(2), 235–243 (2008) Jonsson, H., Johansson, J., Johansson, H.: Identifying critical components in technical infrastructure networks. Proc. Inst. Mech. Eng. O J. Risk Reliab. 222(2), 235–243 (2008)
26.
Zurück zum Zitat Vorobev, S., Edelev, A.: Analysis of the importance of critical objects of the gas industry with the method of determining critical elements in networks of technical infrastructures. In: 10th International Conference on Management of Large-Scale System Development (MLSD). IEEE (2017). https://doi.org/10.1109/mlsd.2017.8109707 Vorobev, S., Edelev, A.: Analysis of the importance of critical objects of the gas industry with the method of determining critical elements in networks of technical infrastructures. In: 10th International Conference on Management of Large-Scale System Development (MLSD). IEEE (2017). https://​doi.​org/​10.​1109/​mlsd.​2017.​8109707
27.
Zurück zum Zitat Massel, L.V., Kopaygorodsky, A.N., Chernousov, A.V.: IT-infrastructure of research activities realized for the power engineering system researches. In: 10th International Conference on Computer Science and Information Technologies, pp. 106–111. Ufa State Aviation Technical University (2008) Massel, L.V., Kopaygorodsky, A.N., Chernousov, A.V.: IT-infrastructure of research activities realized for the power engineering system researches. In: 10th International Conference on Computer Science and Information Technologies, pp. 106–111. Ufa State Aviation Technical University (2008)
28.
Zurück zum Zitat Massel, L.V., Arshinsky, V.L., Massel, A.G.: Intelligent computing on the basis of cognitive and event modeling and its application in energy security studies. Int. J. Energy Optim. Eng. 3(1), 83–91 (2014) Massel, L.V., Arshinsky, V.L., Massel, A.G.: Intelligent computing on the basis of cognitive and event modeling and its application in energy security studies. Int. J. Energy Optim. Eng. 3(1), 83–91 (2014)
Metadaten
Titel
Orlando Tools: Energy Research Application Development Through Convergence of Grid and Cloud Computing
verfasst von
Alexander Feoktistov
Sergei Gorsky
Ivan Sidorov
Roman Kostromin
Alexei Edelev
Lyudmila Massel
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-05807-4_25