Skip to main content
Erschienen in: World Wide Web 4/2020

07.03.2020

High-performance docker integration scheme based on OpenStack

verfasst von: Sijie Yang, Xiaofeng Wang, Xiaoxue Wang, Lun An, Guizhu Zhang

Erschienen in: World Wide Web | Ausgabe 4/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

As an emerging technology in cloud computing Docker is becoming increasingly popular due to its high speed high efficiency and portability. The integration of Docker with OpenStack has been a hot topic in research and industrial areas e.g. as an emulation platform for evaluating cyberspace security technologies. This paper introduces a high-performance Docker integration scheme based on OpenStack that implements a container management service called Yun. Yun interacts with OpenStack’s services and manages the lifecycle of the container through the Docker Engine to integrate OpenStack and Docker. Yun improves the container deployment and throughput as well as the system performance by optimizing the message transmission architecture between internal components the underlying network data transmission architecture between containers and the scheduling methods. Based on the Docker Engine API Yun provides users with interfaces for CPU memory and disk resource limits to satisfy precise resource limits. Regarding scheduling Yun introduces a new NUMA-aware and resource-utilization-aware scheduling model to improve the performance of containers under resource competition and to balance the load of computing resources. Simultaneously Yun decouples from OpenStack versions by isolating its own running environment from the running environment of OpenStack to achieve better compatibility. Experiments show that compared to traditional methods Yun not only achieves the integration of OpenStack and Docker but also exhibits high performance in terms of deployment efficiency container throughput and the container’s system while also achieving load balancing.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Al-Roomi M., Al-Ebrahim S., Buqrais S., Ahmad I.: Cloud computing pricing models: a survey. Int. J. Grid Distrib. Comput. 6(5), 93–106 (2013)CrossRef Al-Roomi M., Al-Ebrahim S., Buqrais S., Ahmad I.: Cloud computing pricing models: a survey. Int. J. Grid Distrib. Comput. 6(5), 93–106 (2013)CrossRef
2.
Zurück zum Zitat Anderson C.: Docker [software engineering]. IEEE Softw. 32(3), 102–c3 (2015)CrossRef Anderson C.: Docker [software engineering]. IEEE Softw. 32(3), 102–c3 (2015)CrossRef
3.
Zurück zum Zitat Virtualenv B.I.: The Open Planning Project pyPA (2014) Virtualenv B.I.: The Open Planning Project pyPA (2014)
4.
Zurück zum Zitat Biederman E.W., Networx L.: Multiple instances of the global linux namespaces. In: Proceedings of the Linux Symposium vol. 1 pp. 101–112. Citeseer (2006) Biederman E.W., Networx L.: Multiple instances of the global linux namespaces. In: Proceedings of the Linux Symposium vol. 1 pp. 101–112. Citeseer (2006)
5.
Zurück zum Zitat Calheiros R.N., Masoumi E., Ranjan R., Buyya R.: Workload prediction using arima model and its impact on cloud applications’ qos. IEEE Trans. Cloud Comput. 3 (4), 449–458 (2015)CrossRef Calheiros R.N., Masoumi E., Ranjan R., Buyya R.: Workload prediction using arima model and its impact on cloud applications’ qos. IEEE Trans. Cloud Comput. 3 (4), 449–458 (2015)CrossRef
6.
Zurück zum Zitat Calinciuc A., Spoiala C.C., Turcu C.O., Filote C.: Openstack and Docker: Building a High-Performance Iaas Platform for Interactive Social Media Applications. In: 2016 International Conference on Development and Application Systems (DAS) pp. 287–290. IEEE (2016) Calinciuc A., Spoiala C.C., Turcu C.O., Filote C.: Openstack and Docker: Building a High-Performance Iaas Platform for Interactive Social Media Applications. In: 2016 International Conference on Development and Application Systems (DAS) pp. 287–290. IEEE (2016)
7.
Zurück zum Zitat Callegati F., Cerroni W., Contoli C., Santandrea G.: Performance of Network Virtualization in Cloud Computing Infrastructures: The Openstack Case. In: 2014 IEEE 3rd International Conference on Cloud Networking (Cloudnet) pp. 132–137. IEEE (2014) Callegati F., Cerroni W., Contoli C., Santandrea G.: Performance of Network Virtualization in Cloud Computing Infrastructures: The Openstack Case. In: 2014 IEEE 3rd International Conference on Cloud Networking (Cloudnet) pp. 132–137. IEEE (2014)
8.
Zurück zum Zitat Cen S., Bo L., Feng W., Hui D., Wei D., Wei S., Zhang X., Zhi Y.: Openstack Platform and Its Application in Big Data Processing. In: International Conference on Intelligent Networks & Intelligent Systems (2016) Cen S., Bo L., Feng W., Hui D., Wei D., Wei S., Zhang X., Zhi Y.: Openstack Platform and Its Application in Big Data Processing. In: International Conference on Intelligent Networks & Intelligent Systems (2016)
9.
Zurück zum Zitat Cheng Y., Chen W., Wang Z., Yu X.: Performance-monitoring-based traffic-aware virtual machine deployment on numa systems. IEEE Syst. J. 11(2), 973–982 (2017)CrossRef Cheng Y., Chen W., Wang Z., Yu X.: Performance-monitoring-based traffic-aware virtual machine deployment on numa systems. IEEE Syst. J. 11(2), 973–982 (2017)CrossRef
10.
Zurück zum Zitat Coullon H., Perez C., Pertin D.: Production Deployment Tools for Iaases: an Overall Model and Survey. In: 2017 IEEE 5th International Conference on Future Internet of Things and Cloud (Ficloud) pp. 183–190. IEEE (2017) Coullon H., Perez C., Pertin D.: Production Deployment Tools for Iaases: an Overall Model and Survey. In: 2017 IEEE 5th International Conference on Future Internet of Things and Cloud (Ficloud) pp. 183–190. IEEE (2017)
12.
Zurück zum Zitat Dutta A., Gnawali O.: Large-Scale Network Protocol Emulation on Commodity Cloud. In: 2014 IEEE Global Communications Conference pp. 1114–1119. IEEE (2014) Dutta A., Gnawali O.: Large-Scale Network Protocol Emulation on Commodity Cloud. In: 2014 IEEE Global Communications Conference pp. 1114–1119. IEEE (2014)
13.
Zurück zum Zitat Hirt T.: Kvm-the kernel-based virtual machine. Red Hat Inc (2010) Hirt T.: Kvm-the kernel-based virtual machine. Red Hat Inc (2010)
14.
Zurück zum Zitat Huang W., Zhang W., Zhang D., Meng L.: Elastic spatial query processing in openstack cloud computing environment for time-constraint data analysis. ISPRS Int. J. Geo-Inf. 6(3), 84 (2017)CrossRef Huang W., Zhang W., Zhang D., Meng L.: Elastic spatial query processing in openstack cloud computing environment for time-constraint data analysis. ISPRS Int. J. Geo-Inf. 6(3), 84 (2017)CrossRef
16.
Zurück zum Zitat Jansen C., Witt M., Krefting D.: Employing Docker Swarm on Openstack for Biomedical Analysis. In: International Conference on Computational Science and Its Applications pp. 303–318. Springer (2016) Jansen C., Witt M., Krefting D.: Employing Docker Swarm on Openstack for Biomedical Analysis. In: International Conference on Computational Science and Its Applications pp. 303–318. Springer (2016)
17.
Zurück zum Zitat Kozhirbayev Z., Sinnott R.O.: A performance comparison of container-based technologies for the cloud. Futur. Gener. Comput. Syst. 68, 175–182 (2017)CrossRef Kozhirbayev Z., Sinnott R.O.: A performance comparison of container-based technologies for the cloud. Futur. Gener. Comput. Syst. 68, 175–182 (2017)CrossRef
18.
Zurück zum Zitat Kristiani E., Yang C.T., Wang Y.T., Huang C.Y.: Implementation of an Edge Computing Architecture Using Openstack and Kubernetes. In: International Conference on Information Science and Applications pp. 675–685. Springer (2018) Kristiani E., Yang C.T., Wang Y.T., Huang C.Y.: Implementation of an Edge Computing Architecture Using Openstack and Kubernetes. In: International Conference on Information Science and Applications pp. 675–685. Springer (2018)
19.
Zurück zum Zitat Kumar K., Kurhekar M.: Economically Efficient Virtualization over Cloud Using Docker Containers. In: 2016 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM) pp. 95–100. IEEE (2016) Kumar K., Kurhekar M.: Economically Efficient Virtualization over Cloud Using Docker Containers. In: 2016 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM) pp. 95–100. IEEE (2016)
20.
Zurück zum Zitat Li H., Zhou H., Zhang H., Feng B., Shi W.: Emustack: an openstack-based dtn network emulation platform (extended version). Mobile Information Systems 2016 Article ID 6540207 15 pages (2016) Li H., Zhou H., Zhang H., Feng B., Shi W.: Emustack: an openstack-based dtn network emulation platform (extended version). Mobile Information Systems 2016 Article ID 6540207 15 pages (2016)
21.
Zurück zum Zitat Lima S., Rocha Á., Roque L.: An overview of openstack architecture: a message queuing services node. Cluster Computing 22(3) 7087–7098 (2019) Lima S., Rocha Á., Roque L.: An overview of openstack architecture: a message queuing services node. Cluster Computing 22(3) 7087–7098 (2019)
22.
Zurück zum Zitat Liu H., An L., Ren J., Wang B.: An interactive traffic replay method in a scaled-down environment. IEEE Access 7 149373–149386 (2019) Liu H., An L., Ren J., Wang B.: An interactive traffic replay method in a scaled-down environment. IEEE Access 7 149373–149386 (2019)
24.
Zurück zum Zitat Ma H., Li L., Liang Y., Chen J., Yin J.: Efficient virtual network transmission using correlated equilibrium on xen-based platform. J. Vis. Commun. Image Represent. 35, 248–256 (2016)CrossRef Ma H., Li L., Liang Y., Chen J., Yin J.: Efficient virtual network transmission using correlated equilibrium on xen-based platform. J. Vis. Commun. Image Represent. 35, 248–256 (2016)CrossRef
25.
Zurück zum Zitat Monsalve J., Landwehr A., Taufer M.: Dynamic Cpu Resource Allocation in Containerized Cloud Environments. In: 2015 IEEE International Conference on Cluster Computing pp. 535–536. IEEE (2015) Monsalve J., Landwehr A., Taufer M.: Dynamic Cpu Resource Allocation in Containerized Cloud Environments. In: 2015 IEEE International Conference on Cluster Computing pp. 535–536. IEEE (2015)
26.
Zurück zum Zitat Morabito R., Kjällman J., Komu M.: Hypervisors Vs. Lightweight Virtualization: a Performance Comparison. In: 2015 IEEE International Conference on Cloud Engineering pp. 386–393. IEEE (2015) Morabito R., Kjällman J., Komu M.: Hypervisors Vs. Lightweight Virtualization: a Performance Comparison. In: 2015 IEEE International Conference on Cloud Engineering pp. 386–393. IEEE (2015)
27.
Zurück zum Zitat Noel B., Michelino D., Velten M., Rocha R., Trigazis S.: Integrating Containers in the Cern Private Cloud. In: 22nd International Conference on Computing in High Energy and Nuclear Physics pp. 092045. IOP Publishing (2017) Noel B., Michelino D., Velten M., Rocha R., Trigazis S.: Integrating Containers in the Cern Private Cloud. In: 22nd International Conference on Computing in High Energy and Nuclear Physics pp. 092045. IOP Publishing (2017)
31.
Zurück zum Zitat Rostanski M., Grochla K., Seman A.: Evaluation of Highly Available and Fault-Tolerant Middleware Clustered Architectures Using Rabbitmq. In: 2014 Federated Conference on Computer Science and Information Systems pp. 879–884. IEEE (2014) Rostanski M., Grochla K., Seman A.: Evaluation of Highly Available and Fault-Tolerant Middleware Clustered Architectures Using Rabbitmq. In: 2014 Federated Conference on Computer Science and Information Systems pp. 879–884. IEEE (2014)
32.
Zurück zum Zitat Sahasrabudhe S., Sonawani S.S.: Improved Filter-Weight Algorithm for Utilization-Aware Resource Scheduling in Openstack. In: 2015 International Conference on Information Processing (ICIP) pp. 43–47. IEEE (2015) Sahasrabudhe S., Sonawani S.S.: Improved Filter-Weight Algorithm for Utilization-Aware Resource Scheduling in Openstack. In: 2015 International Conference on Information Processing (ICIP) pp. 43–47. IEEE (2015)
33.
Zurück zum Zitat Shetty J., Upadhaya S., Rajarajeshwari H., Shobha G., Chandra J.: An empirical performance evaluation of docker container openstack virtual machine and bare metal server. Ind. J. Electr. Eng. Comput. Sci. 7(1), 205–213 (2017) Shetty J., Upadhaya S., Rajarajeshwari H., Shobha G., Chandra J.: An empirical performance evaluation of docker container openstack virtual machine and bare metal server. Ind. J. Electr. Eng. Comput. Sci. 7(1), 205–213 (2017)
34.
Zurück zum Zitat Tang L., Mars J., Zhang X., Hagmann R., Hundt R., Tune E.: Optimizing Google’s Warehouse Scale Computers: The Numa Experience. In: 2013 IEEE 19th International Symposium on High Performance Computer Architecture (HPCA) pp. 188–197. IEEE (2013) Tang L., Mars J., Zhang X., Hagmann R., Hundt R., Tune E.: Optimizing Google’s Warehouse Scale Computers: The Numa Experience. In: 2013 IEEE 19th International Symposium on High Performance Computer Architecture (HPCA) pp. 188–197. IEEE (2013)
35.
Zurück zum Zitat Tarasov V., Rupprecht L., Skourtis D., Warke A., Hildebrand D., Mohamed M., Mandagere N., Li W., Rangaswami R., Zhao M.: In Search of the Ideal Storage Configuration for Docker Containers. In: 2017 IEEE 2nd International Workshops on Foundations and Applications of Self* Systems (FAS* W) pp. 199–206. IEEE (2017) Tarasov V., Rupprecht L., Skourtis D., Warke A., Hildebrand D., Mohamed M., Mandagere N., Li W., Rangaswami R., Zhao M.: In Search of the Ideal Storage Configuration for Docker Containers. In: 2017 IEEE 2nd International Workshops on Foundations and Applications of Self* Systems (FAS* W) pp. 199–206. IEEE (2017)
36.
Zurück zum Zitat Tian Z., Shi W., Wang Y., Zhu C., Du X., Su S., Sun Y., Guizani N.: Real time lateral movement detection based on evidence reasoning network for edge computing environment. IEEE Trans. Ind. Inf. 15(7), 4285–4294 (2019)CrossRef Tian Z., Shi W., Wang Y., Zhu C., Du X., Su S., Sun Y., Guizani N.: Real time lateral movement detection based on evidence reasoning network for edge computing environment. IEEE Trans. Ind. Inf. 15(7), 4285–4294 (2019)CrossRef
37.
Zurück zum Zitat Vinoski S.: Advanced message queuing protocol. IEEE Internet Comput. 10(6), 87–89 (2006)CrossRef Vinoski S.: Advanced message queuing protocol. IEEE Internet Comput. 10(6), 87–89 (2006)CrossRef
38.
Zurück zum Zitat Wang X., Zhai M., Zhang G.: Research on High-Fidelity Router Emulation Technologies Based on Cloud Platform. In: 2018 IEEE 7Th International Conference on Cloud Networking (Cloudnet) pp. 1–4. IEEE (2018) Wang X., Zhai M., Zhang G.: Research on High-Fidelity Router Emulation Technologies Based on Cloud Platform. In: 2018 IEEE 7Th International Conference on Cloud Networking (Cloudnet) pp. 1–4. IEEE (2018)
41.
Zurück zum Zitat Xavier M.G., Neves M.V., Rossi F.D., Ferreto T.C., Lange T., De Rose C.A.: Performance Evaluation of Container-Based Virtualization for High Performance Computing Environments. In: 2013 21st Euromicro International Conference on Parallel Distributed and Network-Based Processing pp. 233–240. IEEE (2013) Xavier M.G., Neves M.V., Rossi F.D., Ferreto T.C., Lange T., De Rose C.A.: Performance Evaluation of Container-Based Virtualization for High Performance Computing Environments. In: 2013 21st Euromicro International Conference on Parallel Distributed and Network-Based Processing pp. 233–240. IEEE (2013)
42.
Zurück zum Zitat Yamato Y., Nishizawa Y., Nagao S., Sato K.: Fast and reliable restoration method of virtual resources on openstack. IEEE Trans. Cloud Comput. 6(2), 572–583 (2018)CrossRef Yamato Y., Nishizawa Y., Nagao S., Sato K.: Fast and reliable restoration method of virtual resources on openstack. IEEE Trans. Cloud Comput. 6(2), 572–583 (2018)CrossRef
43.
Zurück zum Zitat Zhai M., Jiang X., Wang X.: Research on high-throughput routing simulation based on openstack. Computer Engineering and Applications 54(22) 74–79 (2018) Zhai M., Jiang X., Wang X.: Research on high-throughput routing simulation based on openstack. Computer Engineering and Applications 54(22) 74–79 (2018)
44.
Zurück zum Zitat Zhang T., Lee R.B.: Design implementation and verification of cloud architecture for monitoring a virtual machine’s security health. IEEE Trans. Comput. 67(6), 799–815 (2018)MathSciNetCrossRef Zhang T., Lee R.B.: Design implementation and verification of cloud architecture for monitoring a virtual machine’s security health. IEEE Trans. Comput. 67(6), 799–815 (2018)MathSciNetCrossRef
Metadaten
Titel
High-performance docker integration scheme based on OpenStack
verfasst von
Sijie Yang
Xiaofeng Wang
Xiaoxue Wang
Lun An
Guizhu Zhang
Publikationsdatum
07.03.2020
Verlag
Springer US
Erschienen in
World Wide Web / Ausgabe 4/2020
Print ISSN: 1386-145X
Elektronische ISSN: 1573-1413
DOI
https://doi.org/10.1007/s11280-020-00789-9

Weitere Artikel der Ausgabe 4/2020

World Wide Web 4/2020 Zur Ausgabe

Premium Partner