Skip to main content
Top

2021 | OriginalPaper | Chapter

Application and Analysis of Three Common High-Performance Network Data Processing Frameworks

Authors : Gen Zhu, Wen-bin Kang

Published in: Big Data Analytics for Cyber-Physical System in Smart City

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The rise of “cloud” industry and continuous innovation of network technology, more and more basic network architecture equipment is gradually integrated into the architecture based on the general processor platform, from traditional physical network management to virtual network management, gradually from flat the network structure model evolved into a layered network structure based on SDN. Network construction has become controllable and low cost, able to support the performance requirements of large-scale users or applications and massive data processing. There are many excellent high-performance network data processing frameworks on the market that integrate above technical solutions, such as 6wind, windriver, DPDK, PF_RING, Netmap, etc. This article introduces three common DPDK, PF_RING, Netmap high-performance network packet processing framework compares their advantages and disadvantages, and prospects for future development.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Begin, T., Baynat, B., Gallardo, G.A., et al.: An accurate and efficient modeling framework for the performance evaluation of DPDK-based virtual switches. IEEE Trans. Netw. Serv. Manage. 15(4), 1407–1421 (2018)CrossRef Begin, T., Baynat, B., Gallardo, G.A., et al.: An accurate and efficient modeling framework for the performance evaluation of DPDK-based virtual switches. IEEE Trans. Netw. Serv. Manage. 15(4), 1407–1421 (2018)CrossRef
3.
go back to reference Halfhill, T.R.: Broadwell accelerates the DPDK. Microprocess. Rep. 30(7), 19–22 (2016) Halfhill, T.R.: Broadwell accelerates the DPDK. Microprocess. Rep. 30(7), 19–22 (2016)
4.
go back to reference Moharir, M., Johar, D., Bhardwaj, D.: An experimental review on Intel DPDK L2 forwarding. Int. J. Appl. Eng. Res. 12(18 Pt.5), 7833–7837 (2017) Moharir, M., Johar, D., Bhardwaj, D.: An experimental review on Intel DPDK L2 forwarding. Int. J. Appl. Eng. Res. 12(18 Pt.5), 7833–7837 (2017)
5.
go back to reference Li, G., Zhang, D., Li, Y., et al.: Toward energy-efficiency optimization of Pktgen-DPDK for green network testbeds. China Commun. 15(11), 199–207 (2018)CrossRef Li, G., Zhang, D., Li, Y., et al.: Toward energy-efficiency optimization of Pktgen-DPDK for green network testbeds. China Commun. 15(11), 199–207 (2018)CrossRef
6.
go back to reference Alizadeh, R., Belanger, N., Savaria, Y., et al.: DPDK and MKL; enabling technologies for near deterministic cloud-based signal processing. In: 2015 IEEE 13th International New Circuits and Systems Conference: 2015 IEEE 13th International New Circuits and Systems Conference (NEWCAS), Grenoble, France, 7–10 June 2015, pp. 1–4 (2015) Alizadeh, R., Belanger, N., Savaria, Y., et al.: DPDK and MKL; enabling technologies for near deterministic cloud-based signal processing. In: 2015 IEEE 13th International New Circuits and Systems Conference: 2015 IEEE 13th International New Circuits and Systems Conference (NEWCAS), Grenoble, France, 7–10 June 2015, pp. 1–4 (2015)
7.
go back to reference Gallenmuller, S., Emmerich, P., Wohlfart, F., et al.: Comparison of frameworks for high-performance packet IO. In: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS 2013), Oakland, CA, USA, 7–8 May 2015, pp. 29–38 (2015) Gallenmuller, S., Emmerich, P., Wohlfart, F., et al.: Comparison of frameworks for high-performance packet IO. In: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS 2013), Oakland, CA, USA, 7–8 May 2015, pp. 29–38 (2015)
8.
go back to reference Stoev, S.A., Michailidis, G., Bhattacharya, S., et al.: AMON: an open source architecture for online monitoring, statistical analysis, and forensics of multi-gigabit streams. IEEE J. Sel. Areas Commun. 34(6), 1834–1848 (2016)CrossRef Stoev, S.A., Michailidis, G., Bhattacharya, S., et al.: AMON: an open source architecture for online monitoring, statistical analysis, and forensics of multi-gigabit streams. IEEE J. Sel. Areas Commun. 34(6), 1834–1848 (2016)CrossRef
9.
go back to reference Du, J., Liu, P.: Design and implementation of efficient one-way isolation system based on PF_RING. In: 2012 Fourth International Conference on Multimedia Information Networking and Security [v.1], pp. 105–108 (2012) Du, J., Liu, P.: Design and implementation of efficient one-way isolation system based on PF_RING. In: 2012 Fourth International Conference on Multimedia Information Networking and Security [v.1], pp. 105–108 (2012)
10.
go back to reference Zabala, L., Pineda, A., Ferro, A., et al.: Comparing network traffic probes based on commodity hardware. In: The Thirteenth International Conference on Networks: ICN 2014, Nice, France, 23–27 February 2014, pp. 261–267 (2014) Zabala, L., Pineda, A., Ferro, A., et al.: Comparing network traffic probes based on commodity hardware. In: The Thirteenth International Conference on Networks: ICN 2014, Nice, France, 23–27 February 2014, pp. 261–267 (2014)
11.
go back to reference Redzovic, H., Vesovic, M., Smiljanic, A., et al.: Energy-efficient network processing based on netmap framework. Electron. Lett. 53(10), 407–409 (2017)CrossRef Redzovic, H., Vesovic, M., Smiljanic, A., et al.: Energy-efficient network processing based on netmap framework. Electron. Lett. 53(10), 407–409 (2017)CrossRef
12.
go back to reference Garzarella, S., Lettieri, G., Rizzo, L.: Virtual device passthrough for high speed VM networking. In: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS 2013), Oakland, CA, USA, 7–8 May 2015, pp. 99–110 (2015) Garzarella, S., Lettieri, G., Rizzo, L.: Virtual device passthrough for high speed VM networking. In: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems: Eleventh 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS 2013), Oakland, CA, USA, 7–8 May 2015, pp. 99–110 (2015)
13.
go back to reference Mikkelsen, L.M., Thomsen, S.R., Pedersen, M.S., et al.: NetMap - creating a map of application layer QoS metrics of mobile networks using crowd sourcing. In: Internet of Things, Smart Spaces, and Next Generation Networks and Systems: 14th International Conference, NEW2AN 2014, and 7th Conference, ruSMART 2014, Proceedings, St. Petersburg, Russia, 27–29 August 2014, pp. 544–555 (2014) Mikkelsen, L.M., Thomsen, S.R., Pedersen, M.S., et al.: NetMap - creating a map of application layer QoS metrics of mobile networks using crowd sourcing. In: Internet of Things, Smart Spaces, and Next Generation Networks and Systems: 14th International Conference, NEW2AN 2014, and 7th Conference, ruSMART 2014, Proceedings, St. Petersburg, Russia, 27–29 August 2014, pp. 544–555 (2014)
14.
go back to reference Rizzo, L.: Portable packet processing modules for OS kernels. IEEE Netw. Mag. Comput. Commun. 28(2), 6–11 (2014) Rizzo, L.: Portable packet processing modules for OS kernels. IEEE Netw. Mag. Comput. Commun. 28(2), 6–11 (2014)
15.
go back to reference Casoni, M., Grazia, C.A., Patriciello, N.: On the performance of Linux container with Netmap/VALE for networks virtualization. In: 2013 19th IEEE International Conference on Networks: 2013 19th IEEE International Conference on Networks (ICON), Singapore, Singapore, 11–13 December 2013, pp. 1–6 (2013) Casoni, M., Grazia, C.A., Patriciello, N.: On the performance of Linux container with Netmap/VALE for networks virtualization. In: 2013 19th IEEE International Conference on Networks: 2013 19th IEEE International Conference on Networks (ICON), Singapore, Singapore, 11–13 December 2013, pp. 1–6 (2013)
Metadata
Title
Application and Analysis of Three Common High-Performance Network Data Processing Frameworks
Authors
Gen Zhu
Wen-bin Kang
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-33-4572-0_185

Premium Partner