ABSTRACT
As the complexity of modern networks increases, virtualization techniques, such as software-defined networking (SDN) and network function virtualization (NFV), get highlighted to achieve various network management and operating requirements. However, those virtualization techniques (specifically, NFV) have a critical issue that the performance of virtualized network functions (VNFs) is easily affected by diverse environmental factors (e.g., various workloads, resource contentions among VNFs), so resulting in unexpected performance degradations - performance uncertainty. Unfortunately, existing approaches mostly provide limited information about a single VNF or the underlying infrastructure (e.g., Xen, KVM), which is deficient in reasoning why the performance uncertainties occur. For such reasons, we first deeply investigate the behaviors of multiple VNFs along service chains in NFV environments, and define a set of critical performance features for each layer in the NFV hierarchical stack. Based on our investigations and findings, we introduce an automated analysis system, Probius, providing the comprehensive view of VNFs and their service chains on the basis of NFV architectural characteristics. Probius collects most possible NFV performance related features efficiently, analyzes the behaviors of NFV, and finally detects abnormal behaviors of NFV - possible reasons of performance uncertainties. To show the effectiveness of Probius, we have deployed 7 open-source VNFs and found 5 interesting performance issues caused by environmental factors.
- Emerging Threats Open Rulesets. https://rules.emergingthreats.net. (online, 2018. 02.).Google Scholar
- Ftrace: Linux Kernel Internal Tracer. https://www.kernel.org/doc/Documentation/trace/ftrace.txt. (online, 2018. 02.).Google Scholar
- GNU Profiler. https://ftp.gnu.org/old-gnu/Manuals/gprof-2.9.1/html_mono/gprof.html. (online, 2018. 02.).Google Scholar
- iPerf: The TCP, UDP and SCTP Network Bandwidth Measurement Tool. https://iperf.fr. (online, 2018. 02.).Google Scholar
- Java Profiler. https://www.ej-technologies.com/products/jprofiler/overview.html. (online, 2018. 02.).Google Scholar
- Linux Perf. https://perf.wiki.kernel.org/index.php/Main_Page. (online, 2018. 02.).Google Scholar
- Netfilter/iptables Project. https://www.netfilter.org. (online, 2018. 02.).Google Scholar
- Netsniff-ng: A Free Linux Networking Toolkit. http://netsniff-ng.org. (online, 2018. 02.).Google Scholar
- NumPy. http://www.numpy.org. (online, 2018. 02.).Google Scholar
- OpenStack. https://www.openstack.org. (online, 2018. 02.).Google Scholar
- pandas: Python Data Analysis Library. http://pandas.pydata.org. (online, 2018. 02.).Google Scholar
- Performance Events in the KVM Kernel Module. http://www.linux-kvm.org/page/Perf_events. (online, 2018. 02.).Google Scholar
- PSUtil: A Cross-platform Library for Process and System Utilities. https://github.com/giampaolo/psutil. (online, 2018. 02.).Google Scholar
- Snort: Network Intrusion Detection & Prevention System. https://www.snort.org. (online, 2018. 02.).Google Scholar
- Snort v2.9 Rules for Registered Users. https://www.snort.org/downloads/#rule-downloads. (online, 2018. 02.).Google Scholar
- SQLite. https://www.sqlite.org. (online, 2018. 02.).Google Scholar
- StatsModels: Statistics in Python. http://www.statsmodels.org/stable/index.html. (online, 2018. 02.).Google Scholar
- Suricata: Open Source IDS / IPS / NSM Engine. https://suricata-ids.org. (online, 2018. 02.).Google Scholar
- TCPDUMP: A Packet Analyzer. http://www.tcpdump.org. (online, 2018. 02.).Google Scholar
- Trace-cmd: A User-space Front-end Command-line Tool for Ftrace. https://git.kernel.org/pub/scm/linux/kernel/git/rostedt/trace-cmd.git. (online, 2018. 02.).Google Scholar
- James W Anderson, Ryan Braud, Rishi Kapoor, George Porter, and Amin Vahdat. 2012. xOMB: Extensible Open Middleboxes with Commodity Servers. In Proceedings of the ACM/IEEE symposium on Architectures for networking and communications systems. ACM. Google ScholarDigital Library
- ATTO Research. Athene: Software-defined Elastic NFV Platform. http://www.atto-research.com/en/solutions/athene. (online, 2018. 02.).Google Scholar
- Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauer, Ian Pratt, and Andrew Warfield. 2003. Xen and the Art of Virtualization. In ACM SIGOPS Operating Systems Review. ACM. Google ScholarDigital Library
- Kenneth A Bollen and Robert W Jackman. 1985. Regression Diagnostics: An Expository Treatment of Outliers and Influential Cases. Sociological Methods & Research (1985).Google Scholar
- Matthias Bolte, Michael Sievers, Georg Birkenheuer, Oliver Niehörster, and André Brinkmann. 2010. Non-intrusive Virtualization Management using libvirt. In Proceedings of the Conference on Design, Automation and Test in Europe. European Design and Automation Association. Google ScholarDigital Library
- Lianjie Cao, Puneet Sharma, Sonia Fahmy, and Vinay Saxena. 2015. NFV-Vital: A Framework for Characterizing the Performance of Virtual Network Functions. In IEEE Conference on Network Function Virtualization and Software Defined Network. IEEE.Google Scholar
- R Dennis Cook. 1979. Influential Observations in Linear Regression. J. Amer. Statist. Assoc. (1979).Google Scholar
- Tiago de Paula Peixoto. graph-tool: Efficient Network Analysis. https://graph-tool.skewed.de. (online, 2018. 02.).Google Scholar
- Paul Emmerich, Daniel Raumer, Florian Wohlfart, and Georg Carle. 2014. Performance Characteristics of Virtual Switching. In IEEE International Conference on Cloud Networking. IEEE.Google Scholar
- Michio Honda, Felipe Huici, Giuseppe Lettieri, and Luigi Rizzo. 2015. mSwitch: A Highly-Scalable, Modular Software Switch. In Proceedings of the ACM Symposium on Software Defined Networking Research. ACM. Google ScholarDigital Library
- Wei Huang, Jiuxing Liu, Bulent Abali, and Dhabaleswar K Panda. 2006. A Case for High Performance Computing with Virtual Machines. In Proceedings of the Annual International Conference on Supercomputing. ACM. Google ScholarDigital Library
- Jinho Hwang, KK Ramakrishnan, and Timothy Wood. 2014. NetVM: High Performance and Flexible Networking using Virtualization on Commodity Platforms. In Proceedings of the USENIX Conference on Networked Systems Design and Implementation. USENIX Association. Google ScholarDigital Library
- Intel. DPDK. http://dpdk.org. (online, 2018. 02.).Google Scholar
- Avi Kivity, Yaniv Kamay, Dor Laor, Uri Lublin, and Anthony Liguori. 2007. kvm: the Linux Virtual Machine Monitor. In Linux Symposium.Google Scholar
- Younggyun Koh, Rob Knauerhase, Paul Brett, Mic Bowman, Zhihua Wen, and Calton Pu. 2007. An Analysis of Performance Interference Effects in Virtual Environments. In IEEE International Symposium on Performance Analysis of Systems & Software. IEEE.Google Scholar
- Eddie Kohler, Robert Morris, Benjie Chen, John Jannotti, and M Frans Kaashoek. 2000. The Click Modular Router. ACM Transactions on Computer Systems (2000). Google ScholarDigital Library
- KVM. VhostNet. https://www.linux-kvm.org/page/UsingVhost. (online, 2018. 02.).Google Scholar
- John Levon and Philippe Elie. Oprofile: A System Profiler for Linux. (2004).Google Scholar
- Holger Karl Manuel Peuster. 2016. Understand Your Chains: Towards Performance Profile-based Network Service Management. In European Workshop on Software Defined Networks. IEEE.Google Scholar
- Joao Martins, Mohamed Ahmed, Costin Raiciu, Vladimir Olteanu, Michio Honda, Roberto Bifulco, and Felipe Huici. 2014. ClickOS and the Art of Network Function Virtualization. In Proceedings of the USENIX Conference on Networked Systems Design and Implementation. USENIX Association. Google ScholarDigital Library
- Nick McKeown, Tom Anderson, Hari Balakrishnan, Guru Parulkar, Larry Peterson, Jennifer Rexford, Scott Shenker, and Jonathan Turner. 2008. OpenFlow: Enabling Innovation in Campus Networks. ACM SIGCOMM Computer Communication Review (2008). Google ScholarDigital Library
- Yiduo Mei, Ling Liu, Xing Pu, Sankaran Sivathanu, and Xiaoshe Dong. 2013. Performance Analysis of Network I/O Workloads in Virtualized Data Centers. IEEE Transactions on Services Computing (2013). Google ScholarDigital Library
- Priyanka Naik, Dilip Kumar Shaw, and Mythili Vutukuru. {n. d.}. NFVPerf: Online Performance Monitoring and Bottleneck Detection for NFV. ({n. d.}).Google Scholar
- Ruslan Nikolaev and Godmar Back. 2011. Perfctr-xen: A Framework for Performance Counter Virtualization. In ACM SIGPLAN Notices. ACM. Google ScholarDigital Library
- NTOP. PF_RING. http://www.ntop.org/products/packet-capture/pf_ring. (online, 2017. 2018. 02.).Google Scholar
- Shoumik Palkar, Chang Lan, Sangjin Han, Keon Jang, Aurojit Panda, Sylvia Ratnasamy, Luigi Rizzo, and Scott Shenker. 2015. E2: A Framework for NFV Applications. In Proceedings of the ACM Symposium on Operating Systems Principles. ACM. Google ScholarDigital Library
- Ben Pfaff, Justin Pettit, Teemu Koponen, Ethan J Jackson, Andy Zhou, Jarno Rajahalme, Jesse Gross, Alex Wang, Joe Stringer, Pravin Shelar, et al. 2015. The Design and Implementation of Open vSwitch. In Proceedings of the USENIX Conference on Networked Systems Design and Implementation. Google ScholarDigital Library
- Xing Pu, Ling Liu, Yiduo Mei, Sankaran Sivathanu, Younggyun Koh, Calton Pu, and Yuanda Cao. 2013. Who is your neighbor: Net I/O Performance Interference in Virtualized Clouds. IEEE Transactions on Services Computing (2013). Google ScholarDigital Library
- Kaushik Kumar Ram, Alan L Cox, Mehul Chadha, Scott Rixner, and TW Barr. 2013. Hyper-Switch: A Scalable Software Virtual Switching Architecture. In USENIX Annual Technical Conference. USENIX Association. Google ScholarDigital Library
- Luigi Rizzo. 2012. Netmap: A Novel Framework for Fast Packet I/O. In USENIX Security Symposium. USENIX Association. Google ScholarDigital Library
- Luigi Rizzo and Giuseppe Lettieri. 2012. Vale: A Switched Ethernet for Virtual Machines. In Proceedings of the International Conference on Emerging Networking Experiments and Technologies. ACM. Google ScholarDigital Library
- Raphael Vicente Rosa, Christian Esteve Rothenberg, and Robert Szabo. 2015. VBaaS: VNF Benchmark-as-a-service. In European Workshop on Software Defined Networks. IEEE. Google ScholarDigital Library
- Rubicon Communications, LLC. pfSense: Open Source Firewall. https://www.pfsense.org. (online, 2018. 02.).Google Scholar
- Rusty Russell. 2008. virtio: Towards A De-facto Standard for Virtual I/O Devices. ACM SIGOPS Operating Systems Review (2008). Google ScholarDigital Library
- SDxCentral. SDN and NFV Market Size and Forecast Report 2015. https://www.sdxcentral.com/reports/sdn-nfv-market-size-forecast-report-2015. (online, 2018. 02.).Google Scholar
- Vyas Sekar, Norbert Egi, Sylvia Ratnasamy, Michael K Reiter, and Guangyu Shi. 2012. Design and Implementation of a Consolidated Middlebox Architecture. In Proceedings of the USENIX conference on Networked Systems Design and Implementation. USENIX Association. Google ScholarDigital Library
- Zhiming Shen, Sethuraman Subbiah, Xiaohui Gu, and John Wilkes. 2011. Cloud-scale: Elastic Resource Scaling for Multi-tenant Cloud Systems. In Proceedings of the ACM Symposium on Cloud Computing. ACM. Google ScholarDigital Library
- VyOS Project. VyOS: An Open Source Router Operating System. https://vyos.io. (online, 2018. 02.).Google Scholar
- Timothy Wood, Prashant Shenoy, Arun Venkataramani, and Mazin Yousif. 2009. Sandpiper: Black-box and Gray-box Resource Management for Virtual Machines. Computer Networks (2009). Google ScholarDigital Library
- Tianlong Yu, Shadi Abdollahian Noghabi, Shachar Raindel, Hongqiang Harry Liu, Jitu Padhye, and Vyas Sekar. 2016. FreeFlow: High Performance Container Networking. In Proceedings of the workshop on Hot topics in Networks. Google ScholarDigital Library
- Wei Zhang, Guyue Liu, Wenhui Zhang, Neel Shah, Phillip Lopreiato, Gregoire Todeschi, KK Ramakrishnan, and Timothy Wood. 2016. OpenNetVM: A Platform for High Performance Network Service Chains. In Proceedings of the workshop on Hot topics in Middleboxes and Network Function Virtualization. ACM. Google ScholarCross Ref
Index Terms
- Probius: Automated Approach for VNF and Service Chain Analysis in Software-Defined NFV
Recommendations
NFP: Enabling Network Function Parallelism in NFV
SIGCOMM '17: Proceedings of the Conference of the ACM Special Interest Group on Data CommunicationSoftware-based sequential service chains in Network Function Virtualization (NFV) could introduce significant performance overhead. Current acceleration efforts for NFV mainly target on optimizing each component of the sequential service chain. However, ...
A flexible and efficient container-based NFV platform for middlebox networking
SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied ComputingNetwork Function Virtualization (NFV) enables multiple network functions (NFs) to operate simultaneously on a commodity server. Internet Data Centers (IDCs) gain significant flexibility and agility through NFV's ability to dynamically deploy and ...
Diagnosing performance overheads in the xen virtual machine environment
VEE '05: Proceedings of the 1st ACM/USENIX international conference on Virtual execution environmentsVirtual Machine (VM) environments (e.g., VMware and Xen) are experiencing a resurgence of interest for diverse uses including server consolidation and shared hosting. An application's performance in a virtual machine environment can differ markedly from ...
Comments