Skip to main content
Erschienen in: Mobile Networks and Applications 6/2017

04.05.2016

Facing Network Management Challenges with Functional Data Analysis: Techniques & Opportunities

verfasst von: David Muelas, Jorge E. López de Vergara, José R. Berrendero, Javier Ramos, Javier Aracil

Erschienen in: Mobile Networks and Applications | Ausgabe 6/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Current fixed and mobile networks’ behavior is rapidly changing, which calls for flexible monitoring approaches to avoid loosing track with such a fast evolutionary pace. Due to the many challenges that this scenario is posing to network managers, we propose the exploration of Functional Data Analysis (FDA) techniques as a mean to easily deal with network management and analysis issues. Specifically, we describe and evaluate several FDA methods with applications to network measurement preprocessing and clustering, bandwidth allocation, and anomaly and outlier detection. Our work focuses on how these FDA-based tools serve to improve the outcomes of traffic data mining and analysis, providing easy-to-understand and comprehensive outputs for network managers. We present the results that we have obtained from real case studies in the Spanish Academic network using throughput time series, comparing them with other alternatives of the state of the art. With this com- parative, we have qualitatively and quantitatively evaluated the advantages of FDA-methods in the networking area.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Aguado A, López V, Marhuenda J, González de Dios O., Fernández-Palacios JP (2015) ABNO: a feasible SDN approach for multivendor IP and optical networks. IEEE/OSA Journal of Opt Commun and Netw 7(2):A356–A362CrossRef Aguado A, López V, Marhuenda J, González de Dios O., Fernández-Palacios JP (2015) ABNO: a feasible SDN approach for multivendor IP and optical networks. IEEE/OSA Journal of Opt Commun and Netw 7(2):A356–A362CrossRef
2.
Zurück zum Zitat Andrews J, Buzzi S, Choi W, Hanly S, Lozano A, Soong A, Zhang J (2014) What will 5G be?. IEEE J Sel Areas Commun 32(6):1065-1082CrossRef Andrews J, Buzzi S, Choi W, Hanly S, Lozano A, Soong A, Zhang J (2014) What will 5G be?. IEEE J Sel Areas Commun 32(6):1065-1082CrossRef
3.
Zurück zum Zitat Antonello R, Fernandes S, Kamienski C, Sadok D, Kelner J, Gdor I, Szab G, Westholm T (2012) Deep packet inspection tools and techniques in commodity platforms: Challenges and trends. J Netw Comput Appl 35(6):1863–1878CrossRef Antonello R, Fernandes S, Kamienski C, Sadok D, Kelner J, Gdor I, Szab G, Westholm T (2012) Deep packet inspection tools and techniques in commodity platforms: Challenges and trends. J Netw Comput Appl 35(6):1863–1878CrossRef
4.
Zurück zum Zitat Arribas-Gil A, Romo J (2014) Shape outlier detection and visualization for functional data: the outliergram. Biostatistics 15(4):603–619CrossRef Arribas-Gil A, Romo J (2014) Shape outlier detection and visualization for functional data: the outliergram. Biostatistics 15(4):603–619CrossRef
5.
Zurück zum Zitat Bajpai V, Schönwälder J (2015) A survey on internet performance measurement platforms and related standardization efforts. IEEE Commun Surv Tutor 17(3):1313–1341CrossRef Bajpai V, Schönwälder J (2015) A survey on internet performance measurement platforms and related standardization efforts. IEEE Commun Surv Tutor 17(3):1313–1341CrossRef
6.
Zurück zum Zitat Bari MF, Boutaba R, Esteves R, Granville LZ, Podlesny M, Rabbani MG, Zhang Q, Zhani MF (2013) Data center network virtualization: a survey. IEEE Commun Surv Tutor 15(2):909–928CrossRef Bari MF, Boutaba R, Esteves R, Granville LZ, Podlesny M, Rabbani MG, Zhang Q, Zhani MF (2013) Data center network virtualization: a survey. IEEE Commun Surv Tutor 15(2):909–928CrossRef
7.
Zurück zum Zitat Chen N, Rong B, Mouaki A, Li W (2015) Self-organizing scheme based on NFV and SDN architecture for future heterogeneous networks. Mob Netw Appl 20(4):466–472CrossRef Chen N, Rong B, Mouaki A, Li W (2015) Self-organizing scheme based on NFV and SDN architecture for future heterogeneous networks. Mob Netw Appl 20(4):466–472CrossRef
8.
Zurück zum Zitat Claeskens G, Hubert M, Slaets L, Vakili K (2014) Multivariate functional halfspace depth. J Am Stat Assoc 109 (505):411–423MathSciNetCrossRefMATH Claeskens G, Hubert M, Slaets L, Vakili K (2014) Multivariate functional halfspace depth. J Am Stat Assoc 109 (505):411–423MathSciNetCrossRefMATH
9.
10.
Zurück zum Zitat Cuevas A, Febrero M, Fraiman R (2007) Robust estimation and classification for functional data via projection-based depth notions. Comput Stat 22(3):481–496MathSciNetCrossRefMATH Cuevas A, Febrero M, Fraiman R (2007) Robust estimation and classification for functional data via projection-based depth notions. Comput Stat 22(3):481–496MathSciNetCrossRefMATH
11.
Zurück zum Zitat Febrero M, Galeano P, González-Manteiga W (2008) Outlier detection in functional data by depth measures, with application to identify abnormal NOx levels. Environmetrics 19(4):331–345MathSciNetCrossRef Febrero M, Galeano P, González-Manteiga W (2008) Outlier detection in functional data by depth measures, with application to identify abnormal NOx levels. Environmetrics 19(4):331–345MathSciNetCrossRef
12.
Zurück zum Zitat Febrero-Bande M, Oviedo de la Fuente M (2012) Statistical computing in functional data analysis: the R package fda.usc. J Stat Softw 51(4):1–28CrossRef Febrero-Bande M, Oviedo de la Fuente M (2012) Statistical computing in functional data analysis: the R package fda.usc. J Stat Softw 51(4):1–28CrossRef
13.
Zurück zum Zitat García-Dorado JL, Aracil J, Hernández JA, López de Vergara JE (2008) A queueing equivalent thresholding method for thinning traffic captures. In: Network Operations and Management Symposium, 2008. NOMS 2008. IEEE, pp 176–183 García-Dorado JL, Aracil J, Hernández JA, López de Vergara JE (2008) A queueing equivalent thresholding method for thinning traffic captures. In: Network Operations and Management Symposium, 2008. NOMS 2008. IEEE, pp 176–183
14.
Zurück zum Zitat García-Dorado JL, Hernández JA, Aracil J, López de Vergara JE, López-Buedo S (2011) Characterization of the busy-hour traffic of IP networks based on their intrinsic features. Comput Netw 55(9):2111–2125CrossRef García-Dorado JL, Hernández JA, Aracil J, López de Vergara JE, López-Buedo S (2011) Characterization of the busy-hour traffic of IP networks based on their intrinsic features. Comput Netw 55(9):2111–2125CrossRef
15.
Zurück zum Zitat Gibeli LH, Breda GD, Miani RS, Zarpelão BB, De Souza Mendes L (2013) Construction of baselines for VoIP traffic management on open MANs. Int J Netw Manag 23(2):137–153CrossRef Gibeli LH, Breda GD, Miani RS, Zarpelão BB, De Souza Mendes L (2013) Construction of baselines for VoIP traffic management on open MANs. Int J Netw Manag 23(2):137–153CrossRef
16.
18.
Zurück zum Zitat Kyriakopoulos K, Parish D (2007) A live system for wavelet compression of high speed computer network measurements. In: Passive and Active Network Measurement, Lecture Notes in Computer Science, vol 4427. Springer, Berlin Heidelberg, pp 241– 244 Kyriakopoulos K, Parish D (2007) A live system for wavelet compression of high speed computer network measurements. In: Passive and Active Network Measurement, Lecture Notes in Computer Science, vol 4427. Springer, Berlin Heidelberg, pp 241– 244
19.
Zurück zum Zitat Lakhina A, Papagiannaki K, Crovella M, Diot C, Kolaczyk ED, Taft N (2004) Structural analysis of network traffic flows. SIGMETRICS Perform Eval. Rev 32(1):61–72CrossRef Lakhina A, Papagiannaki K, Crovella M, Diot C, Kolaczyk ED, Taft N (2004) Structural analysis of network traffic flows. SIGMETRICS Perform Eval. Rev 32(1):61–72CrossRef
20.
Zurück zum Zitat Lambert M (1995) RFC 1857: A Model for Common Operational Statistics Lambert M (1995) RFC 1857: A Model for Common Operational Statistics
21.
Zurück zum Zitat Li B, Springer J, Bebis G, Gunes MH (2013) A survey of network flow applications. J Netw Comput Appl 36 (2):567–581CrossRef Li B, Springer J, Bebis G, Gunes MH (2013) A survey of network flow applications. J Netw Comput Appl 36 (2):567–581CrossRef
25.
Zurück zum Zitat Mata F, García-dorado JL, Aracil J (2012) Detection of traffic changes in large-scale backbone networks: The case of the Spanish academic network. Comput Netw 56 (2):686–702CrossRef Mata F, García-dorado JL, Aracil J (2012) Detection of traffic changes in large-scale backbone networks: The case of the Spanish academic network. Comput Netw 56 (2):686–702CrossRef
26.
Zurück zum Zitat Moreno V, Ramos J, Muelas D, García-Dorado JL, Gómez-Arribas FJ, Aracil J (2014) Multi-granular, multi-purpose and multi-Gb/s monitoring on off-the-shelf systems. Int J Netw Manag 24(4):221–234CrossRef Moreno V, Ramos J, Muelas D, García-Dorado JL, Gómez-Arribas FJ, Aracil J (2014) Multi-granular, multi-purpose and multi-Gb/s monitoring on off-the-shelf systems. Int J Netw Manag 24(4):221–234CrossRef
27.
Zurück zum Zitat Muelas D, Gordo M, García Dorado JL, López de Vergara JE (2015) Dictyogram: a statistical approach for the definition and visualization of network flow categories. In: 11Th International Conference on Network and Service Management (CNSM 2015), pp 219–227 Muelas D, Gordo M, García Dorado JL, López de Vergara JE (2015) Dictyogram: a statistical approach for the definition and visualization of network flow categories. In: 11Th International Conference on Network and Service Management (CNSM 2015), pp 219–227
28.
Zurück zum Zitat Muelas D, López de Vergara JE, Berrendero JR (2015) Functional data analysis: a step forward in network management. In: 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM), pp 882–885 Muelas D, López de Vergara JE, Berrendero JR (2015) Functional data analysis: a step forward in network management. In: 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM), pp 882–885
29.
Zurück zum Zitat De O, Schmidt R, Van den Berg H, Pras A (2015) Measurement-based network link dimensioning. In: 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM), pp 1071–1077 De O, Schmidt R, Van den Berg H, Pras A (2015) Measurement-based network link dimensioning. In: 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM), pp 1071–1077
30.
Zurück zum Zitat De O, Schmidt R, Sadre R, Melnikov N, Schönwälder J, Pras A (2014) Linking network usage patterns to traffic gaussianity fit. In: 2014 IFIP Networking Conference, pp 1–9 De O, Schmidt R, Sadre R, Melnikov N, Schönwälder J, Pras A (2014) Linking network usage patterns to traffic gaussianity fit. In: 2014 IFIP Networking Conference, pp 1–9
31.
Zurück zum Zitat Oh E, Son K, Krishnamachari B (2013) Dynamic base station switching-on/off strategies for green cellular networks. IEEE Tran Wirel Commun 12(5):2126–2136CrossRef Oh E, Son K, Krishnamachari B (2013) Dynamic base station switching-on/off strategies for green cellular networks. IEEE Tran Wirel Commun 12(5):2126–2136CrossRef
32.
Zurück zum Zitat Papadogiannakis A, Polychronakis M, Markatos EP (2013) Scap: Stream-oriented network traffic capture and analysis for high-speed networks. ACM, NY, USACrossRef Papadogiannakis A, Polychronakis M, Markatos EP (2013) Scap: Stream-oriented network traffic capture and analysis for high-speed networks. ACM, NY, USACrossRef
33.
Zurück zum Zitat Pison G, Struyf A, Rousseeuw PJ (1999) Displaying a clustering with CLUSPLOT. Comput Stat Data Anal 30(4):381–392CrossRefMATH Pison G, Struyf A, Rousseeuw PJ (1999) Displaying a clustering with CLUSPLOT. Comput Stat Data Anal 30(4):381–392CrossRefMATH
34.
Zurück zum Zitat Ramsay J, Hooker G, Graves S (2009) Functional data analysis with R and MATLAB. Springer, New YorkCrossRefMATH Ramsay J, Hooker G, Graves S (2009) Functional data analysis with R and MATLAB. Springer, New YorkCrossRefMATH
35.
37.
Zurück zum Zitat Saad S, Traore I, Ghorbani A, Sayed B, Zhao D, Lu W, Felix J, Hakimian P (2011) Detecting P2P botnets through network behavior analysis and machine learning. In: 2011 Ninth Annual International Conference on Privacy, Security and Trust (PST), pp 174–180 Saad S, Traore I, Ghorbani A, Sayed B, Zhao D, Lu W, Felix J, Hakimian P (2011) Detecting P2P botnets through network behavior analysis and machine learning. In: 2011 Ninth Annual International Conference on Privacy, Security and Trust (PST), pp 174–180
38.
Zurück zum Zitat Simmross-Wattenberg F, Asensio-Pérez J, Casaseca-de-la Higuera P, Martín-Fernández M, Dimitriadis I, Alberola-López C (2011) Anomaly detection in network traffic based on statistical inference and alpha-stable modeling. IEEE Trans Dependable Secure Comput 8(4):494–509CrossRef Simmross-Wattenberg F, Asensio-Pérez J, Casaseca-de-la Higuera P, Martín-Fernández M, Dimitriadis I, Alberola-López C (2011) Anomaly detection in network traffic based on statistical inference and alpha-stable modeling. IEEE Trans Dependable Secure Comput 8(4):494–509CrossRef
39.
Zurück zum Zitat Simoncelli D, Dusi M, Gringoli F, Niccolini S (2013) Stream-monitoring with BlockMon: convergence of network measurements and data analytics platforms. SIGCOMM Comput Commun Rev 43:29–36CrossRef Simoncelli D, Dusi M, Gringoli F, Niccolini S (2013) Stream-monitoring with BlockMon: convergence of network measurements and data analytics platforms. SIGCOMM Comput Commun Rev 43:29–36CrossRef
40.
Zurück zum Zitat Wei TE, Mao CH, Jeng A, Lee HM, Wang HT, Wu DJ (2012) Android malware detection via a latent network behavior analysis. In: 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications (trustcom), pp 1251–1258 Wei TE, Mao CH, Jeng A, Lee HM, Wang HT, Wu DJ (2012) Android malware detection via a latent network behavior analysis. In: 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications (trustcom), pp 1251–1258
41.
Zurück zum Zitat Xu K, Wang F, Wang H (2012) Lightweight and informative traffic metrics for data center monitoring. J Netw Syst Manag 20(2):226–243MathSciNetCrossRef Xu K, Wang F, Wang H (2012) Lightweight and informative traffic metrics for data center monitoring. J Netw Syst Manag 20(2):226–243MathSciNetCrossRef
Metadaten
Titel
Facing Network Management Challenges with Functional Data Analysis: Techniques & Opportunities
verfasst von
David Muelas
Jorge E. López de Vergara
José R. Berrendero
Javier Ramos
Javier Aracil
Publikationsdatum
04.05.2016
Verlag
Springer US
Erschienen in
Mobile Networks and Applications / Ausgabe 6/2017
Print ISSN: 1383-469X
Elektronische ISSN: 1572-8153
DOI
https://doi.org/10.1007/s11036-016-0733-5

Weitere Artikel der Ausgabe 6/2017

Mobile Networks and Applications 6/2017 Zur Ausgabe

Neuer Inhalt