Skip to main content
Erschienen in: Journal of Network and Systems Management 4/2015

01.10.2015

Adaptive Monitoring: Application of Probing to Adapt Passive Monitoring

verfasst von: Deepak Jeswani, Maitreya Natu, R. K. Ghosh

Erschienen in: Journal of Network and Systems Management | Ausgabe 4/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Availability of good quality monitoring data is a vital need for management of today’s data centers. However, effective use of monitoring tools demands an understanding of the monitoring requirements that system administrators most often lack. Instead of a well-defined process of defining a monitoring strategy, system administrators adopt a manual and intuition-based approach. In this paper, we propose to replace the ad-hoc, manual, intuition-based approach with a more systematic, automated, and analytics-based approach for system monitoring. We propose an adaptive monitoring framework where end-to-end probing-based solutions are used to adapt the at-a-point monitoring tools. We present a systematic framework to use probes for adjusting monitoring levels. We present algorithms to select and analyze probes and to dynamically adapt the monitoring policies based on probe analysis. We demonstrate the effectiveness of the proposed solution using real-world examples as well as simulations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Natu, M., Sethi, A.S.: Application of adaptive probing for fault diagnosis in computer networks. In: Proceedings of NOMS’08, Brazil (2008) Natu, M., Sethi, A.S.: Application of adaptive probing for fault diagnosis in computer networks. In: Proceedings of NOMS’08, Brazil (2008)
2.
Zurück zum Zitat Natu, M., Sethi, A.S.: Probabilistic fault diagnosis using adaptive probing. In: Proceedings of DSOM 2007, San Jose, CA (2007) Natu, M., Sethi, A.S.: Probabilistic fault diagnosis using adaptive probing. In: Proceedings of DSOM 2007, San Jose, CA (2007)
3.
Zurück zum Zitat Motwani, R., Raghavan, P.: Randomized algorithms. Cambridge University Press, ISBN 978-0-521-47465-8 (1995) Motwani, R., Raghavan, P.: Randomized algorithms. Cambridge University Press, ISBN 978-0-521-47465-8 (1995)
4.
Zurück zum Zitat Zhang, T., Ramakrishnan, R., Livny, M.: Birch: an efficient data clustering method for very large databases. In: Proceedings of SIGMOD’96, Montreal, Canada, pp. 103–114 (1996) Zhang, T., Ramakrishnan, R., Livny, M.: Birch: an efficient data clustering method for very large databases. In: Proceedings of SIGMOD’96, Montreal, Canada, pp. 103–114 (1996)
5.
Zurück zum Zitat Yoon, H., Yang, K., Shahabi, C.: Feature subset selection and feature ranking for multivariate time series. IEEE Trans. Knowl. Data Eng. 17, 1186–1198 (2005)CrossRef Yoon, H., Yang, K., Shahabi, C.: Feature subset selection and feature ranking for multivariate time series. IEEE Trans. Knowl. Data Eng. 17, 1186–1198 (2005)CrossRef
6.
Zurück zum Zitat Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)MATH Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)MATH
9.
Zurück zum Zitat Ithaka, R., Gentleman, R.: R: a language for data analysis and graphics. J. Comput. Gr. Stat. 5(3), 299–314 (1996) Ithaka, R., Gentleman, R.: R: a language for data analysis and graphics. J. Comput. Gr. Stat. 5(3), 299–314 (1996)
10.
Zurück zum Zitat Medina, A., Lakhina, A., Matta, I., Byers, J.: Brite: an approach to universal topology generation. In: MASCOTS’01. Cincinnati, Ohio (2001) Medina, A., Lakhina, A., Matta, I., Byers, J.: Brite: an approach to universal topology generation. In: MASCOTS’01. Cincinnati, Ohio (2001)
11.
Zurück zum Zitat Schwetman, H.: Csim: a C-based process-oriented simulation language. In: Proceedings of WSC ’86 (1986) Schwetman, H.: Csim: a C-based process-oriented simulation language. In: Proceedings of WSC ’86 (1986)
12.
Zurück zum Zitat Scherr, A.: An analysis of time shared computer systems. MIT Press, Cambridge (1967) Scherr, A.: An analysis of time shared computer systems. MIT Press, Cambridge (1967)
13.
Zurück zum Zitat Brodie, M., Rish, I., Ma, S., Grabarnik, G., Odintsova, N.: Active probing. Technical report, IBM (2002) Brodie, M., Rish, I., Ma, S., Grabarnik, G., Odintsova, N.: Active probing. Technical report, IBM (2002)
14.
Zurück zum Zitat Lakhina, A., Crovella, M., Diot, C.: Diagnosing network-wide traffic anomalies. In: Proceedings of SIGCOMM’04, Portland, Oregon, USA (2004) Lakhina, A., Crovella, M., Diot, C.: Diagnosing network-wide traffic anomalies. In: Proceedings of SIGCOMM’04, Portland, Oregon, USA (2004)
15.
Zurück zum Zitat Groenendijk, J., Huang, Y., Fallon, L.: Adaptive terminal reporting for scalable service quality monitoring in large networks. In: Proceedings of CNSM 2011, Paris, France (2011) Groenendijk, J., Huang, Y., Fallon, L.: Adaptive terminal reporting for scalable service quality monitoring in large networks. In: Proceedings of CNSM 2011, Paris, France (2011)
16.
Zurück zum Zitat Bhatia, S., Kumar, A., Fiuczynski, M.E., Peterson, L.: Lightweight, high-resolution monitoring for troubleshooting production systems. In: Proceedings of the 8th USENIX conference on Operating systems design and implementation, San Diego, California, ser. OSDI’08 (2008) Bhatia, S., Kumar, A., Fiuczynski, M.E., Peterson, L.: Lightweight, high-resolution monitoring for troubleshooting production systems. In: Proceedings of the 8th USENIX conference on Operating systems design and implementation, San Diego, California, ser. OSDI’08 (2008)
17.
Zurück zum Zitat Gaspary, L.P., Canterle, E.: Assessing transaction-based internet applications performance through a passive network traffic monitoring approach. In: Proceedings of GLOBECOM’04, Dallas, USA (2004) Gaspary, L.P., Canterle, E.: Assessing transaction-based internet applications performance through a passive network traffic monitoring approach. In: Proceedings of GLOBECOM’04, Dallas, USA (2004)
18.
Zurück zum Zitat Han, S.-H., Kim, M.-S., Ju, H.-T., Hong, W.-K.J.: The architecture of ng-mon: a passive network monitoring system for high-speed ip networks. In: Proceedings of DSOM’02, Montreal, Canada (2002) Han, S.-H., Kim, M.-S., Ju, H.-T., Hong, W.-K.J.: The architecture of ng-mon: a passive network monitoring system for high-speed ip networks. In: Proceedings of DSOM’02, Montreal, Canada (2002)
19.
Zurück zum Zitat Yu, L., Cheng, L., Qiao, Y., Yuan, Y., Chen, X.: An efficient active probing approach based on the combination of online and offline strategies. In: Proceedings of CNSM’10, pp. 298–301 (2010) Yu, L., Cheng, L., Qiao, Y., Yuan, Y., Chen, X.: An efficient active probing approach based on the combination of online and offline strategies. In: Proceedings of CNSM’10, pp. 298–301 (2010)
20.
Zurück zum Zitat Quan, L., Heidemann, Z., Pradkin, Y.: Detecting internet outages with precise active probing. Technical Report ISI-TR-2012-678 (2012) Quan, L., Heidemann, Z., Pradkin, Y.: Detecting internet outages with precise active probing. Technical Report ISI-TR-2012-678 (2012)
21.
Zurück zum Zitat Jaggard, A., Kopparty, S., Ramachandran, V., Wright, R.N.: The design space of probing algorithms for network-performance measurement. SIGMETRICS Perform. Eval. Rev. 41(1), 105–116 (2013)MATHCrossRef Jaggard, A., Kopparty, S., Ramachandran, V., Wright, R.N.: The design space of probing algorithms for network-performance measurement. SIGMETRICS Perform. Eval. Rev. 41(1), 105–116 (2013)MATHCrossRef
22.
Zurück zum Zitat Quan, L., Heidemann, J., Pradkin, Y.: Trinocular: understanding internet reliability through adaptive probing. SIGCOMM Comput. Commun. Rev. 43(4), 255–266 (2013) Quan, L., Heidemann, J., Pradkin, Y.: Trinocular: understanding internet reliability through adaptive probing. SIGCOMM Comput. Commun. Rev. 43(4), 255–266 (2013)
23.
Zurück zum Zitat Zheng, Q., Cao, G.: Minimizing probing cost and achieving identifiability in probe-based network link monitoring. IEEE Trans. Comput. 62(3), 510–523 (2013)MATHMathSciNetCrossRef Zheng, Q., Cao, G.: Minimizing probing cost and achieving identifiability in probe-based network link monitoring. IEEE Trans. Comput. 62(3), 510–523 (2013)MATHMathSciNetCrossRef
24.
Zurück zum Zitat Liu, S., Zafer, M., Wong, H., Lee, K.: Gateway selection in hybrid wireless networks through cooperative probing. In: Proceedings of IFIP/IEEE international symposium on integrated network management (IM 2013), Ottawa, Canada (2013) Liu, S., Zafer, M., Wong, H., Lee, K.: Gateway selection in hybrid wireless networks through cooperative probing. In: Proceedings of IFIP/IEEE international symposium on integrated network management (IM 2013), Ottawa, Canada (2013)
25.
Zurück zum Zitat Tang, Y., Al-Shaer, E.S., Boutaba, R.: Active integrated fault localization in communication networks. In: Proceedings of IM 2005, pp. 543–556 (2005) Tang, Y., Al-Shaer, E.S., Boutaba, R.: Active integrated fault localization in communication networks. In: Proceedings of IM 2005, pp. 543–556 (2005)
26.
Zurück zum Zitat Al-Shaer, E., Tang, Y.: Qos path monitoring for multicast networks. J. Netw. Syst. Manag. 10(3), 357–381 (2002) Al-Shaer, E., Tang, Y.: Qos path monitoring for multicast networks. J. Netw. Syst. Manag. 10(3), 357–381 (2002)
27.
Zurück zum Zitat Yu, M., Greenberg, A., Maltz, D., Rexford, J., Yuan, L., Kandula, S., Kim, C.: Profiling network performance for multi-tier data center applications. In: Proceedings of NSDI’11, Boston, USA (2011) Yu, M., Greenberg, A., Maltz, D., Rexford, J., Yuan, L., Kandula, S., Kim, C.: Profiling network performance for multi-tier data center applications. In: Proceedings of NSDI’11, Boston, USA (2011)
28.
Zurück zum Zitat Huang, L., Nguyen, X., Garofalakis, M., Hellerstein, J.M.: Communication-efficient online detection of network-wide anomalies. In: Proceedings of INFOCOM’07, Anchorage, Alaska (2007) Huang, L., Nguyen, X., Garofalakis, M., Hellerstein, J.M.: Communication-efficient online detection of network-wide anomalies. In: Proceedings of INFOCOM’07, Anchorage, Alaska (2007)
29.
Zurück zum Zitat Gao, K., Kar, G., Kermani, P.: Approaches to building self healing systems using dependency analysis. In: Proceedings of IEEE/IFIP network operations and management symposium (NOMS), pp. 119–132 (2004) Gao, K., Kar, G., Kermani, P.: Approaches to building self healing systems using dependency analysis. In: Proceedings of IEEE/IFIP network operations and management symposium (NOMS), pp. 119–132 (2004)
30.
Zurück zum Zitat Wolski, R.: Experiences with predicting resource performance on-line in computational grid settings. SIGMETRICS Perform. Eval. Rev. 30(4), 41–49 (2003)CrossRef Wolski, R.: Experiences with predicting resource performance on-line in computational grid settings. SIGMETRICS Perform. Eval. Rev. 30(4), 41–49 (2003)CrossRef
31.
Zurück zum Zitat Jeswani, D., Natu, M.., Ghosh, R.K.: Adaptive monitoring: a framework to adapt passive monitoring using probing. In: Proceedings of CNSM 2012, Las Vegas, USA (2012) Jeswani, D., Natu, M.., Ghosh, R.K.: Adaptive monitoring: a framework to adapt passive monitoring using probing. In: Proceedings of CNSM 2012, Las Vegas, USA (2012)
Metadaten
Titel
Adaptive Monitoring: Application of Probing to Adapt Passive Monitoring
verfasst von
Deepak Jeswani
Maitreya Natu
R. K. Ghosh
Publikationsdatum
01.10.2015
Verlag
Springer US
Erschienen in
Journal of Network and Systems Management / Ausgabe 4/2015
Print ISSN: 1064-7570
Elektronische ISSN: 1573-7705
DOI
https://doi.org/10.1007/s10922-014-9330-8

Weitere Artikel der Ausgabe 4/2015

Journal of Network and Systems Management 4/2015 Zur Ausgabe

Premium Partner