Skip to main content

2015 | OriginalPaper | Buchkapitel

A Flexible Data Model to Support Multi-domain Performance Analysis

verfasst von : Martin Schulz, Abhinav Bhatele, David Böhme, Peer-Timo Bremer, Todd Gamblin, Alfredo Gimenez, Kate Isaacs

Erschienen in: Tools for High Performance Computing 2014

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Performance data can be complex and potentially high dimensional. Further, it can be collected in multiple, independent domains. For example, one can measure code segments, hardware components, data structures, or an application’s communication structure. Performance analysis and visualization tools require access to this data in an easy way and must be able to specify relationships and mappings between these domains in order to provide users with intuitive, actionable performance analysis results.
In this paper, we describe a data model that can represent such complex performance data, and we discuss how this model helps us to specify mappings between domains. We then apply this model to several use cases both for data acquisition and how it can be mapped into the model, and for performance analysis and how it can be used to gain insight into an application’s performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
We will use these two terms interchangeably in the remainder of the paper.
 
Literatur
3.
Zurück zum Zitat Burtscher, M., Kim, B.-D., Diamond, J., McCalpin, J., Koesterke, L., Browne, J.: Perfexpert: an easy-to-use performance diagnosis tool for HPC applications. In: Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (SC’10), Washington, DC, pp. 1–11. IEEE Computer Society (2010) Burtscher, M., Kim, B.-D., Diamond, J., McCalpin, J., Koesterke, L., Browne, J.: Perfexpert: an easy-to-use performance diagnosis tool for HPC applications. In: Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (SC’10), Washington, DC, pp. 1–11. IEEE Computer Society (2010)
4.
Zurück zum Zitat Colella, P., Graves, D.T., Keen, N.D., Ligocki, T.J., Martin, D.F., McCorquodale, P.W., Modiano, D., Schwartz, P.O., Sternberg, T.D., Van Straalen, B.: Chombo software package for AMR applications design document. Technical report, Applied Numerical Algorithms Group, Computational Research Division, Lawrence Berkeley National Laboratory, Berkeley, 15 Apr 2009 Colella, P., Graves, D.T., Keen, N.D., Ligocki, T.J., Martin, D.F., McCorquodale, P.W., Modiano, D., Schwartz, P.O., Sternberg, T.D., Van Straalen, B.: Chombo software package for AMR applications design document. Technical report, Applied Numerical Algorithms Group, Computational Research Division, Lawrence Berkeley National Laboratory, Berkeley, 15 Apr 2009
5.
Zurück zum Zitat Eichenberger, A.E., Mellor-Crummey, J., Schulz, M., Wong, M., Copty, N., Dietrich, R., Liu, X., Loh, E., Lorenz, D.: OMPT: an OpenMP tools application programming interface for performance analysis. In: Rendell, A.P., Chapman, B.M., Mller, M.S. (eds.) OpenMP in the Era of Low Power Devices and Accelerators. Number 8122 in Lecture Notes in Computer Science, pp. 171–185. Springer, Berlin/Heidelberg (2013) Eichenberger, A.E., Mellor-Crummey, J., Schulz, M., Wong, M., Copty, N., Dietrich, R., Liu, X., Loh, E., Lorenz, D.: OMPT: an OpenMP tools application programming interface for performance analysis. In: Rendell, A.P., Chapman, B.M., Mller, M.S. (eds.) OpenMP in the Era of Low Power Devices and Accelerators. Number 8122 in Lecture Notes in Computer Science, pp. 171–185. Springer, Berlin/Heidelberg (2013)
6.
Zurück zum Zitat Fahringer, T., Gerndt, M., Riley, G., Traff, J.L.: The APART Specification Language (illustrated with MPI). Technical report FZJ-ZAM-IB-2001-08, Forschungszentrum Jülich (2001) Fahringer, T., Gerndt, M., Riley, G., Traff, J.L.: The APART Specification Language (illustrated with MPI). Technical report FZJ-ZAM-IB-2001-08, Forschungszentrum Jülich (2001)
7.
Zurück zum Zitat Fürlinger, K., Gerndt, M.: ompP: A profiling tool for OpenMP. In: Proceedings of the First International Workshop on OpenMP (IWOMP’05), Eugene, 1–4 June 2005 Fürlinger, K., Gerndt, M.: ompP: A profiling tool for OpenMP. In: Proceedings of the First International Workshop on OpenMP (IWOMP’05), Eugene, 1–4 June 2005
8.
Zurück zum Zitat Giménez, A., Gamblin, T., Rountree, B., Bhatele, A., Jusufi, I., Bremer, P.-T., Hamann, B.: Dissecting on-node memory access performance: a semantic approach. In: Proceedings of the ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (SC’14), New Orleans, LA. IEEE Computer Society (2014). LLNL-CONF-658626 Giménez, A., Gamblin, T., Rountree, B., Bhatele, A., Jusufi, I., Bremer, P.-T., Hamann, B.: Dissecting on-node memory access performance: a semantic approach. In: Proceedings of the ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (SC’14), New Orleans, LA. IEEE Computer Society (2014). LLNL-CONF-658626
9.
Zurück zum Zitat Hornung, R.D., Kohn, S.R.: Managing application complexity in the SAMRAI object-oriented framework. Concurr. Comput. Pract. Exp. 14(5), 347–368 (2002)CrossRefMATH Hornung, R.D., Kohn, S.R.: Managing application complexity in the SAMRAI object-oriented framework. Concurr. Comput. Pract. Exp. 14(5), 347–368 (2002)CrossRefMATH
10.
Zurück zum Zitat Hydrodynamics challenge problem, lawrence livermore national laboratory. Technical report LLNL-TR-490254 Hydrodynamics challenge problem, lawrence livermore national laboratory. Technical report LLNL-TR-490254
11.
Zurück zum Zitat Isaacs, K., Bremer, P.-T., Jusufi, I., Gamblin, T., Bhatele, A., Schulz, M., Hamann, B.: Combing the communication hairball: visualizing large-scale parallel execution traces using logical time. In: Proceedings of IEEE Symposium on Information Visualization (InfoVis’14), Paris, France (2014) Isaacs, K., Bremer, P.-T., Jusufi, I., Gamblin, T., Bhatele, A., Schulz, M., Hamann, B.: Combing the communication hairball: visualizing large-scale parallel execution traces using logical time. In: Proceedings of IEEE Symposium on Information Visualization (InfoVis’14), Paris, France (2014)
12.
Zurück zum Zitat Landge, A.G., Levine, J.A., Isaacs, K.E., Bhatele, A., Gamblin, T., Schulz, M., Langer, S.H., Bremer, P.-T., Pascucci, V.: Visualizing network traffic to understand the performance of massively parallel simulations. In: Proceedings of IEEE Symposium on Information Visualization (InfoVis’12), Seattle, 14–19 Oct 2012. LLNL-CONF-543359 Landge, A.G., Levine, J.A., Isaacs, K.E., Bhatele, A., Gamblin, T., Schulz, M., Langer, S.H., Bremer, P.-T., Pascucci, V.: Visualizing network traffic to understand the performance of massively parallel simulations. In: Proceedings of IEEE Symposium on Information Visualization (InfoVis’12), Seattle, 14–19 Oct 2012. LLNL-CONF-543359
13.
Zurück zum Zitat Mellor-Crummey, J., Fowler, R., Marin, G.: HPCView: a tool for top-down analysis of node performance. J. Supercomput. 23, 81–101 (2002)CrossRefMATH Mellor-Crummey, J., Fowler, R., Marin, G.: HPCView: a tool for top-down analysis of node performance. J. Supercomput. 23, 81–101 (2002)CrossRefMATH
15.
Zurück zum Zitat Nagel, W.E., Arnold, A., Weber, M., Hoppe, H.C., Solchenbach, K.: VAMPIR: visualization and analysis of MPI resources. Supercomputer 12(1), 69–80 (1996) Nagel, W.E., Arnold, A., Weber, M., Hoppe, H.C., Solchenbach, K.: VAMPIR: visualization and analysis of MPI resources. Supercomputer 12(1), 69–80 (1996)
16.
Zurück zum Zitat Schulz, M., Galarowicz, J., Maghrak, D., Hachfeld, W., Montoya, D., Cranford, S.: Open\(\mid\) speedshop: an open source infrastructure for parallel performance analysis. Sci. Program. 16(2–3), 105–121 (2008) Schulz, M., Galarowicz, J., Maghrak, D., Hachfeld, W., Montoya, D., Cranford, S.: Open\(\mid\) speedshop: an open source infrastructure for parallel performance analysis. Sci. Program. 16(2–3), 105–121 (2008)
17.
Zurück zum Zitat Schulz, M., Levine, J.A., Bremer, P.-T., Gamblin, T., Pascucci, V.: Interpreting performance data across intuitive domains. In: 2011 International Conference on Parallel Processing (ICPP), Taipei City, pp. 206–215 (2011) Schulz, M., Levine, J.A., Bremer, P.-T., Gamblin, T., Pascucci, V.: Interpreting performance data across intuitive domains. In: 2011 International Conference on Parallel Processing (ICPP), Taipei City, pp. 206–215 (2011)
18.
Zurück zum Zitat Shende, S., Malony, A.D.: The tau parallel performance system. Int. J. High Perform. Comput. Appl., ACTS Collection Special Issue 20(2), 287–311 (2005) Shende, S., Malony, A.D.: The tau parallel performance system. Int. J. High Perform. Comput. Appl., ACTS Collection Special Issue 20(2), 287–311 (2005)
19.
Zurück zum Zitat Sigovan, C., Muelder, C.W., Ma, K.-L.: Visualizing large-scale parallel communication traces using a particle animation technique. Comput. Graph. Forum 32(3), 141–150 (2013)CrossRef Sigovan, C., Muelder, C.W., Ma, K.-L.: Visualizing large-scale parallel communication traces using a particle animation technique. Comput. Graph. Forum 32(3), 141–150 (2013)CrossRef
20.
Zurück zum Zitat Tallent, N.R., Adhianto, L., Mellor-Crummey, J.M.: Scalable identification of load imbalance in parallel executions using call path profiles. In: Proceedings of IEEE/ACM Supercomputing’10, New Orleans (2010) Tallent, N.R., Adhianto, L., Mellor-Crummey, J.M.: Scalable identification of load imbalance in parallel executions using call path profiles. In: Proceedings of IEEE/ACM Supercomputing’10, New Orleans (2010)
21.
Zurück zum Zitat Tapus, C., Chung, I.-H., Hollingsworth, J.K.: Active harmony: towards automated performance tuning. In: Proceedings of the Conference on High Performance Networking and Computing, Phoenix, pp. 1–11 (2003) Tapus, C., Chung, I.-H., Hollingsworth, J.K.: Active harmony: towards automated performance tuning. In: Proceedings of the Conference on High Performance Networking and Computing, Phoenix, pp. 1–11 (2003)
23.
Zurück zum Zitat Wolf, F., Wylie, B., Abraham, E., Becker, D., Frings, W., Fuerlinger, K., Geimer, M., Hermanns, M.-A., Mohr, B., Moore, S., Szebenyi, Z.: Usage of the SCALASCA toolset for scalable performance analysis of large-scale parallel applications. In: Proceedings of the 2nd HLRS Parallel Tools Workshop, Stuttgart (2008) Wolf, F., Wylie, B., Abraham, E., Becker, D., Frings, W., Fuerlinger, K., Geimer, M., Hermanns, M.-A., Mohr, B., Moore, S., Szebenyi, Z.: Usage of the SCALASCA toolset for scalable performance analysis of large-scale parallel applications. In: Proceedings of the 2nd HLRS Parallel Tools Workshop, Stuttgart (2008)
24.
Zurück zum Zitat Zaki, O., Lusk, E., Gropp, W., Swider, D.: Toward scalable performance visualization with jumpshot. Int. J. High Perform. Comput. Appl. 13(3), 277–288 (1999)CrossRef Zaki, O., Lusk, E., Gropp, W., Swider, D.: Toward scalable performance visualization with jumpshot. Int. J. High Perform. Comput. Appl. 13(3), 277–288 (1999)CrossRef
Metadaten
Titel
A Flexible Data Model to Support Multi-domain Performance Analysis
verfasst von
Martin Schulz
Abhinav Bhatele
David Böhme
Peer-Timo Bremer
Todd Gamblin
Alfredo Gimenez
Kate Isaacs
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-16012-2_10