Skip to main content

2015 | OriginalPaper | Buchkapitel

Studying Performance Changes with Tracking Analysis

verfasst von : Germán Llort, Harald Servat, Juan Gonzalez, Judit Gimenez, Jesús Labarta

Erschienen in: Tools for High Performance Computing 2014

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Scientific applications can have so many parameters, possible usage scenarios and target architectures, that a single experiment is often not enough for an effective analysis that gets sound understanding of their performance behavior. Different software and hardware settings may have a strong impact on the results, but trying and measuring in detail even just a few possible combinations to decide which configuration is better, rapidly floods the user with excessive amounts of information to compare.
In this chapter we introduce a novel methodology for performance analysis based on object tracking techniques. The most compute-intensive parts of the program are automatically identified via cluster analysis, and then we track the evolution of these regions across different experiments to see how the behavior of the program changes with respect to the varying settings and over time. This methodology addresses an important problem in HPC performance analysis, where the volume of data that can be collected expands rapidly in a potentially high dimensional space of performance metrics, and we are able to manage this complexity and identify coarse properties that change when parameters are varied to target tuning and more detailed performance studies.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Browne, S., Dongarra, J., Garner, N., Ho, G., Mucci, P.: A portable programming interface for performance evaluation on modern processors. Int. J. High Perform. Comput. Appl. 14, 189–204 (2000)CrossRef Browne, S., Dongarra, J., Garner, N., Ho, G., Mucci, P.: A portable programming interface for performance evaluation on modern processors. Int. J. High Perform. Comput. Appl. 14, 189–204 (2000)CrossRef
4.
Zurück zum Zitat Buck, B., Hollingsworth, J.K.: An API for runtime code patching. Int. J. High Perform. Comput. Appl. 14, 317–329 (2000)CrossRef Buck, B., Hollingsworth, J.K.: An API for runtime code patching. Int. J. High Perform. Comput. Appl. 14, 317–329 (2000)CrossRef
5.
Zurück zum Zitat Casas, M., Badia, R., Labarta, J.: Automatic analysis of speedup of MPI applications. In: Proceedings of the 22nd Annual International Conference on Supercomputing (ICS’08), Island of Kos, pp. 349–358. ACM, New York (2008) Casas, M., Badia, R., Labarta, J.: Automatic analysis of speedup of MPI applications. In: Proceedings of the 22nd Annual International Conference on Supercomputing (ICS’08), Island of Kos, pp. 349–358. ACM, New York (2008)
6.
Zurück zum Zitat Casas, M., Bronevetsky, G.: Active measurement of memory resource consumption. In: Proceedings of the 2014 IEEE 28th International Parallel and Distributed Processing Symposium (IPDPS’14), Phoenix, pp. 995–1004. IEEE Computer Society, Washington, DC (2014) Casas, M., Bronevetsky, G.: Active measurement of memory resource consumption. In: Proceedings of the 2014 IEEE 28th International Parallel and Distributed Processing Symposium (IPDPS’14), Phoenix, pp. 995–1004. IEEE Computer Society, Washington, DC (2014)
7.
Zurück zum Zitat Geimer, M., Saviankou, P., Strube, A., Szebenyi, Z., Wolf, F., Wylie, B.J.N.: Further improving the scalability of the SCALASCA toolset. In: Proceedings of the 10th International Conference on Applied Parallel and Scientific Computing (PARA’10), Reykjavik, vol. 2, pp. 463–473. Springer, Berlin/Heidelberg (2012) Geimer, M., Saviankou, P., Strube, A., Szebenyi, Z., Wolf, F., Wylie, B.J.N.: Further improving the scalability of the SCALASCA toolset. In: Proceedings of the 10th International Conference on Applied Parallel and Scientific Computing (PARA’10), Reykjavik, vol. 2, pp. 463–473. Springer, Berlin/Heidelberg (2012)
9.
Zurück zum Zitat González, J., et al.: Automatic detection of parallel applications computation phases. In: IPDPS: 23rd IEEE International Parallel and Distributed Processing Symposium, Sao Paulo (2009) González, J., et al.: Automatic detection of parallel applications computation phases. In: IPDPS: 23rd IEEE International Parallel and Distributed Processing Symposium, Sao Paulo (2009)
10.
Zurück zum Zitat González, J., et al.: Automatic evaluation of the computation structure of parallel applications. In: PDCAT: Proceedings of the 2009 International Conference on Parallel and Distributed Computing, Applications and Technologies, Higashi Hiroshima, pp. 138–145 (2009) González, J., et al.: Automatic evaluation of the computation structure of parallel applications. In: PDCAT: Proceedings of the 2009 International Conference on Parallel and Distributed Computing, Applications and Technologies, Higashi Hiroshima, pp. 138–145 (2009)
11.
Zurück zum Zitat González, J., et al.: Performance data extrapolation in parallel codes. In: ICPADS: 16th IEEE International Conference on Parallel and Distributed Systems, Shanghai, pp. 155–163 (2010) González, J., et al.: Performance data extrapolation in parallel codes. In: ICPADS: 16th IEEE International Conference on Parallel and Distributed Systems, Shanghai, pp. 155–163 (2010)
12.
Zurück zum Zitat Huck, K.A., Malony, A.D.: PerfExplorer: a performance data mining framework for large-scale parallel computing. In: Proceedings of the Conference on Supercomputing, New York, p. 41 (2005) Huck, K.A., Malony, A.D.: PerfExplorer: a performance data mining framework for large-scale parallel computing. In: Proceedings of the Conference on Supercomputing, New York, p. 41 (2005)
13.
Zurück zum Zitat Ibarra, O.H., Kim, C.E.: Fast approximation algorithms for the knapsack and sum of subset problems. J. ACM 22(4), 463–468 (1975)CrossRefMATHMathSciNet Ibarra, O.H., Kim, C.E.: Fast approximation algorithms for the knapsack and sum of subset problems. J. ACM 22(4), 463–468 (1975)CrossRefMATHMathSciNet
14.
Zurück zum Zitat Jones, P.: Parallel Ocean Program (POP) user guide. Technical report, Los Alamos National Laboratory, March 2003 Jones, P.: Parallel Ocean Program (POP) user guide. Technical report, Los Alamos National Laboratory, March 2003
16.
Zurück zum Zitat Mellor-Crummey, J.: HPCToolkit: multi-platform tools for profile-based performance analysis. In: APART, Nov 2003 Mellor-Crummey, J.: HPCToolkit: multi-platform tools for profile-based performance analysis. In: APART, Nov 2003
17.
Zurück zum Zitat Mimica, P., Giannios, D., Aloy, M.A.: Deceleration of arbitrarily magnetized GRB Ejecta: the complete evolution. Technical report arXiv:0810.2961, Oct 2008. Comments: 13 pages, 10 figures, revised version sent to the referee (first version submitted on 6th of August) Mimica, P., Giannios, D., Aloy, M.A.: Deceleration of arbitrarily magnetized GRB Ejecta: the complete evolution. Technical report arXiv:0810.2961, Oct 2008. Comments: 13 pages, 10 figures, revised version sent to the referee (first version submitted on 6th of August)
20.
Zurück zum Zitat Palaniappan, K., et al.: Moving object segmentation using the flux tensor for biological video microscopy. In: PCM, Hong Kong, p. 483 (2007) Palaniappan, K., et al.: Moving object segmentation using the flux tensor for biological video microscopy. In: PCM, Hong Kong, p. 483 (2007)
21.
Zurück zum Zitat Patwary, M.A., Palsetia, D., Agrawal, A., Liao, W.-K., Manne, F., Choudhary, A.: A new scalable parallel DBSCAN algorithm using the disjoint-set data structure. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC’12), Salt Lake City, pp. 62:1–62:11. IEEE Computer Society, Los Alamitos (2012) Patwary, M.A., Palsetia, D., Agrawal, A., Liao, W.-K., Manne, F., Choudhary, A.: A new scalable parallel DBSCAN algorithm using the disjoint-set data structure. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC’12), Salt Lake City, pp. 62:1–62:11. IEEE Computer Society, Los Alamitos (2012)
22.
Zurück zum Zitat Roth, P.C.: ETRUSCA: event trace reduction using statistical data clustering analysis. Master’s thesis, University of Iowa (1992) Roth, P.C.: ETRUSCA: event trace reduction using statistical data clustering analysis. Master’s thesis, University of Iowa (1992)
23.
Zurück zum Zitat Servat, H., et al.: Detailed performance analysis using coarse grain sampling. In: PROPER (2009) Servat, H., et al.: Detailed performance analysis using coarse grain sampling. In: PROPER (2009)
24.
Zurück zum Zitat Servat, H., et al.: Unveiling internal evolution of parallel application computation phases. In: ICPP, Taipei, pp. 155–164 (2011) Servat, H., et al.: Unveiling internal evolution of parallel application computation phases. In: ICPP, Taipei, pp. 155–164 (2011)
25.
Zurück zum Zitat Shende, S.S., Malony, A.D.: The tau parallel performance system. Int. J. High Perform. Comput. Appl. 20, 287–311 (2006)CrossRef Shende, S.S., Malony, A.D.: The tau parallel performance system. Int. J. High Perform. Comput. Appl. 20, 287–311 (2006)CrossRef
26.
Zurück zum Zitat Song, F., et al.: An algebra for cross-experiment performance analysis. In: ICPP, Montreal, pp. 63–72 (2004) Song, F., et al.: An algebra for cross-experiment performance analysis. In: ICPP, Montreal, pp. 63–72 (2004)
30.
Zurück zum Zitat Yilmaz, A., et al.: Object tracking: a survey. ACM Comput. Surv. 38(4) (2006) Yilmaz, A., et al.: Object tracking: a survey. ACM Comput. Surv. 38(4) (2006)
Metadaten
Titel
Studying Performance Changes with Tracking Analysis
verfasst von
Germán Llort
Harald Servat
Juan Gonzalez
Judit Gimenez
Jesús Labarta
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-16012-2_9