Skip to main content
Top

2019 | OriginalPaper | Chapter

Projecting Performance Data over Simulation Geometry Using SOSflow and ALPINE

Authors : Chad Wood, Matthew Larsen, Alfredo Gimenez, Kevin Huck, Cyrus Harrison, Todd Gamblin, Allen Malony

Published in: Programming and Performance Visualization Tools

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The performance of HPC simulation codes is often tied to their simulated domains; e.g., properties of the input decks, boundaries of the underlying meshes, and parallel decomposition of the simulation space. A variety of research efforts have demonstrated the utility of projecting performance data onto the simulation geometry to enable analysis of these kinds of performance problems. However, current methods to do so are largely ad-hoc and limited in terms of extensibility and scalability. Furthermore, few methods enable this projection online, resulting in large storage and processing requirements for offline analysis. We present a general, extensible, and scalable solution for in-situ (online) visualization of performance data projected onto the underlying geometry of simulation codes. Our solution employs the scalable observation system SOSflow with the in-situ visualization framework ALPINE to automatically extract simulation geometry and stream aggregated performance metrics to respective locations within the geometry at runtime. Our system decouples the resources and mechanisms to collect, aggregate, project, and visualize the resulting data, thus mitigating overhead and enabling online analysis at large scales. Furthermore, our method requires minimal user input and modification of existing code, enabling general and widespread adoption.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Hydrodynamics Challenge Problem, Lawrence Livermore National Laboratory. Technical report LLNL-TR-490254 Hydrodynamics Challenge Problem, Lawrence Livermore National Laboratory. Technical report LLNL-TR-490254
2.
go back to reference Ahrens, J., Geveci, B., Law, C.: ParaView: an end-user tool for large data visualization. In: The Visualization Handbook, vol. 717 (2005) Ahrens, J., Geveci, B., Law, C.: ParaView: an end-user tool for large data visualization. In: The Visualization Handbook, vol. 717 (2005)
3.
go back to reference Boehme, D., et al.: Caliper: performance introspection for HPC software stacks. In: International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2016, pp. 550–560. IEEE (2016) Boehme, D., et al.: Caliper: performance introspection for HPC software stacks. In: International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2016, pp. 550–560. IEEE (2016)
4.
go back to reference Böhme, D., Beckingsdale, D., Schulz, M.: Flexible data aggregation for performance profiling. In: IEEE Cluster (2017) Böhme, D., Beckingsdale, D., Schulz, M.: Flexible data aggregation for performance profiling. In: IEEE Cluster (2017)
5.
go back to reference Childs, H., et al.: VisIt: an end-user tool for visualizing and analyzing very large data. In: High Performance Visualization-Enabling Extreme-Scale Scientific Insight, pp. 357–372. CRC Press/Francis-Taylor Group (2012) Childs, H., et al.: VisIt: an end-user tool for visualizing and analyzing very large data. In: High Performance Visualization-Enabling Extreme-Scale Scientific Insight, pp. 357–372. CRC Press/Francis-Taylor Group (2012)
6.
go back to reference Gimenez, A.A., et al.: MemAxes: visualization and analytics for characterizing complex memory performance behaviors. IEEE Trans. Vis. Comput. Graph. 24, 2180–2193 (2017)CrossRef Gimenez, A.A., et al.: MemAxes: visualization and analytics for characterizing complex memory performance behaviors. IEEE Trans. Vis. Comput. Graph. 24, 2180–2193 (2017)CrossRef
7.
go back to reference Husain, B., Giménez, A., Levine, J.A., Gamblin, T., Bremer, P.T.: Relating memory performance data to application domain data using an integration API. In: Proceedings of the 2nd Workshop on Visual Performance Analysis, p. 5. ACM (2015) Husain, B., Giménez, A., Levine, J.A., Gamblin, T., Bremer, P.T.: Relating memory performance data to application domain data using an integration API. In: Proceedings of the 2nd Workshop on Visual Performance Analysis, p. 5. ACM (2015)
8.
go back to reference Isaacs, K.E., Landge, A.G., Gamblin, T., Bremer, P.T., Pascucci, V., Hamann, B.: Exploring performance data with boxfish. In: 2012 SC Companion: High Performance Computing, Networking, Storage and Analysis (SCC), pp. 1380–1381. IEEE (2012) Isaacs, K.E., Landge, A.G., Gamblin, T., Bremer, P.T., Pascucci, V., Hamann, B.: Exploring performance data with boxfish. In: 2012 SC Companion: High Performance Computing, Networking, Storage and Analysis (SCC), pp. 1380–1381. IEEE (2012)
9.
go back to reference Kunen, A., Bailey, T., Brown, P.: KRIPKE-a massively parallel transport mini-app. Technical report, Lawrence Livermore National Laboratory (LLNL), Livermore, CA (2015) Kunen, A., Bailey, T., Brown, P.: KRIPKE-a massively parallel transport mini-app. Technical report, Lawrence Livermore National Laboratory (LLNL), Livermore, CA (2015)
12.
go back to reference Larsen, M., et al.: The alpine in situ infrastructure: ascending from the ashes of strawman. In: Proceedings of the In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization Workshop, ISAV2017. ACM, New York (2017) Larsen, M., et al.: The alpine in situ infrastructure: ascending from the ashes of strawman. In: Proceedings of the In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization Workshop, ISAV2017. ACM, New York (2017)
13.
go back to reference Larsen, M., Brugger, E., Childs, H., Eliot, J., Griffin, K., Harrison, C.: Strawman: a batch in situ visualization and analysis infrastructure for multi-physics simulation codes. In: Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization, ISAV2015, pp. 30–35. ACM, New York (2015). https://doi.org/10.1145/2828612.2828625 Larsen, M., Brugger, E., Childs, H., Eliot, J., Griffin, K., Harrison, C.: Strawman: a batch in situ visualization and analysis infrastructure for multi-physics simulation codes. In: Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization, ISAV2015, pp. 30–35. ACM, New York (2015). https://​doi.​org/​10.​1145/​2828612.​2828625
14.
go back to reference Larsen, M., Harrison, C., Kress, J., Pugmire, D., Meredith, J.S., Childs, H.: Performance modeling of in situ rendering. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, p. 24. IEEE Press (2016) Larsen, M., Harrison, C., Kress, J., Pugmire, D., Meredith, J.S., Childs, H.: Performance modeling of in situ rendering. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, p. 24. IEEE Press (2016)
15.
go back to reference Messina, P.: The exascale computing project. Comput. Sci. Eng. 19(3), 63–67 (2017)CrossRef Messina, P.: The exascale computing project. Comput. Sci. Eng. 19(3), 63–67 (2017)CrossRef
16.
go back to reference Moreland, K., et al.: Vtk-m: accelerating the visualization toolkit for massively threaded architectures. IEEE Comput. Graph. Appl. 36(3), 48–58 (2016)CrossRef Moreland, K., et al.: Vtk-m: accelerating the visualization toolkit for massively threaded architectures. IEEE Comput. Graph. Appl. 36(3), 48–58 (2016)CrossRef
17.
go back to reference Schroeder, W.J., Lorensen, B., Martin, K.: The Visualization Toolkit: An Object-oriented Approach to 3D Graphics. Kitware, New York (2004) Schroeder, W.J., Lorensen, B., Martin, K.: The Visualization Toolkit: An Object-oriented Approach to 3D Graphics. Kitware, New York (2004)
19.
go back to reference Schulz, M., Levine, J.A., Bremer, P.T., Gamblin, T., Pascucci, V.: Interpreting performance data across intuitive domains. In: 2011 International Conference on Parallel Processing (ICPP), pp. 206–215. IEEE (2011) Schulz, M., Levine, J.A., Bremer, P.T., Gamblin, T., Pascucci, V.: Interpreting performance data across intuitive domains. In: 2011 International Conference on Parallel Processing (ICPP), pp. 206–215. IEEE (2011)
20.
go back to reference Wood, C., et al.: A scalable observation system for introspection and in situ analytics. In: Proceedings of the 5th Workshop on Extreme-Scale Programming Tools, pp. 42–49. IEEE Press (2016) Wood, C., et al.: A scalable observation system for introspection and in situ analytics. In: Proceedings of the 5th Workshop on Extreme-Scale Programming Tools, pp. 42–49. IEEE Press (2016)
Metadata
Title
Projecting Performance Data over Simulation Geometry Using SOSflow and ALPINE
Authors
Chad Wood
Matthew Larsen
Alfredo Gimenez
Kevin Huck
Cyrus Harrison
Todd Gamblin
Allen Malony
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-17872-7_12

Premium Partner