Skip to main content

2015 | OriginalPaper | Buchkapitel

Asynchronous in Situ Processing with Gromacs: Taking Advantage of GPUs

verfasst von : Monica L. Hernandez, Matthieu Dreher, Carlos J. Barrios, Bruno Raffin

Erschienen in: High Performance Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Numerical simulations using supercomputers are producing an ever growing amount of data. Efficient production and analysis of these data are the key to future discoveries. The in situ paradigm is emerging as a promising solution to avoid the I/O bottleneck encountered in the file system for both the simulation and the analytics by treating the data as soon as they are produced in memory. Various strategies and implementations have been proposed in the last years to support in situ treatments with a low impact on the simulation performance. Yet, little efforts have been made when it comes to perform in situ analytics with hybrid simulations supporting accelerators like GPUs. In this article, we propose a study of the in situ strategies with Gromacs, a molecular dynamic simulation code supporting multi-GPUs, as our application target. We specifically focus on the computational resources usage of the machine by the simulation and the in situ analytics. We finally extend the usual in situ placement strategies to the case of in situ analytics running on a GPU and study their impact on both Gromacs performance and the resource usage of the machine. We show in particular that running in situ analytics on the GPU can be a more efficient solution than on the CPU especially when the CPU is the bottleneck of the simulation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Allard, J., Gouranton, V., Lecointre, L., Limet, S., Melin, E., Raffin, B., Robert, S.: FlowVR: a middleware for large scale virtual reality applications. In: Proceedings of Euro-Par 2004, Pisa, Italia (August 2004) Allard, J., Gouranton, V., Lecointre, L., Limet, S., Melin, E., Raffin, B., Robert, S.: FlowVR: a middleware for large scale virtual reality applications. In: Proceedings of Euro-Par 2004, Pisa, Italia (August 2004)
4.
Zurück zum Zitat Docan, C., Parashar, M., Klasky, S.: DataSpaces: an interaction and coordination framework for coupled simulation workflows. Cluster Comput. 15, 163–181 (2012)CrossRef Docan, C., Parashar, M., Klasky, S.: DataSpaces: an interaction and coordination framework for coupled simulation workflows. Cluster Comput. 15, 163–181 (2012)CrossRef
5.
Zurück zum Zitat Dorier, M., Antoniu, G., Cappello, F., Snir, M., Orf, L.: Damaris: how to efficiently leverage multicore parallelism to achieve scalable, Jitter-Free I/O. In: CLUSTER - IEEE International Conference on Cluster Computing. IEEE, September 2012 Dorier, M., Antoniu, G., Cappello, F., Snir, M., Orf, L.: Damaris: how to efficiently leverage multicore parallelism to achieve scalable, Jitter-Free I/O. In: CLUSTER - IEEE International Conference on Cluster Computing. IEEE, September 2012
6.
Zurück zum Zitat Dorier, M., Sisneros, Roberto, R., Peterka, T., Antoniu, G., Semeraro, Dave, B.: Damaris/Viz: a nonintrusive, adaptable and user-friendly in situ visualization framework. In: LDAV - IEEE Symposium on Large-Scale Data Analysis and Visualization, Atlanta, United States, October 2013 Dorier, M., Sisneros, Roberto, R., Peterka, T., Antoniu, G., Semeraro, Dave, B.: Damaris/Viz: a nonintrusive, adaptable and user-friendly in situ visualization framework. In: LDAV - IEEE Symposium on Large-Scale Data Analysis and Visualization, Atlanta, United States, October 2013
7.
Zurück zum Zitat Dreher, M., Raffin, B.: A flexible framework for asynchronous in situ and in transit analytics for scientific simulations. In: 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), May 2014 Dreher, M., Raffin, B.: A flexible framework for asynchronous in situ and in transit analytics for scientific simulations. In: 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), May 2014
8.
Zurück zum Zitat Dreher, M., Piuzzi, M., Ahmed, T., Matthieu, C., Baaden, M., Férey, N., Limet, S., Raffin, B., Robert, S.: Interactive molecular dynamics: scaling up to large systems. In: International Conference on Computational Science, ICCS 2013. Elsevier, Barcelone, Spain, June 2013 Dreher, M., Piuzzi, M., Ahmed, T., Matthieu, C., Baaden, M., Férey, N., Limet, S., Raffin, B., Robert, S.: Interactive molecular dynamics: scaling up to large systems. In: International Conference on Computational Science, ICCS 2013. Elsevier, Barcelone, Spain, June 2013
9.
Zurück zum Zitat Fabian, N., Moreland, K., Thompson, D., Bauer, A., Marion, P., Geveci, B., Rasquin, M., Jansen, K.: The paraview coprocessing library: a scalable, general purpose in situ visualization library. In: 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV), October 2011 Fabian, N., Moreland, K., Thompson, D., Bauer, A., Marion, P., Geveci, B., Rasquin, M., Jansen, K.: The paraview coprocessing library: a scalable, general purpose in situ visualization library. In: 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV), October 2011
10.
Zurück zum Zitat Hagan, R., Cao, Y.: Multi-GPU load balancing for in-situ visualization. In: The 2011 International Conference on Parallel and Distributed Processing Techniques and Applications (2011) Hagan, R., Cao, Y.: Multi-GPU load balancing for in-situ visualization. In: The 2011 International Conference on Parallel and Distributed Processing Techniques and Applications (2011)
11.
Zurück zum Zitat Hess, B., Kutzner, C., van der Spoel, D., Lindahl, E.: GROMACS 4: algorithms for highly efficient, load-balanced, and scalable molecular simulation. J. Chem. Theory Comput. 4, 435–447 (2008)CrossRef Hess, B., Kutzner, C., van der Spoel, D., Lindahl, E.: GROMACS 4: algorithms for highly efficient, load-balanced, and scalable molecular simulation. J. Chem. Theory Comput. 4, 435–447 (2008)CrossRef
12.
Zurück zum Zitat Humphrey, W., Dalke, A., Schulten, K.: VMD - visual molecular dynamics. J. Mol. Graph. 14, 33–38 (1996)CrossRef Humphrey, W., Dalke, A., Schulten, K.: VMD - visual molecular dynamics. J. Mol. Graph. 14, 33–38 (1996)CrossRef
13.
Zurück zum Zitat Klasky, S., Ethier, S., Lin, Z., Martins, K., Mccune, D., Samtaney, R.: Grid-based parallel data streaming implemented for the Gyrokinetic Toroidal code. In: Supercomputing Conference (SC 2003). IEEE Computer Society (2003) Klasky, S., Ethier, S., Lin, Z., Martins, K., Mccune, D., Samtaney, R.: Grid-based parallel data streaming implemented for the Gyrokinetic Toroidal code. In: Supercomputing Conference (SC 2003). IEEE Computer Society (2003)
14.
Zurück zum Zitat Krone, M., Stone, J.E., Ertl, T., Schulten, K.: Fast visualization of Gaussian density surfaces for molecular dynamics and particle system trajectories. In: EuroVis 2012 Short Papers, vol. 1 (2012) Krone, M., Stone, J.E., Ertl, T., Schulten, K.: Fast visualization of Gaussian density surfaces for molecular dynamics and particle system trajectories. In: EuroVis 2012 Short Papers, vol. 1 (2012)
15.
Zurück zum Zitat Levine, B.G., Stone, J.E., Kohlmeyer, A.: Fast analysis of molecular dynamics trajectories with graphics processing units Radial distribution function histogramming. J. Comput. Phys. 230(9), 3556–3569 (2011)CrossRefMATH Levine, B.G., Stone, J.E., Kohlmeyer, A.: Fast analysis of molecular dynamics trajectories with graphics processing units Radial distribution function histogramming. J. Comput. Phys. 230(9), 3556–3569 (2011)CrossRefMATH
16.
Zurück zum Zitat Li, M., Vazhkudai, S.S., Butt, A.R., Meng, F., Ma, X., Kim, Y., Engelmann, C., Shipman, G.: Functional partitioning to optimize end-to-end performance on many-core architectures. In: Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2010. IEEE Computer Society, Washington (2010) Li, M., Vazhkudai, S.S., Butt, A.R., Meng, F., Ma, X., Kim, Y., Engelmann, C., Shipman, G.: Functional partitioning to optimize end-to-end performance on many-core architectures. In: Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2010. IEEE Computer Society, Washington (2010)
17.
Zurück zum Zitat Lofstead, J.F., Klasky, S., Schwan, K., Podhorszki, N., Jin, C.: Flexible IO and integration for scientific codes through the adaptable IO system (ADIOS). In: 6th International Workshop on Challenges of Large Applications in Distributed Environments (2008) Lofstead, J.F., Klasky, S., Schwan, K., Podhorszki, N., Jin, C.: Flexible IO and integration for scientific codes through the adaptable IO system (ADIOS). In: 6th International Workshop on Challenges of Large Applications in Distributed Environments (2008)
18.
Zurück zum Zitat Lorendeau, B., Fournier, Y., Ribes, A.: In-situ visualization in fluid mechanics using catalyst: a case study for code saturne. In: 2013 IEEE Symposium on Large-Scale Data Analysis and Visualization (LDAV), October 2013 Lorendeau, B., Fournier, Y., Ribes, A.: In-situ visualization in fluid mechanics using catalyst: a case study for code saturne. In: 2013 IEEE Symposium on Large-Scale Data Analysis and Visualization (LDAV), October 2013
19.
Zurück zum Zitat Moreland, K.: Oh, \(\$\)#! Exascale! the effect of emerging architectures on scientific discovery. In: High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion, November 2012 Moreland, K.: Oh, \(\$\)#! Exascale! the effect of emerging architectures on scientific discovery. In: High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion, November 2012
20.
Zurück zum Zitat Phillips, J.C., Braun, R., Wang, W., Gumbart, J., Tajkhorshid, E., Villa, E., Chipot, C., Skeel, R.D., Kal, L., Schulten, K.: Scalable molecular dynamics with NAMD. J. Comput. Chem. 26(16), 1781–1802 (2005)CrossRef Phillips, J.C., Braun, R., Wang, W., Gumbart, J., Tajkhorshid, E., Villa, E., Chipot, C., Skeel, R.D., Kal, L., Schulten, K.: Scalable molecular dynamics with NAMD. J. Comput. Chem. 26(16), 1781–1802 (2005)CrossRef
21.
Zurück zum Zitat Pronk, S., Pall, S., Schulz, R., Larsson, P., Bjelkmar, P., Apostolov, R., Shirts, M.R., Smith, J.C., Kasson, P.M., van der Spoel, D., Hess, B., Lindahl, E.: Gromacs 4.5: a high-throughput and highly parallel open source molecular simulation toolkit. Bioinformatics (2013) Pronk, S., Pall, S., Schulz, R., Larsson, P., Bjelkmar, P., Apostolov, R., Shirts, M.R., Smith, J.C., Kasson, P.M., van der Spoel, D., Hess, B., Lindahl, E.: Gromacs 4.5: a high-throughput and highly parallel open source molecular simulation toolkit. Bioinformatics (2013)
22.
Zurück zum Zitat Singh, A., Balaji, P., Feng, W.c.: GePSeA: a general-purpose software acceleration framework for lightweight task offloading. In: Proceedings of the 2009 International Conference on Parallel Processing, ICPP 2009. IEEE Computer Society, Washington (2009) Singh, A., Balaji, P., Feng, W.c.: GePSeA: a general-purpose software acceleration framework for lightweight task offloading. In: Proceedings of the 2009 International Conference on Parallel Processing, ICPP 2009. IEEE Computer Society, Washington (2009)
23.
Zurück zum Zitat Soumagne, J., Biddiscombe, J.: Computational steering and parallel online monitoring using RMA through the HDF5 DSM virtual file driver. In: Proceedings of the International Conference on Computational Science, ICCS 2011, Singapore, vol. 4, June 2011 Soumagne, J., Biddiscombe, J.: Computational steering and parallel online monitoring using RMA through the HDF5 DSM virtual file driver. In: Proceedings of the International Conference on Computational Science, ICCS 2011, Singapore, vol. 4, June 2011
24.
Zurück zum Zitat Stone, J.E., Hardy, D.J., Ufimtsev, I.S., Schulten, K.: GPU-accelerated molecular modeling coming of age. J. Mol. Graph. Model. 29(2), 116–125 (2010)CrossRef Stone, J.E., Hardy, D.J., Ufimtsev, I.S., Schulten, K.: GPU-accelerated molecular modeling coming of age. J. Mol. Graph. Model. 29(2), 116–125 (2010)CrossRef
25.
Zurück zum Zitat Stone, J.E., Kohlmeyer, A., Vandivort, K.L., Schulten, K.: Immersive molecular visualization and interactive modeling with commodity hardware. In: Bebis, G., et al. (eds.) ISVC 2010, Part II. LNCS, vol. 6454, pp. 382–393. Springer, Heidelberg (2010) CrossRef Stone, J.E., Kohlmeyer, A., Vandivort, K.L., Schulten, K.: Immersive molecular visualization and interactive modeling with commodity hardware. In: Bebis, G., et al. (eds.) ISVC 2010, Part II. LNCS, vol. 6454, pp. 382–393. Springer, Heidelberg (2010) CrossRef
26.
Zurück zum Zitat Stone, J.E., McGreevy, R., Isralewitz, B., Schulten, K.: GPU accelerated analysis and visualization of large structures solved by molecular dynamics flexible fitting. Faraday discussions 169 (2014) Stone, J.E., McGreevy, R., Isralewitz, B., Schulten, K.: GPU accelerated analysis and visualization of large structures solved by molecular dynamics flexible fitting. Faraday discussions 169 (2014)
27.
Zurück zum Zitat Stone, J.E., Vandivort, K.L., Schulten, K.: GPU-accelerated molecular visualization on petascale supercomputing platforms. In: Proceedings of the 8th International Workshop on Ultrascale Visualization, UltraVis 2013. ACM, New York (2013) Stone, J.E., Vandivort, K.L., Schulten, K.: GPU-accelerated molecular visualization on petascale supercomputing platforms. In: Proceedings of the 8th International Workshop on Ultrascale Visualization, UltraVis 2013. ACM, New York (2013)
28.
Zurück zum Zitat Tu, T., Yu, H., Ramirez-Guzman, L., Bielak, J., Ghattas, O., Ma, K.L., O’Hallaron, D.: From mesh generation to scientific visualization: an end-to-end approach to parallel supercomputing. In: SC 2006 Conference, Proceedings of the ACM/IEEE, November 2006 Tu, T., Yu, H., Ramirez-Guzman, L., Bielak, J., Ghattas, O., Ma, K.L., O’Hallaron, D.: From mesh generation to scientific visualization: an end-to-end approach to parallel supercomputing. In: SC 2006 Conference, Proceedings of the ACM/IEEE, November 2006
29.
Zurück zum Zitat Vishwanath, V., Hereld, M., Papka, M.: Toward simulation-time data analysis and I/O acceleration on leadership-class systems. In: 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV), October 2011 Vishwanath, V., Hereld, M., Papka, M.: Toward simulation-time data analysis and I/O acceleration on leadership-class systems. In: 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV), October 2011
30.
Zurück zum Zitat Whitlock, B., Favre, J.M., Meredith, J.S.: Parallel in situ coupling of simulation with a fully featured visualization system. In: Proceedings of the 11th Eurographics Conference on Parallel Graphics and Visualization, EGPGV 2011. Eurographics Association (2011) Whitlock, B., Favre, J.M., Meredith, J.S.: Parallel in situ coupling of simulation with a fully featured visualization system. In: Proceedings of the 11th Eurographics Conference on Parallel Graphics and Visualization, EGPGV 2011. Eurographics Association (2011)
31.
Zurück zum Zitat Yu, H., Wang, C., Grout, R., Chen, J., Ma, K.L.: In situ visualization for large-scale combustion simulations. IEEE Comput. Graph. Appl. 3, 45–57 (2010) Yu, H., Wang, C., Grout, R., Chen, J., Ma, K.L.: In situ visualization for large-scale combustion simulations. IEEE Comput. Graph. Appl. 3, 45–57 (2010)
32.
Zurück zum Zitat Zhao, G., Perilla, J.R., Yufenyuy, E.L., Meng, X., Chen, B., Ning, J., Ahn, J., Gronenborn, A.M., Schulten, K., Aiken, C.: Mature HIV-1 capsid structure by cryo-electron microscopy and all-atom molecular dynamics. Nature 497, 643–646 (2013)CrossRef Zhao, G., Perilla, J.R., Yufenyuy, E.L., Meng, X., Chen, B., Ning, J., Ahn, J., Gronenborn, A.M., Schulten, K., Aiken, C.: Mature HIV-1 capsid structure by cryo-electron microscopy and all-atom molecular dynamics. Nature 497, 643–646 (2013)CrossRef
33.
Zurück zum Zitat Zheng, F., Abbasi, H., Docan, C., Lofstead, J., Liu, Q., Klasky, S., Parashar, M., Podhorszki, N., Schwan, K., Wolf, M.: PreDatA - preparatory data analytics on peta-scale machines. In: 2010 IEEE International Symposium on Parallel Distributed Processing (IPDPS) (2010) Zheng, F., Abbasi, H., Docan, C., Lofstead, J., Liu, Q., Klasky, S., Parashar, M., Podhorszki, N., Schwan, K., Wolf, M.: PreDatA - preparatory data analytics on peta-scale machines. In: 2010 IEEE International Symposium on Parallel Distributed Processing (IPDPS) (2010)
34.
Zurück zum Zitat Zheng, F., Abbasi, H., Cao, J., Dayal, J., Schwan, K., Wolf, M., Klasky, S., Podhorszki, N.: In-situ I/O processing: a case for location flexibility. In: Proceedings of the Sixth Workshop on Parallel Data Storage, PDSW 2011, ACM, New York (2011) Zheng, F., Abbasi, H., Cao, J., Dayal, J., Schwan, K., Wolf, M., Klasky, S., Podhorszki, N.: In-situ I/O processing: a case for location flexibility. In: Proceedings of the Sixth Workshop on Parallel Data Storage, PDSW 2011, ACM, New York (2011)
35.
Zurück zum Zitat Zheng, F., Yu, H., Hantas, C., Wolf, M., Eisenhauer, G., Schwan, K., Abbasi, H., Klasky, S.: Goldrush: resource efficient in situ scientific data analytics using fine-grained interference aware execution. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC 2013. ACM (2013) Zheng, F., Yu, H., Hantas, C., Wolf, M., Eisenhauer, G., Schwan, K., Abbasi, H., Klasky, S.: Goldrush: resource efficient in situ scientific data analytics using fine-grained interference aware execution. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC 2013. ACM (2013)
36.
Zurück zum Zitat Zheng, F., Zou, H., Eisenhauer, G., Schwan, K., Wolf, M., Dayal, J., Nguyen, T.A., Cao, J., Abbasi, H., Klasky, S., Podhorszki, N., Yu, H.: FlexIO: I/O middleware for location-flexible scientific data analytics. In: Proceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing, IPDPS 2013. IEEE Computer Society (2013) Zheng, F., Zou, H., Eisenhauer, G., Schwan, K., Wolf, M., Dayal, J., Nguyen, T.A., Cao, J., Abbasi, H., Klasky, S., Podhorszki, N., Yu, H.: FlexIO: I/O middleware for location-flexible scientific data analytics. In: Proceedings of the 2013 IEEE 27th International Symposium on Parallel and Distributed Processing, IPDPS 2013. IEEE Computer Society (2013)
Metadaten
Titel
Asynchronous in Situ Processing with Gromacs: Taking Advantage of GPUs
verfasst von
Monica L. Hernandez
Matthieu Dreher
Carlos J. Barrios
Bruno Raffin
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-26928-3_7

Neuer Inhalt