Skip to main content

2021 | OriginalPaper | Buchkapitel

I/O Post- and Co-Processing for High-Order Methods

verfasst von : M. Rasquin, K. Hillewaert, F. Bassi, A. Colombo, F. Massa, G. Rahier, E. Martin, F. Renac

Erschienen in: TILDA: Towards Industrial LES/DNS in Aeronautics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

While the exascale computing era is approaching, the growing gap between computing resources and IO bandwidth for massively parallel simulations has already become a major bottleneck for the scientific discovery process. In this context, various strategies to enable and accelerate the analysis of data produced by massively parallel high-order methods are presented, with an emphasis on in-situ visualization and co-processing techniques. First, a library of parallel procedures is presented for an efficient collection of turbulence statistics within the framework of a modal discontinuous Galerkin method. Afterwards, an acoustic co-processing strategy is presented whereby sound radiation calculations are performed concurrently with CFD calculations in order to avoid the need to store prohibitive amount of data. Finally, an open-source and scalable post-hoc visualization and processing tool dedicated to the analysis of large data sets produced by high order methods is first presented. This post-hoc processing tool has then been extended to a co-processing interface which enables live in-situ visualization and analysis of high-order solutions produced by massively parallel simulations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat J. Ahrens, B. Geveci, C. Law, Paraview: an end-user tool for large data visualization, in The Visualization Handbook (2005), p. 717 J. Ahrens, B. Geveci, C. Law, Paraview: an end-user tool for large data visualization, in The Visualization Handbook (2005), p. 717
2.
Zurück zum Zitat N. Ali, P. Carns, K. Iskra, D. Kimpe, S. Lang, R. Latham, R. Ross, L. Ward, P. Sadayappan, Scalable i/o forwarding framework for high-performance computing systems, in IEEE International Conference on Cluster Computing and Workshops, CLUSTER’09 (IEEE, 2009), pp. 1–10 N. Ali, P. Carns, K. Iskra, D. Kimpe, S. Lang, R. Latham, R. Ross, L. Ward, P. Sadayappan, Scalable i/o forwarding framework for high-performance computing systems, in IEEE International Conference on Cluster Computing and Workshops, CLUSTER’09 (IEEE, 2009), pp. 1–10
3.
Zurück zum Zitat U. Ayachit, A. Bauer, B. Geveci, P. O’Leary, K. Moreland, N. Fabian, J. Mauldin, Paraview catalyst: enabling in situ data analysis and visualization, in Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization, ISAV2015 (ACM, New York, NY, USA, 2015), pp. 25–29 U. Ayachit, A. Bauer, B. Geveci, P. O’Leary, K. Moreland, N. Fabian, J. Mauldin, Paraview catalyst: enabling in situ data analysis and visualization, in Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization, ISAV2015 (ACM, New York, NY, USA, 2015), pp. 25–29
4.
Zurück zum Zitat F. Bassi, L. Botti, A. Colombo, A. Crivellini, A. Ghidoni, F. Massa, On the development of an implicit high-order discontinuous Galerkin method for DNS and implicit LES of turbulent flows. Eur. J. Mech.—B/Fluids 55, 367–379 (2016)MathSciNetCrossRef F. Bassi, L. Botti, A. Colombo, A. Crivellini, A. Ghidoni, F. Massa, On the development of an implicit high-order discontinuous Galerkin method for DNS and implicit LES of turbulent flows. Eur. J. Mech.—B/Fluids 55, 367–379 (2016)MathSciNetCrossRef
5.
Zurück zum Zitat F. Bassi, L. Botti, A. Colombo, A. Crivellini, A. Ghidoni, A. Nigro, S. Rebay, Time integration in the discontinuous Galerkin Code MIGALE—unsteady problems, in IDIHOM: Industrialization of High-Order Methods—A Top-Down Approach volume 128 of Notes on Numerical Fluid Mechanics and Multidisciplinary Design, ed. by N. Kroll, C. Hirsch, F. Bassi, C. Johnston, K. Hillewaert (Springer International Publishing, 2015), pp. 205–230 F. Bassi, L. Botti, A. Colombo, A. Crivellini, A. Ghidoni, A. Nigro, S. Rebay, Time integration in the discontinuous Galerkin Code MIGALE—unsteady problems, in IDIHOM: Industrialization of High-Order Methods—A Top-Down Approach volume 128 of Notes on Numerical Fluid Mechanics and Multidisciplinary Design, ed. by N. Kroll, C. Hirsch, F. Bassi, C. Johnston, K. Hillewaert (Springer International Publishing, 2015), pp. 205–230
6.
Zurück zum Zitat F. Bassi, L. Botti, A. Colombo, D.A. Di Pietro, P. Tesini, On the flexibility of agglomeration based physical space discontinuous Galerkin discretizations. J. Comput. Phys. 231(1), 45–65 (2012)MathSciNetCrossRef F. Bassi, L. Botti, A. Colombo, D.A. Di Pietro, P. Tesini, On the flexibility of agglomeration based physical space discontinuous Galerkin discretizations. J. Comput. Phys. 231(1), 45–65 (2012)MathSciNetCrossRef
7.
Zurück zum Zitat A.C. Bauer, H. Abbasi, J. Ahrens, H. Childs, B. Geveci, S. Klasky, K. Moreland, P. O’Leary, V. Vishwanath, B. Whitlock, E.W. Bethel, In situ methods, infrastructures, and applications on high performance computing platforms. Comput. Graphics Forum 35(3), 577–597 (2016)CrossRef A.C. Bauer, H. Abbasi, J. Ahrens, H. Childs, B. Geveci, S. Klasky, K. Moreland, P. O’Leary, V. Vishwanath, B. Whitlock, E.W. Bethel, In situ methods, infrastructures, and applications on high performance computing platforms. Comput. Graphics Forum 35(3), 577–597 (2016)CrossRef
8.
Zurück zum Zitat C. Carton de Wiart, K. Hillewaert, A discontinuous Galerkin method for implicit LES of moderate Reynolds number flows, in AIAA SciTech, 53rd AIAA Aerospace Sciences Meeting (Kissimmee, Florida, 2015) C. Carton de Wiart, K. Hillewaert, A discontinuous Galerkin method for implicit LES of moderate Reynolds number flows, in AIAA SciTech, 53rd AIAA Aerospace Sciences Meeting (Kissimmee, Florida, 2015)
9.
Zurück zum Zitat C. Carton de Wiart, K. Hillewaert, L. Bricteux, G. Winckelmans, Implicit LES of free and wall bounded turbulent flows based on the discontinuous Galerkin/symmetric interior penalty method. Int. J. Numer. Meth. Fluids 78(6), 335–354 (2014). https://doi.org/10.1002/fld.4021 C. Carton de Wiart, K. Hillewaert, L. Bricteux, G. Winckelmans, Implicit LES of free and wall bounded turbulent flows based on the discontinuous Galerkin/symmetric interior penalty method. Int. J. Numer. Meth. Fluids 78(6), 335–354 (2014). https://​doi.​org/​10.​1002/​fld.​4021
10.
Zurück zum Zitat C. Carton de Wiart, K. Hillewaert, M. Duponcheel, G. Winckelmans, Assessment of a discontinuous Galerkin method for the simulation of vortical flows at high Reynolds number. Int. J. Numer. Meth. Fluids 74, 469–493 (2013). https://doi.org/10.1002/fld.3859 C. Carton de Wiart, K. Hillewaert, M. Duponcheel, G. Winckelmans, Assessment of a discontinuous Galerkin method for the simulation of vortical flows at high Reynolds number. Int. J. Numer. Meth. Fluids 74, 469–493 (2013). https://​doi.​org/​10.​1002/​fld.​3859
11.
Zurück zum Zitat H. Childs, E. Brugger, B. Whitlock, J. Meredith, S. Ahern, D. Pugmire, K. Biagas, M. Miller, G.H. Weber, H. Krishnan et al., Visit: an end-user tool for visualizing and analyzing very large data, in High Performance Visualization–Enabling Extreme-Scale Scientific Insight (2012), pp. 357–372 H. Childs, E. Brugger, B. Whitlock, J. Meredith, S. Ahern, D. Pugmire, K. Biagas, M. Miller, G.H. Weber, H. Krishnan et al., Visit: an end-user tool for visualizing and analyzing very large data, in High Performance Visualization–Enabling Extreme-Scale Scientific Insight (2012), pp. 357–372
12.
Zurück zum Zitat H. Childs, D. Pugmire, S. Ahern, B. Whitlock, M. Howison, G.H Weber, E.W. Bethel et al., Extreme scaling of production visualization software on diverse architectures. IEEE Comput. Graph. Appl. 30(3), 22–31 (2010) H. Childs, D. Pugmire, S. Ahern, B. Whitlock, M. Howison, G.H Weber, E.W. Bethel et al., Extreme scaling of production visualization software on diverse architectures. IEEE Comput. Graph. Appl. 30(3), 22–31 (2010)
13.
Zurück zum Zitat B. Cockburn, Discontinuous galerkin methods for convection-dominated problems, in High-Order Methods for Computational Physics (Springer, 1999), pp. 69–224 B. Cockburn, Discontinuous galerkin methods for convection-dominated problems, in High-Order Methods for Computational Physics (Springer, 1999), pp. 69–224
14.
Zurück zum Zitat B. Cockburn, G.E. Karniadakis, C.-W. Shu, The development of discontinuous galerkin methods, in Discontinuous Galerkin Methods (Springer, 2000), pp. 3–50 B. Cockburn, G.E. Karniadakis, C.-W. Shu, The development of discontinuous galerkin methods, in Discontinuous Galerkin Methods (Springer, 2000), pp. 3–50
15.
Zurück zum Zitat B. Cockburn, C.-W. Shu, The local discontinuous galerkin method for time-dependent convection-diffusion systems. SIAM J. Numer. Anal. 35(6), 2440–2463 (1998)MathSciNetCrossRef B. Cockburn, C.-W. Shu, The local discontinuous galerkin method for time-dependent convection-diffusion systems. SIAM J. Numer. Anal. 35(6), 2440–2463 (1998)MathSciNetCrossRef
16.
Zurück zum Zitat T.J. Corona, D. Thompson, Arbitrary-order lagrange finite elements in the visualization toolkit. Kitware Source Quaterly Magazine 43, 6–9 (2018) T.J. Corona, D. Thompson, Arbitrary-order lagrange finite elements in the visualization toolkit. Kitware Source Quaterly Magazine 43, 6–9 (2018)
17.
Zurück zum Zitat N. Fabian, K. Moreland, D. Thompson, A.C. Bauer, P. Marion, B. Gevecik, M. Rasquin, K.E. Jansen, The paraview coprocessing library: a scalable, general purpose in situ visualization library, in 2011 IEEE Symposium onLarge Data Analysis and Visualization (LDAV) (IEEE, 2011), pp. 89–96 N. Fabian, K. Moreland, D. Thompson, A.C. Bauer, P. Marion, B. Gevecik, M. Rasquin, K.E. Jansen, The paraview coprocessing library: a scalable, general purpose in situ visualization library, in 2011 IEEE Symposium onLarge Data Analysis and Visualization (LDAV) (IEEE, 2011), pp. 89–96
18.
Zurück zum Zitat J.E. Ffowcs Williams, D.L. Hawkings, Sound generation by turbulence and surfaces in arbitrary motion. Philos. Trans. Roy. Soc. Lond. Series A, Math. Phys. Sci. 264(1151), 321–342 (1969) J.E. Ffowcs Williams, D.L. Hawkings, Sound generation by turbulence and surfaces in arbitrary motion. Philos. Trans. Roy. Soc. Lond. Series A, Math. Phys. Sci. 264(1151), 321–342 (1969)
19.
Zurück zum Zitat J.B. Freund, Noise-source turbulence statistics and the noise from a mach 0.9 jet. Phys. Fluids 15(6), 1788–1799 (2003) J.B. Freund, Noise-source turbulence statistics and the noise from a mach 0.9 jet. Phys. Fluids 15(6), 1788–1799 (2003)
20.
Zurück zum Zitat C. Geuzaine, J.-F. Remacle, Gmsh: a 3-d finite element mesh generator with built-in pre-and post-processing facilities. Int. J. Numer. Meth. Eng. 79(11), 1309–1331 (2009)MathSciNetCrossRef C. Geuzaine, J.-F. Remacle, Gmsh: a 3-d finite element mesh generator with built-in pre-and post-processing facilities. Int. J. Numer. Meth. Eng. 79(11), 1309–1331 (2009)MathSciNetCrossRef
21.
Zurück zum Zitat R. Heiland, M. Pauline Baker, A survey of co-processing systems (Technical report, NCSA Univesity of Illinois (USA), 1998) R. Heiland, M. Pauline Baker, A survey of co-processing systems (Technical report, NCSA Univesity of Illinois (USA), 1998)
22.
Zurück zum Zitat H.T. Huynh, A flux reconstruction approach to high-order schemes including discontinuous galerkin methods, in 18th AIAA CFD Conference (2007), p. 4079 H.T. Huynh, A flux reconstruction approach to high-order schemes including discontinuous galerkin methods, in 18th AIAA CFD Conference (2007), p. 4079
23.
Zurück zum Zitat P. Jordan, Y. Gervais, J.C. Valiere, H. Foulon, Final results from single point measurements. project deliverable d3. 4, jean–eu 5th framework programme (Technical report, G4RD-CT2000-00313, 2002) P. Jordan, Y. Gervais, J.C. Valiere, H. Foulon, Final results from single point measurements. project deliverable d3. 4, jean–eu 5th framework programme (Technical report, G4RD-CT2000-00313, 2002)
24.
Zurück zum Zitat M. Lorteau, M. de la Llave Plata, N. Lupoglazoff, F. Vuillot, V. Couaillier, Analysis of turbulent jet simulations for aeroacoustics using high-order dg methods, in 17th ONERA-DLR Aerospace Symposium ODAS, Aussois, France (2017) M. Lorteau, M. de la Llave Plata, N. Lupoglazoff, F. Vuillot, V. Couaillier, Analysis of turbulent jet simulations for aeroacoustics using high-order dg methods, in 17th ONERA-DLR Aerospace Symposium ODAS, Aussois, France (2017)
25.
Zurück zum Zitat J.D. Mulder, J.J. van Wijk, R. van Liere, A survey of computational steering environments. Future Gener. Comput. Syst. 15(1), 119–129 (1999)CrossRef J.D. Mulder, J.J. van Wijk, R. van Liere, A survey of computational steering environments. Future Gener. Comput. Syst. 15(1), 119–129 (1999)CrossRef
26.
Zurück zum Zitat G. Perez, J. Prieur, G. Rahier, F. Vuillot, Theoretical and numerical discussion on volume integral methods for jet noise prediction, in 13th AIAA/CEAS Aeroacoustics Conference (28th AIAA Aeroacoustics Conference) (2007), p. 3593 G. Perez, J. Prieur, G. Rahier, F. Vuillot, Theoretical and numerical discussion on volume integral methods for jet noise prediction, in 13th AIAA/CEAS Aeroacoustics Conference (28th AIAA Aeroacoustics Conference) (2007), p. 3593
27.
Zurück zum Zitat G. Rahier, M. Huet, J. Prieur, Additional terms for the use of ffowcs williams and hawkings surface integrals in turbulent flows. Comput. Fluids 120, 158–172 (2015)MathSciNetCrossRef G. Rahier, M. Huet, J. Prieur, Additional terms for the use of ffowcs williams and hawkings surface integrals in turbulent flows. Comput. Fluids 120, 158–172 (2015)MathSciNetCrossRef
28.
Zurück zum Zitat G. Rahier, Comparison of surface and volume integral methods for transonic propeller acoustic predictions. Comput. Fluids 179, 178–193 (2019)MathSciNetCrossRef G. Rahier, Comparison of surface and volume integral methods for transonic propeller acoustic predictions. Comput. Fluids 179, 178–193 (2019)MathSciNetCrossRef
29.
Zurück zum Zitat M. Rasquin, A. Bauer, K. Hillewaert, Scientific post hoc and in situ visualisation of high-order polynomial solutions from massively parallel, simulations. Int. J. Comput. Fluid Dyn. 33(4), 171–180 (2019)MathSciNetCrossRef M. Rasquin, A. Bauer, K. Hillewaert, Scientific post hoc and in situ visualisation of high-order polynomial solutions from massively parallel, simulations. Int. J. Comput. Fluid Dyn. 33(4), 171–180 (2019)MathSciNetCrossRef
30.
Zurück zum Zitat M. Rasquin, P. Marion, V. Vishwanath, B. Matthews, M. Hereld, K. Jansen, R. Loy, A. Bauer, M. Zhou, O. Sahni et al., Electronic poster: co-visualization of full data and in situ data extracts from unstructured grid cfd at 160k cores, in Proceedings of the 2011 Companion on High Performance Computing Networking, Storage and Analysis Companion (ACM, 2011), pp. 103–104 M. Rasquin, P. Marion, V. Vishwanath, B. Matthews, M. Hereld, K. Jansen, R. Loy, A. Bauer, M. Zhou, O. Sahni et al., Electronic poster: co-visualization of full data and in situ data extracts from unstructured grid cfd at 160k cores, in Proceedings of the 2011 Companion on High Performance Computing Networking, Storage and Analysis Companion (ACM, 2011), pp. 103–104
31.
Zurück zum Zitat J.-F. Remacle, N. Chevaugeon, E. Marchandise, C. Geuzaine, Efficient visualization of high-order finite elements. Int. J. Numer. Meth. Eng. 69(4), 750–771 (2007)MathSciNetCrossRef J.-F. Remacle, N. Chevaugeon, E. Marchandise, C. Geuzaine, Efficient visualization of high-order finite elements. Int. J. Numer. Meth. Eng. 69(4), 750–771 (2007)MathSciNetCrossRef
32.
Zurück zum Zitat F. Renac, M. de la Llave Plata, E. Martin, J.-B. Chapelier, V. Couaillier, Aghora: a high-order dg solver for turbulent flow simulations, in IDIHOM: Industrialization of High-Order Methods-A Top-Down Approach (Springer, 2015), pp. 315–335 F. Renac, M. de la Llave Plata, E. Martin, J.-B. Chapelier, V. Couaillier, Aghora: a high-order dg solver for turbulent flow simulations, in IDIHOM: Industrialization of High-Order Methods-A Top-Down Approach (Springer, 2015), pp. 315–335
33.
Zurück zum Zitat M. Rivi, L. Calori, G. Muscianisi, V. Slavnic, In-situ visualization: state-of-the-art and some use cases. PRACE White Paper (2012), pp. 1–18 M. Rivi, L. Calori, G. Muscianisi, V. Slavnic, In-situ visualization: state-of-the-art and some use cases. PRACE White Paper (2012), pp. 1–18
34.
Zurück zum Zitat W.J. Schroeder, B. Lorensen, K. Martin, The Visualization Toolkit: An Object-Oriented Approach to 3D Graphics (Kitware, 2004) W.J. Schroeder, B. Lorensen, K. Martin, The Visualization Toolkit: An Object-Oriented Approach to 3D Graphics (Kitware, 2004)
35.
Zurück zum Zitat A. Uzun, A.S. Lyrintzis, G.A. Blaisdell, Coupling of integral acoustics methods with les for jet noise prediction. Int. J. Aeroacoustics 3(4), 297–346 (2004) A. Uzun, A.S. Lyrintzis, G.A. Blaisdell, Coupling of integral acoustics methods with les for jet noise prediction. Int. J. Aeroacoustics 3(4), 297–346 (2004)
36.
Zurück zum Zitat V. Vishwanath, M. Hereld, M.E. Papka, Toward simulation-time data analysis and i/o acceleration on leadership-class systems, in 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV) (IEEE, 2011), pp. 9–14 V. Vishwanath, M. Hereld, M.E. Papka, Toward simulation-time data analysis and i/o acceleration on leadership-class systems, in 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV) (IEEE, 2011), pp. 9–14
37.
Zurück zum Zitat D.M. Williams, P. Castonguay, P.E. Vincent, A. Jameson, Energy stable flux reconstruction schemes for advection–diffusion problems on triangles. J. Comput. Phys. 250, 53–76 (2013) D.M. Williams, P. Castonguay, P.E. Vincent, A. Jameson, Energy stable flux reconstruction schemes for advection–diffusion problems on triangles. J. Comput. Phys. 250, 53–76 (2013)
38.
Zurück zum Zitat F.D. Witherden, P.E. Vincent, A. Jameson, High-order flux reconstruction schemes, in Handbook of Numerical Analysis, vol. 17 (Elsevier, 2016), pp. 227–263 F.D. Witherden, P.E. Vincent, A. Jameson, High-order flux reconstruction schemes, in Handbook of Numerical Analysis, vol. 17 (Elsevier, 2016), pp. 227–263
39.
Zurück zum Zitat H. Yi, M. Rasquin, J. Fang, I.A. Bolotnov, In-situ visualization and computational steering for large-scale simulation of turbulent flows in complex geometries, in 2014 IEEE International Conference on Big Data (IEEE, 2014), pp. 567–572 H. Yi, M. Rasquin, J. Fang, I.A. Bolotnov, In-situ visualization and computational steering for large-scale simulation of turbulent flows in complex geometries, in 2014 IEEE International Conference on Big Data (IEEE, 2014), pp. 567–572
Metadaten
Titel
I/O Post- and Co-Processing for High-Order Methods
verfasst von
M. Rasquin
K. Hillewaert
F. Bassi
A. Colombo
F. Massa
G. Rahier
E. Martin
F. Renac
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-62048-6_9

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.