Skip to main content
Top

2019 | OriginalPaper | Chapter

Load-Balancing and Spatial Adaptivity for Coarse-Grained Molecular Dynamics Applications

Authors : Steffen Hirschmann, Michael Lahnert, Carolin Schober, Malte Brunn, Miriam Mehl, Dirk Pflüger

Published in: High Performance Computing in Science and Engineering ' 18

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We present our approach for a scalable implementation of coupled soft matter simulations for inhomogeneous applications based on the simulation package ESPResSo and an extended version of the adaptive grid framework p4est. Our main contribution in this paper is the development and implementation of a joint partitioning of two or more distinct octree-based grids based on the concept of a finest common tree. This concept guarantees that, on all grids, the same process is responsible for each point in space and, thus, avoids communication of data in overlapping volumes handled in different partitions. We achieve up to 85% parallel efficiency in a weak scaling setting. Our proposed algorithms take only a small fraction of the overall runtime of grid adaption.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The callback is called for child cells before it is called on a cell itself.
 
Literature
1.
go back to reference P. Ahlrichs, B. Dünweg, Simulation of a single polymer chain in solution by combining lattice Boltzmann and molecular dynamics. J. Chem. Phys. 111(17), 8225–8239 (1999)CrossRef P. Ahlrichs, B. Dünweg, Simulation of a single polymer chain in solution by combining lattice Boltzmann and molecular dynamics. J. Chem. Phys. 111(17), 8225–8239 (1999)CrossRef
2.
go back to reference A. Arnold et al., ESPResSo 3.1: molecular dynamics software for coarse-grained models, in Meshfree Methods for Partial Differential Equations VI, ed. by M. Griebel, M.A. Schweitzer. Lecture Notes in Computational Science and Engineering, vol. 89 (Springer, Berlin, Heidelberg, 2012), pp. 1–23MATH A. Arnold et al., ESPResSo 3.1: molecular dynamics software for coarse-grained models, in Meshfree Methods for Partial Differential Equations VI, ed. by M. Griebel, M.A. Schweitzer. Lecture Notes in Computational Science and Engineering, vol. 89 (Springer, Berlin, Heidelberg, 2012), pp. 1–23MATH
3.
go back to reference M. Brunn, Coupling of particle simulation and lattice Boltzmann background flow on adaptive grids. M.A. thesis, University of Stuttgart, Germany, 2017 M. Brunn, Coupling of particle simulation and lattice Boltzmann background flow on adaptive grids. M.A. thesis, University of Stuttgart, Germany, 2017
4.
go back to reference M. Buchholz, Framework zur Parallelisierung von Molekulardynamiksimulationen in verfahrenstechnischen Anwendungen. Ph.D. thesis (2010) M. Buchholz, Framework zur Parallelisierung von Molekulardynamiksimulationen in verfahrenstechnischen Anwendungen. Ph.D. thesis (2010)
5.
go back to reference C. Burstedde et al., p4est: scalable algorithms for parallel adaptive mesh refinement on forests of octrees. SIAM J. Sci. Comput. 33(3), 1103–1133 (2011)MathSciNetCrossRef C. Burstedde et al., p4est: scalable algorithms for parallel adaptive mesh refinement on forests of octrees. SIAM J. Sci. Comput. 33(3), 1103–1133 (2011)MathSciNetCrossRef
6.
go back to reference P.M. Campbell et al., Dynamic octree load balancing using space-filling curves. In: Williams College Department of Computer Science, Technical Report (2003), pp. 1–26 P.M. Campbell et al., Dynamic octree load balancing using space-filling curves. In: Williams College Department of Computer Science, Technical Report (2003), pp. 1–26
7.
go back to reference B. Dünweg, A.J.C. Ladd, Lattice Boltzmann simulations of soft matter systems, in Advanced Computer Simulation Approaches for Soft Matter Sciences III (2009), pp. 89–166 B. Dünweg, A.J.C. Ladd, Lattice Boltzmann simulations of soft matter systems, in Advanced Computer Simulation Approaches for Soft Matter Sciences III (2009), pp. 89–166
8.
go back to reference B. Dünweg et al., Statistical mechanics of the fluctuating lattice Boltzmann equation. Phys. Rev. E 76(3), 036704 (2007) B. Dünweg et al., Statistical mechanics of the fluctuating lattice Boltzmann equation. Phys. Rev. E 76(3), 036704 (2007)
9.
go back to reference B. Forsyth et al., Particle charge distribution measurement for commonly generated laboratory aerosols. Aerosol Sci. Technol. 28(6), 489–501 (1998)CrossRef B. Forsyth et al., Particle charge distribution measurement for commonly generated laboratory aerosols. Aerosol Sci. Technol. 28(6), 489–501 (1998)CrossRef
10.
go back to reference C. Helsper, W. Mölter, Determination and neutralization of the charge produced by the dispersion of powders. J. Aerosol Sci. 18(6), 877–880 (1987)CrossRef C. Helsper, W. Mölter, Determination and neutralization of the charge produced by the dispersion of powders. J. Aerosol Sci. 18(6), 877–880 (1987)CrossRef
11.
go back to reference S. Hirschmann et al., Towards understanding optimal load-balancing of heterogeneous short-range molecular dynamics, in Workshop on High Performance Computing and Big Data in Molecular Engineering 2016. Hyderabad, India (2016) S. Hirschmann et al., Towards understanding optimal load-balancing of heterogeneous short-range molecular dynamics, in Workshop on High Performance Computing and Big Data in Molecular Engineering 2016. Hyderabad, India (2016)
12.
go back to reference S. Hirschmann et al., Load balancing with p4est for short-range molecular dynamics with ESPResSo, in Advances in Parallel Computing, ed. by S. Bassini et al., vol. 32 (IOS Press, 2017), pp. 455–464 S. Hirschmann et al., Load balancing with p4est for short-range molecular dynamics with ESPResSo, in Advances in Parallel Computing, ed. by S. Bassini et al., vol. 32 (IOS Press, 2017), pp. 455–464
13.
go back to reference R.W. Hockney, J.W. Eastwood, Computer Simulation Using Particles (Taylor & Francis, Inc., Bristol, PA, USA, 1988) R.W. Hockney, J.W. Eastwood, Computer Simulation Using Particles (Taylor & Francis, Inc., Bristol, PA, USA, 1988)
14.
go back to reference T. Isaac et al., Recursive algorithms for distributed forests of octrees. SIAM J. Sci. Comput. 37(5), C497–C531 (2015)MathSciNetCrossRef T. Isaac et al., Recursive algorithms for distributed forests of octrees. SIAM J. Sci. Comput. 37(5), C497–C531 (2015)MathSciNetCrossRef
15.
go back to reference A.M. Johnston et al., Electrical charge characteristics of dry aerosols produced by a number of laboratory mechanical dispensers. Aerosol Sci. Technol. 6(2), 115–127 (1987)MathSciNetCrossRef A.M. Johnston et al., Electrical charge characteristics of dry aerosols produced by a number of laboratory mechanical dispensers. Aerosol Sci. Technol. 6(2), 115–127 (1987)MathSciNetCrossRef
16.
go back to reference M. Lahnert et al., Minimally-invasive integration of p4est in ESPResSo for adaptive Lattice-Boltzmann, in The 30th Computational Fluid Dynamics Symposium (Japan Society of Fluid Mechanics, 2016) M. Lahnert et al., Minimally-invasive integration of p4est in ESPResSo for adaptive Lattice-Boltzmann, in The 30th Computational Fluid Dynamics Symposium (Japan Society of Fluid Mechanics, 2016)
17.
go back to reference M. Lahnert et al., Towards Lattice-Boltzmann on dynamically adaptive grids - minimally-invasive grid exchange in ESPResSo, in VII European Congress on Computational Methods in Applied Sciences and Engineering, ECCOMAS, ed. by M. Papadrakakis et al. (2016) M. Lahnert et al., Towards Lattice-Boltzmann on dynamically adaptive grids - minimally-invasive grid exchange in ESPResSo, in VII European Congress on Computational Methods in Applied Sciences and Engineering, ECCOMAS, ed. by M. Papadrakakis et al. (2016)
18.
go back to reference H.J. Limbach et al., ESPResSo - an extensible simulation package for research on soft matter systems. Comput. Phys. Commun. 174(9), 704–727 (2006)CrossRef H.J. Limbach et al., ESPResSo - an extensible simulation package for research on soft matter systems. Comput. Phys. Commun. 174(9), 704–727 (2006)CrossRef
19.
go back to reference M. Mehl et al., Navier-Stokes and Lattice-Boltzmann on octree-like grids in the Peano framework. Int. J. Numer. Methods Fluids 65(1–3), 67–86 (2010)MathSciNetCrossRef M. Mehl et al., Navier-Stokes and Lattice-Boltzmann on octree-like grids in the Peano framework. Int. J. Numer. Methods Fluids 65(1–3), 67–86 (2010)MathSciNetCrossRef
20.
go back to reference W.F. Mitchell, A refinement-tree based partitioning method for dynamic load balancing with adaptively refined grids. J. Parallel Distrib. Comput. 67(4), 417–429 (2007)CrossRef W.F. Mitchell, A refinement-tree based partitioning method for dynamic load balancing with adaptively refined grids. J. Parallel Distrib. Comput. 67(4), 417–429 (2007)CrossRef
21.
go back to reference G.M. Morton, A computer oriented geodetic data base; and a new technique in file sequencing. Technical report IBM Ltd., 1966 G.M. Morton, A computer oriented geodetic data base; and a new technique in file sequencing. Technical report IBM Ltd., 1966
22.
go back to reference A. Pınar, C. Aykanat, Fast optimal load balancing algorithms for 1D partitioning. J. Parallel Distrib. Comput. 64(8), 974–996 (2004)CrossRef A. Pınar, C. Aykanat, Fast optimal load balancing algorithms for 1D partitioning. J. Parallel Distrib. Comput. 64(8), 974–996 (2004)CrossRef
23.
go back to reference M. Rohde et al., A generic, mass conservative local grid refinement technique for lattice-Boltzmann schemes. Int. J. Numer. Methods Fluids 51(4), 439–468 (2006)MathSciNetCrossRef M. Rohde et al., A generic, mass conservative local grid refinement technique for lattice-Boltzmann schemes. Int. J. Numer. Methods Fluids 51(4), 439–468 (2006)MathSciNetCrossRef
24.
go back to reference U.D. Schiller, Thermal fluctuations and boundary conditions in the lattice Boltzmann method. PhD thesis. Johannes Gutenberg-Universität, Mainz, 2008 U.D. Schiller, Thermal fluctuations and boundary conditions in the lattice Boltzmann method. PhD thesis. Johannes Gutenberg-Universität, Mainz, 2008
25.
go back to reference C. Schober et al., Simulating the interaction of electrostatically charged particles in the inflow area of cabin air filters using a fully coupled system, in Coupled Problems in Science and Engineering VII, ed. by M. Papadrakakis et al. (2017) C. Schober et al., Simulating the interaction of electrostatically charged particles in the inflow area of cabin air filters using a fully coupled system, in Coupled Problems in Science and Engineering VII, ed. by M. Papadrakakis et al. (2017)
26.
go back to reference F. Schornbaum, U. Rüde, Massively parallel algorithms for the lattice Boltzmann method on nonuniform grids. SIAM J. Sci. Comput. 38(2), C96–C126 (2016)MathSciNetCrossRef F. Schornbaum, U. Rüde, Massively parallel algorithms for the lattice Boltzmann method on nonuniform grids. SIAM J. Sci. Comput. 38(2), C96–C126 (2016)MathSciNetCrossRef
27.
go back to reference I. Tischler, Implementing adaptive electrokinetics in ESPResSo. MA thesis. University of Stuttgart, Germany (2018) I. Tischler, Implementing adaptive electrokinetics in ESPResSo. MA thesis. University of Stuttgart, Germany (2018)
28.
go back to reference C. Xiaolin, M. Zeyao, A new scalable parallel method for molecular dynamics based on cell-block data structure, in Parallel and Distributed Processing and Applications, ed. by J. Cao et al., vol. 3358. Lecture Notes in Computer Science (Springer, Berlin, 2005), pp. 757–764 C. Xiaolin, M. Zeyao, A new scalable parallel method for molecular dynamics based on cell-block data structure, in Parallel and Distributed Processing and Applications, ed. by J. Cao et al., vol. 3358. Lecture Notes in Computer Science (Springer, Berlin, 2005), pp. 757–764
Metadata
Title
Load-Balancing and Spatial Adaptivity for Coarse-Grained Molecular Dynamics Applications
Authors
Steffen Hirschmann
Michael Lahnert
Carolin Schober
Malte Brunn
Miriam Mehl
Dirk Pflüger
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-13325-2_26

Premium Partner