Skip to main content
Erschienen in: Engineering with Computers 4/2017

24.03.2017 | Original Article

GPUs in subsurface simulation: an investigation

verfasst von: Rajeev Das

Erschienen in: Engineering with Computers | Ausgabe 4/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Subsurface simulations are computationally intensive tasks and require a considerable amount of time to solve. To gain computational speed in simulating subsurface scenarios, this paper investigates the use of graphical processing units (GPUs). Accelerators such as GPUs have a different architecture compared to the conventional central processing units, which necessitates a distinct approach. Various techniques that are well suited to deal with GPUs and simulating subsurface phenomena are explored with an emphasis on groundwater flow problems. Finite volume method with implicit time steps to solve groundwater scenarios is discussed and the associated challenges are highlighted. Krylov solvers used in large-scale systems along with preconditioners to improve convergence are described in detail. An appropriate solver preconditioner pair that provides speedup is identified to solve groundwater flow scenarios. The role of matrix storage formats is examined in a GPU environment, and recommendations that could further improve performance are made. This paper concludes by presenting simulation results that test the ideas explored on different generations of NVIDIA GPUs and the speedup attained in them.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Keyes DE et al (2013) Multiphysics simulations Challenges and opportunities. Int J High Perform C 27(1):4–83CrossRef Keyes DE et al (2013) Multiphysics simulations Challenges and opportunities. Int J High Perform C 27(1):4–83CrossRef
2.
Zurück zum Zitat Barry DA (1990) Supercomputers and their use in modeling subsurface solute transport. Rev Geophys 28(3):277–295CrossRef Barry DA (1990) Supercomputers and their use in modeling subsurface solute transport. Rev Geophys 28(3):277–295CrossRef
3.
4.
Zurück zum Zitat Steefel CI, DePaolo DJ, Lichtner PC (2005) Reactive transport modeling: an essential tool and a new research approach for the Earth sciences. Earth Planet Sci Lett 240(3):539–558CrossRef Steefel CI, DePaolo DJ, Lichtner PC (2005) Reactive transport modeling: an essential tool and a new research approach for the Earth sciences. Earth Planet Sci Lett 240(3):539–558CrossRef
5.
Zurück zum Zitat Xing H (2009) Advances in geocomputing. Springer, Berlin Xing H (2009) Advances in geocomputing. Springer, Berlin
6.
Zurück zum Zitat Kirk DB, Wen-mei WH (2012) Programming massively parallel processors: a hands-on approach. Elsevier, San Francisco Kirk DB, Wen-mei WH (2012) Programming massively parallel processors: a hands-on approach. Elsevier, San Francisco
7.
Zurück zum Zitat Jeffers J, Reinders J (2013) Intel Xeon Phi coprocessor high-performance programming. Elsevier, San Francisco Jeffers J, Reinders J (2013) Intel Xeon Phi coprocessor high-performance programming. Elsevier, San Francisco
8.
Zurück zum Zitat Li R, Saad Y (2013) GPU-accelerated preconditioned iterative linear solvers. J Supercomput 63(2):443–466CrossRef Li R, Saad Y (2013) GPU-accelerated preconditioned iterative linear solvers. J Supercomput 63(2):443–466CrossRef
9.
Zurück zum Zitat Bear J (1972) Dynamics of fluids in porous media. American Elsevier, New YorkMATH Bear J (1972) Dynamics of fluids in porous media. American Elsevier, New YorkMATH
10.
Zurück zum Zitat Anderson MP, Woessner WW (1992) Applied groundwater modeling: simulation of flow and advective transport. Academic Press, San Diego Anderson MP, Woessner WW (1992) Applied groundwater modeling: simulation of flow and advective transport. Academic Press, San Diego
11.
Zurück zum Zitat Huyakorn PS, Pinder GF (1983) Computational methods in subsurface flow. Academic Press, San DiegoMATH Huyakorn PS, Pinder GF (1983) Computational methods in subsurface flow. Academic Press, San DiegoMATH
12.
Zurück zum Zitat Bear J, Verruijt A (1987) Modeling groundwater flow and pollution. Kluwer Academic Publishers, Dordrecht Bear J, Verruijt A (1987) Modeling groundwater flow and pollution. Kluwer Academic Publishers, Dordrecht
13.
Zurück zum Zitat Jasak H (1996) Error analysis and estimation for the finite volume method with applications to fluid flows, PhD dissertation. Imperial College of Science, Technology and Medicine, London Jasak H (1996) Error analysis and estimation for the finite volume method with applications to fluid flows, PhD dissertation. Imperial College of Science, Technology and Medicine, London
14.
Zurück zum Zitat Batu V (2005) Applied flow and solute transport modeling in aquifers: fundamental principles and analytical and numerical methods. CRC Press, Boca RatonCrossRef Batu V (2005) Applied flow and solute transport modeling in aquifers: fundamental principles and analytical and numerical methods. CRC Press, Boca RatonCrossRef
15.
Zurück zum Zitat Aziz K, Settari A (1979) Petroleum Reservoir Simulation. Applied Science Publishers Ltd, London Aziz K, Settari A (1979) Petroleum Reservoir Simulation. Applied Science Publishers Ltd, London
16.
Zurück zum Zitat Kelley CT (1987) Iterative methods for linear and nonlinear equations. SIAM, PhiladelphiaMATH Kelley CT (1987) Iterative methods for linear and nonlinear equations. SIAM, PhiladelphiaMATH
17.
18.
Zurück zum Zitat Van der Vorst HA (2003). Iterative Krylov methods for large linear systems. Cambridge University Press, CambridgeCrossRefMATH Van der Vorst HA (2003). Iterative Krylov methods for large linear systems. Cambridge University Press, CambridgeCrossRefMATH
19.
Zurück zum Zitat Barrett R, Berry MW, Chan TF, Demmel J, Donato J, Dongarra J, Eijkhout V, Pozo R, Romine C, Van der Vorst H (1994) Templates for the solution of linear systems: building blocks for iterative methods. SIAM, PhiladelphiaCrossRefMATH Barrett R, Berry MW, Chan TF, Demmel J, Donato J, Dongarra J, Eijkhout V, Pozo R, Romine C, Van der Vorst H (1994) Templates for the solution of linear systems: building blocks for iterative methods. SIAM, PhiladelphiaCrossRefMATH
20.
Zurück zum Zitat Liesen J, Strakos Z (2012) Krylov subspace methods: principles and analysis. Oxford University Press, OxfordCrossRefMATH Liesen J, Strakos Z (2012) Krylov subspace methods: principles and analysis. Oxford University Press, OxfordCrossRefMATH
21.
Zurück zum Zitat Knoll DA, Keyes DE (2004) Jacobian-free Newton–Krylov methods: a survey of approaches and applications. J Comput Phys 193(2):357–397MathSciNetCrossRefMATH Knoll DA, Keyes DE (2004) Jacobian-free Newton–Krylov methods: a survey of approaches and applications. J Comput Phys 193(2):357–397MathSciNetCrossRefMATH
22.
Zurück zum Zitat Hoemmen M (2010) Communication-avoiding Krylov subspace methods, PhD dissertation. University of California, Berkeley Hoemmen M (2010) Communication-avoiding Krylov subspace methods, PhD dissertation. University of California, Berkeley
24.
Zurück zum Zitat Chen TY (2001) Preconditioning sparse matrices for computing eigenvalues and solving linear systems of equations, PhD dissertation. University of California, Berkeley Chen TY (2001) Preconditioning sparse matrices for computing eigenvalues and solving linear systems of equations, PhD dissertation. University of California, Berkeley
25.
Zurück zum Zitat Bell N, Garland M (2009) Implementing sparse matrix-vector multiplication on throughput-oriented processors. In: Proceedings of the conference on high performance computing networking, storage and analysis, ACM Bell N, Garland M (2009) Implementing sparse matrix-vector multiplication on throughput-oriented processors. In: Proceedings of the conference on high performance computing networking, storage and analysis, ACM
26.
Zurück zum Zitat Bell N, Garland M (2008) Efficient sparse matrix-vector multiplication on CUDA 2(5). Nvidia Technical Report NVR-2008-004, Nvidia Corporation Bell N, Garland M (2008) Efficient sparse matrix-vector multiplication on CUDA 2(5). Nvidia Technical Report NVR-2008-004, Nvidia Corporation
27.
Zurück zum Zitat Lichtner P, et al (2015) PFLOTRAN user manual: a massively parallel reactive flow and transport model for describing surface and subsurface processes. No. LA-UR-15-20403. Los Alamos National Laboratory (LANL) Lichtner P, et al (2015) PFLOTRAN user manual: a massively parallel reactive flow and transport model for describing surface and subsurface processes. No. LA-UR-15-20403. Los Alamos National Laboratory (LANL)
28.
Zurück zum Zitat Balay S, Abhyankar S, Adams M, Brown J, Brune P, Buschelman K, Eijkhout V, Gropp W, Kaushik D, Knepley M, McInnes LC (2014) Petsc users manual revision 3.5. Technical report. Argonne National Laboratory (ANL) Balay S, Abhyankar S, Adams M, Brown J, Brune P, Buschelman K, Eijkhout V, Gropp W, Kaushik D, Knepley M, McInnes LC (2014) Petsc users manual revision 3.5. Technical report. Argonne National Laboratory (ANL)
29.
Zurück zum Zitat Smith B, Bjorstad P, Gropp W (2004) Domain decomposition: parallel multilevel methods for elliptic partial differential equations. Cambridge University Press, CambridgeMATH Smith B, Bjorstad P, Gropp W (2004) Domain decomposition: parallel multilevel methods for elliptic partial differential equations. Cambridge University Press, CambridgeMATH
30.
Zurück zum Zitat Hammond GE, Lichtner PC (2010) Field-scale model for the natural attenuation of uranium at the Hanford 300 Area using high-performance computing. Water Resour Res 46(9):1–31CrossRef Hammond GE, Lichtner PC (2010) Field-scale model for the natural attenuation of uranium at the Hanford 300 Area using high-performance computing. Water Resour Res 46(9):1–31CrossRef
31.
Zurück zum Zitat Hammond GE, Lichtner PC, Mills RT (2014) Evaluating the performance of parallel subsurface simulators: An illustrative example with PFLOTRAN. Water Resour Res 50(1):208–228CrossRef Hammond GE, Lichtner PC, Mills RT (2014) Evaluating the performance of parallel subsurface simulators: An illustrative example with PFLOTRAN. Water Resour Res 50(1):208–228CrossRef
32.
Zurück zum Zitat Mualem Y (1976) A new model for predicting the hydraulic conductivity of unsaturated porous media. Water Resour Res 12(3):513–522CrossRef Mualem Y (1976) A new model for predicting the hydraulic conductivity of unsaturated porous media. Water Resour Res 12(3):513–522CrossRef
33.
Zurück zum Zitat Van Genuchten MT (1980) A closed-form equation for predicting the hydraulic conductivity of unsaturated soils. Soil Sci Soc Am J 44(5):892–898CrossRef Van Genuchten MT (1980) A closed-form equation for predicting the hydraulic conductivity of unsaturated soils. Soil Sci Soc Am J 44(5):892–898CrossRef
34.
Zurück zum Zitat Schaap MG, Van Genuchten MT (2006) A modified Mualem–van Genuchten formulation for improved description of the hydraulic conductivity near saturation. Vadose Zone J 5(1):27–34CrossRef Schaap MG, Van Genuchten MT (2006) A modified Mualem–van Genuchten formulation for improved description of the hydraulic conductivity near saturation. Vadose Zone J 5(1):27–34CrossRef
35.
Zurück zum Zitat Peiró J and Sherwin S (2005) Finite difference, finite element and finite volume methods for partial differential equations. Handbook of materials modeling. Springer Netherlands, pp 2415–2446 Peiró J and Sherwin S (2005) Finite difference, finite element and finite volume methods for partial differential equations. Handbook of materials modeling. Springer Netherlands, pp 2415–2446
36.
Zurück zum Zitat Pinder GF, Gray WG (1977) Finite element simulation in surface and subsurface hydrology. Academic Press, New York Pinder GF, Gray WG (1977) Finite element simulation in surface and subsurface hydrology. Academic Press, New York
37.
Zurück zum Zitat Archer RA (2000) Computing flow and pressure transients in heterogeneous media using boundary element methods, PhD dissertation. Stanford University Archer RA (2000) Computing flow and pressure transients in heterogeneous media using boundary element methods, PhD dissertation. Stanford University
38.
Zurück zum Zitat Brebbia CA (1980) The boundary element method for engineers, 2nd edn. Pentech Press, London Brebbia CA (1980) The boundary element method for engineers, 2nd edn. Pentech Press, London
39.
Zurück zum Zitat Bajaj R (2009) An unstructured finite volume simulator for multiphase flow through fractured-porous media, MS dissertation. Massachusetts Institute of Technology Bajaj R (2009) An unstructured finite volume simulator for multiphase flow through fractured-porous media, MS dissertation. Massachusetts Institute of Technology
40.
Zurück zum Zitat Schäfer M (2006) Computational engineering-introduction to numerical methods. Springer, New York Schäfer M (2006) Computational engineering-introduction to numerical methods. Springer, New York
42.
Zurück zum Zitat Falgout RD (2006) An introduction to algebraic multigrid computing. Comput Sci Eng 8(6): 24–33CrossRef Falgout RD (2006) An introduction to algebraic multigrid computing. Comput Sci Eng 8(6): 24–33CrossRef
43.
Zurück zum Zitat Wu CT, Elman HC (2006) Analysis and comparison of geometric and algebraic multigrid for convection-diffusion equations. SIAM J Sci Comput 28(6):2208–2228MathSciNetCrossRefMATH Wu CT, Elman HC (2006) Analysis and comparison of geometric and algebraic multigrid for convection-diffusion equations. SIAM J Sci Comput 28(6):2208–2228MathSciNetCrossRefMATH
45.
Zurück zum Zitat Baskaran MM, Bordawekar R (2008) Optimizing sparse matrix-vector multiplication on GPUs using compile-time and run-time strategies. IBM Reserach Report, RC24704 (W0812-047) Baskaran MM, Bordawekar R (2008) Optimizing sparse matrix-vector multiplication on GPUs using compile-time and run-time strategies. IBM Reserach Report, RC24704 (W0812-047)
46.
Zurück zum Zitat Anzt H, Tomov S, Luszczek P, Sawyer W, Dongarra J (2015) Acceleration of GPU-based Krylov solvers via data transfer reduction. Int J High Perform C 29(3):366–383CrossRef Anzt H, Tomov S, Luszczek P, Sawyer W, Dongarra J (2015) Acceleration of GPU-based Krylov solvers via data transfer reduction. Int J High Perform C 29(3):366–383CrossRef
47.
Zurück zum Zitat Mei X, Chu X (2015) Dissecting GPU memory hierarchy through microbenchmarking. arXiv preprint arXiv:1509.02308 Mei X, Chu X (2015) Dissecting GPU memory hierarchy through microbenchmarking. arXiv preprint arXiv:1509.02308
49.
Zurück zum Zitat Bell N, Hoberock J (2011) Thrust: a productivity-oriented library for CUDA. GPU computing Gems Jade Edition 1st edn. Morgan Kaufmann Publishers Inc. San Francisco Bell N, Hoberock J (2011) Thrust: a productivity-oriented library for CUDA. GPU computing Gems Jade Edition 1st edn. Morgan Kaufmann Publishers Inc. San Francisco
51.
Zurück zum Zitat Yan S, Li C, Zhang Y, Zhou H (2014) yaSpMV: yet another SpMV framework on GPUs.ACM Sigplan Notices 49(8):107–118CrossRef Yan S, Li C, Zhang Y, Zhou H (2014) yaSpMV: yet another SpMV framework on GPUs.ACM Sigplan Notices 49(8):107–118CrossRef
52.
Zurück zum Zitat Brezina M, Falgout R, MacLachlan S, Manteuffel T, McCormick S, Ruge J (2005) Adaptive smoothed aggregation (α SA) multigrid. SIAM Rev 47(2):317–346MathSciNetCrossRefMATH Brezina M, Falgout R, MacLachlan S, Manteuffel T, McCormick S, Ruge J (2005) Adaptive smoothed aggregation (α SA) multigrid. SIAM Rev 47(2):317–346MathSciNetCrossRefMATH
53.
Zurück zum Zitat Demidov D, Ahnert K, Rupp K, Gottschling P (2013) Programming CUDA and OpenCL: a case study using modern C++ libraries. SIAM J Sci Comput 35(5):C453–C472MathSciNetCrossRefMATH Demidov D, Ahnert K, Rupp K, Gottschling P (2013) Programming CUDA and OpenCL: a case study using modern C++ libraries. SIAM J Sci Comput 35(5):C453–C472MathSciNetCrossRefMATH
Metadaten
Titel
GPUs in subsurface simulation: an investigation
verfasst von
Rajeev Das
Publikationsdatum
24.03.2017
Verlag
Springer London
Erschienen in
Engineering with Computers / Ausgabe 4/2017
Print ISSN: 0177-0667
Elektronische ISSN: 1435-5663
DOI
https://doi.org/10.1007/s00366-017-0506-1

Weitere Artikel der Ausgabe 4/2017

Engineering with Computers 4/2017 Zur Ausgabe

Neuer Inhalt