Skip to main content
Top
Published in: Journal of Scientific Computing 2/2014

01-11-2014

Parallel Domain Decomposition Methods with Mixed Order Discretization for Fully Implicit Solution of Tracer Transport Problems on the Cubed-Sphere

Authors: Haijian Yang, Chao Yang, Xiao-Chuan Cai

Published in: Journal of Scientific Computing | Issue 2/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, a fully implicit finite volume Eulerian scheme and a corresponding scalable parallel solver are developed for some tracer transport problems on the cubed-sphere. To efficiently solve the large sparse linear system at each time step on parallel computers, we introduce a Schwarz preconditioned Krylov subspace method using two discretizations. More precisely speaking, the higher order method is used for the residual calculation and the lower order method is used for the construction of the preconditioner. The matrices from the two discretizations have similar sparsity pattern and eigenvalue distributions, but the matrix from the lower order method is a lot sparser, as a result, excellent scalability results (in total computing time and the number of iterations) are obtained. Even though Schwarz preconditioner is originally designed for elliptic problems, our experiments indicate clearly that the method scales well for this class of purely hyperbolic problems. In addition, we show numerically that the proposed method is highly scalable in terms of both strong and weak scalabilities on a supercomputer with thousands of processors.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Balay, S., Buschelman, K., Gropp, W.D., Kaushik, D., Knepley, M., McInnes, L.C., Smith, B.F., Zhang, H.: PETSc Users Manual. Argonne National Laboratory (2012) Balay, S., Buschelman, K., Gropp, W.D., Kaushik, D., Knepley, M., McInnes, L.C., Smith, B.F., Zhang, H.: PETSc Users Manual. Argonne National Laboratory (2012)
2.
go back to reference Brown, P.N., Shumaker, D.E., Woodward, C.S.: Fully implicit solution of large-scale non-equilibrium radiation diffusion with high order time integration. J. Comput. Phys. 204, 760–783 (2005)MathSciNetCrossRefMATH Brown, P.N., Shumaker, D.E., Woodward, C.S.: Fully implicit solution of large-scale non-equilibrium radiation diffusion with high order time integration. J. Comput. Phys. 204, 760–783 (2005)MathSciNetCrossRefMATH
3.
go back to reference Cai, X.-C., Gropp, W.D., Keyes, D.E., Melvin, R.G., Young, D.P.: Parallel Newton-Krylov-Schwarz algorithms for the transonic full potential equation. SIAM J. Sci. Comput. 19, 246–265 (1998)MathSciNetCrossRefMATH Cai, X.-C., Gropp, W.D., Keyes, D.E., Melvin, R.G., Young, D.P.: Parallel Newton-Krylov-Schwarz algorithms for the transonic full potential equation. SIAM J. Sci. Comput. 19, 246–265 (1998)MathSciNetCrossRefMATH
4.
go back to reference Cai, X.-C., Sarkis, M.: A restricted additive Schwarz preconditioner for general sparse linear systems. SIAM J. Sci. Comput. 21, 792–797 (1999)MathSciNetCrossRefMATH Cai, X.-C., Sarkis, M.: A restricted additive Schwarz preconditioner for general sparse linear systems. SIAM J. Sci. Comput. 21, 792–797 (1999)MathSciNetCrossRefMATH
5.
go back to reference Chen, C., Xiao, F.: Shallow water model on cubed-sphere by multi-moment finite volume method. J. Comput. Phys. 227, 5019–5044 (2008)MathSciNetCrossRefMATH Chen, C., Xiao, F.: Shallow water model on cubed-sphere by multi-moment finite volume method. J. Comput. Phys. 227, 5019–5044 (2008)MathSciNetCrossRefMATH
6.
go back to reference Evans, K.J., Knoll, D.A.: Temporal accuracy of phase change convection simulations using the JFNK-SIMPLE algorithm. Int. J. Num. Meth. Fluids. 55, 637–655 (2007)CrossRefMATH Evans, K.J., Knoll, D.A.: Temporal accuracy of phase change convection simulations using the JFNK-SIMPLE algorithm. Int. J. Num. Meth. Fluids. 55, 637–655 (2007)CrossRefMATH
7.
go back to reference Erath, C., Lauritzen, P.H., Garcia, J.H., Tufo, H.M.: Integrating a scalable and efficient semi-Lagrangian multi-tracer transport scheme in HOMME. Proc. Comput. Sci. 9, 994–1003 (2012)CrossRef Erath, C., Lauritzen, P.H., Garcia, J.H., Tufo, H.M.: Integrating a scalable and efficient semi-Lagrangian multi-tracer transport scheme in HOMME. Proc. Comput. Sci. 9, 994–1003 (2012)CrossRef
8.
go back to reference Harris, L.M., Lauritzen, P.H., Mittal, R.: A flux-form version of the conservative semi-Lagrangian multi-tracer transport scheme (CSLAM) on the cubed-sphere grid. J. Comput. Phys. 230, 1215–1237 (2011)MathSciNetCrossRefMATH Harris, L.M., Lauritzen, P.H., Mittal, R.: A flux-form version of the conservative semi-Lagrangian multi-tracer transport scheme (CSLAM) on the cubed-sphere grid. J. Comput. Phys. 230, 1215–1237 (2011)MathSciNetCrossRefMATH
9.
go back to reference Jacobson, M.Z.: Fundamentals of Atmospheric Modeling. Cambridge University Press, New York (1999) Jacobson, M.Z.: Fundamentals of Atmospheric Modeling. Cambridge University Press, New York (1999)
10.
go back to reference Knoll, D.A., Chacon, L., Margolin, L.G., Mousseau, V.A.: On balanced approximations for time integration of multiple time scale systems. J. Comput. Phys. 185, 583–611 (2003)CrossRefMATH Knoll, D.A., Chacon, L., Margolin, L.G., Mousseau, V.A.: On balanced approximations for time integration of multiple time scale systems. J. Comput. Phys. 185, 583–611 (2003)CrossRefMATH
11.
go back to reference Lauritzen, P.H., Nair, R.D., Ullrich, P.A.: A conservative semi-Lagrangian multi-tracer transport scheme (CSLAM) on the cubed-sphere grid. J. Comput. Phys. 229, 1401–1424 (2010)MathSciNetCrossRefMATH Lauritzen, P.H., Nair, R.D., Ullrich, P.A.: A conservative semi-Lagrangian multi-tracer transport scheme (CSLAM) on the cubed-sphere grid. J. Comput. Phys. 229, 1401–1424 (2010)MathSciNetCrossRefMATH
12.
go back to reference Lauritzen, P.H., Skamarock, W.C.: Test-case suite for 2D passive tracer transport: a proposal for the NCAR transport workshop. March (2011) Lauritzen, P.H., Skamarock, W.C.: Test-case suite for 2D passive tracer transport: a proposal for the NCAR transport workshop. March (2011)
13.
go back to reference Lauritzen, P.H., Jablonowski, C., Taylor, M., Nair, R.: Numerical Techniques for Global Atmospheric Models. Lecture Notes in Computational Science and Engineering. Springer, Berlin (2011)CrossRef Lauritzen, P.H., Jablonowski, C., Taylor, M., Nair, R.: Numerical Techniques for Global Atmospheric Models. Lecture Notes in Computational Science and Engineering. Springer, Berlin (2011)CrossRef
14.
go back to reference Lauritzen, P.H., Ullrich, P.A., Nair, R.D.: Atmospheric transport schemes: desirable properties and a semi-Lagrangian view on finite-volume discretizations. In: Lecture Notes in Computational Science and Engineering (Tutorials), vol. 80, Springer, (2011) Lauritzen, P.H., Ullrich, P.A., Nair, R.D.: Atmospheric transport schemes: desirable properties and a semi-Lagrangian view on finite-volume discretizations. In: Lecture Notes in Computational Science and Engineering (Tutorials), vol. 80, Springer, (2011)
15.
go back to reference Lauritzen, P.H., Skamarock, W.C., Prather, M.J., Taylor, M.A.: A standard test case suite for two-dimensional linear transport on the sphere. Geosci. Model Dev. Discuss. 5, 189–228 (2012)CrossRef Lauritzen, P.H., Skamarock, W.C., Prather, M.J., Taylor, M.A.: A standard test case suite for two-dimensional linear transport on the sphere. Geosci. Model Dev. Discuss. 5, 189–228 (2012)CrossRef
16.
go back to reference Lauritzen, P.H., Thuburn, J.: Evaluating advection/transport schemes using interrelated tracers, scatter plots and numerical mixing diagnostics. Q. J. Roy. Meteor. Soc. 138, 906–918 (2012)CrossRef Lauritzen, P.H., Thuburn, J.: Evaluating advection/transport schemes using interrelated tracers, scatter plots and numerical mixing diagnostics. Q. J. Roy. Meteor. Soc. 138, 906–918 (2012)CrossRef
17.
go back to reference Nair, R.D., Thomas, S.J., Loft, R.D.: A discontinuous Galerkin global shallow water model. Mon. Weather Rev. 133, 876–888 (2005)CrossRef Nair, R.D., Thomas, S.J., Loft, R.D.: A discontinuous Galerkin global shallow water model. Mon. Weather Rev. 133, 876–888 (2005)CrossRef
18.
go back to reference Nair, R.D., Lauritzen, P.H.: A class of deformational-flow test cases for linear transport problems on the sphere. J. Comput. Phys. 229, 8868–8887 (2010)MathSciNetCrossRefMATH Nair, R.D., Lauritzen, P.H.: A class of deformational-flow test cases for linear transport problems on the sphere. J. Comput. Phys. 229, 8868–8887 (2010)MathSciNetCrossRefMATH
20.
go back to reference Rancic, M.R., Purser, J., Mesinger, F.: A global-shallow water model using an expanded spherical cube: Gnomonic versus conformal coordinates. Q. J. Roy. Meteor. Soc. 122, 959–982 (1996)CrossRef Rancic, M.R., Purser, J., Mesinger, F.: A global-shallow water model using an expanded spherical cube: Gnomonic versus conformal coordinates. Q. J. Roy. Meteor. Soc. 122, 959–982 (1996)CrossRef
21.
go back to reference Ronchi, C., Iacono, R., Paolucci, P.: The cubed sphere: a new method for the solution of partial differential equations in spherical geometry. J. Comput. Phys. 124, 93–114 (1996)MathSciNetCrossRefMATH Ronchi, C., Iacono, R., Paolucci, P.: The cubed sphere: a new method for the solution of partial differential equations in spherical geometry. J. Comput. Phys. 124, 93–114 (1996)MathSciNetCrossRefMATH
22.
go back to reference Sadourny, R., Arakawa, A., Mintz, Y.: Integration of the nondivergent barotropic vorticity equation with an icosahedralhexagonal grid for the sphere. Mon. Weather Rev. 96, 351–356 (1968)CrossRef Sadourny, R., Arakawa, A., Mintz, Y.: Integration of the nondivergent barotropic vorticity equation with an icosahedralhexagonal grid for the sphere. Mon. Weather Rev. 96, 351–356 (1968)CrossRef
23.
go back to reference Sadourny, R.: Conservative finite-difference approximations of the primitive equations on quasi-uniform spherical grids. Mon. Weather Rev. 100, 211–224 (1972)CrossRef Sadourny, R.: Conservative finite-difference approximations of the primitive equations on quasi-uniform spherical grids. Mon. Weather Rev. 100, 211–224 (1972)CrossRef
24.
25.
go back to reference Shadid, J.N., Tuminaro, R.S., Devine, K.D., Hennigan, G.L., Lin, P.T.: Performance of fully coupled domain decomposition preconditioners for finite element transport/reaction simulations. J. Comput. Phys. 205, 24–47 (2005)MathSciNetCrossRefMATH Shadid, J.N., Tuminaro, R.S., Devine, K.D., Hennigan, G.L., Lin, P.T.: Performance of fully coupled domain decomposition preconditioners for finite element transport/reaction simulations. J. Comput. Phys. 205, 24–47 (2005)MathSciNetCrossRefMATH
26.
go back to reference Smith, B., Bjørstad, P., Gropp, W.: Domain Decomposition: Parallel Multilevel Methods for Elliptic Partial Differential Equations. Cambridge University Press, Cambridge (1996)MATH Smith, B., Bjørstad, P., Gropp, W.: Domain Decomposition: Parallel Multilevel Methods for Elliptic Partial Differential Equations. Cambridge University Press, Cambridge (1996)MATH
27.
go back to reference Toselli, A., Widlund, O.: Domain Decomposition Methods-Algorithms and Theory. Springer, Berlin (2005)MATH Toselli, A., Widlund, O.: Domain Decomposition Methods-Algorithms and Theory. Springer, Berlin (2005)MATH
28.
go back to reference Van Albada, G.D., van Leer, B., Roberts, W.W.: A comparative study of computational methods in cosmic gas dynamics. Astron. Astrophys. 108, 95–103 (1982) Van Albada, G.D., van Leer, B., Roberts, W.W.: A comparative study of computational methods in cosmic gas dynamics. Astron. Astrophys. 108, 95–103 (1982)
29.
go back to reference White III, J.B., Dongarra, J.J.: High-performance high-resolution semi-Lagrangian tracer transport on a sphere. J. Comput. Phys. 230, 6778–6799 (2011)CrossRefMATH White III, J.B., Dongarra, J.J.: High-performance high-resolution semi-Lagrangian tracer transport on a sphere. J. Comput. Phys. 230, 6778–6799 (2011)CrossRefMATH
30.
go back to reference Williamson, D.L., Drake, J.B., Hack, J.J., Jakob, R., Swarztrauber, P.N.: A standard test set for numerical approximations to the shallow water equations in spherical geometry. J. Comput. Phys. 102, 211–224 (1992)MathSciNetCrossRefMATH Williamson, D.L., Drake, J.B., Hack, J.J., Jakob, R., Swarztrauber, P.N.: A standard test set for numerical approximations to the shallow water equations in spherical geometry. J. Comput. Phys. 102, 211–224 (1992)MathSciNetCrossRefMATH
31.
go back to reference Wu, Y., Cai, X.-C., Keyes, D.E.: Additive Schwarz methods for hyperbolic equations. In: Mandel, J., Farhat, C., Cai, X.-C. (eds.) Proceedings of the 10th International Conference on Domain Decomposition Methods, AMS, pp. 513–521 (1998) Wu, Y., Cai, X.-C., Keyes, D.E.: Additive Schwarz methods for hyperbolic equations. In: Mandel, J., Farhat, C., Cai, X.-C. (eds.) Proceedings of the 10th International Conference on Domain Decomposition Methods, AMS, pp. 513–521 (1998)
32.
go back to reference Yang, C., Cao, J., Cai, X.-C.: A fully implicit domain decomposition algorithm for shallow water equations on the cubed-sphere. SIAM J. Sci. Comput. 32, 418–438 (2010)MathSciNetCrossRefMATH Yang, C., Cao, J., Cai, X.-C.: A fully implicit domain decomposition algorithm for shallow water equations on the cubed-sphere. SIAM J. Sci. Comput. 32, 418–438 (2010)MathSciNetCrossRefMATH
33.
go back to reference Yang, C., Cai, X.-C.: Parallel multilevel methods for implicit solution of shallow water equations with nonsmooth topography on cubed-sphere. J. Comput. Phys. 230, 2523–2539 (2011)MathSciNetCrossRefMATH Yang, C., Cai, X.-C.: Parallel multilevel methods for implicit solution of shallow water equations with nonsmooth topography on cubed-sphere. J. Comput. Phys. 230, 2523–2539 (2011)MathSciNetCrossRefMATH
34.
go back to reference Yang, C., Cai, X.-C.: A scalable fully implicit compressible Euler solver for mesoscale nonhydrostatic simulation of atmospheric flows. SIAM J. Sci. Comput. To appear Yang, C., Cai, X.-C.: A scalable fully implicit compressible Euler solver for mesoscale nonhydrostatic simulation of atmospheric flows. SIAM J. Sci. Comput. To appear
35.
go back to reference Yang, H., Cai, X.-C.: Parallel two-grid semismooth Newton-Krylov-Schwarz method for nonlinear complementarity problems. J. Sci. Comput. 47, 258–280 (2011)MathSciNetCrossRefMATH Yang, H., Cai, X.-C.: Parallel two-grid semismooth Newton-Krylov-Schwarz method for nonlinear complementarity problems. J. Sci. Comput. 47, 258–280 (2011)MathSciNetCrossRefMATH
36.
go back to reference Yang, H., Prudencio, E., Cai, X.-C.: Fully implicit Lagrange-Newton-Krylov-Schwarz algorithms for boundary control of unsteady incompressible flows. Int. J. Numer. Meth. Eng. 91, 644–665 (2012)MathSciNetCrossRefMATH Yang, H., Prudencio, E., Cai, X.-C.: Fully implicit Lagrange-Newton-Krylov-Schwarz algorithms for boundary control of unsteady incompressible flows. Int. J. Numer. Meth. Eng. 91, 644–665 (2012)MathSciNetCrossRefMATH
37.
Metadata
Title
Parallel Domain Decomposition Methods with Mixed Order Discretization for Fully Implicit Solution of Tracer Transport Problems on the Cubed-Sphere
Authors
Haijian Yang
Chao Yang
Xiao-Chuan Cai
Publication date
01-11-2014
Publisher
Springer US
Published in
Journal of Scientific Computing / Issue 2/2014
Print ISSN: 0885-7474
Electronic ISSN: 1573-7691
DOI
https://doi.org/10.1007/s10915-014-9828-y

Other articles of this Issue 2/2014

Journal of Scientific Computing 2/2014 Go to the issue

Premium Partner