Skip to main content
Erschienen in:
Buchtitelbild

2019 | OriginalPaper | Buchkapitel

Efficient Computation of Sparse Higher Derivative Tensors

verfasst von : Jens Deussen, Uwe Naumann

Erschienen in: Computational Science – ICCS 2019

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The computation of higher derivatives tensors is expensive even for adjoint algorithmic differentiation methods. In this work we introduce methods to exploit the symmetry and the sparsity structure of higher derivatives to considerably improve the efficiency of their computation. The proposed methods apply coloring algorithms to two-dimensional compressed slices of the derivative tensors. The presented work is a step towards feasibility of higher-order methods which might benefit numerical simulations in numerous applications of computational science and engineering.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Griewank, A., Walther, A.: Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation. SIAM (2008) Griewank, A., Walther, A.: Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation. SIAM (2008)
2.
Zurück zum Zitat Naumann, U.: The Art of Differentiating Computer Programs: An Introduction to Algorithmic Differentiation, SE24 in Software, Environments and Tools. SIAM (2012) Naumann, U.: The Art of Differentiating Computer Programs: An Introduction to Algorithmic Differentiation, SE24 in Software, Environments and Tools. SIAM (2012)
3.
Zurück zum Zitat Gundersen, G., Steihaug, T.: Sparsity in higher order methods for unconstrained optimization. Optim. Methods Softw. 27, 275–294 (2012)MathSciNetCrossRef Gundersen, G., Steihaug, T.: Sparsity in higher order methods for unconstrained optimization. Optim. Methods Softw. 27, 275–294 (2012)MathSciNetCrossRef
4.
Zurück zum Zitat Ederington, L.H., Guan, W.: Higher order greeks. J. Deriv. 14, 7–34 (2007)CrossRef Ederington, L.H., Guan, W.: Higher order greeks. J. Deriv. 14, 7–34 (2007)CrossRef
5.
Zurück zum Zitat Smith, R.C.: Uncertainty Quantification: Theory, Implementation, and Applications. SIAM (2013) Smith, R.C.: Uncertainty Quantification: Theory, Implementation, and Applications. SIAM (2013)
6.
7.
Zurück zum Zitat Putko, M.M., Taylor, A.C., Newman, P.A., Green, L.L.: Approach for input uncertainty propagation and robust design in CFD using sensitivity derivatives. J. Fluids Eng. 124, 60–69 (2002)CrossRef Putko, M.M., Taylor, A.C., Newman, P.A., Green, L.L.: Approach for input uncertainty propagation and robust design in CFD using sensitivity derivatives. J. Fluids Eng. 124, 60–69 (2002)CrossRef
8.
Zurück zum Zitat Griewank, A., Utke, J., Walther, A.: Evaluating higher derivative tensors by forward propagation of univariate Taylor series. Math. Comput. 69, 1117–1130 (2000)MathSciNetCrossRef Griewank, A., Utke, J., Walther, A.: Evaluating higher derivative tensors by forward propagation of univariate Taylor series. Math. Comput. 69, 1117–1130 (2000)MathSciNetCrossRef
9.
Zurück zum Zitat Gower, R.M., Gower, A.L.: Higher-order reverse automatic differentiation with emphasis on the third-order. Math. Program. 155, 81–103 (2016)MathSciNetCrossRef Gower, R.M., Gower, A.L.: Higher-order reverse automatic differentiation with emphasis on the third-order. Math. Program. 155, 81–103 (2016)MathSciNetCrossRef
10.
Zurück zum Zitat Jones, M.T., Plassmann, P.E.: Scalable iterative solution of sparse linear systems. Parallel Comput. 20, 753–773 (1994)MathSciNetCrossRef Jones, M.T., Plassmann, P.E.: Scalable iterative solution of sparse linear systems. Parallel Comput. 20, 753–773 (1994)MathSciNetCrossRef
11.
Zurück zum Zitat Gebremedhin, A.H., Manne, F., Pothen, A.: What color is your Jacobian? Graph coloring for computing derivatives. SIAM Rev. 47, 629–705 (2005)MathSciNetCrossRef Gebremedhin, A.H., Manne, F., Pothen, A.: What color is your Jacobian? Graph coloring for computing derivatives. SIAM Rev. 47, 629–705 (2005)MathSciNetCrossRef
13.
Zurück zum Zitat Hascoët, L., Naumann, U., Pascual, V.: “To be recorded” analysis in reverse-mode automatic differentiation. FGCS 21, 1401–1417 (2005)CrossRef Hascoët, L., Naumann, U., Pascual, V.: “To be recorded” analysis in reverse-mode automatic differentiation. FGCS 21, 1401–1417 (2005)CrossRef
14.
Zurück zum Zitat Coleman, T.F., Moré, J.J.: Estimation of sparse Hessian matrices and graph coloring problems. Math. Program. 28, 243–270 (1984)MathSciNetCrossRef Coleman, T.F., Moré, J.J.: Estimation of sparse Hessian matrices and graph coloring problems. Math. Program. 28, 243–270 (1984)MathSciNetCrossRef
15.
Zurück zum Zitat Coleman, T.F., Cai, J.-Y.: The cyclic coloring problem and estimation of sparse Hessian matrices. SIAM J. Algebraic Discrete Methods 7, 221–235 (1986)MathSciNetCrossRef Coleman, T.F., Cai, J.-Y.: The cyclic coloring problem and estimation of sparse Hessian matrices. SIAM J. Algebraic Discrete Methods 7, 221–235 (1986)MathSciNetCrossRef
16.
Zurück zum Zitat Gay, D.M.: More AD of nonlinear AMPL models: computing Hessian information and exploiting partial separability. In: Computational Differentiation: Applications, Techniques, and Tools, pp. 173–184. SIAM (1996) Gay, D.M.: More AD of nonlinear AMPL models: computing Hessian information and exploiting partial separability. In: Computational Differentiation: Applications, Techniques, and Tools, pp. 173–184. SIAM (1996)
17.
Zurück zum Zitat Gower, R.M., Mello, M.P.: Computing the sparsity pattern of Hessians using automatic differentiation. ACM TOMS 40, 10:1–10:15 (2014)MathSciNetCrossRef Gower, R.M., Mello, M.P.: Computing the sparsity pattern of Hessians using automatic differentiation. ACM TOMS 40, 10:1–10:15 (2014)MathSciNetCrossRef
18.
Zurück zum Zitat Gebremedhin, A.H., Nguyen, D., Patwary, M.M.A., Pothen, A.: ColPack: software for graph coloring and related problems in scientific computing. ACM TOMS 40, 1:1–1:31 (2013)MathSciNetCrossRef Gebremedhin, A.H., Nguyen, D., Patwary, M.M.A., Pothen, A.: ColPack: software for graph coloring and related problems in scientific computing. ACM TOMS 40, 1:1–1:31 (2013)MathSciNetCrossRef
Metadaten
Titel
Efficient Computation of Sparse Higher Derivative Tensors
verfasst von
Jens Deussen
Uwe Naumann
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-22734-0_1

Premium Partner