Skip to main content
Erschienen in: Optimization and Engineering 3/2022

01.09.2022 | Research Article

Effect of inexact adjoint solutions on the discrete-adjoint approach to gradient-based optimization

verfasst von: David A. Brown, Siva Nadarajah

Erschienen in: Optimization and Engineering | Ausgabe 3/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

New algorithms are developed to adapt the convergence tolerances for the constraint and adjoint equations for practical engineering optimization problems solved using the discrete adjoint approach. The algorithms are designed to achieve design order convergence of the optimization algorithm at reduced computational cost. We have found based on analysis and supported by numerical experimentation that adapting both the constraint and adjoint equation tolerances based on the norm of the gradient is sufficient to achieve design order convergence. We have also found that adapting the constraint equation tolerance is necessary, though we were not able to show analytically that adapting the adjoint equation tolerance is necessary. Based on the numerical experimentation, it appears that design order convergence can be achieved without adapting the adjoint equation in some cases but not others. The gain in computational efficiency using the new algorithms over using fixed tolerances is demonstrated through three numerical test problems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Bertsekas DP (1996) Constrained optimization and Lagrange multiplier methods. Athena Scientific, BelmontMATH Bertsekas DP (1996) Constrained optimization and Lagrange multiplier methods. Athena Scientific, BelmontMATH
Zurück zum Zitat Brown DA, Nadarajah S (2018) An adaptive constraint tolerance method for optimization algorithms based on the discrete adjoint method Brown DA, Nadarajah S (2018) An adaptive constraint tolerance method for optimization algorithms based on the discrete adjoint method
Zurück zum Zitat Brown DA, Nadarajah S (2018) Inexactly constrained discrete adjoint approach for steepest descent-based optimization algorithms. Numer Algorithms 78(2):983–1000MathSciNetCrossRef Brown DA, Nadarajah S (2018) Inexactly constrained discrete adjoint approach for steepest descent-based optimization algorithms. Numer Algorithms 78(2):983–1000MathSciNetCrossRef
Zurück zum Zitat Carter RG (1991) On the global convergence of trust region algorithms using inexact gradient information. SIAM J Numer Anal 28(1):251–265MathSciNetCrossRef Carter RG (1991) On the global convergence of trust region algorithms using inexact gradient information. SIAM J Numer Anal 28(1):251–265MathSciNetCrossRef
Zurück zum Zitat Carter RG (1993) Numerical experience with a class of algorithms for nonlinear optimization using inexact function and gradient information. SIAM J Sci Comput 14(2):368–388MathSciNetCrossRef Carter RG (1993) Numerical experience with a class of algorithms for nonlinear optimization using inexact function and gradient information. SIAM J Sci Comput 14(2):368–388MathSciNetCrossRef
Zurück zum Zitat Eisenstat SC, Walker HF (1996) Choosing the forcing terms in an inexact Newton method. SIAM J Sci Comput 17:16–32MathSciNetCrossRef Eisenstat SC, Walker HF (1996) Choosing the forcing terms in an inexact Newton method. SIAM J Sci Comput 17:16–32MathSciNetCrossRef
Zurück zum Zitat Fontecilla R (1984) On inexact quasi-Newton methods for constrained optimization. In: Boggs PT, Byrd RH, Schnabel RB (eds) Numerical optimization. pp. SIAM, Philadelphia, pp 102–118 Fontecilla R (1984) On inexact quasi-Newton methods for constrained optimization. In: Boggs PT, Byrd RH, Schnabel RB (eds) Numerical optimization. pp. SIAM, Philadelphia, pp 102–118
Zurück zum Zitat Giles MB, Dutta MC, Müller J-D, Pierce NA (2003) Algorithm developments for discrete adjoint methods. AIAA J 41(2):198–205CrossRef Giles MB, Dutta MC, Müller J-D, Pierce NA (2003) Algorithm developments for discrete adjoint methods. AIAA J 41(2):198–205CrossRef
Zurück zum Zitat Giles MB, Pierce NA (2000) An introduction to the adjoint approach to design. Flow Turbul Combust 65:393–415CrossRef Giles MB, Pierce NA (2000) An introduction to the adjoint approach to design. Flow Turbul Combust 65:393–415CrossRef
Zurück zum Zitat Golub GH, van Loan CF (1996) Matrix computations, third. The Johns Hopkins University Press Golub GH, van Loan CF (1996) Matrix computations, third. The Johns Hopkins University Press
Zurück zum Zitat Gu C, Zhu D, Pei Y (2018) A new inexact SQP algorithm for nonlinear systems of mixed equalities and inequalities. Numer Algorithms 78:1233–1253MathSciNetCrossRef Gu C, Zhu D, Pei Y (2018) A new inexact SQP algorithm for nonlinear systems of mixed equalities and inequalities. Numer Algorithms 78:1233–1253MathSciNetCrossRef
Zurück zum Zitat Heinkenschloss M, Vicente LN (2001) Analysis of inexact trust-region SQP algorithms. SIAM J Optim 12(2):283–302MathSciNetCrossRef Heinkenschloss M, Vicente LN (2001) Analysis of inexact trust-region SQP algorithms. SIAM J Optim 12(2):283–302MathSciNetCrossRef
Zurück zum Zitat Hicken JE, Zingg DW (2010) Aerodynamic optimization algorithm with integrated geometry parameterization and mesh movement. AIAA J 48(2):401–413CrossRef Hicken JE, Zingg DW (2010) Aerodynamic optimization algorithm with integrated geometry parameterization and mesh movement. AIAA J 48(2):401–413CrossRef
Zurück zum Zitat Ito K, Kelley CT, Sachs EW (1995) Inexact primal-dual interior-point iteration for linear programs in function spaces. Comput Optim Appl 4(3):189–201MathSciNetCrossRef Ito K, Kelley CT, Sachs EW (1995) Inexact primal-dual interior-point iteration for linear programs in function spaces. Comput Optim Appl 4(3):189–201MathSciNetCrossRef
Zurück zum Zitat Jäger H, Sachs EW (1997) Global convergence of inexact reduced SQP methods. Optim Methods Softw 7(2):83–110CrossRef Jäger H, Sachs EW (1997) Global convergence of inexact reduced SQP methods. Optim Methods Softw 7(2):83–110CrossRef
Zurück zum Zitat Jameson A (1995) Optimum aerodynamic design using CFD and control. AIAA-95-1729 Jameson A (1995) Optimum aerodynamic design using CFD and control. AIAA-95-1729
Zurück zum Zitat Kouri DP, Heinkenschloss M, Ridzal D, van Bolemen Waanders BG (2014) Inexact objective function evaluations in a trust-region algorithm for PDE-constrained optimization under uncertainty. SIAM J Sci Comput 36(6):3011–3029MathSciNetCrossRef Kouri DP, Heinkenschloss M, Ridzal D, van Bolemen Waanders BG (2014) Inexact objective function evaluations in a trust-region algorithm for PDE-constrained optimization under uncertainty. SIAM J Sci Comput 36(6):3011–3029MathSciNetCrossRef
Zurück zum Zitat Krakos JA, Darmofal DL (2010) Effect of small-scale output unsteadiness on adjoint-based sensitivity. AIAA J 48(11):2611–2623CrossRef Krakos JA, Darmofal DL (2010) Effect of small-scale output unsteadiness on adjoint-based sensitivity. AIAA J 48(11):2611–2623CrossRef
Zurück zum Zitat Leibfritz F, Sachs EW (1999) Inexact SQP interior point methods and large scale optimal control problems. SIAM J Control Optim 38(1):272–293MathSciNetCrossRef Leibfritz F, Sachs EW (1999) Inexact SQP interior point methods and large scale optimal control problems. SIAM J Control Optim 38(1):272–293MathSciNetCrossRef
Zurück zum Zitat Luers M, Sagebaum M, Mann S, Backhaus J, Grossmann D, Gauger NR (2018) Adjoint-based volumetric shape optimization of turbine blades. AIAA 2018–3638 Luers M, Sagebaum M, Mann S, Backhaus J, Grossmann D, Gauger NR (2018) Adjoint-based volumetric shape optimization of turbine blades. AIAA 2018–3638
Zurück zum Zitat Mader CA, Martins JRRA, Alonso JJ, van der Weide E (2008) ADjoint: an approach for the rapid development of discrete adjoint solvers. AIAA J 46(4):863–873CrossRef Mader CA, Martins JRRA, Alonso JJ, van der Weide E (2008) ADjoint: an approach for the rapid development of discrete adjoint solvers. AIAA J 46(4):863–873CrossRef
Zurück zum Zitat Nadarajah SK, Jameson A (2000) A comparison of the continuous and discrete adjoint approach to automatic aerodynamic optimization. AIAA-2000-0667 Nadarajah SK, Jameson A (2000) A comparison of the continuous and discrete adjoint approach to automatic aerodynamic optimization. AIAA-2000-0667
Zurück zum Zitat Nadarajah SK, Jameson A (2001) Studies of the continuous and discrete adjoint approaches to viscous automatic aerodynamic optimization. AIAA-2001-2530 Nadarajah SK, Jameson A (2001) Studies of the continuous and discrete adjoint approaches to viscous automatic aerodynamic optimization. AIAA-2001-2530
Zurück zum Zitat Nadarajah SK, Jameson A (2007) Optimum shape design for unsteady flows with time-accurate continuous and discrete adjoint method. AIAA J 45(7):1478–1491CrossRef Nadarajah SK, Jameson A (2007) Optimum shape design for unsteady flows with time-accurate continuous and discrete adjoint method. AIAA J 45(7):1478–1491CrossRef
Zurück zum Zitat Nadarajah SK, Jameson A, Alonso JJ (2002) Sonic boom reduction using an adjoint method for wing-body configurations in supersonic flow. September. AIAA-2002-5547 Nadarajah SK, Jameson A, Alonso JJ (2002) Sonic boom reduction using an adjoint method for wing-body configurations in supersonic flow. September. AIAA-2002-5547
Zurück zum Zitat Nemec M, Zingg DW (2001) Towards efficient aerodynamic shape optimization based on the Navier–Stokes equations. June. AIAA-2001-2532 Nemec M, Zingg DW (2001) Towards efficient aerodynamic shape optimization based on the Navier–Stokes equations. June. AIAA-2001-2532
Zurück zum Zitat Nielsen EJ, Lu J, Park MA, Darmofal DL (2004) An implicit, exact dual adjoint solution method for turbulent flows on unstructured grids. Comput Fluids 33(9):1131–1155MathSciNetCrossRef Nielsen EJ, Lu J, Park MA, Darmofal DL (2004) An implicit, exact dual adjoint solution method for turbulent flows on unstructured grids. Comput Fluids 33(9):1131–1155MathSciNetCrossRef
Zurück zum Zitat Nocedal J, Wright SJ (2006) Numerical optimization, second. Springer Nocedal J, Wright SJ (2006) Numerical optimization, second. Springer
Zurück zum Zitat Ortega JM, Rheinboldt WC (1970) Iterative solution of nonlinear equations in several variables. SIAM Ortega JM, Rheinboldt WC (1970) Iterative solution of nonlinear equations in several variables. SIAM
Zurück zum Zitat Padway E, Mavriplis D (2019) Advances in the pseudo-time accurate formulation of the adjoint and tangent systems for sensitivity computation and design. January. AIAA 2019-0699 Padway E, Mavriplis D (2019) Advances in the pseudo-time accurate formulation of the adjoint and tangent systems for sensitivity computation and design. January. AIAA 2019-0699
Zurück zum Zitat Pironneau O, Polak E (2002) Consistent approximations and approximate functions and gradients in optimal control. SIAM J Control Optim 41(2):487–510MathSciNetCrossRef Pironneau O, Polak E (2002) Consistent approximations and approximate functions and gradients in optimal control. SIAM J Control Optim 41(2):487–510MathSciNetCrossRef
Zurück zum Zitat Reuther J, Jameson A (1994) Control theory based airfoil design for potential flow and a finite volume discretization. January. AIAA-94-0499 Reuther J, Jameson A (1994) Control theory based airfoil design for potential flow and a finite volume discretization. January. AIAA-94-0499
Zurück zum Zitat Ridzal D (2006) Trust-region SQP methods with inexact linear system solves for large-scale optimization. Ph.D. thesis, Rice University, Houston, Texas, United States Ridzal D (2006) Trust-region SQP methods with inexact linear system solves for large-scale optimization. Ph.D. thesis, Rice University, Houston, Texas, United States
Zurück zum Zitat Ridzal D, Heinkenschloss M (2013) A matrix-free trust-region SQP method for equality constrained optimization. SIAM J Optim 24(3) Ridzal D, Heinkenschloss M (2013) A matrix-free trust-region SQP method for equality constrained optimization. SIAM J Optim 24(3)
Zurück zum Zitat Saad Y (1992) Numerical methods for large eigenvalue problems. Manchester University Press Saad Y (1992) Numerical methods for large eigenvalue problems. Manchester University Press
Zurück zum Zitat Schittkowski K (2015) NLPQLP: a Fortran implementation of a sequential quadratic programming algorithm with distributed and non-monotone line search—user’s guide, Version 4.2. Technical report. University of Bayreuth Schittkowski K (2015) NLPQLP: a Fortran implementation of a sequential quadratic programming algorithm with distributed and non-monotone line search—user’s guide, Version 4.2. Technical report. University of Bayreuth
Zurück zum Zitat Shi-Dong D, Chen C-H, Nadarajah S (2017) Adjoint-base aerodynamic optimization of benchmark CRM wing. AIAA 2017-3755 Shi-Dong D, Chen C-H, Nadarajah S (2017) Adjoint-base aerodynamic optimization of benchmark CRM wing. AIAA 2017-3755
Metadaten
Titel
Effect of inexact adjoint solutions on the discrete-adjoint approach to gradient-based optimization
verfasst von
David A. Brown
Siva Nadarajah
Publikationsdatum
01.09.2022
Verlag
Springer US
Erschienen in
Optimization and Engineering / Ausgabe 3/2022
Print ISSN: 1389-4420
Elektronische ISSN: 1573-2924
DOI
https://doi.org/10.1007/s11081-021-09681-5

Weitere Artikel der Ausgabe 3/2022

Optimization and Engineering 3/2022 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.