Skip to main content
Top
Published in: Optimization and Engineering 3/2016

07-11-2015

Integration of expert knowledge into radial basis function surrogate models

Authors: Zuzana Nedělková, Peter Lindroth, Ann-Brith Strömberg, Michael Patriksson

Published in: Optimization and Engineering | Issue 3/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

A current application in a collaboration between Chalmers University of Technology and Volvo Group Trucks Technology concerns the global optimization of a complex simulation-based function describing the rolling resistance coefficient (RRC) of a truck tyre. This function is crucial for the optimization of truck tyres selection considered. The need to explicitly describe and optimize this function provided the main motivation for the research presented in this article. Many optimization algorithms for simulation-based optimization problems use sample points to create a computationally simple surrogate model of the objective function. Typically, not all important characteristics of the complex function (as, e.g., non-negativity)—here referred to as expert knowledge—are automatically inherited by the surrogate model. We demonstrate the integration of several types of expert knowledge into a radial basis function interpolation. The methodology is first illustrated on a simple example function and then applied to a function describing the RRC of truck tyres. Our numerical results indicate that expert knowledge can be advantageously incorporated and utilized when creating global approximations of unknown functions from sample points.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Footnotes
1
A logarithmic transformation possesses a non-negative and smooth surrogate model of the unknown function in this case. On the other hand, the resulting surrogate function then becomes exponential, which may contradict the expert knowledge.
 
Literature
go back to reference Abramson MA, Audet C (2006) Convergence of mesh adaptive direct search to second-order stationary points. SIAM J Optim 17(2):606–619MathSciNetCrossRefMATH Abramson MA, Audet C (2006) Convergence of mesh adaptive direct search to second-order stationary points. SIAM J Optim 17(2):606–619MathSciNetCrossRefMATH
go back to reference Ali R, Dhillon R, El-Gindy M, Öijer F, Johansson I, Trivedi M (2013) Prediction of rolling resistance and steering characteristics using finite element analysis truck tyre model. Int J Veh Syst Model Test 8(2):179–201CrossRef Ali R, Dhillon R, El-Gindy M, Öijer F, Johansson I, Trivedi M (2013) Prediction of rolling resistance and steering characteristics using finite element analysis truck tyre model. Int J Veh Syst Model Test 8(2):179–201CrossRef
go back to reference Bazaraa MS, Sherali HD, Shetty CM (2006) Nonlinear programming: theory and algorithms, 3rd edn. Wiley, HobokenCrossRefMATH Bazaraa MS, Sherali HD, Shetty CM (2006) Nonlinear programming: theory and algorithms, 3rd edn. Wiley, HobokenCrossRefMATH
go back to reference Billups S, Larson J, Graf P (2013) Derivative-free optimization of expensive functions with computational error using weighted regression. SIAM J Optim 23(1):27–53MathSciNetCrossRefMATH Billups S, Larson J, Graf P (2013) Derivative-free optimization of expensive functions with computational error using weighted regression. SIAM J Optim 23(1):27–53MathSciNetCrossRefMATH
go back to reference Björck Å (1996) Numerical methods for least squares problems. Society for Industrial and Applied Mathematics, PhiladelphiaCrossRefMATH Björck Å (1996) Numerical methods for least squares problems. Society for Industrial and Applied Mathematics, PhiladelphiaCrossRefMATH
go back to reference Buhmann MD (2003) Radial basis functions: theory and implementations. Cambridge monographs on applied and computational mathematics, vol 12. Cambridge University Press, Cambridge Buhmann MD (2003) Radial basis functions: theory and implementations. Cambridge monographs on applied and computational mathematics, vol 12. Cambridge University Press, Cambridge
go back to reference Coleman TF, Branch MA, Grace A, MathWorks I (1999) Optimization Toolbox: for use with MATLAB. The MathWorks Inc, Natick Coleman TF, Branch MA, Grace A, MathWorks I (1999) Optimization Toolbox: for use with MATLAB. The MathWorks Inc, Natick
go back to reference Conn AR, Scheinberg K, Vicente LN (2009) Introduction to derivative-free optimization. MPS-SIAM series on optimization, vol 8. Society for Industrial and Applied Mathematics, Philadelphia Conn AR, Scheinberg K, Vicente LN (2009) Introduction to derivative-free optimization. MPS-SIAM series on optimization, vol 8. Society for Industrial and Applied Mathematics, Philadelphia
go back to reference Elsayed K, Lacor C (2014) Robust parameter design optimization using kriging, RBF and RBFNN with gradient-based and evolutionary optimization techniques. Appl Math Comput 236:325–344MathSciNetMATH Elsayed K, Lacor C (2014) Robust parameter design optimization using kriging, RBF and RBFNN with gradient-based and evolutionary optimization techniques. Appl Math Comput 236:325–344MathSciNetMATH
go back to reference Fisher WD (1961) A note on curve fitting with minimum deviations by linear programming. J Am Stat Assoc 56(294):359–362MathSciNetCrossRef Fisher WD (1961) A note on curve fitting with minimum deviations by linear programming. J Am Stat Assoc 56(294):359–362MathSciNetCrossRef
go back to reference Fornberg B, Flyer N, Hovde S, Piret C (2008) Locality properties of radial basis function expansion coefficients for equispaced interpolation. IMA J Numer Anal 28(1):121–142MathSciNetCrossRefMATH Fornberg B, Flyer N, Hovde S, Piret C (2008) Locality properties of radial basis function expansion coefficients for equispaced interpolation. IMA J Numer Anal 28(1):121–142MathSciNetCrossRefMATH
go back to reference Forrester AIJ, Keane AJ, Bressloff NW (2006) Design and analysis of “noisy” computer experiments. AIAA J 44(10):2331–2339CrossRef Forrester AIJ, Keane AJ, Bressloff NW (2006) Design and analysis of “noisy” computer experiments. AIAA J 44(10):2331–2339CrossRef
go back to reference Gärtner B, Schönherr S (2000) An efficient, exact, and generic quadratic programming solver for geometric optimization. In: Cheng SW, Cheong O, Argarwal P, Fortune S (eds) Proceedings of the sixteenth annual symposium on computational geometry. ACM, New York, pp 110–118CrossRef Gärtner B, Schönherr S (2000) An efficient, exact, and generic quadratic programming solver for geometric optimization. In: Cheng SW, Cheong O, Argarwal P, Fortune S (eds) Proceedings of the sixteenth annual symposium on computational geometry. ACM, New York, pp 110–118CrossRef
go back to reference Hürlimann W (1995) A uniform approximation to the sampling distribution of the coefficient of variation. Stat Probab Lett 24(3):263–268MathSciNetCrossRefMATH Hürlimann W (1995) A uniform approximation to the sampling distribution of the coefficient of variation. Stat Probab Lett 24(3):263–268MathSciNetCrossRefMATH
go back to reference Jakobsson S, Patriksson M, Rudholm J, Wojciechowski A (2010) A method for simulation based optimization using radial basis functions. Optim Eng 4(11):501–532MathSciNetCrossRefMATH Jakobsson S, Patriksson M, Rudholm J, Wojciechowski A (2010) A method for simulation based optimization using radial basis functions. Optim Eng 4(11):501–532MathSciNetCrossRefMATH
go back to reference Kohavi R (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Kaufmann M (ed) Proceedings of the 14th international joint conference on artificial intelligence, vol 2. Montréal, pp 1137–1143 Kohavi R (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Kaufmann M (ed) Proceedings of the 14th international joint conference on artificial intelligence, vol 2. Montréal, pp 1137–1143
go back to reference Kozlov MK, Tarasov SP, Khachiyan LG (1980) The polynomial solvability of convex quadratic programming. USSR Comput Math Math Phys 20(5):223–228MathSciNetCrossRefMATH Kozlov MK, Tarasov SP, Khachiyan LG (1980) The polynomial solvability of convex quadratic programming. USSR Comput Math Math Phys 20(5):223–228MathSciNetCrossRefMATH
go back to reference Lophaven SN, Nielsen HB, Sondergaard J (2002) DACE—a MATLAB kriging toolbox, version 2.0. Technical Report. Department of Informatics and Mathematical Modelling, Technical University of Denmark, Kongens Lyngby Lophaven SN, Nielsen HB, Sondergaard J (2002) DACE—a MATLAB kriging toolbox, version 2.0. Technical Report. Department of Informatics and Mathematical Modelling, Technical University of Denmark, Kongens Lyngby
go back to reference MATLAB (2012) MATLAB-Version: 8.0. 0.783 (R2012b). The MathWorks Inc, Natick MATLAB (2012) MATLAB-Version: 8.0. 0.783 (R2012b). The MathWorks Inc, Natick
go back to reference McKay MD, Beckman RJ, Conover WJ (1979) Comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21(2):239–245MathSciNetMATH McKay MD, Beckman RJ, Conover WJ (1979) Comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21(2):239–245MathSciNetMATH
go back to reference Meckesheimer M, Booker AJ, Barton RR, Simpson TW (2002) Computationally inexpensive metamodel assessment strategies. AIAA J 40(10):2053–2060CrossRef Meckesheimer M, Booker AJ, Barton RR, Simpson TW (2002) Computationally inexpensive metamodel assessment strategies. AIAA J 40(10):2053–2060CrossRef
go back to reference Mitsos A (2011) Global optimization of semi-infinite programs via restriction of the right-hand side. Optimization 60(10–11):1291–1308MathSciNetCrossRefMATH Mitsos A (2011) Global optimization of semi-infinite programs via restriction of the right-hand side. Optimization 60(10–11):1291–1308MathSciNetCrossRefMATH
go back to reference Müller J, Shoemaker CA, Piché R (2013) SO-MI: A surrogate model algorithm for computationally expensive nonlinear mixed-integer black-box global optimization problems. Comput Oper Res 40(5):1383–1400MathSciNetCrossRef Müller J, Shoemaker CA, Piché R (2013) SO-MI: A surrogate model algorithm for computationally expensive nonlinear mixed-integer black-box global optimization problems. Comput Oper Res 40(5):1383–1400MathSciNetCrossRef
go back to reference Nesterov Y, Nemirovskii AS, Ye Y (1994) Interior-point polynomial algorithms in convex programming. Studies in applied mathematics, vol 13. Society for Industrial and Applied Mathematics, Philadelphia Nesterov Y, Nemirovskii AS, Ye Y (1994) Interior-point polynomial algorithms in convex programming. Studies in applied mathematics, vol 13. Society for Industrial and Applied Mathematics, Philadelphia
go back to reference Ni Q, Hu S (2004) A new derivative free optimization method based on conic interpolation model. Acta Math Sci Ser B 24(2):281–290MathSciNetMATH Ni Q, Hu S (2004) A new derivative free optimization method based on conic interpolation model. Acta Math Sci Ser B 24(2):281–290MathSciNetMATH
go back to reference Pacejka HB, Besselink I (2012) Tire and vehicle dynamics. Automotive engineering, Elsevier, Oxford Pacejka HB, Besselink I (2012) Tire and vehicle dynamics. Automotive engineering, Elsevier, Oxford
go back to reference Pereira AI, Costa MFP, Fernandes EMGP (2011) Interior point filter method for semi-infinite programming problems. Optimization 60(10–11):1309–1338MathSciNetCrossRefMATH Pereira AI, Costa MFP, Fernandes EMGP (2011) Interior point filter method for semi-infinite programming problems. Optimization 60(10–11):1309–1338MathSciNetCrossRefMATH
go back to reference Peri D, Tinti F (2012) A multistart gradient-based algorithm with surrogate model for global optimization. Commun Appl Ind Math 3(1) Peri D, Tinti F (2012) A multistart gradient-based algorithm with surrogate model for global optimization. Commun Appl Ind Math 3(1)
go back to reference Polak E (1997) Optimization: algorithms and consistent approximation. Applied mathematical sciences series, vol 124. Springer, New York Polak E (1997) Optimization: algorithms and consistent approximation. Applied mathematical sciences series, vol 124. Springer, New York
go back to reference Rao CR, Toutenburg H (2009) Shalabh, Heumann C (2009) Linear models and generalizations: least squares and alternatives. Springer series in statistics. Springer, Berlin Rao CR, Toutenburg H (2009) Shalabh, Heumann C (2009) Linear models and generalizations: least squares and alternatives. Springer series in statistics. Springer, Berlin
go back to reference Regis RG, Shoemaker CA (2005) Constrained global optimization of expensive black box functions using radial basis functions. J Glob Optim 31(1):153–171MathSciNetCrossRefMATH Regis RG, Shoemaker CA (2005) Constrained global optimization of expensive black box functions using radial basis functions. J Glob Optim 31(1):153–171MathSciNetCrossRefMATH
go back to reference Tsunoda M, Monden A, Keung J, Matsumoto K (2012) Incorporating expert judgment into regression models of software effort estimation. In: Leung KRPH, Muenchaisri P (eds) Proceedings of the 19th Asia-Pacific software engineering conference, vol 1. IEEE Computer Society, Hong Kong, pp 374–379 Tsunoda M, Monden A, Keung J, Matsumoto K (2012) Incorporating expert judgment into regression models of software effort estimation. In: Leung KRPH, Muenchaisri P (eds) Proceedings of the 19th Asia-Pacific software engineering conference, vol 1. IEEE Computer Society, Hong Kong, pp 374–379
go back to reference Wendland H (2005) Scattered data approximation. Cambridge Monographs on Applied and Computational Mathematics, CambridgeMATH Wendland H (2005) Scattered data approximation. Cambridge Monographs on Applied and Computational Mathematics, CambridgeMATH
go back to reference Wild SM, Shoemaker C (2013) Global convergence of radial basis function trust-region algorithms for derivative-free optimization. SIAM Rev 55(2):349–371MathSciNetCrossRefMATH Wild SM, Shoemaker C (2013) Global convergence of radial basis function trust-region algorithms for derivative-free optimization. SIAM Rev 55(2):349–371MathSciNetCrossRefMATH
go back to reference Zhu W, Wang Y, Zhu QF (1998) Second-order derivative-based smoothness measure for error concealment in DCT-based codecs. IEEE Trans Circuits Syst Video Technol 8(6):713–718CrossRef Zhu W, Wang Y, Zhu QF (1998) Second-order derivative-based smoothness measure for error concealment in DCT-based codecs. IEEE Trans Circuits Syst Video Technol 8(6):713–718CrossRef
Metadata
Title
Integration of expert knowledge into radial basis function surrogate models
Authors
Zuzana Nedělková
Peter Lindroth
Ann-Brith Strömberg
Michael Patriksson
Publication date
07-11-2015
Publisher
Springer US
Published in
Optimization and Engineering / Issue 3/2016
Print ISSN: 1389-4420
Electronic ISSN: 1573-2924
DOI
https://doi.org/10.1007/s11081-015-9297-7

Other articles of this Issue 3/2016

Optimization and Engineering 3/2016 Go to the issue

Premium Partners