Skip to main content
Top
Published in: Soft Computing 4/2016

07-02-2015 | Methodologies and Application

Surrogate modeling based on an adaptive network and granular computing

Authors: Israel Cruz-Vega, Hugo Jair Escalante, Carlos A. Reyes, Jesus A. Gonzalez, Alejandro Rosales

Published in: Soft Computing | Issue 4/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Reducing the number of evaluations of expensive fitness functions is one of the main concerns in evolutionary algorithms, especially when working with instances of contemporary engineering problems. As an alternative to this efficiency constraint, surrogate-based methods are grounded in the construction of approximate models that estimate the solutions’ fitness by modeling the relationships between solution variables and their performance. This paper proposes a methodology based on granular computing for the construction of surrogate models for evolutionary algorithms. Under the proposed method, granules are associated with representative solutions of the problem under analysis. New solutions are evaluated with the expensive (original) fitness function only if they are not already covered by an existing granule. The parameters defining granules are periodically adapted as the search goes on using a neuro-fuzzy network that does not only reduce the number of fitness function evaluations, but also provides better convergence capabilities. The proposed method is evaluated on classical benchmark functions and on a recent benchmark created to test large-scale optimization models. Our results show that the proposed method considerably reduces the actual number of fitness function evaluations without significantly degrading the quality of solutions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Footnotes
1
One should note that although we have chosen genetic algorithms for the implementation of the proposed method, the same approach can be implemented with other population-based search strategies (e.g., particle swarm optimization or differential evolution).
 
2
In Akbarzadeh et al. (2008), the radius of the Gaussian similarity function was proposed as:
https://static-content.springer.com/image/art%3A10.1007%2Fs00500-015-1605-9/MediaObjects/500_2015_1605_Equ18_HTML.gif
that is, in inverse proportion to the exponential of the fitness value of the granule’s center, relating fitness function values and similarity measures in the similarity function. Since similarity values and fitness values do not necessarily lie in the same scale, it makes no sense to use the definition for \(\sigma _{k}\) from Eq. (3), see Cruz-Vega and Escalante (2015) for details. Instead, in our work, \(\sigma _{k}\) is only related with measures in the same scale, that is distances in the variables space, see Eq. (2). In this way, we avoid the construction of granules that could have undefined values.
 
3
We considered the GA implementation of the global optimization toolbox of Matlab (Goldberg and Holland 1988).
 
Literature
go back to reference Aja-Fernández S, Alberola-López C (2004) Fuzzy granules as a basic word representation for computing with words. In: 9th conference speech and computer Aja-Fernández S, Alberola-López C (2004) Fuzzy granules as a basic word representation for computing with words. In: 9th conference speech and computer
go back to reference Akbarzadeh-T MR, Davarynejad M, Pariz N (2008) Adaptive fuzzy fitness granulation for evolutionary optimization. Int J Approx Reason 49(3):523–538CrossRef Akbarzadeh-T MR, Davarynejad M, Pariz N (2008) Adaptive fuzzy fitness granulation for evolutionary optimization. Int J Approx Reason 49(3):523–538CrossRef
go back to reference Akbarzadeh-T MR, Mosavat I, Abbasi S (2003) Friendship modeling for cooperative co-evolutionary fuzzy systems: a hybrid ga-gp algorithm. In: 22nd international conference of the North American Fuzzy Information Processing Society, 2003 (NAFIPS 2003). IEEE, pp 61–66 Akbarzadeh-T MR, Mosavat I, Abbasi S (2003) Friendship modeling for cooperative co-evolutionary fuzzy systems: a hybrid ga-gp algorithm. In: 22nd international conference of the North American Fuzzy Information Processing Society, 2003 (NAFIPS 2003). IEEE, pp 61–66
go back to reference Castellano G, Fanelli AM, Mencar C (2003) Fuzzy information granules: a compact, transparent and efficient representation. JACIII 7(2):160–168 Castellano G, Fanelli AM, Mencar C (2003) Fuzzy information granules: a compact, transparent and efficient representation. JACIII 7(2):160–168
go back to reference Clarke SM, Griebsch JH, Simpson TW (2005) Analysis of support vector regression for approximation of complex engineering analyses. J Mech Des 127(6):1077–1087CrossRef Clarke SM, Griebsch JH, Simpson TW (2005) Analysis of support vector regression for approximation of complex engineering analyses. J Mech Des 127(6):1077–1087CrossRef
go back to reference Cruz-Vega I, Escalante HJ (2015) A note on: adaptive fuzzy fitness granulation for evolutionary optimization. Int J Approx Reason 57:40–43CrossRef Cruz-Vega I, Escalante HJ (2015) A note on: adaptive fuzzy fitness granulation for evolutionary optimization. Int J Approx Reason 57:40–43CrossRef
go back to reference Cruz-Vega I, Garcia-Limon M, Escalante HJ (2014) Adaptive-surrogate based on a neuro-fuzzy network and granular computing. In: Proceedings of the 2014 conference on genetic and evolutionary computation. ACM, pp 761–768 Cruz-Vega I, Garcia-Limon M, Escalante HJ (2014) Adaptive-surrogate based on a neuro-fuzzy network and granular computing. In: Proceedings of the 2014 conference on genetic and evolutionary computation. ACM, pp 761–768
go back to reference De Jong KA (1975) An analysis of the behavior of a class of genetic adaptive systems. Ph.D. Dissertation. University of Michigan, Ann Arbor, MI, USA, AAI7609381 De Jong KA (1975) An analysis of the behavior of a class of genetic adaptive systems. Ph.D. Dissertation. University of Michigan, Ann Arbor, MI, USA, AAI7609381
go back to reference Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18CrossRef Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18CrossRef
go back to reference Digalakis JG, Margaritis KG (2002) An experimental study of benchmarking functions for genetic algorithms. Int J Comput Math 79(4):403–416MathSciNetCrossRefMATH Digalakis JG, Margaritis KG (2002) An experimental study of benchmarking functions for genetic algorithms. Int J Comput Math 79(4):403–416MathSciNetCrossRefMATH
go back to reference Do Wan Kim HJL, Park JB, Joo YH (2006) Ga-based construction of fuzzy classifiers using information granules Do Wan Kim HJL, Park JB, Joo YH (2006) Ga-based construction of fuzzy classifiers using information granules
go back to reference Farina M (2002) A neural network based generalized response surface multiobjective evolutionary algorithm. In: Proceedings of the 2002 congress on evolutionary computation, 2002 (CEC’02), vol 1. IEEE, pp 956–961 Farina M (2002) A neural network based generalized response surface multiobjective evolutionary algorithm. In: Proceedings of the 2002 congress on evolutionary computation, 2002 (CEC’02), vol 1. IEEE, pp 956–961
go back to reference Goldberg DE, Holland JH (1988) Genetic algorithms and machine learning. Mach Learn 3(2):95–99CrossRef Goldberg DE, Holland JH (1988) Genetic algorithms and machine learning. Mach Learn 3(2):95–99CrossRef
go back to reference Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft Comput 9(1):3–12CrossRef Jin Y (2005) A comprehensive survey of fitness approximation in evolutionary computation. Soft Comput 9(1):3–12CrossRef
go back to reference Jin Y (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evol Comput 1(2):61– 70CrossRef Jin Y (2011) Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evol Comput 1(2):61– 70CrossRef
go back to reference Karakasis MK, Giannakoglou KC (2004) On the use of surrogate evaluation models in multi-objective evolutionary algorithms. In: Proceedings of European congress on computational methods in applied sciences and engineering (ECCOMAS 2004) Karakasis MK, Giannakoglou KC (2004) On the use of surrogate evaluation models in multi-objective evolutionary algorithms. In: Proceedings of European congress on computational methods in applied sciences and engineering (ECCOMAS 2004)
go back to reference Leite D, Gomide F, Ballini R, Costa P (2011) Fuzzy granular evolving modeling for time series prediction. In: 2011 IEEE international conference on fuzzy systems (FUZZ). IEEE, pp 2794–2801 Leite D, Gomide F, Ballini R, Costa P (2011) Fuzzy granular evolving modeling for time series prediction. In: 2011 IEEE international conference on fuzzy systems (FUZZ). IEEE, pp 2794–2801
go back to reference Li X, Tang K, Omidvar MN, Yang Z, Qin K, China H (2013) Benchmark functions for the CEC 2013 special session and competition on large-scale global optimization. Gene 7:33 (2013) Li X, Tang K, Omidvar MN, Yang Z, Qin K, China H (2013) Benchmark functions for the CEC 2013 special session and competition on large-scale global optimization. Gene 7:33 (2013)
go back to reference Morse PM (1929) Diatomic molecules according to the wave mechanics. ii. Vibrational levels. Phys Rev 34(1):57CrossRefMATH Morse PM (1929) Diatomic molecules according to the wave mechanics. ii. Vibrational levels. Phys Rev 34(1):57CrossRefMATH
go back to reference Myers WR, Montgomery DC (2003) Response surface methodology. Encycl Biopharm Stat 1:858–869 Myers WR, Montgomery DC (2003) Response surface methodology. Encycl Biopharm Stat 1:858–869
go back to reference Panoutsos G, Mahfouf M (2010) A neural-fuzzy modelling framework based on granular computing: concepts and applications. Fuzzy Sets Syst 161(21):2808–2830MathSciNetCrossRef Panoutsos G, Mahfouf M (2010) A neural-fuzzy modelling framework based on granular computing: concepts and applications. Fuzzy Sets Syst 161(21):2808–2830MathSciNetCrossRef
go back to reference Park KJ, Pedrycz W, Oh SK (2007) A genetic approach to modeling fuzzy systems based on information granulation and successive generation-based evolution method. Simul Model Pract Theory 15(9):1128–1145CrossRef Park KJ, Pedrycz W, Oh SK (2007) A genetic approach to modeling fuzzy systems based on information granulation and successive generation-based evolution method. Simul Model Pract Theory 15(9):1128–1145CrossRef
go back to reference Pedrycz W (2014) Allocation of information granularity in optimization and decision-making models: towards building the foundations of granular computing. Eur J Oper Res 232(1):137–145MathSciNetCrossRef Pedrycz W (2014) Allocation of information granularity in optimization and decision-making models: towards building the foundations of granular computing. Eur J Oper Res 232(1):137–145MathSciNetCrossRef
go back to reference Pedrycz W, Song M (2012) A genetic reduction of feature space in the design of fuzzy models. Appl Soft Comput 12(9):2801–2816CrossRef Pedrycz W, Song M (2012) A genetic reduction of feature space in the design of fuzzy models. Appl Soft Comput 12(9):2801–2816CrossRef
go back to reference Pintér JD (2006) Global optimization: scientific and engineering case studies, vol 85. Springer, Berlin Pintér JD (2006) Global optimization: scientific and engineering case studies, vol 85. Springer, Berlin
go back to reference Puris A, Bello R, Molina D, Herrera F (2012) Variable mesh optimization for continuous optimization problems. Soft Comput 16(3):511–525CrossRef Puris A, Bello R, Molina D, Herrera F (2012) Variable mesh optimization for continuous optimization problems. Soft Comput 16(3):511–525CrossRef
go back to reference Roberts C, Johnston RL, Wilson NT (2000) A genetic algorithm for the structural optimization of morse clusters. Theor Chem Acc 104(2):123–130CrossRef Roberts C, Johnston RL, Wilson NT (2000) A genetic algorithm for the structural optimization of morse clusters. Theor Chem Acc 104(2):123–130CrossRef
go back to reference Roh SB, Pedrycz W, Ahn TC (2014) A design of granular fuzzy classifier. Expert Syst Appl 41(15):6786–6795 Roh SB, Pedrycz W, Ahn TC (2014) A design of granular fuzzy classifier. Expert Syst Appl 41(15):6786–6795
go back to reference Sacks J, Welch WJ, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Stat Sci 4(4):409–423 Sacks J, Welch WJ, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Stat Sci 4(4):409–423
go back to reference Velasco J, Saucedo-Espinosa MA, Escalante HJ, Mendoza K, Villarreal-Rodrıguez CE, Chacón-Mondragón OL, Rodrıguez A, Berrones A (2014) An adaptive random search for unconstrained global optimization. Computacion y Sistemas 18(2):243–257 Velasco J, Saucedo-Espinosa MA, Escalante HJ, Mendoza K, Villarreal-Rodrıguez CE, Chacón-Mondragón OL, Rodrıguez A, Berrones A (2014) An adaptive random search for unconstrained global optimization. Computacion y Sistemas 18(2):243–257
go back to reference Yao JT, Vasilakos AV, Pedrycz W (2013) Granular computing: perspectives and challenges. IEEE Trans Cybern 43(6):1977–1989 Yao JT, Vasilakos AV, Pedrycz W (2013) Granular computing: perspectives and challenges. IEEE Trans Cybern 43(6):1977–1989
go back to reference Yao Y (2005) Perspectives of granular computing. In: 2005 IEEE international conference on granular computing, vol 1. IEEE, pp 85–90 Yao Y (2005) Perspectives of granular computing. In: 2005 IEEE international conference on granular computing, vol 1. IEEE, pp 85–90
go back to reference Yao YY (2004) Granular computing. In: Proceedings of the 4th Chinese national conference on rough sets and soft computing, vol 31, pp 1–5 Yao YY (2004) Granular computing. In: Proceedings of the 4th Chinese national conference on rough sets and soft computing, vol 31, pp 1–5
go back to reference Zadeh LA (1997) Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90(2):111–127MathSciNetCrossRefMATH Zadeh LA (1997) Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90(2):111–127MathSciNetCrossRefMATH
go back to reference Zhang J, Chowdhury S, Messac A (2012) An adaptive hybrid surrogate model. Struct Multidiscip Optim 46(2):223–238CrossRef Zhang J, Chowdhury S, Messac A (2012) An adaptive hybrid surrogate model. Struct Multidiscip Optim 46(2):223–238CrossRef
Metadata
Title
Surrogate modeling based on an adaptive network and granular computing
Authors
Israel Cruz-Vega
Hugo Jair Escalante
Carlos A. Reyes
Jesus A. Gonzalez
Alejandro Rosales
Publication date
07-02-2015
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 4/2016
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-015-1605-9

Other articles of this Issue 4/2016

Soft Computing 4/2016 Go to the issue

Methodologies and Application

Modeling and implementation of Z-number

Premium Partner