Top

Structural and Multidisciplinary Optimization

Published in:

20-02-2019 | Research Paper

An efficient space division–based width optimization method for RBF network using fuzzy clustering algorithms

Authors: Yunwei Zhang, Chunlin Gong, Hai Fang, Hua Su, Chunna Li, Andrea Da Ronch

Published in: Structural and Multidisciplinary Optimization | Issue 2/2019

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The Radial Basis Function (RBF) network is one of the most widely used surrogate models in multidisciplinary design optimization. However, one of the challenges of applying the RBF network to engineering problems is how to efficiently optimize its width parameters. In this work, a novel space division–based width optimization (SDWO) method is proposed to decompose the complex multivariable width optimization into several small-scale single-variable width optimizations. The SDWO method consists of two main steps. First, a two-stage fuzzy clustering algorithm is carried out to group the samples and divide the input space into several overlapping local regions, and the overlapping degree is controlled by a dimensionless expansion factor. Second, in each local region, one small-scale local RBF network (LRBFN) is constructed by solving a single-variable optimization problem when the LRBFN is needed for prediction. All these LRBFNs are independent of each other and can be constructed in parallel. The proposed method is efficient and particularly suitable for large sample sets. Test results of four sample sets verify that the proposed SDWO method has better performance than the conventional width optimization method in terms of both training efficiency and approximation accuracy. An inter-stage structure optimization is carried out, which demonstrates the efficiency of the proposed method in practical engineering applications.

previous article Robust topology optimization of solid continua for peak response serviceability to uncertain quasi-static loads with temporal correlation

next article Monitored convergence curve: a new framework for metaheuristic structural optimization algorithms

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Available only for authorised users

Akhtar T, Shoemaker CA (2016) Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection. J Glob Optim 64:17–32. https://doi.org/10.1007/s10898-015-0270-y MathSciNetCrossRefMATH

Alexandridis A, Chondrodima E, Sarimveis H (2013) Radial basis function network training using a nonsymmetric partition of the input space and particle swarm optimization. IEEE Trans Neural Networks Learn Syst 24:219–230. https://doi.org/10.1109/TNNLS.2012.2227794 CrossRef

Aurenhammer F (1991) Voronoi diagrams. ACM Comput Surv doi: https://doi.org/10.1111/j.1447-0756.2010.01436.x

Benoudjit N, Verleysen M (2003) On the kernel widths in radial-basis function networks. Neural Process Lett 18:139–154. https://doi.org/10.1023/A:1026289910256 CrossRef

Benoudjit N, Archambeau C, Lendasse A, et al (2002) Width optimization of the Gaussian kernels in radial basis function networks. In: European symposium on artificial neural networks. Bruges, pp 425–432

Bezdek JC (1981) Pattern recognition with fuzzy objective function algorithms. In: Plenum press. New York, London

Bezdek JC, Ehrlich R, Full W (1984) FCM: the fuzzy c-means clustering algorithm. Comput Geosci 10:191–203. https://doi.org/10.1016/0098-3004(84)90020-7 CrossRef

Bortman M, Aladjem M (2009) A growing and pruning method for radial basis function networks. IEEE Trans Neural Netw 20:1039–1045. https://doi.org/10.1006/brcg.1996.0066 CrossRef

Broomhead DS, Lowe D (1988) Multivariable functional interpolation and adaptive networks. Complex Syst 2:321–355MathSciNetMATH

Carvalho AD, Brizzotti MM (2001) Combining RBF networks trained by different clustering techniques. Neural Process Lett 14:227–240. https://doi.org/10.1023/A:1012703414861 CrossRefMATH

Chen S, Cowan CFN, Grant PM (1991) Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans Neural Netw 2:302–309CrossRef

Chuang K-S, Tzeng H-L, Chen S et al (2006) Fuzzy c-means clustering with spatial information for image segmentation. Comput Med Imaging Graph 30:9–15. https://doi.org/10.1016/j.compmedimag.2005.10.001 CrossRef

van Dam ER, Rennen G, Husslage B (2009) Bounds for maximin Latin hypercube designs. Oper Res 57:595–608MathSciNetCrossRefMATH

Fang H, Gong C, Li C et al (2018) A surrogate model based nested optimization framework for inverse problem considering interval uncertainty. Struct Multidiscip Optim 58(3):869–883. https://doi.org/10.1007/s00158-018-1931-5 MathSciNetCrossRef

Feng Z, Zhang Q, Zhang Q et al (2015) A multiobjective optimization based framework to balance the global exploration and local exploitation in expensive optimization. J Glob Optim 61:677–694. https://doi.org/10.1007/s10898-014-0210-2 MathSciNetCrossRefMATH

Haftka RT, Villanueva D, Chaudhuri A (2016) Parallel surrogate-assisted global optimization with expensive functions – a survey. Struct Multidiscip Optim 54:3–13. https://doi.org/10.1007/s00158-016-1432-3 MathSciNetCrossRef

Hansen P, Jaumard B (1997) Cluster analysis and mathematical programming. Math Program 79:191–215. https://doi.org/10.1007/BF02614317 MathSciNetMATH

Harpham C, Dawson CW, Brown MR (2004) A review of genetic algorithms applied to training radial basis function networks. Neural Comput Appl 13:193–201. https://doi.org/10.1007/s00521-004-0404-5 CrossRef

Haupt RL, Haupt SE (1998) Practical genetic algorithms. John Wiley&Sons

Huang G, Saratchandran P, Sundararajan N (2004) An efficient sequential learning algorithm for growing and pruning RBF(GAP-RBF) networks. IEEE Trans Syst Man Cybern 34:2284–2292 1083-4419/04CrossRef

Huang G, Saratchandran P, Sundararajan N (2005) A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation. IEEE Trans Neural Netw 16:57–67. https://doi.org/10.1109/TNN.2004.836241 CrossRef

Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications. Neurocomputing 70:489–501. https://doi.org/10.1016/j.neucom.2005.12.126 CrossRef

Huang GB, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2:107–122. https://doi.org/10.1007/s13042-011-0019-y CrossRef

Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of ICNN’95—international conference on neural networks. IEEE, Piscataway, NJ, pp 1942–1948

Kocherry JJ, Rahul Rajan AV (2007) MDO test suite. http://www.eng.buffalo.edu/Research/MODEL/mdo.test.orig/class2prob4.html. Accessed 20 April 2018

Leonard JA, Kramer MA (1991) Radial basis function networks for classifying process faults. IEEE Control Syst 11:31–38

Li X, Gao W, Gu L et al (2017) A cooperative radial basis function method for variable-fidelity surrogate modeling. Struct Multidiscip Optim 56:1077–1092. https://doi.org/10.1007/s00158-017-1704-6 CrossRef

Liu J, Lampinen J (2005) A differential evolution based incremental training method for RBF networks. In: Proc. 2005 conference on genetic and evolutionary computation. Washington DC, pp 881–888

Liu H, Ong YS, Cai J (2017) A survey of adaptive sampling for global metamodeling in support of simulation-based complex engineering design. Struct Multidiscip Optim 57:1–24. https://doi.org/10.1007/s00158-017-1739-8

Lowe D (1989) Adaptive radial basis function nonlinearities, and the problem of generalisation. In: Proceedings of first IEE international conference on artificial neural networks. pp 171–176

Neruda R, Kudová P (2005) Learning methods for radial basis function networks. Futur Gener Comput Syst 21:1131–1142. https://doi.org/10.1016/j.future.2004.03.013 CrossRefMATH

Niros AD, Tsekouras GE, Tsolakis D et al (2015) Hierarchical fuzzy clustering in conjunction with particle swarm optimization to efficiently design RBF neural networks. J Intell Robot Syst 78:105–125. https://doi.org/10.1007/s10846-014-0152-4 CrossRef

Oh SK, Kim WD, Pedrycz W, Joo SC (2012) Design of K-means clustering-based polynomial radial basis function neural networks (pRBF NNs) realized with the aid of particle swarm optimization and differential evolution. Neurocomputing 78:121–132. https://doi.org/10.1016/j.neucom.2011.06.031 CrossRef

Orr M (1998) Optimising the widths of radial basis functions. In: Proceedings 5th Brazilian symposium on neural networks (cat. No.98EX209). IEEE Comput. Soc, pp 26–29

Park J, Sandberg I (1991) Universal approximation using radial-basis-function networks. Neural Comput 3:246–257CrossRef

Peng J, Li K, Huang D (2006) A hybrid forward algorithm for RBF neural network construction. IEEE Trans Neural Netw 17:1439–1451CrossRef

Peng L, Liu L, Long T, Guo X (2014) Sequential RBF surrogate-based efficient optimization method for engineering design problems with expensive black-box functions. Chin J Mech Eng 27:1099–1111. https://doi.org/10.3901/CJME.2014.0820.138 CrossRef

Platt JC (1991) A resource-allocating network for function interpolation. Neural Comput 3:213–225. https://doi.org/10.1162/neco.1991.3.2.213 MathSciNetCrossRef

Poggio T, Girosi F (1990) Networks for approximation and learning. Proc IEEE 78:1481–1497. https://doi.org/10.1109/5.58326 CrossRefMATH

Sheta AF, De Jong K (2001) Time-series forecasting using GA-tuned radial basis functions. Inf Sci 133:221–228. https://doi.org/10.1016/S0020-0255(01)00086-X CrossRefMATH

Shi R, Liu L, Long T et al (2018) Multidisciplinary modeling and surrogate assisted optimization for satellite constellation systems. Struct Multidiscip Optim 58(5):2173–2218. https://doi.org/10.1007/s00158-018-2032-1 CrossRef

Smolik M, Skala V (2018) Large scattered data interpolation with radial basis functions and space subdivision. Integrated Comp-Aided Eng 25:49–62. https://doi.org/10.3233/ICA-170556 CrossRef

Sobester A, Leary SJ, Keane AJ (2004) A parallel updating scheme for approximating and optimizing high fidelity computer simulations. Struct Multidiscip Optim 27:371–383. https://doi.org/10.1007/s00158-004-0397-9 CrossRef

Stetco A, Zeng XJ, Keane J (2015) Fuzzy C-means++: fuzzy C-means with effective seeding initialization. Expert Syst Appl 42:7541–7548. https://doi.org/10.1016/j.eswa.2015.05.014 CrossRef

Sun Y, Zhu X, Zhang L, Zhao Z (2012) Structure optimization design of interstage section. Missiles and Space Veh 7182:5–6 1047182(2012)05-0006-05

Verleysenl M, Hlavackova K (1996) Learning in RBF networks. In: International conference on neural networks (ICNN). Washington, DC, pp 199–204

Vuković N, Miljković Z (2013) A growing and pruning sequential learning algorithm of hyper basis function neural network for function approximation. Neural Netw 46:210–226. https://doi.org/10.1016/j.neunet.2013.06.004 CrossRefMATH

Watson D (1993) Spatial tessellations: concepts and applications of voronoi diagrams. Comput Geosci doi: https://doi.org/10.1016/0098-3004(93)90024-Y

Yao W, Chen X, Zhao Y, van Tooren M (2012) Concurrent subspace width optimization method for RBF neural network modeling. IEEE Trans Neural Networks Learn Syst 23:247–259. https://doi.org/10.1109/TNNLS.2011.2178560 CrossRef

Zhou Z, Ong YS, Nair PB et al (2007) Combining global and local surrogate models to accelerate evolutionary optimization. IEEE Trans Syst Man Cybern Part C Appl Rev 37:66–76. https://doi.org/10.1109/TSMCC.2005.855506 CrossRef

Title: An efficient space division–based width optimization method for RBF network using fuzzy clustering algorithms
Authors: Yunwei Zhang
Chunlin Gong
Hai Fang
Hua Su
Chunna Li
Andrea Da Ronch
Publication date: 20-02-2019
Publisher: Springer Berlin Heidelberg
Published in: Structural and Multidisciplinary Optimization / Issue 2/2019
Print ISSN: 1615-147X
Electronic ISSN: 1615-1488
DOI: https://doi.org/10.1007/s00158-019-02217-7

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 2/2019

Crashworthiness optimization of front rail structure using macro element method and evolutionary algorithm

A sampling-based optimization algorithm for solution spaces with pair-wise-coupled design variables

Multiscale structural optimization towards three-dimensional printable structures

A simulated annealing approach for optimizing composite structures blended with multiple stacking sequence tables

Topology optimization of continua considering mass and inertia characteristics

An inverse reconstruction approach considering uncertainty and correlation for vehicle-vehicle collision accidents

Premium Partners