Skip to main content
Top
Published in: Soft Computing 1/2012

01-01-2012 | Original Paper

Study on semiparametric Wilcoxon fuzzy neural networks

Authors: Hsu-Kun Wu, Yih-Lon Lin, Jer-Guang Hsieh, Jyh-Horng Jeng

Published in: Soft Computing | Issue 1/2012

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Fuzzy neural network (FNN) has long been recognized as an efficient and powerful learning machine for general machine learning problems. Recently, Wilcoxon fuzzy neural network (WFNN), which generalizes the rank-based Wilcoxon approach for linear parametric regression problems to nonparametric neural network, was proposed aiming at improving robustness against outliers. FNN and WFNN are nonparametric models in the sense that they put no restrictions, except possibly smoothness, on the functional form of the regression function. However, they may be difficult to interpret and, even worse, yield poor estimates with high computational cost when the number of predictor variables is large. To overcome this drawback, semiparametric models have been proposed in statistical regression theory. A semiparametric model keeps the easy interpretability of its parametric part and retains the flexibility of its nonparametric part. Based on this, semiparametric FNN and semiparametric WFNN will be proposed in this paper. The learning rules are based on the backfitting procedure frequently used in semiparametric regression. Simulation results show that the semiparametric models perform better than their nonparametric counterparts.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Angelov P, Xydeas C (2006) Fuzzy systems design: direct and indirect approaches. Soft Comput 10(9):836–849CrossRef Angelov P, Xydeas C (2006) Fuzzy systems design: direct and indirect approaches. Soft Comput 10(9):836–849CrossRef
go back to reference Boser BE, Guyon IM, Vapnik VN (1992) A training algorithm for optimal margin classifiers. In: Haussler D (ed) Proceedings of the fifth annual workshop on computational learning theory. ACM Press, New York, pp 144–152 Boser BE, Guyon IM, Vapnik VN (1992) A training algorithm for optimal margin classifiers. In: Haussler D (ed) Proceedings of the fifth annual workshop on computational learning theory. ACM Press, New York, pp 144–152
go back to reference Breiman L, Friedman JH (1985) Estimating optimal transformations for multiple regression and correlations. J Am Stat Assoc 80:580–619CrossRefMATHMathSciNet Breiman L, Friedman JH (1985) Estimating optimal transformations for multiple regression and correlations. J Am Stat Assoc 80:580–619CrossRefMATHMathSciNet
go back to reference Chuang CC, Su SF, Chen SS (2001) Robust TSK fuzzy modeling for function approximation with outliers. IEEE Trans Fuzzy Syst 9:810–821CrossRef Chuang CC, Su SF, Chen SS (2001) Robust TSK fuzzy modeling for function approximation with outliers. IEEE Trans Fuzzy Syst 9:810–821CrossRef
go back to reference Cortes C, Vapnik VN (1995) Support vector networks. Mach Learn 20:273–297MATH Cortes C, Vapnik VN (1995) Support vector networks. Mach Learn 20:273–297MATH
go back to reference Härdle W, Müller M, Sperlich S, Werwatz A (2004) Nonparametric and Semiparametric Models. Springer, BerlinCrossRefMATH Härdle W, Müller M, Sperlich S, Werwatz A (2004) Nonparametric and Semiparametric Models. Springer, BerlinCrossRefMATH
go back to reference Hartman EJ, Keeler JD, Kowalski JM (1990) Layered neural networks with Gaussian hidden units as universal approximations. Neural Comput 2:210–215CrossRef Hartman EJ, Keeler JD, Kowalski JM (1990) Layered neural networks with Gaussian hidden units as universal approximations. Neural Comput 2:210–215CrossRef
go back to reference Hogg RV, McKean JW, Craig AT (2005) Introduction to mathematical statistics, 6th edn. Prentice-Hall, Englewood Cliffs Hogg RV, McKean JW, Craig AT (2005) Introduction to mathematical statistics, 6th edn. Prentice-Hall, Englewood Cliffs
go back to reference Hornik K, Stinchcombe M, White H (1989) Multilayer feedforward networks are universal approximators. Neural Netw 2(5):359–366CrossRef Hornik K, Stinchcombe M, White H (1989) Multilayer feedforward networks are universal approximators. Neural Netw 2(5):359–366CrossRef
go back to reference Hsieh JG, Lin YL, Jeng JH (2008) Preliminary study on Wilcoxon learning machines. IEEE Trans Neural Netw 19(2):201–211CrossRef Hsieh JG, Lin YL, Jeng JH (2008) Preliminary study on Wilcoxon learning machines. IEEE Trans Neural Netw 19(2):201–211CrossRef
go back to reference Kecman V (2001) Learning and soft computing. MIT Press, CambridgeMATH Kecman V (2001) Learning and soft computing. MIT Press, CambridgeMATH
go back to reference Li H, Liu P (2005) Approximation analysis of feedforward regular fuzzy neural network with two hidden layers. Fuzzy Sets Syst 150(2):373–396CrossRefMATH Li H, Liu P (2005) Approximation analysis of feedforward regular fuzzy neural network with two hidden layers. Fuzzy Sets Syst 150(2):373–396CrossRefMATH
go back to reference Liu P (2000) Analyses of regular fuzzy neural networks for approximation capabilities. Fuzzy Sets Syst 114:329–338CrossRefMATH Liu P (2000) Analyses of regular fuzzy neural networks for approximation capabilities. Fuzzy Sets Syst 114:329–338CrossRefMATH
go back to reference Liu P (2001) Universal approximations of continuous fuzzy-valued functions by multi-layer regular fuzzy neural networks. Fuzzy Sets Syst 119:313–320CrossRefMATH Liu P (2001) Universal approximations of continuous fuzzy-valued functions by multi-layer regular fuzzy neural networks. Fuzzy Sets Syst 119:313–320CrossRefMATH
go back to reference Maindonald J, Braun J (2007) Data analysis and graphics using R, 2nd edn. Cambridge University Press, New YorkMATH Maindonald J, Braun J (2007) Data analysis and graphics using R, 2nd edn. Cambridge University Press, New YorkMATH
go back to reference Otadi M, Mosleh M, Abbasbandy S (2011) Numerical solution of fully fuzzy linear systems by fuzzy neural network. Soft Comput (to appear) Otadi M, Mosleh M, Abbasbandy S (2011) Numerical solution of fully fuzzy linear systems by fuzzy neural network. Soft Comput (to appear)
go back to reference Park J, Sandberg IW (1991) Universal approximation using radial basis function networks. Neural Comput 3:246–257CrossRef Park J, Sandberg IW (1991) Universal approximation using radial basis function networks. Neural Comput 3:246–257CrossRef
go back to reference Rumelhart DE, Hinton GE, Williams RJ (1986) Learning internal representations by error propagation. In: Rumelhart DE, McClelland JL (eds) Parallel distributed processing: explorations in the microstructure of cognition, foundations, vol 1. MIT Press, Cambridge, pp 318–362 Rumelhart DE, Hinton GE, Williams RJ (1986) Learning internal representations by error propagation. In: Rumelhart DE, McClelland JL (eds) Parallel distributed processing: explorations in the microstructure of cognition, foundations, vol 1. MIT Press, Cambridge, pp 318–362
go back to reference Ruppert D, Wand MP, Carroll RJ (2003) Semiparametric regression. Cambridge University Press, New YorkCrossRefMATH Ruppert D, Wand MP, Carroll RJ (2003) Semiparametric regression. Cambridge University Press, New YorkCrossRefMATH
go back to reference Tsai HH, Yu PT (2000) On the optimal design of fuzzy neural networks with robust learning for function approximation. IEEE Trans Syst Man Cybern B Cybern 30:217–223CrossRef Tsai HH, Yu PT (2000) On the optimal design of fuzzy neural networks with robust learning for function approximation. IEEE Trans Syst Man Cybern B Cybern 30:217–223CrossRef
go back to reference Wang LX (1997) A Course in Fuzzy Systems and Control. Prentice-Hall, Englewood CliffsMATH Wang LX (1997) A Course in Fuzzy Systems and Control. Prentice-Hall, Englewood CliffsMATH
go back to reference Wang WY, Lee TT, Liu CL, Wang CH (1997) Function approximation using fuzzy neural networks with robust learning algorithm. IEEE Trans Syst Man Cybern B Cybern 27(4):740–747CrossRef Wang WY, Lee TT, Liu CL, Wang CH (1997) Function approximation using fuzzy neural networks with robust learning algorithm. IEEE Trans Syst Man Cybern B Cybern 27(4):740–747CrossRef
Metadata
Title
Study on semiparametric Wilcoxon fuzzy neural networks
Authors
Hsu-Kun Wu
Yih-Lon Lin
Jer-Guang Hsieh
Jyh-Horng Jeng
Publication date
01-01-2012
Publisher
Springer-Verlag
Published in
Soft Computing / Issue 1/2012
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-011-0730-3

Other articles of this Issue 1/2012

Soft Computing 1/2012 Go to the issue

Premium Partner