Skip to main content
Top
Published in: Neural Processing Letters 1/2016

01-08-2016

An Improved Neural Network with Random Weights Using Backtracking Search Algorithm

Authors: Bingqing Wang, Lijin Wang, Yilong Yin, Yunlong Xu, Wenting Zhao, Yuchun Tang

Published in: Neural Processing Letters | Issue 1/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper proposes a hybrid algorithm by combining backtracking search algorithm (BSA) and a neural network with random weights (NNRWs), called BSA-NNRWs-N. BSA is utilized to optimize the hidden layer parameters of the single layer feed-forward network (SLFN) and NNRWs is used to derive the output layer weights. In addition, to avoid over-fitting on the validation set, a new cost function is proposed to replace the root mean square error (RMSE). In the new cost function, a constraint is added by considering RMSE on both training and validation sets. Experiments on classification and regression data sets show promising performance of the proposed BSA-NNRWs-N.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kecman V (2001) Learning and soft computing: support vector machines, neural networks, and fuzzy logic models. MIT press, CambridgeMATH Kecman V (2001) Learning and soft computing: support vector machines, neural networks, and fuzzy logic models. MIT press, CambridgeMATH
2.
go back to reference Wang L, Xiuju F (2006) Data mining with computational intelligence. Springer, HeidelbergMATH Wang L, Xiuju F (2006) Data mining with computational intelligence. Springer, HeidelbergMATH
4.
go back to reference Han M, Fan JC, Wang J (2011) A dynamic feedforward neural network based on gaussian particle swarm optimization and its application for predictive control. IEEE Trans Neural Netw 22:1457–1468CrossRef Han M, Fan JC, Wang J (2011) A dynamic feedforward neural network based on gaussian particle swarm optimization and its application for predictive control. IEEE Trans Neural Netw 22:1457–1468CrossRef
5.
go back to reference Slowik A (2011) Application of an adaptive differential evolution algorithm with multiple trial vectors to artificial neural network training. IEEE Trans Ind Electron 58:3160–3167CrossRef Slowik A (2011) Application of an adaptive differential evolution algorithm with multiple trial vectors to artificial neural network training. IEEE Trans Ind Electron 58:3160–3167CrossRef
6.
go back to reference Song Y, Chen ZQ, Yuan ZZ (2007) New chaotic PSO-based neural network predictive conrol for nonlinear process. IEEE Trans Neural Netw 18:595–601CrossRef Song Y, Chen ZQ, Yuan ZZ (2007) New chaotic PSO-based neural network predictive conrol for nonlinear process. IEEE Trans Neural Netw 18:595–601CrossRef
7.
go back to reference Schmidt W, Kraaijveld M, Duin R (1992) Feedforward neural networks with random weights. In: Proceedings of 11th IAPR international conference on pattern recognition methodology and systems, pp 1–4 Schmidt W, Kraaijveld M, Duin R (1992) Feedforward neural networks with random weights. In: Proceedings of 11th IAPR international conference on pattern recognition methodology and systems, pp 1–4
8.
go back to reference Cao FL, Tan YP, Cai MM (2014) Sparse algorithms of random weight networks and appllications. Expert Syst Appl 41:2457–2462CrossRef Cao FL, Tan YP, Cai MM (2014) Sparse algorithms of random weight networks and appllications. Expert Syst Appl 41:2457–2462CrossRef
9.
go back to reference Cao FL, Ye HL, Wang DH (2015) A probabilistic learning algorithm for robust modeling using neural networks with random weights. Inf Sci 313:62–78CrossRef Cao FL, Ye HL, Wang DH (2015) A probabilistic learning algorithm for robust modeling using neural networks with random weights. Inf Sci 313:62–78CrossRef
10.
go back to reference Zhao JW, Wang ZH, Cao FL, Wang DH (2015) A local learning algorithm for random weights networks. Knowl-Based Syst 74:159–166CrossRef Zhao JW, Wang ZH, Cao FL, Wang DH (2015) A local learning algorithm for random weights networks. Knowl-Based Syst 74:159–166CrossRef
11.
go back to reference Pao YH, Takefji Y (1992) Functional-link net computing. IEEE Comput J 25:76–79CrossRef Pao YH, Takefji Y (1992) Functional-link net computing. IEEE Comput J 25:76–79CrossRef
12.
go back to reference Igelnik B, Pao YH (1995) Stochastic choice of basis functions in adaptive function approximation and the functional-link net. IEEE Trans Neural Netw 6:1320–1329CrossRef Igelnik B, Pao YH (1995) Stochastic choice of basis functions in adaptive function approximation and the functional-link net. IEEE Trans Neural Netw 6:1320–1329CrossRef
13.
go back to reference Civicioglu P (2013) Backtracking search optimization algorithm for numerical optimization problems. Appl Math Comput 219:8121–8144MathSciNetMATH Civicioglu P (2013) Backtracking search optimization algorithm for numerical optimization problems. Appl Math Comput 219:8121–8144MathSciNetMATH
14.
go back to reference Chen WN, Zhang J, Lin Y et al (2013) Particle swarm optimization with an aging leader and challengers. IEEE Trans Evol Comput 7:241–258CrossRef Chen WN, Zhang J, Lin Y et al (2013) Particle swarm optimization with an aging leader and challengers. IEEE Trans Evol Comput 7:241–258CrossRef
15.
go back to reference Bartlett PL (1998) The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Trans Inf Theory 44:525–536MathSciNetCrossRefMATH Bartlett PL (1998) The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Trans Inf Theory 44:525–536MathSciNetCrossRefMATH
16.
go back to reference Cao J, Lin Z Z, Huang GB (2012) Self-adaptive evolutionary extreme learning machine. Neural Process Lett 36:285–305CrossRef Cao J, Lin Z Z, Huang GB (2012) Self-adaptive evolutionary extreme learning machine. Neural Process Lett 36:285–305CrossRef
17.
go back to reference Han F, Yao HF, Ling QH (2012) An improved extreme learning machine based on particle swarm optimization, Bio-inspired computing and applications. Springer, Heidelberg Han F, Yao HF, Ling QH (2012) An improved extreme learning machine based on particle swarm optimization, Bio-inspired computing and applications. Springer, Heidelberg
Metadata
Title
An Improved Neural Network with Random Weights Using Backtracking Search Algorithm
Authors
Bingqing Wang
Lijin Wang
Yilong Yin
Yunlong Xu
Wenting Zhao
Yuchun Tang
Publication date
01-08-2016
Publisher
Springer US
Published in
Neural Processing Letters / Issue 1/2016
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-015-9480-z

Other articles of this Issue 1/2016

Neural Processing Letters 1/2016 Go to the issue

OriginalPaper

Computation by Time