Skip to main content
Top

2016 | OriginalPaper | Chapter

Impact of Weight Initialization on Multilayer Perceptron Using Fuzzy Similarity Quality Measure

Authors : Lenniet Coello, Yumilka Fernández, Yaima Filiberto, Rafael Bello

Published in: Applied Computer Sciences in Engineering

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents an algorithm for initializing the weights in multilayer perceptrons based on the new metrics called Fuzzy Similarity Quality. The new metric used a binary fuzzy relation for quantify the strength of the similarity between two objects. This measure computes the grade of similarity in a decision system in which the features can have discrete or continuous values. Experimental results show that the proposed initialization method performs better than other previously reported methods to calculate the weight of features.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Filiberto, Y., Bello, R., Caballero, Y., Larrua, R.: A method to build similarity relations into extended rough set theory. In: 10th International Conference on Intelligent Systems Design and Applications, pp. 1314–1319 (2010) Filiberto, Y., Bello, R., Caballero, Y., Larrua, R.: A method to build similarity relations into extended rough set theory. In: 10th International Conference on Intelligent Systems Design and Applications, pp. 1314–1319 (2010)
2.
go back to reference Verdegay, J.L., Yager, R.R., Bonissone, P.P.: On heuristics as a fundamental component of soft computing. J. Fuzzy Sets Syst. 159, 846–855 (2008)MathSciNetCrossRef Verdegay, J.L., Yager, R.R., Bonissone, P.P.: On heuristics as a fundamental component of soft computing. J. Fuzzy Sets Syst. 159, 846–855 (2008)MathSciNetCrossRef
3.
go back to reference Fu, X., Zhang, S., Pang, Z.: A resource limited immune approach for evolving architecture and weights of multilayer neural network. In: Tan, Y., Shi, Y., Tan, K.C. (eds.) ICSI 2010, Part I. LNCS, vol. 6145, pp. 328–337. Springer, Heidelberg (2010)CrossRef Fu, X., Zhang, S., Pang, Z.: A resource limited immune approach for evolving architecture and weights of multilayer neural network. In: Tan, Y., Shi, Y., Tan, K.C. (eds.) ICSI 2010, Part I. LNCS, vol. 6145, pp. 328–337. Springer, Heidelberg (2010)CrossRef
4.
go back to reference Adam, S., Karras, D.A., Vrahatis, M.N.: Revisiting the problem of weight initialization for multi-layer perceptrons trained with back propagation. In: Köppen, M., Kasabov, N., Coghill, G. (eds.) ICONIP 2008. LNCS, vol. 5507, pp. 308–315. Springer, Heidelberg (2009). doi:10.1007/978-3-642-03040-6_38 CrossRef Adam, S., Karras, D.A., Vrahatis, M.N.: Revisiting the problem of weight initialization for multi-layer perceptrons trained with back propagation. In: Köppen, M., Kasabov, N., Coghill, G. (eds.) ICONIP 2008. LNCS, vol. 5507, pp. 308–315. Springer, Heidelberg (2009). doi:10.​1007/​978-3-642-03040-6_​38 CrossRef
5.
go back to reference Coello, L., Fernandez, Y., Filiberto, Y., Bello, R.: Improving the MLP learning by using a method to calculate the initial weights with the quality of similarity measure based on fuzzy sets and particle swarms. J. Computación y Sistemas 19, 1–12 (2015) Coello, L., Fernandez, Y., Filiberto, Y., Bello, R.: Improving the MLP learning by using a method to calculate the initial weights with the quality of similarity measure based on fuzzy sets and particle swarms. J. Computación y Sistemas 19, 1–12 (2015)
6.
go back to reference Filiberto, Y., Bello, R., Caballero, Y., Larrua, R.: Using PSO and RST to predict the resistant capacity of connections in composite structures. In: González, J.R., Pelta, D.A., Cruz, C., Terrazas, G., Krasnogor, N. (eds.) NICSO 2010. SCI, vol. 284, pp. 359–370. Springer, Heidelberg (2010)CrossRef Filiberto, Y., Bello, R., Caballero, Y., Larrua, R.: Using PSO and RST to predict the resistant capacity of connections in composite structures. In: González, J.R., Pelta, D.A., Cruz, C., Terrazas, G., Krasnogor, N. (eds.) NICSO 2010. SCI, vol. 284, pp. 359–370. Springer, Heidelberg (2010)CrossRef
7.
go back to reference Fernandez, Y., Coello, L., Filiberto, Y., Bello, R., Falco, R.: Learning similarity measures from data with fuzzy sets and particle swarms. In: 11th International Conference on Electrical Engineering, Computing Science and Automatic Control, pp. 1–6. IEEE Press, Mexico (2014) Fernandez, Y., Coello, L., Filiberto, Y., Bello, R., Falco, R.: Learning similarity measures from data with fuzzy sets and particle swarms. In: 11th International Conference on Electrical Engineering, Computing Science and Automatic Control, pp. 1–6. IEEE Press, Mexico (2014)
8.
go back to reference Filiberto, Y., Bello, R., Caballero, Y., Frias, M.: An analysis about the measure quality of similarity and its applications in machine learning. In: 4th International Workshop on Knowledge Discovery, Knowledge Management and Decision Support, pp. 130–139, Mexico (2013) Filiberto, Y., Bello, R., Caballero, Y., Frias, M.: An analysis about the measure quality of similarity and its applications in machine learning. In: 4th International Workshop on Knowledge Discovery, Knowledge Management and Decision Support, pp. 130–139, Mexico (2013)
11.
go back to reference Iman, R., Davenport, J.: Approximations of the critical region of the Friedman statistic. Commun. Stat. Part A Theor. Meth. 9, 571–595 (1980)CrossRefMATH Iman, R., Davenport, J.: Approximations of the critical region of the Friedman statistic. Commun. Stat. Part A Theor. Meth. 9, 571–595 (1980)CrossRefMATH
12.
Metadata
Title
Impact of Weight Initialization on Multilayer Perceptron Using Fuzzy Similarity Quality Measure
Authors
Lenniet Coello
Yumilka Fernández
Yaima Filiberto
Rafael Bello
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-50880-1_11

Premium Partner