Skip to main content

2016 | OriginalPaper | Buchkapitel

Accuracy Increase on Evolving Product Unit Neural Networks via Feature Subset Selection

verfasst von : Antonio J. Tallón-Ballesteros, José C. Riquelme, Roberto Ruiz

Erschienen in: Hybrid Artificial Intelligent Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A framework that combines feature selection with evolutionary artificial neural networks is presented. This paper copes with neural networks that are applied in classification tasks. In machine learning area, feature selection is one of the most common techniques for pre-processing the data. A set of filters have been taken into consideration to assess the proposal. The experimentation has been conducted on nine data sets from the UCI repository that report test error rates about fifteen percent or above with reference classifiers such as C4.5 or 1-NN. The new proposal significantly improves the baseline framework, both approaches based on evolutionary product unit neural networks. Also several classifiers have been tried in order to illustrate the performance of the different methods considered.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aggarwal, C.C.: An introduction to data classification. In: Data Classification: Algorithms and Applications, p. 1 (2014) Aggarwal, C.C.: An introduction to data classification. In: Data Classification: Algorithms and Applications, p. 1 (2014)
2.
Zurück zum Zitat Bache, K., Lichman, M.: UCI machine learning repository online (2015) Bache, K., Lichman, M.: UCI machine learning repository online (2015)
3.
Zurück zum Zitat Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetMATH Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetMATH
4.
Zurück zum Zitat Downing, K.L.: Intelligence Emerging: Adaptivity and Search in Evolving Neural Systems. MIT Press, Cambridge (2015) Downing, K.L.: Intelligence Emerging: Adaptivity and Search in Evolving Neural Systems. MIT Press, Cambridge (2015)
5.
Zurück zum Zitat Durbin, R., Rumelhart, D.: Products units: a computationally powerful and biologically plausible extension to backpropagation networks. Neural Comput. 1(1), 133–142 (1989)CrossRef Durbin, R., Rumelhart, D.: Products units: a computationally powerful and biologically plausible extension to backpropagation networks. Neural Comput. 1(1), 133–142 (1989)CrossRef
6.
Zurück zum Zitat Hall, M.A.: Correlation-based feature selection for discrete and numeric class machine learning. In: Proceedings of the Seventeenth International Conference on Machine Learning (ICML ), pp. 359–366. Morgan Kaufmann, San Francisco (2000) Hall, M.A.: Correlation-based feature selection for discrete and numeric class machine learning. In: Proceedings of the Seventeenth International Conference on Machine Learning (ICML ), pp. 359–366. Morgan Kaufmann, San Francisco (2000)
7.
Zurück zum Zitat Kohavi, R.: A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI ), vol. 14, pp. 1137–1145 (1995) Kohavi, R.: A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI ), vol. 14, pp. 1137–1145 (1995)
8.
Zurück zum Zitat Kwak, N., Choi, C.-H.: Input feature selection for classification problems. IEEE Trans. Neural Netw. 13(1), 143–159 (2002)CrossRef Kwak, N., Choi, C.-H.: Input feature selection for classification problems. IEEE Trans. Neural Netw. 13(1), 143–159 (2002)CrossRef
9.
Zurück zum Zitat Liu, H., Motoda, H.: Feature Selection for Knowledge Discovery and Data Mining, vol. 454. Springer Science & Business Media, New York (2012)MATH Liu, H., Motoda, H.: Feature Selection for Knowledge Discovery and Data Mining, vol. 454. Springer Science & Business Media, New York (2012)MATH
10.
Zurück zum Zitat Liu, H., Setiono, R.: A probabilistic approach to feature selection - a filter solution. In: Proceedings of the thirteenth International Conference on Machine Learning (ICML), pp. 319–327, Italy. Morgan Kaufmann (1996) Liu, H., Setiono, R.: A probabilistic approach to feature selection - a filter solution. In: Proceedings of the thirteenth International Conference on Machine Learning (ICML), pp. 319–327, Italy. Morgan Kaufmann (1996)
11.
Zurück zum Zitat Prechelt, L.: Proben1: A set of neural network benchmark problems and benchmarking rules (1994) Prechelt, L.: Proben1: A set of neural network benchmark problems and benchmarking rules (1994)
12.
Zurück zum Zitat Quinlan, J.R.: C4.5: Programming for machine learning. Morgan Kauffmann, San Francisco (1993) Quinlan, J.R.: C4.5: Programming for machine learning. Morgan Kauffmann, San Francisco (1993)
13.
Zurück zum Zitat Rojas, R.: Neural Networks: A Systematic Introduction. Springer Science & Business Media, New York (2013)MATH Rojas, R.: Neural Networks: A Systematic Introduction. Springer Science & Business Media, New York (2013)MATH
14.
Zurück zum Zitat Ruiz, R., Riquelme, J.C., Aguilar-Ruiz, J.S.: Projection-based measure for efficient feature selection. J. Intell. Fuzzy Syst. 12(3–4), 175–183 (2002)MATH Ruiz, R., Riquelme, J.C., Aguilar-Ruiz, J.S.: Projection-based measure for efficient feature selection. J. Intell. Fuzzy Syst. 12(3–4), 175–183 (2002)MATH
15.
Zurück zum Zitat Ruiz, R., Riquelme, J.C., Aguilar-Ruiz, J.S.: Incremental wrapper-based gene selection from microarray expression data for cancer classification. Pattern Recogn. 39(12), 2383–2392 (2006)CrossRef Ruiz, R., Riquelme, J.C., Aguilar-Ruiz, J.S.: Incremental wrapper-based gene selection from microarray expression data for cancer classification. Pattern Recogn. 39(12), 2383–2392 (2006)CrossRef
16.
Zurück zum Zitat Tallón-Ballesteros, A.J., Gutiérrez-Peña, P.A., Hervás-Martínez, C.: Distribution of the search of evolutionary product unit neural networks for classification. arXiv preprint (2012). arxiv:1205.3336 Tallón-Ballesteros, A.J., Gutiérrez-Peña, P.A., Hervás-Martínez, C.: Distribution of the search of evolutionary product unit neural networks for classification. arXiv preprint (2012). arxiv:​1205.​3336
17.
Zurück zum Zitat Wang, J.: On the trainability, stability, representability, and realizability of artificial neural networks. Ph.D. thesis, Case Western Reserve University (1991) Wang, J.: On the trainability, stability, representability, and realizability of artificial neural networks. Ph.D. thesis, Case Western Reserve University (1991)
18.
Zurück zum Zitat Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques. Data Management Systems. Morgan Kaufmann, San Francisco (2005)MATH Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques. Data Management Systems. Morgan Kaufmann, San Francisco (2005)MATH
Metadaten
Titel
Accuracy Increase on Evolving Product Unit Neural Networks via Feature Subset Selection
verfasst von
Antonio J. Tallón-Ballesteros
José C. Riquelme
Roberto Ruiz
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-32034-2_12