Skip to main content

2017 | OriginalPaper | Buchkapitel

Chebyshev Multilayer Perceptron Neural Network with Levenberg Marquardt-Back Propagation Learning for Classification Tasks

verfasst von : Umer Iqbal, Rozaida Ghazali

Erschienen in: Recent Advances on Soft Computing and Data Mining

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Artificial neural network has been proved among the best tools in data mining for classification tasks. Multilayer perceptron (MLP) neural network commonly used due to the fast convergence and easy implementation. Meanwhile, it fails to tackle higher dimensional problems. In this paper, Chebyshev multilayer perceptron neural network with Levenberg Marquardt back propagation learning is presented for classification task. Here, Chebyshev orthogonal polynomial is used as functional expansion for solution of higher dimension problems. Four benchmarked datasets for classification are collected from UCI repository. The computational results are compared with MLP trained by different training algorithms namely, Gradient Descent back propagation (MLP-GD), Levenberg Marquardt back propagation (MLP-LM), Gradient Descent back propagation with momentum (MLP-GDM), and Gradient Descent with momentum and adaptive learning rate (MLP-GDX). The findings show that, proposed model outperforms all compared methods in terms of accuracy, precision and sensitivity.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Kumar, M., Singh, S., Rath, S.K.: Classification of microarray data using functional link neural network. Procedia Comput. Sci. 57, 727–737 (2015)CrossRef Kumar, M., Singh, S., Rath, S.K.: Classification of microarray data using functional link neural network. Procedia Comput. Sci. 57, 727–737 (2015)CrossRef
2.
Zurück zum Zitat Decker, R., Kroll, F.: Classification in marketing research by means of LEM2-generated rules. In: Advances in Data Analysis, pp. 425–432 (2007) Decker, R., Kroll, F.: Classification in marketing research by means of LEM2-generated rules. In: Advances in Data Analysis, pp. 425–432 (2007)
3.
Zurück zum Zitat Bebarta, D.K., Biswal, B., Rout, A.K., Dash, P.K.: Forecasting and classification of Indian stocks using different polynomial functional link artificial neural networks. In: INDICON Annual IEEE, pp. 178–182 (2012) Bebarta, D.K., Biswal, B., Rout, A.K., Dash, P.K.: Forecasting and classification of Indian stocks using different polynomial functional link artificial neural networks. In: INDICON Annual IEEE, pp. 178–182 (2012)
4.
Zurück zum Zitat Paliwal, M., Kumar, U.A.: Neural networks and statistical techniques: a review of applications. Expert Syst. Appl. 36(1), 2–17 (2009)CrossRef Paliwal, M., Kumar, U.A.: Neural networks and statistical techniques: a review of applications. Expert Syst. Appl. 36(1), 2–17 (2009)CrossRef
5.
Zurück zum Zitat Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Cogn. Model. 5(3), 533–536 (1988)MATH Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Cogn. Model. 5(3), 533–536 (1988)MATH
6.
Zurück zum Zitat Silva-Ramírez, E.L., Pino-Mejías, R., López-Coello, M.: Single imputation with multilayer perceptron and multiple imputation combining multilayer perceptron and k-nearest neighbours for monotone patterns. Appl. Soft Comput. 29, 65–74 (2015)CrossRef Silva-Ramírez, E.L., Pino-Mejías, R., López-Coello, M.: Single imputation with multilayer perceptron and multiple imputation combining multilayer perceptron and k-nearest neighbours for monotone patterns. Appl. Soft Comput. 29, 65–74 (2015)CrossRef
7.
Zurück zum Zitat Mabu, S., Obayashi, M., Kuremoto, T.: Ensemble learning of rule-based evolutionary algorithm using multi-layer perceptron for supporting decisions in stock trading problems. Appl. Soft Comput. 36, 357–367 (2015)CrossRef Mabu, S., Obayashi, M., Kuremoto, T.: Ensemble learning of rule-based evolutionary algorithm using multi-layer perceptron for supporting decisions in stock trading problems. Appl. Soft Comput. 36, 357–367 (2015)CrossRef
8.
Zurück zum Zitat Jedliński, Ł., Jonak, J.: Early fault detection in gearboxes based on support vector machines and multilayer perceptron with a continuous wavelet transform. Appl. Soft Comput. 30, 636–641 (2015)CrossRef Jedliński, Ł., Jonak, J.: Early fault detection in gearboxes based on support vector machines and multilayer perceptron with a continuous wavelet transform. Appl. Soft Comput. 30, 636–641 (2015)CrossRef
9.
Zurück zum Zitat Rehman, M.Z., Nawi, N.M.: The effect of adaptive momentum in improving the accuracy of gradient descent back propagation algorithm on classification problems. In: Software Engineering and Computer Systems, pp. 380–390 (2011) Rehman, M.Z., Nawi, N.M.: The effect of adaptive momentum in improving the accuracy of gradient descent back propagation algorithm on classification problems. In: Software Engineering and Computer Systems, pp. 380–390 (2011)
10.
Zurück zum Zitat Shah, H., Ghazali, R., Nawi, N.M., Deris, M.M., Herawan, T.: Global artificial bee colony-Levenberq-Marquardt (GABC-LM) algorithm for classification. Int. J. Appl. Evol. Comput. (IJAEC) 4(3), 58–74 (2013)CrossRef Shah, H., Ghazali, R., Nawi, N.M., Deris, M.M., Herawan, T.: Global artificial bee colony-Levenberq-Marquardt (GABC-LM) algorithm for classification. Int. J. Appl. Evol. Comput. (IJAEC) 4(3), 58–74 (2013)CrossRef
11.
Zurück zum Zitat Lee, T.T., Jeng, J.T.: The Chebyshev-polynomials-based unified model neural networks for function approximation. IEEE Trans. Syst. Man Cybern. Part B: Cybernet. 28(6), 925–935 (1998)CrossRef Lee, T.T., Jeng, J.T.: The Chebyshev-polynomials-based unified model neural networks for function approximation. IEEE Trans. Syst. Man Cybern. Part B: Cybernet. 28(6), 925–935 (1998)CrossRef
12.
Zurück zum Zitat Konstantinidis, S., Karampiperis, P., Sicilia, M.A.: Enhancing the Levenberg-Marquardt method in neural network training using the direct computation of the error cost function hessian. In: Proceedings of the 16th International Conference on Engineering Applications of Neural Networks (INNS) (2015) Konstantinidis, S., Karampiperis, P., Sicilia, M.A.: Enhancing the Levenberg-Marquardt method in neural network training using the direct computation of the error cost function hessian. In: Proceedings of the 16th International Conference on Engineering Applications of Neural Networks (INNS) (2015)
13.
Zurück zum Zitat Blake, C., Merz, C.J.: UCI repository of machine learning databases (1998) Blake, C., Merz, C.J.: UCI repository of machine learning databases (1998)
14.
Zurück zum Zitat Bui, D.T., Tuan, T.A., Klempe, H., Pradhan, B., Revhaug, I.: Spatial prediction models for shallow landslide hazards: a comparative assessment of the efficacy of support vector machines, artificial neural networks, kernel logistic regression, and logistic model tree. Landslides, pp. 1–18 (2015) Bui, D.T., Tuan, T.A., Klempe, H., Pradhan, B., Revhaug, I.: Spatial prediction models for shallow landslide hazards: a comparative assessment of the efficacy of support vector machines, artificial neural networks, kernel logistic regression, and logistic model tree. Landslides, pp. 1–18 (2015)
15.
Zurück zum Zitat Liu, H., Tian, H.Q., Liang, X.F., Li, Y.F.: Wind speed forecasting approach using secondary decomposition algorithm and Elman neural networks. Appl. Energy 157, 183–194 (2015)CrossRef Liu, H., Tian, H.Q., Liang, X.F., Li, Y.F.: Wind speed forecasting approach using secondary decomposition algorithm and Elman neural networks. Appl. Energy 157, 183–194 (2015)CrossRef
16.
Zurück zum Zitat Singh, B., De, S., Zhang, Y., Goldstein, T., Taylor, G.: Layer-specific adaptive learning rates for deep networks (2015) Singh, B., De, S., Zhang, Y., Goldstein, T., Taylor, G.: Layer-specific adaptive learning rates for deep networks (2015)
17.
Zurück zum Zitat Gates, G.W.: The reduced nearest neighbor rule. IEEE Trans. Inf. Theor. 431–435 (1972) Gates, G.W.: The reduced nearest neighbor rule. IEEE Trans. Inf. Theor. 431–435 (1972)
Metadaten
Titel
Chebyshev Multilayer Perceptron Neural Network with Levenberg Marquardt-Back Propagation Learning for Classification Tasks
verfasst von
Umer Iqbal
Rozaida Ghazali
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-51281-5_17

Premium Partner