Skip to main content

2017 | OriginalPaper | Buchkapitel

Optimizing Weights in Elman Recurrent Neural Networks with Wolf Search Algorithm

verfasst von : Nazri Mohd. Nawi, M. Z. Rehman, Norhamreeza Abdul Hamid, Abdullah Khan, Rashid Naseem, Jamal Uddin

Erschienen in: Recent Advances on Soft Computing and Data Mining

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a Metahybrid algorithm that consists of the dual combination of Wolf Search (WS) and Elman Recurrent Neural Network (ERNN). ERNN is one of the most efficient feed forward neural network learning algorithm. Since ERNN uses gradient descent technique during the training process; therefore, it is not devoid of local minima and slow convergence problem. This paper used a new metaheuristic search algorithm, called wolf search (WS) based on wolf’s predatory behavior to train the weights in ERNN to achieve faster convergence and to avoid the local minima. The performance of the proposed Metahybrid Wolf Search Elman Recurrent Neural Network (WRNN) is compared with Bat with back propagation (Bat-BP) algorithm and other hybrid variants on benchmark classification datasets. The simulation results show that the proposed Metahybrid WRNN algorithm has better performance in terms of CPU time, accuracy and MSE than the other algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Nawi, N.M., Khan, A., Rehman, M.Z.: A new optimized Cuckoo Search Recurrent Neural Network (CSRNN) algorithm. In: The 8th International Conference on Robotic, Vision, Signal Processing and Power Applications, pp. 335–341. Springer, Singapore (2013) Nawi, N.M., Khan, A., Rehman, M.Z.: A new optimized Cuckoo Search Recurrent Neural Network (CSRNN) algorithm. In: The 8th International Conference on Robotic, Vision, Signal Processing and Power Applications, pp. 335–341. Springer, Singapore (2013)
2.
Zurück zum Zitat Radhika, Y., Shashi, M.: Atmospheric temperature prediction using support vector machines. Int. J. Comput. Theory Eng. 1, 55–58 (2009)CrossRef Radhika, Y., Shashi, M.: Atmospheric temperature prediction using support vector machines. Int. J. Comput. Theory Eng. 1, 55–58 (2009)CrossRef
3.
Zurück zum Zitat Akcayol, M.A., Cinar, C.: Artificial neural network based modeling of heated catalytic converter performance. Appl. Therm. Eng. 25, 2341–2350 (2005)CrossRef Akcayol, M.A., Cinar, C.: Artificial neural network based modeling of heated catalytic converter performance. Appl. Therm. Eng. 25, 2341–2350 (2005)CrossRef
4.
Zurück zum Zitat Rehman, M.Z., Nawi, N.M.: Improving the accuracy of Gradient Descent Back Propagation algorithm (GDAM) on classification problems. Int. J. New Comput. Archit. Appl. 1, 861–870 (2011) Rehman, M.Z., Nawi, N.M.: Improving the accuracy of Gradient Descent Back Propagation algorithm (GDAM) on classification problems. Int. J. New Comput. Archit. Appl. 1, 861–870 (2011)
5.
Zurück zum Zitat Kosko, B.: Neural Network and Fuzzy System. Prentice Hall, Upper Saddle River (1994)MATH Kosko, B.: Neural Network and Fuzzy System. Prentice Hall, Upper Saddle River (1994)MATH
6.
Zurück zum Zitat Krasnopolsky, V.M., Chevallier, F.: Some neural network applications in environmental sciences. part II: advancing computational efficiency of environmental numerical models. Neural Netw. 16, 335–348 (2003)CrossRef Krasnopolsky, V.M., Chevallier, F.: Some neural network applications in environmental sciences. part II: advancing computational efficiency of environmental numerical models. Neural Netw. 16, 335–348 (2003)CrossRef
7.
Zurück zum Zitat Coppin, B.: Artificial Intelligence Illuminated. Jones and Bartlett Publishers Inc., Sudbury (2004) Coppin, B.: Artificial Intelligence Illuminated. Jones and Bartlett Publishers Inc., Sudbury (2004)
8.
Zurück zum Zitat Basheer, I.A., Hajmeer, M.: Artificial neural networks: fundamentals, computing, design, and application. J. Microbiol. Methods 43, 3–31 (2000)CrossRef Basheer, I.A., Hajmeer, M.: Artificial neural networks: fundamentals, computing, design, and application. J. Microbiol. Methods 43, 3–31 (2000)CrossRef
9.
Zurück zum Zitat He, Z., Wu, M., Gong, B.: Neural network and its application on machinery fault diagnosis. In: IEEE International Conference on Systems Engineering. pp. 576–579 (1992) He, Z., Wu, M., Gong, B.: Neural network and its application on machinery fault diagnosis. In: IEEE International Conference on Systems Engineering. pp. 576–579 (1992)
10.
Zurück zum Zitat Li, B., Chow, M.Y., Tipsuwan, Y., Hung, J.C.: Neural-network-based motor rolling bearing fault diagnosis. IEEE Trans. Ind. Electron. 47, 1060–1069 (2000)CrossRef Li, B., Chow, M.Y., Tipsuwan, Y., Hung, J.C.: Neural-network-based motor rolling bearing fault diagnosis. IEEE Trans. Ind. Electron. 47, 1060–1069 (2000)CrossRef
11.
Zurück zum Zitat Nawi, N.M., Khan, A., Rehman, M.Z.: CSBPRNN: a new hybridization technique using cuckoo search to train back propagation recurrent neural network. In: Herawan, T., Deris, M.M., Abawajy, J. (eds.) Proceedings of the First International Conference on Advanced Data and Information Engineering (DaEng-2013). LNEE, vol. 285, pp. 111–118. Springer, Singapore (2014). doi:10.1007/978-981-4585-18-7_13CrossRef Nawi, N.M., Khan, A., Rehman, M.Z.: CSBPRNN: a new hybridization technique using cuckoo search to train back propagation recurrent neural network. In: Herawan, T., Deris, M.M., Abawajy, J. (eds.) Proceedings of the First International Conference on Advanced Data and Information Engineering (DaEng-2013). LNEE, vol. 285, pp. 111–118. Springer, Singapore (2014). doi:10.​1007/​978-981-4585-18-7_​13CrossRef
12.
Zurück zum Zitat Zhang, J., Lok, T., Lyu, M.R.: A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training. Appl. Math. Comput. 185, 1026–1037 (2007)MATH Zhang, J., Lok, T., Lyu, M.R.: A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training. Appl. Math. Comput. 185, 1026–1037 (2007)MATH
13.
Zurück zum Zitat Ab Aziz, M.F., Hj Shamsuddin, S.M., Alwee, R.: Enhancement of particle swarm optimization in elman recurrent network with bounded Vmax function. In: Proceedings 2009 3rd Asia International Conference on Modelling and Simulation, AMS 2009, pp. 125–130 (2009) Ab Aziz, M.F., Hj Shamsuddin, S.M., Alwee, R.: Enhancement of particle swarm optimization in elman recurrent network with bounded Vmax function. In: Proceedings 2009 3rd Asia International Conference on Modelling and Simulation, AMS 2009, pp. 125–130 (2009)
14.
Zurück zum Zitat Sutskever, I., Hinton, G., Taylor, G.: The Recurrent temporal restricted Boltzmann machine. Neural Inf. Process. Syst. 21, 1601–1608 (2008) Sutskever, I., Hinton, G., Taylor, G.: The Recurrent temporal restricted Boltzmann machine. Neural Inf. Process. Syst. 21, 1601–1608 (2008)
15.
Zurück zum Zitat Gupta, L., McAvoy, M., Phegley, J.: Classification of temporal sequences via prediction using the simple recurrent neural network. Pattern Recognit. 33, 1759–1770 (2000)CrossRef Gupta, L., McAvoy, M., Phegley, J.: Classification of temporal sequences via prediction using the simple recurrent neural network. Pattern Recognit. 33, 1759–1770 (2000)CrossRef
16.
Zurück zum Zitat Saad, E.W., Prokhorov II, D., Donald, C.W.: Comparative study of stock trend prediction using time delay, recurrent and probabilistic neural networks. IEEE Trans. Neural Netw. 9, 1456–1470 (1998)CrossRef Saad, E.W., Prokhorov II, D., Donald, C.W.: Comparative study of stock trend prediction using time delay, recurrent and probabilistic neural networks. IEEE Trans. Neural Netw. 9, 1456–1470 (1998)CrossRef
17.
Zurück zum Zitat Guo, L., Rivero, D., Pazos, A.: Epileptic seizure detection using multiwavelet transform based approximate entropy and artificial neural networks. J. Neurosci. Methods 193, 156–163 (2010)CrossRef Guo, L., Rivero, D., Pazos, A.: Epileptic seizure detection using multiwavelet transform based approximate entropy and artificial neural networks. J. Neurosci. Methods 193, 156–163 (2010)CrossRef
18.
Zurück zum Zitat Güler, N.F., Übeyli, E.D., Güler, I.: Recurrent neural networks employing Lyapunov exponents for EEG signals classification. Expert Syst. Appl. 29, 506–514 (2005)CrossRef Güler, N.F., Übeyli, E.D., Güler, I.: Recurrent neural networks employing Lyapunov exponents for EEG signals classification. Expert Syst. Appl. 29, 506–514 (2005)CrossRef
19.
Zurück zum Zitat Übeyli, E.D.: Recurrent neural networks employing Lyapunov exponents for analysis of doppler ultrasound signals. Expert Syst. Appl. 34, 2538–2544 (2008)CrossRef Übeyli, E.D.: Recurrent neural networks employing Lyapunov exponents for analysis of doppler ultrasound signals. Expert Syst. Appl. 34, 2538–2544 (2008)CrossRef
20.
Zurück zum Zitat Karaboga, D., Akay, B., Ozturk, C.: Artificial Bee Colony (ABC) optimization algorithm for training feed-forward neural networks. In: Torra, V., Narukawa, Y., Yoshida, Y. (eds.) MDAI 2007. LNCS (LNAI), vol. 4617. Springer, Heidelberg (2007). doi:10.1007/978-3-540-73729-2CrossRef Karaboga, D., Akay, B., Ozturk, C.: Artificial Bee Colony (ABC) optimization algorithm for training feed-forward neural networks. In: Torra, V., Narukawa, Y., Yoshida, Y. (eds.) MDAI 2007. LNCS (LNAI), vol. 4617. Springer, Heidelberg (2007). doi:10.​1007/​978-3-540-73729-2CrossRef
21.
Zurück zum Zitat Karaboga, D., Akay, B.: A comparative study of Artificial Bee Colony algorithm. Appl. Math. Comput. 214, 108–132 (2009)MathSciNetMATH Karaboga, D., Akay, B.: A comparative study of Artificial Bee Colony algorithm. Appl. Math. Comput. 214, 108–132 (2009)MathSciNetMATH
22.
Zurück zum Zitat Nawi, N.M., Rehman, M.Z., Khan, A.: A new Bat Based Back-Propagation (BAT-BP) algorithm. In: Swiątek, J., Grzech, A., Swiątek, P., Tomczak, J.M. (eds.) Advances in Systems Science, pp. 395–404. Springer, Cham (2014)CrossRef Nawi, N.M., Rehman, M.Z., Khan, A.: A new Bat Based Back-Propagation (BAT-BP) algorithm. In: Swiątek, J., Grzech, A., Swiątek, P., Tomczak, J.M. (eds.) Advances in Systems Science, pp. 395–404. Springer, Cham (2014)CrossRef
23.
Zurück zum Zitat Tang, R., Fong, S., Yang, X.-S., Deb, S.: Wolf search algorithm with ephemeral memory. In: Seventh International Conference on Digital Information Management (ICDIM 2012), pp. 165–172 (2012) Tang, R., Fong, S., Yang, X.-S., Deb, S.: Wolf search algorithm with ephemeral memory. In: Seventh International Conference on Digital Information Management (ICDIM 2012), pp. 165–172 (2012)
24.
Zurück zum Zitat Wolberg, W.H., Mangasarian, O.L.: Multisurface method of pattern separation for medical diagnosis applied to breast cytology. Proc. Natl. Acad. Sci. U.S.A. 87, 9193–9196 (1990)CrossRefMATH Wolberg, W.H., Mangasarian, O.L.: Multisurface method of pattern separation for medical diagnosis applied to breast cytology. Proc. Natl. Acad. Sci. U.S.A. 87, 9193–9196 (1990)CrossRefMATH
25.
Zurück zum Zitat Quinlan, J.R.: Induction of decision trees. Mach. Learn. 1, 81–106 (1986)CrossRef Quinlan, J.R.: Induction of decision trees. Mach. Learn. 1, 81–106 (1986)CrossRef
26.
Zurück zum Zitat Fisher, R.: The use of multiple measurements in taxonomic problems. Ann. Eugen. 7, 179–188 (1936)CrossRef Fisher, R.: The use of multiple measurements in taxonomic problems. Ann. Eugen. 7, 179–188 (1936)CrossRef
27.
Zurück zum Zitat Quinlan, J.R.: Simplifying decision trees. Int. J. Man-Mach. Stud. Spec. Issue: Knowl. Acquisition Knowl.-Based Syst. Part 5 27(3), 221–234 (1987)CrossRef Quinlan, J.R.: Simplifying decision trees. Int. J. Man-Mach. Stud. Spec. Issue: Knowl. Acquisition Knowl.-Based Syst. Part 5 27(3), 221–234 (1987)CrossRef
Metadaten
Titel
Optimizing Weights in Elman Recurrent Neural Networks with Wolf Search Algorithm
verfasst von
Nazri Mohd. Nawi
M. Z. Rehman
Norhamreeza Abdul Hamid
Abdullah Khan
Rashid Naseem
Jamal Uddin
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-51281-5_2

Premium Partner