Skip to main content

2017 | OriginalPaper | Buchkapitel

Chicken S-BP: An Efficient Chicken Swarm Based Back-Propagation Algorithm

verfasst von : Abdullah Khan, Nazri Mohd Nawi, Rahmat Shah, Nasreen Akhter, Atta Ullah, M. Z. Rehman, Norhamreeza AbdulHamid, Haruna Chiroma

Erschienen in: Recent Advances on Soft Computing and Data Mining

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

An innovative metaheuristic based algorithm Chicken Swarm Optimization (CSO) is inspired by characteristics of chicken flock. CSO is particularly suitable for the investigation in candidate solutions for large spaces. This paper hybridize the CSO algorithm with the Back Propagation (BP) algorithm to solve the local minimum problem and to enhance convergence to global minimum in BP algorithm. The proposed Chicken Swarm Back Propagation (Chicken S-BP) is compared with the Artificial Bee Colony Back-Propagation (ABCBP), Genetic Algorithm Neural Network (GANN) and traditional BPNN algorithms. In particular Iris, Australian Credit Card, and 7-Bit Party classification datasets are used in training and testing the performance of the Chicken S-BP hybrid network. Results of simulation illustrates that Chicken S-BP algorithm efficiently prevents local minima and provides optimal solution.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Rumelhart, D.E., McClelland, J.L.: Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Foundations. MIT Press, New York (1986)CrossRef Rumelhart, D.E., McClelland, J.L.: Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Foundations. MIT Press, New York (1986)CrossRef
2.
Zurück zum Zitat Nawi, N.M., Khan, A., Rehman, M.Z.: A new back-propagation neural network optimized with cuckoo search algorithm. In: Murgante, B., Misra, S., Carlini, M., Torre, C.M., Nguyen, H.Q., Taniar, D., Apduhan, B.O., Gervasi, O. (eds.) ICCSA 2013. LNCS, vol. 7971, pp. 413–426. Springer, Berlin (2013). doi:10.1007/978-3-642-39637-3_33CrossRef Nawi, N.M., Khan, A., Rehman, M.Z.: A new back-propagation neural network optimized with cuckoo search algorithm. In: Murgante, B., Misra, S., Carlini, M., Torre, C.M., Nguyen, H.Q., Taniar, D., Apduhan, B.O., Gervasi, O. (eds.) ICCSA 2013. LNCS, vol. 7971, pp. 413–426. Springer, Berlin (2013). doi:10.​1007/​978-3-642-39637-3_​33CrossRef
3.
Zurück zum Zitat Lahmiri, S.: A comparative study of back propagation algorithms in financial prediction. Int. J. Comput. Sci. Eng. Appl. 1(4), 15–21 (2011) Lahmiri, S.: A comparative study of back propagation algorithms in financial prediction. Int. J. Comput. Sci. Eng. Appl. 1(4), 15–21 (2011)
4.
Zurück zum Zitat Rehman, M.Z., Nawi, N.M.: The effect of adaptive momentum in improving the accuracy of gradient descent back propagation algorithm on classification problems. In: Mohamad Zain, J., Wan Mohd, W.M., El-Qawasmeh, E. (eds.) ICSECS 2011. CCIS, vol. 179, pp. 380–390. Springer, Berlin (2011). doi:10.1007/978-3-642-22170-5_33CrossRef Rehman, M.Z., Nawi, N.M.: The effect of adaptive momentum in improving the accuracy of gradient descent back propagation algorithm on classification problems. In: Mohamad Zain, J., Wan Mohd, W.M., El-Qawasmeh, E. (eds.) ICSECS 2011. CCIS, vol. 179, pp. 380–390. Springer, Berlin (2011). doi:10.​1007/​978-3-642-22170-5_​33CrossRef
5.
Zurück zum Zitat Nandy, S., Sarkar, P.P., Das, A.: Analysis of a nature inspired firefly algorithm based back-propagation neural network training. Int. J. Comput. Appl. 43(22), 0975–8887 (2012) Nandy, S., Sarkar, P.P., Das, A.: Analysis of a nature inspired firefly algorithm based back-propagation neural network training. Int. J. Comput. Appl. 43(22), 0975–8887 (2012)
6.
Zurück zum Zitat Xingbo, S., Pingxian, Y.: BP neural networks with improved activation function and its application in the micrographs classification. In: 2008 Fourth International Conference on Natural Computation, ICNC 2008 (2008) Xingbo, S., Pingxian, Y.: BP neural networks with improved activation function and its application in the micrographs classification. In: 2008 Fourth International Conference on Natural Computation, ICNC 2008 (2008)
7.
Zurück zum Zitat Wang, X.G., Tang, Z., Tamura, H., Ishii, M., Sun, W.D.: An improved backpropagation algorithm to avoid the local minima problem. Neurocomputing 56, 455–460 (2004)CrossRef Wang, X.G., Tang, Z., Tamura, H., Ishii, M., Sun, W.D.: An improved backpropagation algorithm to avoid the local minima problem. Neurocomputing 56, 455–460 (2004)CrossRef
8.
Zurück zum Zitat Yu, C.C., Liu, B.D.: A Backpropagation algorithm with adaptive learning rate and momentum coefficient. In: IJCNN 2002, Honolulu, pp. 1218–1223 (2002) Yu, C.C., Liu, B.D.: A Backpropagation algorithm with adaptive learning rate and momentum coefficient. In: IJCNN 2002, Honolulu, pp. 1218–1223 (2002)
9.
Zurück zum Zitat Zhang, J.R., et al.: A hybrid particle swarm optimization–back-propagation algorithm for feedforward neural network training. Appl. Math. Comput. 185(2), 1026–1037 (2007)MATH Zhang, J.R., et al.: A hybrid particle swarm optimization–back-propagation algorithm for feedforward neural network training. Appl. Math. Comput. 185(2), 1026–1037 (2007)MATH
10.
Zurück zum Zitat Mendes, R., et al.: Particle swarms for feedforward neural network training. In: 2002 Proceedings of the 2002 International Joint Conference on Neural Networks, IJCNN (2002) Mendes, R., et al.: Particle swarms for feedforward neural network training. In: 2002 Proceedings of the 2002 International Joint Conference on Neural Networks, IJCNN (2002)
11.
Zurück zum Zitat Karaboga, D., Akay, B., Ozturk, C.: Artificial bee colony (ABC) optimization algorithm for training feed-forward neural networks. In: Torra, V., Narukawa, Y., Yoshida, Y. (eds.) MDAI 2007. LNCS (LNAI), vol. 4617, pp. 318–329. Springer, Berlin (2007). doi:10.1007/978-3-540-73729-2_30CrossRef Karaboga, D., Akay, B., Ozturk, C.: Artificial bee colony (ABC) optimization algorithm for training feed-forward neural networks. In: Torra, V., Narukawa, Y., Yoshida, Y. (eds.) MDAI 2007. LNCS (LNAI), vol. 4617, pp. 318–329. Springer, Berlin (2007). doi:10.​1007/​978-3-540-73729-2_​30CrossRef
12.
Zurück zum Zitat Karaboga, D., Ozturk, C.: Neural networks training by artificial bee colony algorithm on pattern classification. Neural Netw. World 19(3), 279–292 (2009) Karaboga, D., Ozturk, C.: Neural networks training by artificial bee colony algorithm on pattern classification. Neural Netw. World 19(3), 279–292 (2009)
13.
Zurück zum Zitat Yao, X.: Evolutionary artificial neural networks. Int. J. Neural Syst. 4(03), 203–222 (1993)CrossRef Yao, X.: Evolutionary artificial neural networks. Int. J. Neural Syst. 4(03), 203–222 (1993)CrossRef
15.
Zurück zum Zitat Yang, X.S.: A new metaheuristic bat-inspired algorithm. In: González, J.R., Pelta, D.A., Cruz, C., Terrazas, G., Krasnogor, N. (eds.) Nature Inspired Cooperative Strategies for Optimization (NICSO 2010), pp. 65–74. Springer, Heidelberg (2010)CrossRef Yang, X.S.: A new metaheuristic bat-inspired algorithm. In: González, J.R., Pelta, D.A., Cruz, C., Terrazas, G., Krasnogor, N. (eds.) Nature Inspired Cooperative Strategies for Optimization (NICSO 2010), pp. 65–74. Springer, Heidelberg (2010)CrossRef
16.
Zurück zum Zitat Nawi, N.M., Rehman, M.Z., Khan, A.: A new bat based back-propagation (BAT-BP) algorithm. In: Swiątek, J., Grzech, A., Swiątek, P., Tomczak, J.M. (eds.). AISC, vol. 240, pp. 395–404 Springer, Cham (2014). doi:10.1007/978-3-319-01857-7_38CrossRef Nawi, N.M., Rehman, M.Z., Khan, A.: A new bat based back-propagation (BAT-BP) algorithm. In: Swiątek, J., Grzech, A., Swiątek, P., Tomczak, J.M. (eds.). AISC, vol. 240, pp. 395–404 Springer, Cham (2014). doi:10.​1007/​978-3-319-01857-7_​38CrossRef
17.
Zurück zum Zitat Nawi, N.M., Khan, A., Rehman, M.Z.: CSLM: levenberg marquardt based back propagation algorithm optimized with cuckoo search. J. ICT Res. Appl. 7(2), 103–116 (2013)CrossRef Nawi, N.M., Khan, A., Rehman, M.Z.: CSLM: levenberg marquardt based back propagation algorithm optimized with cuckoo search. J. ICT Res. Appl. 7(2), 103–116 (2013)CrossRef
18.
Zurück zum Zitat Montana, D.J., Davis, L.: Training feedforward neural networks using genetic algorithms. In: IJCAI (1989) Montana, D.J., Davis, L.: Training feedforward neural networks using genetic algorithms. In: IJCAI (1989)
19.
Zurück zum Zitat Meng, X., Liu, Y., Gao, X., Zhang, H.: A new bio-inspired algorithm: chicken swarm optimization. In: Tan, Y., Shi, Y., Coello, C.A. (eds.) ICSI 2014. LNCS, vol. 8794, pp. 86–94. Springer, Cham (2014). doi:10.1007/978-3-319-11857-4_10CrossRef Meng, X., Liu, Y., Gao, X., Zhang, H.: A new bio-inspired algorithm: chicken swarm optimization. In: Tan, Y., Shi, Y., Coello, C.A. (eds.) ICSI 2014. LNCS, vol. 8794, pp. 86–94. Springer, Cham (2014). doi:10.​1007/​978-3-319-11857-4_​10CrossRef
20.
Zurück zum Zitat Fisher, R.A.: The use of multiple measurements in taxonomic problems. Ann. Eugenics 7, 179–188 (1936)CrossRef Fisher, R.A.: The use of multiple measurements in taxonomic problems. Ann. Eugenics 7, 179–188 (1936)CrossRef
Metadaten
Titel
Chicken S-BP: An Efficient Chicken Swarm Based Back-Propagation Algorithm
verfasst von
Abdullah Khan
Nazri Mohd Nawi
Rahmat Shah
Nasreen Akhter
Atta Ullah
M. Z. Rehman
Norhamreeza AbdulHamid
Haruna Chiroma
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-51281-5_13