Skip to main content
Erschienen in: Wireless Personal Communications 4/2017

03.04.2017

Neural Network Trained by Biogeography-Based Optimizer with Chaos for Sonar Data Set Classification

verfasst von: M. R. Mosavi, M. Khishe, M. Akbarisani

Erschienen in: Wireless Personal Communications | Ausgabe 4/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multi-layer Perceptron Neural Networks (MLP NNs) are one of the most popular NNs in classification of the actual objectives. “Training” is the most important developmental section of these types of networks which has gained a lot of attention in the recent years. Using the gradient descent and recursive methods have been common for the purposes of training the MLP networks from a long time ago. Improper classification, being stuck in the local minimums and low convergence speed are amongst the drawbacks of the traditional methods. Using the heuristic and meta-heuristic algorithms became very popular in the recent year for the purposes of overcoming these drawbacks. This paper uses a method named “biogeography-based optimizer (BBO) with Chaos (CBBO)” to train the MLP NNs. This method presents greater discovery capabilities in comparison with the heuristic methods with regard to the immigration and emigration operators and also separate mutations for each individual. This algorithm will be compared with the ant colony optimization, particle swarm optimization, genetics algorithm, differential evolution and also the classic BBO through four data sets in order to test the presented method. The measured metrics include the convergence speed, the probability of getting stuck in local minimums, and classification accuracy. The results indicate that the new algorithm presents better or comparable results in all cases in comparison with the mentioned algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Let a biogeography-based optimizer train your multi-layer perceptron. Journal of Information Sciences, 269, 188–209.MathSciNetCrossRef Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Let a biogeography-based optimizer train your multi-layer perceptron. Journal of Information Sciences, 269, 188–209.MathSciNetCrossRef
2.
Zurück zum Zitat Abedifar, V., Eshghi, M., Mirjalili, S., & M. Mirjalili, S. (2013). An optimized virtual network mapping using PSO in cloud computing. In 21st Iranian Conference on Electrical Engineering (pp 1–6). Abedifar, V., Eshghi, M., Mirjalili, S., & M. Mirjalili, S. (2013). An optimized virtual network mapping using PSO in cloud computing. In 21st Iranian Conference on Electrical Engineering (pp 1–6).
3.
Zurück zum Zitat Nguyen, L. S., Frauendorfer, D., Mast, M. S., & Gatica-Perez, D. (2014). Hire me: Computational inference of hirability in employment interviews based on nonverbal behavior. IEEE Transactions on Multimedia, 16(4), 1018–1031.CrossRef Nguyen, L. S., Frauendorfer, D., Mast, M. S., & Gatica-Perez, D. (2014). Hire me: Computational inference of hirability in employment interviews based on nonverbal behavior. IEEE Transactions on Multimedia, 16(4), 1018–1031.CrossRef
4.
Zurück zum Zitat Auer, P., Burgsteiner, H., & Maass, W. (2008). A learning rule for very simple universal approximators consisting of a single layer of perceptrons. Journal of Neural Networks, 21(5), 786–795.CrossRefMATH Auer, P., Burgsteiner, H., & Maass, W. (2008). A learning rule for very simple universal approximators consisting of a single layer of perceptrons. Journal of Neural Networks, 21(5), 786–795.CrossRefMATH
5.
Zurück zum Zitat Barakat, M., Lefebvre, D., Khalil, M., Druaux, F., & Mustapha, O. (2013). Parameter selection algorithm with self adaptive growing neural network classifier for diagnosis issues. Journal of Machine Learning and Cybernetics, 4(3), 217–233.CrossRef Barakat, M., Lefebvre, D., Khalil, M., Druaux, F., & Mustapha, O. (2013). Parameter selection algorithm with self adaptive growing neural network classifier for diagnosis issues. Journal of Machine Learning and Cybernetics, 4(3), 217–233.CrossRef
6.
Zurück zum Zitat Guo, Z. X., Wong, W. K., & Li, M. (2012). Sparsely connected neural network-based time series forecasting. Information Sciences, 193, 54–71.CrossRef Guo, Z. X., Wong, W. K., & Li, M. (2012). Sparsely connected neural network-based time series forecasting. Information Sciences, 193, 54–71.CrossRef
7.
Zurück zum Zitat Csáji, B. C. (2001). Approximation with artificial neural networks. Hungary: Faculty of Sciences, Etvs Lornd University. Csáji, B. C. (2001). Approximation with artificial neural networks. Hungary: Faculty of Sciences, Etvs Lornd University.
8.
Zurück zum Zitat Reed, R. D., & Marks, R. J. (1999). Neural smithing: Supervised learning in feedforward artificial neural networks. Cambridge: MIT Press. Reed, R. D., & Marks, R. J. (1999). Neural smithing: Supervised learning in feedforward artificial neural networks. Cambridge: MIT Press.
10.
Zurück zum Zitat Zhang, N. (2009). An online gradient method with momentum for two-layer feedforward neural networks. Applied Mathematics and Computation, 212(2), 488–498.MathSciNetCrossRefMATH Zhang, N. (2009). An online gradient method with momentum for two-layer feedforward neural networks. Applied Mathematics and Computation, 212(2), 488–498.MathSciNetCrossRefMATH
11.
Zurück zum Zitat Hush, D. R., & Home, B. G. (1993). Progress in supervised neural networks. IEEE Signal Processing Magazine, 10(1), 8–39.CrossRef Hush, D. R., & Home, B. G. (1993). Progress in supervised neural networks. IEEE Signal Processing Magazine, 10(1), 8–39.CrossRef
12.
Zurück zum Zitat Ng, S. C., Cheung, C. C., Leung, S. H., & Luk, A. (2003). Fast convergence for backpropagation network with magnified gradient function. IEEE Joint Conference on Neural Networks, 3, 1903–1908. Ng, S. C., Cheung, C. C., Leung, S. H., & Luk, A. (2003). Fast convergence for backpropagation network with magnified gradient function. IEEE Joint Conference on Neural Networks, 3, 1903–1908.
13.
Zurück zum Zitat Magoulas, G. D., Vrahatis, M. N., & Androulakis, G. S. (1997). On the alleviation of the problem of local minima in back-propagation. Nonlinear Analysis, Theory, Methods & Applications, 30(7), 4545–4550.MathSciNetCrossRefMATH Magoulas, G. D., Vrahatis, M. N., & Androulakis, G. S. (1997). On the alleviation of the problem of local minima in back-propagation. Nonlinear Analysis, Theory, Methods & Applications, 30(7), 4545–4550.MathSciNetCrossRefMATH
14.
Zurück zum Zitat Ho, Y. C., & Pepyne, D. L. (2002). Simple explanation of the no-free-lunch theorem and its implications. Journal of Optimization Theory and Applications, 115(3), 549–570.MathSciNetCrossRefMATH Ho, Y. C., & Pepyne, D. L. (2002). Simple explanation of the no-free-lunch theorem and its implications. Journal of Optimization Theory and Applications, 115(3), 549–570.MathSciNetCrossRefMATH
15.
Zurück zum Zitat Wang, P., Yu, X., & Lu, J. (2014). Identification and evolution of structurally dominant nodes in protein–protein interaction networks. IEEE Transactions on Biomedical Circuits and Systems, 8(1), 87–97.CrossRef Wang, P., Yu, X., & Lu, J. (2014). Identification and evolution of structurally dominant nodes in protein–protein interaction networks. IEEE Transactions on Biomedical Circuits and Systems, 8(1), 87–97.CrossRef
16.
Zurück zum Zitat Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Grey wolf optimizer. Advances in Engineering Software, 69, 46–61.CrossRef Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Grey wolf optimizer. Advances in Engineering Software, 69, 46–61.CrossRef
17.
Zurück zum Zitat Mendes, R., Cortez, P., Rocha, M., & Neves, J. (2002). Particle swarms for feedforward neural network training. In IEEE Joint Conference on Neural Networks (Vol. 2, pp. 1895–1899). Mendes, R., Cortez, P., Rocha, M., & Neves, J. (2002). Particle swarms for feedforward neural network training. In IEEE Joint Conference on Neural Networks (Vol. 2, pp. 1895–1899).
18.
Zurück zum Zitat Seiffert, U. (2001). Multiple layer perceptron training using genetic algorithms. In European Symposium on Artificial Neural Networks (pp. 159–164). Seiffert, U. (2001). Multiple layer perceptron training using genetic algorithms. In European Symposium on Artificial Neural Networks (pp. 159–164).
19.
Zurück zum Zitat Blum, C., & Socha, K. (2005). Training feed-forward neural networks with ant colony optimization: An application to pattern classification. In Hybrid Intelligent Systems Conference (pp. 6–14). Blum, C., & Socha, K. (2005). Training feed-forward neural networks with ant colony optimization: An application to pattern classification. In Hybrid Intelligent Systems Conference (pp. 6–14).
20.
Zurück zum Zitat Li, G., Na, J., Stoten, D., & Ren, X. (2014). Adaptive neural network feedforward control for dynamically substructured systems. IEEE Transactions on Control Systems Technology, 22(3), 944–954.CrossRef Li, G., Na, J., Stoten, D., & Ren, X. (2014). Adaptive neural network feedforward control for dynamically substructured systems. IEEE Transactions on Control Systems Technology, 22(3), 944–954.CrossRef
21.
Zurück zum Zitat Boussaid, I., Lepagnot, J., & Siarry, P. (2013). A survey on optimization metaheuristics. Information Sciences, 237, 82–117.MathSciNetCrossRefMATH Boussaid, I., Lepagnot, J., & Siarry, P. (2013). A survey on optimization metaheuristics. Information Sciences, 237, 82–117.MathSciNetCrossRefMATH
22.
Zurück zum Zitat Mirjalili, S. M., Mirjalili, S., & Lewis, A. (2014). A novel multi-objective optimization framework for designing photonic crystal waveguides. Photonics Technology Letters, 26(2), 146–149.CrossRef Mirjalili, S. M., Mirjalili, S., & Lewis, A. (2014). A novel multi-objective optimization framework for designing photonic crystal waveguides. Photonics Technology Letters, 26(2), 146–149.CrossRef
23.
Zurück zum Zitat Mirjalili, S. M., Mirjalili, S., Lewis, A., & Abedi, K. (2014). A tri-objective particle swarm optimizer for designing line defect photonic crystal waveguides. Photonics and Nanostructures Fundamentals and Applications, 12(2), 152–163.CrossRef Mirjalili, S. M., Mirjalili, S., Lewis, A., & Abedi, K. (2014). A tri-objective particle swarm optimizer for designing line defect photonic crystal waveguides. Photonics and Nanostructures Fundamentals and Applications, 12(2), 152–163.CrossRef
24.
Zurück zum Zitat Saremi, S., Mirjalili, S. M., & Mirjalili, S. (2014). Unit cell topology optimization of line defect photonic crystal waveguide. Procedia Technology, 12, 174–179.CrossRef Saremi, S., Mirjalili, S. M., & Mirjalili, S. (2014). Unit cell topology optimization of line defect photonic crystal waveguide. Procedia Technology, 12, 174–179.CrossRef
25.
Zurück zum Zitat Saremi, S., Mirjalili, S. M., & Mirjalili, S. (2014). Chaotic krill herd optimization algorithm. Procedia Technology, 12, 180–185.CrossRef Saremi, S., Mirjalili, S. M., & Mirjalili, S. (2014). Chaotic krill herd optimization algorithm. Procedia Technology, 12, 180–185.CrossRef
26.
Zurück zum Zitat Mirjalili, S. M., & Mirjalili, S. (2014). Oval-shaped-hole photonic crystal waveguide design by MoMIR framework. Photonics Technology Letters, 26(24), 2446–2449.CrossRef Mirjalili, S. M., & Mirjalili, S. (2014). Oval-shaped-hole photonic crystal waveguide design by MoMIR framework. Photonics Technology Letters, 26(24), 2446–2449.CrossRef
27.
Zurück zum Zitat Mirjalili, S., Mirjalili, S. M., & Yang, X. S. (2013). Binary bat algorithm. Neural Computing and Applications, 25(3–4), 663–681. Mirjalili, S., Mirjalili, S. M., & Yang, X. S. (2013). Binary bat algorithm. Neural Computing and Applications, 25(3–4), 663–681.
28.
Zurück zum Zitat Lin, L., & Gen, M. (2009). Auto-tuning strategy for evolutionary algorithms: balancing between exploration and exploitation. Soft Computing, 13(2), 157–168.CrossRefMATH Lin, L., & Gen, M. (2009). Auto-tuning strategy for evolutionary algorithms: balancing between exploration and exploitation. Soft Computing, 13(2), 157–168.CrossRefMATH
29.
Zurück zum Zitat Olorunda, O., & Engelbrecht, A. P. (2008). Measuring exploration/exploitation in particle swarms using swarm diversity. In IEEE World Congress on Computational Intelligence (pp. 1128–1134). Olorunda, O., & Engelbrecht, A. P. (2008). Measuring exploration/exploitation in particle swarms using swarm diversity. In IEEE World Congress on Computational Intelligence (pp. 1128–1134).
30.
Zurück zum Zitat Guo, W., Wang, L., & Wu, Q. (2014). An analysis of the migration rates for biogeography-based optimization. Information Science, 254, 111–140.MathSciNetCrossRef Guo, W., Wang, L., & Wu, Q. (2014). An analysis of the migration rates for biogeography-based optimization. Information Science, 254, 111–140.MathSciNetCrossRef
31.
Zurück zum Zitat Saremi, S., Mirjalili, S., & Lewis, A. (2014). Biogeography-based optimization with chaos. Neural Computing and Applications, 25(5), 1077–1097.CrossRef Saremi, S., Mirjalili, S., & Lewis, A. (2014). Biogeography-based optimization with chaos. Neural Computing and Applications, 25(5), 1077–1097.CrossRef
32.
Zurück zum Zitat Zhang, J. R., Zhang, J., Lok, T. M., & Lyu, M. R. (2007). A hybrid particle swarm optimization—back-propagation algorithm for feedforward neural network training. Applied Mathematics and Computation, 185(2), 1026–1037.CrossRefMATH Zhang, J. R., Zhang, J., Lok, T. M., & Lyu, M. R. (2007). A hybrid particle swarm optimization—back-propagation algorithm for feedforward neural network training. Applied Mathematics and Computation, 185(2), 1026–1037.CrossRefMATH
Metadaten
Titel
Neural Network Trained by Biogeography-Based Optimizer with Chaos for Sonar Data Set Classification
verfasst von
M. R. Mosavi
M. Khishe
M. Akbarisani
Publikationsdatum
03.04.2017
Verlag
Springer US
Erschienen in
Wireless Personal Communications / Ausgabe 4/2017
Print ISSN: 0929-6212
Elektronische ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-017-4110-x

Weitere Artikel der Ausgabe 4/2017

Wireless Personal Communications 4/2017 Zur Ausgabe