Skip to main content

2019 | OriginalPaper | Buchkapitel

9. Evolutionary Deep Neural Networks

verfasst von : Seyedali Mirjalili

Erschienen in: Evolutionary Algorithms and Neural Networks

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter first employs a kinematic model of hand to create two datasets for static hand postures. Neural Networks with different learning algorithms are then applied to the datasets for classification. The chapter also considers the comparison and analysis of different evolutionary algorithms for classifying datasets as well. Another contribution is finding the best set of features for the dataset using evolutionary algorithms. The results show that due to the large number of samples and features, Back Propagation is not effective due to the problem of local optima stagnation. However, Evolutionary Algorithms are able to efficiently classify the dataset with a very high accuracy and convergence speed. It was also observed that feature selection is important and evolutionary algorithms are able to find the optimal set of features for this problem.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat McCulloch, W. S., & Pitts, W. (1990). A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biology, 52(1), 99–115.CrossRef McCulloch, W. S., & Pitts, W. (1990). A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biology, 52(1), 99–115.CrossRef
2.
Zurück zum Zitat Kiang, M. Y. (2001). Extending the Kohonen self-organizing map networks for clustering analysis. Computational Statistics & Data Analysis, 38, 161–180.MathSciNetCrossRef Kiang, M. Y. (2001). Extending the Kohonen self-organizing map networks for clustering analysis. Computational Statistics & Data Analysis, 38, 161–180.MathSciNetCrossRef
3.
Zurück zum Zitat Gudise, V. G., & Venayagamoorthy, G. K. (2003) Comparison of particle swarm optimization and backpropagation as training algorithms for neural networks. In Proceedings of the 2003 IEEE swarm intelligence symposium. SIS’03 (pp. 110–117). Gudise, V. G., & Venayagamoorthy, G. K. (2003) Comparison of particle swarm optimization and backpropagation as training algorithms for neural networks. In Proceedings of the 2003 IEEE swarm intelligence symposium. SIS’03 (pp. 110–117).
4.
Zurück zum Zitat Bebis, G., & Georgiopoulos, M. (1994). Feed-forward neural networks. IEEE Potentials, 13, 27–31.CrossRef Bebis, G., & Georgiopoulos, M. (1994). Feed-forward neural networks. IEEE Potentials, 13, 27–31.CrossRef
5.
Zurück zum Zitat Lang, B. (2005). Monotonic multi-layer perceptron networks as universal approximators. In International conference on artificial neural networks (pp. 31–37). Lang, B. (2005). Monotonic multi-layer perceptron networks as universal approximators. In International conference on artificial neural networks (pp. 31–37).
6.
Zurück zum Zitat Ciregan, D., Meier, U., & Schmidhuber, J. (2012). Multi-column deep neural networks for image classification. In 2012 IEEE conference on computer vision and pattern recognition (CVPR) (pp. 3642–3649). Ciregan, D., Meier, U., & Schmidhuber, J. (2012). Multi-column deep neural networks for image classification. In 2012 IEEE conference on computer vision and pattern recognition (CVPR) (pp. 3642–3649).
7.
Zurück zum Zitat Li, J., Cheng, J.-H., Shi, J.-Y., & Huang, F. (2012). Brief introduction of back propagation (BP) neural network algorithm and its improvement. In Advances in computer science and information engineering (pp. 553–558). Springer. Li, J., Cheng, J.-H., Shi, J.-Y., & Huang, F. (2012). Brief introduction of back propagation (BP) neural network algorithm and its improvement. In Advances in computer science and information engineering (pp. 553–558). Springer.
8.
Zurück zum Zitat Lee, Y., Oh, S.-H., & Kim, M. W. (1993). An analysis of premature saturation in back propagation learning. Neural Networks, 6, 719–728.CrossRef Lee, Y., Oh, S.-H., & Kim, M. W. (1993). An analysis of premature saturation in back propagation learning. Neural Networks, 6, 719–728.CrossRef
9.
Zurück zum Zitat Ibnkahla, M. (2003). Nonlinear system identification using neural networks trained with natural gradient descent. EURASIP Journal on Advances in Signal Processing, 2003, 1–9.CrossRef Ibnkahla, M. (2003). Nonlinear system identification using neural networks trained with natural gradient descent. EURASIP Journal on Advances in Signal Processing, 2003, 1–9.CrossRef
10.
Zurück zum Zitat Siddique, N., & Adeli, H. (2013). Evolutionary neural networks. In Computational intelligence: synergies of fuzzy logic, neural networks and evolutionary computing (pp. 307–355). Siddique, N., & Adeli, H. (2013). Evolutionary neural networks. In Computational intelligence: synergies of fuzzy logic, neural networks and evolutionary computing (pp. 307–355).
11.
Zurück zum Zitat BoussaD, I., Lepagnot, J., & Siarry, P. (2013). A survey on optimization metaheuristics. Information Sciences, 237, 82–117.MathSciNetCrossRef BoussaD, I., Lepagnot, J., & Siarry, P. (2013). A survey on optimization metaheuristics. Information Sciences, 237, 82–117.MathSciNetCrossRef
12.
Zurück zum Zitat Schaffer, J. D., Whitley, D., Eshelman, L. J. (1992) Combinations of genetic algorithms and neural networks: A survey of the state of the art. In International workshop on combinations of genetic algorithms and neural networks. COGANN-92 (pp. 1–37). Schaffer, J. D., Whitley, D., Eshelman, L. J. (1992) Combinations of genetic algorithms and neural networks: A survey of the state of the art. In International workshop on combinations of genetic algorithms and neural networks. COGANN-92 (pp. 1–37).
13.
Zurück zum Zitat Khan, K., & Sahai, A. (2012). A comparison of BA, GA, PSO, BP and LM for training feed forward neural networks in e-learning context. International Journal of Intelligent Systems and Applications, 4, 23. Khan, K., & Sahai, A. (2012). A comparison of BA, GA, PSO, BP and LM for training feed forward neural networks in e-learning context. International Journal of Intelligent Systems and Applications, 4, 23.
14.
Zurück zum Zitat Ilonen, J., Kamarainen, J.-K., & Lampinen, J. (2003). Differential evolution training algorithm for feed-forward neural networks. Neural Processing Letters, 17, 93–105.CrossRef Ilonen, J., Kamarainen, J.-K., & Lampinen, J. (2003). Differential evolution training algorithm for feed-forward neural networks. Neural Processing Letters, 17, 93–105.CrossRef
15.
Zurück zum Zitat Magoulas, G. D., Plagianakos, V. P., & Vrahatis, M. N. (2004). Neural network-based colonoscopic diagnosis using on-line learning and differential evolution. Applied Soft Computing, 4, 369–379.CrossRef Magoulas, G. D., Plagianakos, V. P., & Vrahatis, M. N. (2004). Neural network-based colonoscopic diagnosis using on-line learning and differential evolution. Applied Soft Computing, 4, 369–379.CrossRef
16.
Zurück zum Zitat Oberweger, M., Riegler, G., Wohlhart, P., & Lepetit, V. (2016). Efficiently creating 3D training data for fine hand pose estimation. arXiv preprint arXiv:1605.03389. Oberweger, M., Riegler, G., Wohlhart, P., & Lepetit, V. (2016). Efficiently creating 3D training data for fine hand pose estimation. arXiv preprint arXiv:​1605.​03389.
17.
Zurück zum Zitat Malvezzi, M., Gioioso, G., Salvietti, G., Prattichizzo, D., & Bicchi, A. (2013). Syngrasp: A matlab toolbox for grasp analysis of human and robotic hands. In IEEE international conference on robotics and automation (ICRA) (pp. 1088–1093). Malvezzi, M., Gioioso, G., Salvietti, G., Prattichizzo, D., & Bicchi, A. (2013). Syngrasp: A matlab toolbox for grasp analysis of human and robotic hands. In IEEE international conference on robotics and automation (ICRA) (pp. 1088–1093).
18.
Zurück zum Zitat Malvezzi, M., Gioioso, G., Salvietti, G., & Prattichizzo, D. (2015). Syngrasp: A matlab toolbox for underactuated and compliant hands. IEEE Robotics & Automation Magazine, 22, 52–68.CrossRef Malvezzi, M., Gioioso, G., Salvietti, G., & Prattichizzo, D. (2015). Syngrasp: A matlab toolbox for underactuated and compliant hands. IEEE Robotics & Automation Magazine, 22, 52–68.CrossRef
19.
Zurück zum Zitat Kennedy, J. (2011). Particle swarm optimization. In Encyclopedia of machine learning (pp. 760–766). Springer. Kennedy, J. (2011). Particle swarm optimization. In Encyclopedia of machine learning (pp. 760–766). Springer.
20.
Zurück zum Zitat Das, S. (2001). Filters, wrappers and a boosting-based hybrid for feature selection. In ICML (pp. 74–81). Das, S. (2001). Filters, wrappers and a boosting-based hybrid for feature selection. In ICML (pp. 74–81).
Metadaten
Titel
Evolutionary Deep Neural Networks
verfasst von
Seyedali Mirjalili
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-319-93025-1_9

Premium Partner