Skip to main content

2018 | OriginalPaper | Buchkapitel

Breaking the Stereotypical Dogma of Artificial Neural Networks with Cartesian Genetic Programming

verfasst von : Gul Muhammad Khan, Arbab Masood Ahmad

Erschienen in: Inspired by Nature

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter presents the work done in the field of Cartesian Genetic Programming evolved Artificial Neural Networks (CGPANN). Three types of CGPANN are presented, the Feed-forward CGPANN (FFCGPAN), Recurrent CGPANN and the CGPANN that has developmental plasticity, also called Plastic CGPANN or PCGPANN. Each of these networks is explained with the help of diagrams. Performance results obtained for a number of benchmark problems using these networks are illustrated with the help of tables. Artificial Neural Networks (ANNs) suffer from the dilemma of how to select complexity of the network for a specific task, what should be the pattern of inter-connectivity, and in case of feedback, what topology will produce the best possible results. Cartesian Genetic Programming (CGP) offers the ability to select not only the desired network complexity but also the inter-connectivity patterns, topology of feedback systems, and above all, decides which input parameters should be weighted more or less and which one to be neglected. In this chapter we discuss how CGP is used to evolve the architecture of Neural Networks for optimum network and characteristics. Don’t you want a system that designs everything for you? That helps you select the optimal network, the inter-connectivity, the topology, the complexity, input parameters selection and input sensitivity? If yes, then CGP evolved Artificial Neural Network (CGPANN) and CGP evolved Recurrent Neural Network (CGPRNN) is the answer to your questions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ali, J., Khan, G.M., Mahmud, S.A.: Enhancing growth curve approach using CGPANN for predicting the sustainability of new food products. In: IFIP International Conference on Artificial Intelligence Applications and Innovations, pp. 286–297. Springer (2014) Ali, J., Khan, G.M., Mahmud, S.A.: Enhancing growth curve approach using CGPANN for predicting the sustainability of new food products. In: IFIP International Conference on Artificial Intelligence Applications and Innovations, pp. 286–297. Springer (2014)
2.
Zurück zum Zitat Arbab, M.A., Khan, G.M., Sahibzada, A.M.: Cardiac arrhythmia classification using cartesian genetic programming evolved artificial neural network. Exp. Clin. Cardiol. 20(9) (2014) Arbab, M.A., Khan, G.M., Sahibzada, A.M.: Cardiac arrhythmia classification using cartesian genetic programming evolved artificial neural network. Exp. Clin. Cardiol. 20(9) (2014)
3.
Zurück zum Zitat Bidlo, M.: Evolutionary design of generic combinational multipliers using development. In: International Conference on Evolvable Systems, pp. 77–88. Springer (2007) Bidlo, M.: Evolutionary design of generic combinational multipliers using development. In: International Conference on Evolvable Systems, pp. 77–88. Springer (2007)
4.
Zurück zum Zitat Carpenter, G.A., Grossberg, S.: The art of adaptive pattern recognition by a self-organizing neural network. Computer 21(3), 77–88 (1988)CrossRef Carpenter, G.A., Grossberg, S.: The art of adaptive pattern recognition by a self-organizing neural network. Computer 21(3), 77–88 (1988)CrossRef
5.
Zurück zum Zitat Fekiač, J., Zelinka, I., Burguillo, J.C.: A review of methods for encoding neural network topologies in evolutionary computation. In: Proceedings of 25th European Conference on Modeling and Simulation ECMS 2011, pp. 410–416 (2011) Fekiač, J., Zelinka, I., Burguillo, J.C.: A review of methods for encoding neural network topologies in evolutionary computation. In: Proceedings of 25th European Conference on Modeling and Simulation ECMS 2011, pp. 410–416 (2011)
6.
Zurück zum Zitat Gomez, F., Schmidhuber, J., Miikkulainen, R.: Accelerated neural evolution through cooperatively coevolved synapses. J. Mach. Learn. Res. 9(May), 937–965 (2008)MATHMathSciNet Gomez, F., Schmidhuber, J., Miikkulainen, R.: Accelerated neural evolution through cooperatively coevolved synapses. J. Mach. Learn. Res. 9(May), 937–965 (2008)MATHMathSciNet
7.
Zurück zum Zitat Gomez, F.J., Miikkulainen, R.: Solving non-markovian control tasks with neuroevolution. IJCAI 99, 1356–1361 (1999) Gomez, F.J., Miikkulainen, R.: Solving non-markovian control tasks with neuroevolution. IJCAI 99, 1356–1361 (1999)
8.
Zurück zum Zitat Guo, H., Nandi, A.K.: Breast cancer diagnosis using genetic programming generated feature. Pattern Recognit. 39(5), 980–987 (2006)CrossRef Guo, H., Nandi, A.K.: Breast cancer diagnosis using genetic programming generated feature. Pattern Recognit. 39(5), 980–987 (2006)CrossRef
9.
Zurück zum Zitat Haider, A., Hanif, M.N.: Inflation forecasting in Pakistan using artificial neural networks. Pak. Econ. Soc. Rev. 123–138 (2009) Haider, A., Hanif, M.N.: Inflation forecasting in Pakistan using artificial neural networks. Pak. Econ. Soc. Rev. 123–138 (2009)
10.
Zurück zum Zitat Iranpour, M., Almassi, S., Analoui, M.: Breast cancer detection from fna using svm and rbf classifier. In: 1st Joint Congress on Fuzzy and Intelligent Systems (2007) Iranpour, M., Almassi, S., Analoui, M.: Breast cancer detection from fna using svm and rbf classifier. In: 1st Joint Congress on Fuzzy and Intelligent Systems (2007)
11.
Zurück zum Zitat Jordan, M.I.: Attractor dynamics and parallellism in a connectionist sequential machine. In: Proceedings of the 8th Confererence of the Cognitive Science Society, pp. 531–546. Lawrence Erlbaum Associates (1986) Jordan, M.I.: Attractor dynamics and parallellism in a connectionist sequential machine. In: Proceedings of the 8th Confererence of the Cognitive Science Society, pp. 531–546. Lawrence Erlbaum Associates (1986)
12.
Zurück zum Zitat Kamruzzaman, J., Sarker, R.A.: Forecasting of currency exchange rates using ANN: a case study. In: Neural Networks and Signal Processing, 2003. Proceedings of the 2003 International Conference on, vol. 1, pp. 793–797. IEEE (2003, December) Kamruzzaman, J., Sarker, R.A.: Forecasting of currency exchange rates using ANN: a case study. In: Neural Networks and Signal Processing, 2003. Proceedings of the 2003 International Conference on, vol. 1, pp. 793–797. IEEE (2003, December)
13.
Zurück zum Zitat Khan, G.M., Ali, J., Mahmud, S.A.: Wind power forecastingan application of machine learning in renewable energy. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1130–1137. IEEE (2014) Khan, G.M., Ali, J., Mahmud, S.A.: Wind power forecastingan application of machine learning in renewable energy. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1130–1137. IEEE (2014)
14.
Zurück zum Zitat Khan, G.M., Khattak, A.R., Zafari, F., Mahmud, S.A.: Electrical load forecasting using fast learning recurrent neural networks. In: The 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–6. IEEE (2013) Khan, G.M., Khattak, A.R., Zafari, F., Mahmud, S.A.: Electrical load forecasting using fast learning recurrent neural networks. In: The 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–6. IEEE (2013)
15.
Zurück zum Zitat Khan, G.M., Nayab, D., Mahmud, S.A., Zafar, H.: Evolving dynamic forecasting model for foreign currency exchange rates using plastic neural networks. In: 2013 12th International Conference on Machine Learning and Applications (ICMLA), vol. 2, pp. 15–20. IEEE (2013) Khan, G.M., Nayab, D., Mahmud, S.A., Zafar, H.: Evolving dynamic forecasting model for foreign currency exchange rates using plastic neural networks. In: 2013 12th International Conference on Machine Learning and Applications (ICMLA), vol. 2, pp. 15–20. IEEE (2013)
16.
Zurück zum Zitat Khan, G.M., Ullah, F., Mahmud, S.A.: MPEG-4 internet traffic estimation using recurrent CGPANN. In: International Conference on Engineering Applications of Neural Networks, pp. 22–31. Springer (2013) Khan, G.M., Ullah, F., Mahmud, S.A.: MPEG-4 internet traffic estimation using recurrent CGPANN. In: International Conference on Engineering Applications of Neural Networks, pp. 22–31. Springer (2013)
17.
Zurück zum Zitat Khan, G.M., Zafari, F.: Dynamic feedback neuro-evolutionary networks for forecasting the highly fluctuating electrical loads. Genet. Program. Evolvable Mach. 17(4), 391–408 (2016)CrossRef Khan, G.M., Zafari, F.: Dynamic feedback neuro-evolutionary networks for forecasting the highly fluctuating electrical loads. Genet. Program. Evolvable Mach. 17(4), 391–408 (2016)CrossRef
18.
Zurück zum Zitat Khan, G.M., Zafari, F., Mahmud, S.A.: Very short term load forecasting using cartesian genetic programming evolved recurrent neural networks (CGPRNN). In: 2013 12th International Conference on Machine Learning and Applications (ICMLA), vol. 2, pp. 152–155. IEEE (2013) Khan, G.M., Zafari, F., Mahmud, S.A.: Very short term load forecasting using cartesian genetic programming evolved recurrent neural networks (CGPRNN). In: 2013 12th International Conference on Machine Learning and Applications (ICMLA), vol. 2, pp. 152–155. IEEE (2013)
19.
Zurück zum Zitat Khan, M.M., Ahmad, A.M., Khan, G.M., Miller, J.F.: Fast learning neural networks using cartesian genetic programming. Neurocomputing 121, 274–289 (2013)CrossRef Khan, M.M., Ahmad, A.M., Khan, G.M., Miller, J.F.: Fast learning neural networks using cartesian genetic programming. Neurocomputing 121, 274–289 (2013)CrossRef
20.
Zurück zum Zitat Khan, M.M., Khan, G.M., Miller, J.F.: Developmental plasticity in cartesian genetic programming artificial neural networks. In: Proceedings of the 8th International Conference on Informatics in Control, Automation and Robotics (ICINCO 2011), pp. 449–458. SciTePress (2011) Khan, M.M., Khan, G.M., Miller, J.F.: Developmental plasticity in cartesian genetic programming artificial neural networks. In: Proceedings of the 8th International Conference on Informatics in Control, Automation and Robotics (ICINCO 2011), pp. 449–458. SciTePress (2011)
21.
Zurück zum Zitat Kryuchin, O.V., Arzamastsev, A.A., Troitzsch, K.G.: The prediction of currency exchange rates using artificial neural networks. Exch. Organ. Behav. Teach. J. 4 (2007) Kryuchin, O.V., Arzamastsev, A.A., Troitzsch, K.G.: The prediction of currency exchange rates using artificial neural networks. Exch. Organ. Behav. Teach. J. 4 (2007)
22.
Zurück zum Zitat Liu, K., Subbarayan, S., Shoults, R., Manry, M., Kwan, C., Lewis, F., Naccarino, J.: Comparison of very short-term load forecasting techniques. IEEE Trans. Power Syst. 11(2), 877–882 (1996)CrossRef Liu, K., Subbarayan, S., Shoults, R., Manry, M., Kwan, C., Lewis, F., Naccarino, J.: Comparison of very short-term load forecasting techniques. IEEE Trans. Power Syst. 11(2), 877–882 (1996)CrossRef
23.
Zurück zum Zitat Moriarty, D.E.: Symbiotic evolution of neural networks in sequential decision tasks. Ph.D. thesis, University of Texas at Austin USA (1997) Moriarty, D.E.: Symbiotic evolution of neural networks in sequential decision tasks. Ph.D. thesis, University of Texas at Austin USA (1997)
24.
Zurück zum Zitat Nayab, D., Khan, G.M., Mahmud, S.A.: Prediction of foreign currency exchange rates using cgpann. In: International Conference on Engineering Applications of Neural Networks, pp. 91–101. Springer (2013) Nayab, D., Khan, G.M., Mahmud, S.A.: Prediction of foreign currency exchange rates using cgpann. In: International Conference on Engineering Applications of Neural Networks, pp. 91–101. Springer (2013)
25.
Zurück zum Zitat Pan, Z., Nie, L.: Evolving both the topology and weights of neural networks. Parallel Algorithms Appl. 9(3–4), 299–307 (1996)CrossRefMATH Pan, Z., Nie, L.: Evolving both the topology and weights of neural networks. Parallel Algorithms Appl. 9(3–4), 299–307 (1996)CrossRefMATH
26.
Zurück zum Zitat Papadrakakis, M., Papadopoulos, V., Lagaros, N.D.: Structural reliability analyis of elastic-plastic structures using neural networks and monte carlo simulation. Comput. Methods Appl. Mech. Eng. 136(1–2), 145–163 (1996)CrossRefMATH Papadrakakis, M., Papadopoulos, V., Lagaros, N.D.: Structural reliability analyis of elastic-plastic structures using neural networks and monte carlo simulation. Comput. Methods Appl. Mech. Eng. 136(1–2), 145–163 (1996)CrossRefMATH
27.
Zurück zum Zitat Philip, A.A., Taofiki, A.A., Bidemi, A.A.: Artificial neural network model for forecasting foreign exchange rate. World Comput. Sci. Inf. Technol. J. (WCSIT) 1 (3) 110–118 (2011) Philip, A.A., Taofiki, A.A., Bidemi, A.A.: Artificial neural network model for forecasting foreign exchange rate. World Comput. Sci. Inf. Technol. J. (WCSIT) 1 (3) 110–118 (2011)
28.
Zurück zum Zitat Pujol, J.C.F., Poli, R.: Evolving the topology and the weights of neural networks using a dual representation. Appl. Intell. 8(1), 73–84 (1998)CrossRef Pujol, J.C.F., Poli, R.: Evolving the topology and the weights of neural networks using a dual representation. Appl. Intell. 8(1), 73–84 (1998)CrossRef
29.
Zurück zum Zitat Refenes, A.N., Azema-Barac, M., Chen, L., Karoussos, S.: Currency exchange rate prediction and neural network design strategies. Neural Comput. Appl. 1(1), 46–58 (1993)CrossRef Refenes, A.N., Azema-Barac, M., Chen, L., Karoussos, S.: Currency exchange rate prediction and neural network design strategies. Neural Comput. Appl. 1(1), 46–58 (1993)CrossRef
30.
Zurück zum Zitat Rehman, M., Ali, J., Khan, G.M., Mahmud, S.A.: Extracting trends ensembles in solar irradiance for green energy generation using neuro-evolution. In: IFIP International Conference on Artificial Intelligence Applications and Innovations, pp. 456–465. Springer (2014) Rehman, M., Ali, J., Khan, G.M., Mahmud, S.A.: Extracting trends ensembles in solar irradiance for green energy generation using neuro-evolution. In: IFIP International Conference on Artificial Intelligence Applications and Innovations, pp. 456–465. Springer (2014)
31.
Zurück zum Zitat Rehman, M., Khan, G.M., Mahmud, S.A.: Foreign currency exchange rates prediction using cgp and recurrent neural network. IERI Procedia 10, 239–244 (2014)CrossRef Rehman, M., Khan, G.M., Mahmud, S.A.: Foreign currency exchange rates prediction using cgp and recurrent neural network. IERI Procedia 10, 239–244 (2014)CrossRef
32.
Zurück zum Zitat Sadeghi, B.: A bp-neural network predictor model for plastic injection molding process. J. Mater. Process. Technol. 103(3), 411–416 (2000)CrossRefMathSciNet Sadeghi, B.: A bp-neural network predictor model for plastic injection molding process. J. Mater. Process. Technol. 103(3), 411–416 (2000)CrossRefMathSciNet
33.
Zurück zum Zitat Sarangi, P.P., Sahu, A., Panda, M.: A hybrid differential evolution and back-propagation algorithm for feedforward neural network training. Int. J. Comput. Appl. 84(14) (2013) Sarangi, P.P., Sahu, A., Panda, M.: A hybrid differential evolution and back-propagation algorithm for feedforward neural network training. Int. J. Comput. Appl. 84(14) (2013)
34.
Zurück zum Zitat Singh, D., Singh, S.: A self-selecting neural network for short-term load forecasting. Electr. Power Compon. Syst. 29(2), 117–130 (2001)CrossRef Singh, D., Singh, S.: A self-selecting neural network for short-term load forecasting. Electr. Power Compon. Syst. 29(2), 117–130 (2001)CrossRef
35.
Zurück zum Zitat Stanley, K.O., Miikkulainen, R.: Efficient reinforcement learning through evolving neural network topologies. In: Proceedings of the 4th Annual Conference on Genetic and Evolutionary Computation, pp. 569–577. Morgan Kaufmann Publishers Inc. (2002) Stanley, K.O., Miikkulainen, R.: Efficient reinforcement learning through evolving neural network topologies. In: Proceedings of the 4th Annual Conference on Genetic and Evolutionary Computation, pp. 569–577. Morgan Kaufmann Publishers Inc. (2002)
36.
Zurück zum Zitat Wieland, A.P.: Evolving neural network controllers for unstable systems. In: IJCNN-91-Seattle International Joint Conference on Neural Networks, 1991, vol. 2, pp. 667–673. IEEE (1991) Wieland, A.P.: Evolving neural network controllers for unstable systems. In: IJCNN-91-Seattle International Joint Conference on Neural Networks, 1991, vol. 2, pp. 667–673. IEEE (1991)
Metadaten
Titel
Breaking the Stereotypical Dogma of Artificial Neural Networks with Cartesian Genetic Programming
verfasst von
Gul Muhammad Khan
Arbab Masood Ahmad
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-67997-6_10