Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Evolvable Hardware Challenges: Past, Present and the Path to a Promising Future Read chapter Read first chapter

2018 | OriginalPaper | Chapter

Breaking the Stereotypical Dogma of Artificial Neural Networks with Cartesian Genetic Programming

Authors : Gul Muhammad Khan, Arbab Masood Ahmad

Published in: Inspired by Nature

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter presents the work done in the field of Cartesian Genetic Programming evolved Artificial Neural Networks (CGPANN). Three types of CGPANN are presented, the Feed-forward CGPANN (FFCGPAN), Recurrent CGPANN and the CGPANN that has developmental plasticity, also called Plastic CGPANN or PCGPANN. Each of these networks is explained with the help of diagrams. Performance results obtained for a number of benchmark problems using these networks are illustrated with the help of tables. Artificial Neural Networks (ANNs) suffer from the dilemma of how to select complexity of the network for a specific task, what should be the pattern of inter-connectivity, and in case of feedback, what topology will produce the best possible results. Cartesian Genetic Programming (CGP) offers the ability to select not only the desired network complexity but also the inter-connectivity patterns, topology of feedback systems, and above all, decides which input parameters should be weighted more or less and which one to be neglected. In this chapter we discuss how CGP is used to evolve the architecture of Neural Networks for optimum network and characteristics. Don’t you want a system that designs everything for you? That helps you select the optimal network, the inter-connectivity, the topology, the complexity, input parameters selection and input sensitivity? If yes, then CGP evolved Artificial Neural Network (CGPANN) and CGP evolved Recurrent Neural Network (CGPRNN) is the answer to your questions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Approximate Computing: An Old Job for Cartesian Genetic Programming?
next chapter Multi-step Ahead Forecasting Using Cartesian Genetic Programming
Literature
1.
Ali, J., Khan, G.M., Mahmud, S.A.: Enhancing growth curve approach using CGPANN for predicting the sustainability of new food products. In: IFIP International Conference on Artificial Intelligence Applications and Innovations, pp. 286–297. Springer (2014)
2.
Arbab, M.A., Khan, G.M., Sahibzada, A.M.: Cardiac arrhythmia classification using cartesian genetic programming evolved artificial neural network. Exp. Clin. Cardiol. 20(9) (2014)
3.
Bidlo, M.: Evolutionary design of generic combinational multipliers using development. In: International Conference on Evolvable Systems, pp. 77–88. Springer (2007)
4.
Carpenter, G.A., Grossberg, S.: The art of adaptive pattern recognition by a self-organizing neural network. Computer 21(3), 77–88 (1988)CrossRef
5.
Fekiač, J., Zelinka, I., Burguillo, J.C.: A review of methods for encoding neural network topologies in evolutionary computation. In: Proceedings of 25th European Conference on Modeling and Simulation ECMS 2011, pp. 410–416 (2011)
6.
Gomez, F., Schmidhuber, J., Miikkulainen, R.: Accelerated neural evolution through cooperatively coevolved synapses. J. Mach. Learn. Res. 9(May), 937–965 (2008)MATHMathSciNet
7.
Gomez, F.J., Miikkulainen, R.: Solving non-markovian control tasks with neuroevolution. IJCAI 99, 1356–1361 (1999)
8.
Guo, H., Nandi, A.K.: Breast cancer diagnosis using genetic programming generated feature. Pattern Recognit. 39(5), 980–987 (2006)CrossRef
9.
Haider, A., Hanif, M.N.: Inflation forecasting in Pakistan using artificial neural networks. Pak. Econ. Soc. Rev. 123–138 (2009)
10.
Iranpour, M., Almassi, S., Analoui, M.: Breast cancer detection from fna using svm and rbf classifier. In: 1st Joint Congress on Fuzzy and Intelligent Systems (2007)
11.
Jordan, M.I.: Attractor dynamics and parallellism in a connectionist sequential machine. In: Proceedings of the 8th Confererence of the Cognitive Science Society, pp. 531–546. Lawrence Erlbaum Associates (1986)
12.
Kamruzzaman, J., Sarker, R.A.: Forecasting of currency exchange rates using ANN: a case study. In: Neural Networks and Signal Processing, 2003. Proceedings of the 2003 International Conference on, vol. 1, pp. 793–797. IEEE (2003, December)
13.
Khan, G.M., Ali, J., Mahmud, S.A.: Wind power forecastingan application of machine learning in renewable energy. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 1130–1137. IEEE (2014)
14.
Khan, G.M., Khattak, A.R., Zafari, F., Mahmud, S.A.: Electrical load forecasting using fast learning recurrent neural networks. In: The 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–6. IEEE (2013)
15.
Khan, G.M., Nayab, D., Mahmud, S.A., Zafar, H.: Evolving dynamic forecasting model for foreign currency exchange rates using plastic neural networks. In: 2013 12th International Conference on Machine Learning and Applications (ICMLA), vol. 2, pp. 15–20. IEEE (2013)
16.
Khan, G.M., Ullah, F., Mahmud, S.A.: MPEG-4 internet traffic estimation using recurrent CGPANN. In: International Conference on Engineering Applications of Neural Networks, pp. 22–31. Springer (2013)
17.
Khan, G.M., Zafari, F.: Dynamic feedback neuro-evolutionary networks for forecasting the highly fluctuating electrical loads. Genet. Program. Evolvable Mach. 17(4), 391–408 (2016)CrossRef
18.
Khan, G.M., Zafari, F., Mahmud, S.A.: Very short term load forecasting using cartesian genetic programming evolved recurrent neural networks (CGPRNN). In: 2013 12th International Conference on Machine Learning and Applications (ICMLA), vol. 2, pp. 152–155. IEEE (2013)
19.
Khan, M.M., Ahmad, A.M., Khan, G.M., Miller, J.F.: Fast learning neural networks using cartesian genetic programming. Neurocomputing 121, 274–289 (2013)CrossRef
20.
Khan, M.M., Khan, G.M., Miller, J.F.: Developmental plasticity in cartesian genetic programming artificial neural networks. In: Proceedings of the 8th International Conference on Informatics in Control, Automation and Robotics (ICINCO 2011), pp. 449–458. SciTePress (2011)
21.
Kryuchin, O.V., Arzamastsev, A.A., Troitzsch, K.G.: The prediction of currency exchange rates using artificial neural networks. Exch. Organ. Behav. Teach. J. 4 (2007)
22.
Liu, K., Subbarayan, S., Shoults, R., Manry, M., Kwan, C., Lewis, F., Naccarino, J.: Comparison of very short-term load forecasting techniques. IEEE Trans. Power Syst. 11(2), 877–882 (1996)CrossRef
23.
Moriarty, D.E.: Symbiotic evolution of neural networks in sequential decision tasks. Ph.D. thesis, University of Texas at Austin USA (1997)
24.
Nayab, D., Khan, G.M., Mahmud, S.A.: Prediction of foreign currency exchange rates using cgpann. In: International Conference on Engineering Applications of Neural Networks, pp. 91–101. Springer (2013)
25.
Pan, Z., Nie, L.: Evolving both the topology and weights of neural networks. Parallel Algorithms Appl. 9(3–4), 299–307 (1996)CrossRefMATH
26.
Papadrakakis, M., Papadopoulos, V., Lagaros, N.D.: Structural reliability analyis of elastic-plastic structures using neural networks and monte carlo simulation. Comput. Methods Appl. Mech. Eng. 136(1–2), 145–163 (1996)CrossRefMATH
27.
Philip, A.A., Taofiki, A.A., Bidemi, A.A.: Artificial neural network model for forecasting foreign exchange rate. World Comput. Sci. Inf. Technol. J. (WCSIT) 1 (3) 110–118 (2011)
28.
Pujol, J.C.F., Poli, R.: Evolving the topology and the weights of neural networks using a dual representation. Appl. Intell. 8(1), 73–84 (1998)CrossRef
29.
Refenes, A.N., Azema-Barac, M., Chen, L., Karoussos, S.: Currency exchange rate prediction and neural network design strategies. Neural Comput. Appl. 1(1), 46–58 (1993)CrossRef
30.
Rehman, M., Ali, J., Khan, G.M., Mahmud, S.A.: Extracting trends ensembles in solar irradiance for green energy generation using neuro-evolution. In: IFIP International Conference on Artificial Intelligence Applications and Innovations, pp. 456–465. Springer (2014)
31.
Rehman, M., Khan, G.M., Mahmud, S.A.: Foreign currency exchange rates prediction using cgp and recurrent neural network. IERI Procedia 10, 239–244 (2014)CrossRef
32.
Sadeghi, B.: A bp-neural network predictor model for plastic injection molding process. J. Mater. Process. Technol. 103(3), 411–416 (2000)CrossRefMathSciNet
33.
Sarangi, P.P., Sahu, A., Panda, M.: A hybrid differential evolution and back-propagation algorithm for feedforward neural network training. Int. J. Comput. Appl. 84(14) (2013)
34.
Singh, D., Singh, S.: A self-selecting neural network for short-term load forecasting. Electr. Power Compon. Syst. 29(2), 117–130 (2001)CrossRef
35.
Stanley, K.O., Miikkulainen, R.: Efficient reinforcement learning through evolving neural network topologies. In: Proceedings of the 4th Annual Conference on Genetic and Evolutionary Computation, pp. 569–577. Morgan Kaufmann Publishers Inc. (2002)
36.
Wieland, A.P.: Evolving neural network controllers for unstable systems. In: IJCNN-91-Seattle International Joint Conference on Neural Networks, 1991, vol. 2, pp. 667–673. IEEE (1991)
Metadata
Title
Breaking the Stereotypical Dogma of Artificial Neural Networks with Cartesian Genetic Programming
Authors
Gul Muhammad Khan
Arbab Masood Ahmad
Copyright Year
2018
Book
Inspired by Nature

Print ISBN: 978-3-319-67996-9

Electronic ISBN: 978-3-319-67997-6

Copyright Year: 2018

DOI
https://doi.org/10.1007/978-3-319-67997-6_10

Premium Partner

    Image Credits