Skip to main content
Top
Published in: Neural Computing and Applications 12/2017

09-04-2016 | Original Article

A novel machine learning method based on generalized behavioral learning theory

Authors: Ömer Faruk Ertuğrul, Mehmet Emin Tağluk

Published in: Neural Computing and Applications | Issue 12/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Learning is an important talent for understanding the nature and accordingly controlling behavioral characteristics. Behavioral learning theories are one of the popular learning theories which are built on experimental findings. These theories are widely applied in psychotherapy, psychology, neurology as well as in advertisements and robotics. There is an abundant literature associated with understanding learning mechanism, and various models have been proposed for the realization of learning theories. Nevertheless, none of those models are able to satisfactorily simulate the concept of classical conditioning. In this study, popular behavioral learning theories were firstly simplified and the contentious issues with them were clarified by conducting intuitive experiments. The experimental results and information available in the literature were evaluated, and behavioral learning theories were jointly generalized accordingly. The proposed model, to our knowledge, is the first one that possesses not only modeling all features of classical conditioning but also including all features with behavioral theories such as Pavlov, Watson, Guthrie, Thorndike and Skinner. Also, a microcontroller card (Arduino Mega 2560) was used to validate the applicability of the proposed model in robotics. Obtained results showed that this generalized model has a high capacity for modeling human learning. Then, the proposed learning model was further improved to be utilized as a machine learning method that can continuously learn similar to human being. The result obtained from the use of this method, in terms of computational cost and accuracy, showed that the proposed method can be successfully employed in machine learning, especially for time ordered datasets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
10.
go back to reference Pavlov IP (1927) Conditioned reflexes. Dover Publications, New York Pavlov IP (1927) Conditioned reflexes. Dover Publications, New York
12.
go back to reference Schunk DH (2012) Learning theories an educational perspective, 6th edn. Pearson, London Schunk DH (2012) Learning theories an educational perspective, 6th edn. Pearson, London
15.
go back to reference Clouse RL, Kim S, Waldron MB (1997) An adaptive threshold learning algorithm for classical conditioning. In: Proceedings of the 19th international conference of the IEEE/EMBS, Chicago, pp 1380–1382 Clouse RL, Kim S, Waldron MB (1997) An adaptive threshold learning algorithm for classical conditioning. In: Proceedings of the 19th international conference of the IEEE/EMBS, Chicago, pp 1380–1382
18.
go back to reference Li G, Quirk GJ, Nair SS (2007) Modeling acquisition and extinction of conditioned fear in LA neurons using learning algorithm. In: Proceedings of the 2007 American control conference Marriott Marquis Hotel at Times Square New York City, USA, pp 552–557. doi:10.1109/acc.2007.4283135 Li G, Quirk GJ, Nair SS (2007) Modeling acquisition and extinction of conditioned fear in LA neurons using learning algorithm. In: Proceedings of the 2007 American control conference Marriott Marquis Hotel at Times Square New York City, USA, pp 552–557. doi:10.​1109/​acc.​2007.​4283135
19.
go back to reference Prueckl R, Taub AH, Herreros I, Hogri R, Magal A, Bamford SA, Giovannucci A, Ofek R, Shacham-Diamand Y, Verschure PFMJ, Mintz M, Scharinger J, Silmon A, Guger C (2011) Behavioral rehabilitation of the eye closure reflex in senescent rats using a real-time biosignal acquisition system. In: 33rd annual international conference of the IEEE EMBS, Boston, Massachusetts, USA, pp 4211–4214. doi:10.1109/iembs.2011.6091045 Prueckl R, Taub AH, Herreros I, Hogri R, Magal A, Bamford SA, Giovannucci A, Ofek R, Shacham-Diamand Y, Verschure PFMJ, Mintz M, Scharinger J, Silmon A, Guger C (2011) Behavioral rehabilitation of the eye closure reflex in senescent rats using a real-time biosignal acquisition system. In: 33rd annual international conference of the IEEE EMBS, Boston, Massachusetts, USA, pp 4211–4214. doi:10.​1109/​iembs.​2011.​6091045
20.
go back to reference Courville AC, Daw ND, Gordon GJ, Touretzky DS (2003) Model uncertainty in classical conditioning. In: 17th annual conference on advances in neural information processing systems (NIPS), Vancouver, BC, Canada Courville AC, Daw ND, Gordon GJ, Touretzky DS (2003) Model uncertainty in classical conditioning. In: 17th annual conference on advances in neural information processing systems (NIPS), Vancouver, BC, Canada
21.
go back to reference Austermann A, Yamada S (2008) Learning to understand multimodal rewards for human–robot-interaction using hidden Markov Models and classical conditioning. In: 2008 IEEE congress on evolutionary computation (CEC), pp 4096–4103. doi:10.1109/CEC.2008.4631356 Austermann A, Yamada S (2008) Learning to understand multimodal rewards for human–robot-interaction using hidden Markov Models and classical conditioning. In: 2008 IEEE congress on evolutionary computation (CEC), pp 4096–4103. doi:10.​1109/​CEC.​2008.​4631356
22.
go back to reference Hassan H, Watan M (2000) On mathematical analysis of Pavlovian conditioning learning process using artificial neural network model. In: 10th mediterranean electrotechnical conference, MEleCon, vol II, pp 578–581. doi:10.1109/MELCON.2000.879999 Hassan H, Watan M (2000) On mathematical analysis of Pavlovian conditioning learning process using artificial neural network model. In: 10th mediterranean electrotechnical conference, MEleCon, vol II, pp 578–581. doi:10.​1109/​MELCON.​2000.​879999
24.
go back to reference Wagner AR (1981) SOP: a model of automatic memory processing in animal behavior. In: Spear NE, Miller RR (eds) Information processing in animals: memory mechanisms, chapter 1, vol 85. Erlbaum, New Jersey, pp 5–44 Wagner AR (1981) SOP: a model of automatic memory processing in animal behavior. In: Spear NE, Miller RR (eds) Information processing in animals: memory mechanisms, chapter 1, vol 85. Erlbaum, New Jersey, pp 5–44
25.
go back to reference Sutton RS, Barto AG (1990) Time-derivative models of Pavlovian reinforcement. In: Gabriel A, Moore J (eds) Learning and computational neuroscience: foundations and adaptive networks, chapter 12. MIT Press, Cambridge, pp 497–537 Sutton RS, Barto AG (1990) Time-derivative models of Pavlovian reinforcement. In: Gabriel A, Moore J (eds) Learning and computational neuroscience: foundations and adaptive networks, chapter 12. MIT Press, Cambridge, pp 497–537
26.
go back to reference Klopf AH (1989) Classical conditioning: phenomena predicted by a drive-reinforcement model of neural function. In: Byrne JH, Berry WO (eds) Neural models of plasticity: experimental and theoretical approaches, chapter 6. Academic Press, New York, pp 94–103. doi:10.1016/B978-0-12-148955-7.50011-4 Klopf AH (1989) Classical conditioning: phenomena predicted by a drive-reinforcement model of neural function. In: Byrne JH, Berry WO (eds) Neural models of plasticity: experimental and theoretical approaches, chapter 6. Academic Press, New York, pp 94–103. doi:10.​1016/​B978-0-12-148955-7.​50011-4
28.
go back to reference Malaka R, Lange R, Hammer M (1995) A constant prediction model for classical conditioning. In: Elser N, Menzel R (eds) Learning and memory: proceedings of the 23rd Gottingen neurobiology conference, vol 1. Thieme-Verlag, Stuttgart, p 75 Malaka R, Lange R, Hammer M (1995) A constant prediction model for classical conditioning. In: Elser N, Menzel R (eds) Learning and memory: proceedings of the 23rd Gottingen neurobiology conference, vol 1. Thieme-Verlag, Stuttgart, p 75
29.
go back to reference Balkenius C, Morén J (1998) Computational models of classical conditioning: a comparative study. In: Proceedings of the fifth international conference on simulation of adaptive behavior on from animals to animats, vol 5 Balkenius C, Morén J (1998) Computational models of classical conditioning: a comparative study. In: Proceedings of the fifth international conference on simulation of adaptive behavior on from animals to animats, vol 5
30.
go back to reference Klopf AH (1988) A neuronal model of classical conditioning. Psychobiology 16(2):85–125 Klopf AH (1988) A neuronal model of classical conditioning. Psychobiology 16(2):85–125
31.
go back to reference Liu S, Ding Y (2008) An adaptive network policy management framework based on classical conditioning. In: Proceedings of the 7th world congress on intelligent control and automation, Chongqing, China, pp 3336–3340. doi:10.1109/WCICA.2008.4593455 Liu S, Ding Y (2008) An adaptive network policy management framework based on classical conditioning. In: Proceedings of the 7th world congress on intelligent control and automation, Chongqing, China, pp 3336–3340. doi:10.​1109/​WCICA.​2008.​4593455
32.
go back to reference Liu S, Ding Y (2009) A classical conditioning model for policy-based management. In: 2009 international conference on networks security, wireless communications and trusted computing, pp 249–252. doi:10.1109/NSWCTC.2009.129 Liu S, Ding Y (2009) A classical conditioning model for policy-based management. In: 2009 international conference on networks security, wireless communications and trusted computing, pp 249–252. doi:10.​1109/​NSWCTC.​2009.​129
33.
go back to reference Ertugrul OF, Tagluk ME (2014) Learning with classical conditioning. In: Signal processing and communications applications conference (SIU), 2014 22nd. IEEE, pp 927–930. doi:10.1109/SIU.2014.6830382 Ertugrul OF, Tagluk ME (2014) Learning with classical conditioning. In: Signal processing and communications applications conference (SIU), 2014 22nd. IEEE, pp 927–930. doi:10.​1109/​SIU.​2014.​6830382
36.
go back to reference Malaka R (1999) Models of classical conditioning models of classical conditioning. Bull Math Biol 61:33–83, Article No. bulm.1998.0074 Malaka R (1999) Models of classical conditioning models of classical conditioning. Bull Math Biol 61:33–83, Article No. bulm.1998.0074
38.
go back to reference Watson JB (1959) Behaviorism. University of Chicago Press, Chicago, p 82 Watson JB (1959) Behaviorism. University of Chicago Press, Chicago, p 82
42.
go back to reference Hassan HM, Al-Hamadi A (2008) On comparative evaluation of Thorndike’s psycho-learning experimental work versus an optimal swarm ıntelligent system. In: CIMCA 2008, IAWTIC 2008, and ISE 2008, IEEE Computer Society, syf., pp 1083–1088. doi:10.1109/CIMCA.2008.224 Hassan HM, Al-Hamadi A (2008) On comparative evaluation of Thorndike’s psycho-learning experimental work versus an optimal swarm ıntelligent system. In: CIMCA 2008, IAWTIC 2008, and ISE 2008, IEEE Computer Society, syf., pp 1083–1088. doi:10.​1109/​CIMCA.​2008.​224
43.
go back to reference Skinner BF (2013) A life [paperback]. by Daniel W. Bjork: 9781557984166: Amazon.com: Books Skinner BF (2013) A life [paperback]. by Daniel W. Bjork: 9781557984166: Amazon.com: Books
46.
47.
go back to reference Ruan X, Ren H (2009) Bionic learning algorithm based on Skinner’s operant conditioning and control of robot. In: IEEE Computer Society, 2009 WASE international conference on information engineering, pp 62–66. doi:10.1109/ICIE.2009.143 Ruan X, Ren H (2009) Bionic learning algorithm based on Skinner’s operant conditioning and control of robot. In: IEEE Computer Society, 2009 WASE international conference on information engineering, pp 62–66. doi:10.​1109/​ICIE.​2009.​143
48.
go back to reference Ruan X, Dai L (2010) Skinner-rat experiment based on autonomous operant conditioning automata. In: Sixth international conference on natural computation (ICNC 2010), IEEE circuits and systems society, pp 1970-1973. doi:10.1109/ICNC.2010.5584702 Ruan X, Dai L (2010) Skinner-rat experiment based on autonomous operant conditioning automata. In: Sixth international conference on natural computation (ICNC 2010), IEEE circuits and systems society, pp 1970-1973. doi:10.​1109/​ICNC.​2010.​5584702
49.
go back to reference Ren H, Ruan X (2009) Applying of recurrent network based on Skinner’s operant conditioning in robot. In: 2009 international conference on intelligent human-machine systems and cybernetics, IEEE, syf., pp 351–354. doi:10.1109/ihmsc.2009.96 Ren H, Ruan X (2009) Applying of recurrent network based on Skinner’s operant conditioning in robot. In: 2009 international conference on intelligent human-machine systems and cybernetics, IEEE, syf., pp 351–354. doi:10.​1109/​ihmsc.​2009.​96
50.
go back to reference Cai J, Ruan X (2009) Self-balance control of inverted pendulum based on fuzzy skinner operant conditioning. Int Conf Inf Technol Comput Sci 2009:518–521. doi:10.1109/ITCS.2009.241 Cai J, Ruan X (2009) Self-balance control of inverted pendulum based on fuzzy skinner operant conditioning. Int Conf Inf Technol Comput Sci 2009:518–521. doi:10.​1109/​ITCS.​2009.​241
52.
go back to reference Morris MJ (2000) The Artie simulation of operant conditioning. Mex J Behav Anal 26:251–271 Morris MJ (2000) The Artie simulation of operant conditioning. Mex J Behav Anal 26:251–271
53.
go back to reference Kamin LJ (1968) Attention-like processes in classical conditioning. In: Jones MR (ed) Miami symposium on the prediction of behavior: aversive stimulation. University of Miami Press, Miami, pp 9–31 Kamin LJ (1968) Attention-like processes in classical conditioning. In: Jones MR (ed) Miami symposium on the prediction of behavior: aversive stimulation. University of Miami Press, Miami, pp 9–31
56.
go back to reference Hughes JR (1958) Post-tetanic potentiation. Physiol Rev 38(1):91–113 Hughes JR (1958) Post-tetanic potentiation. Physiol Rev 38(1):91–113
58.
go back to reference Hebb DO (1961) Distinctive features of learning in the higher animal. In: Delafresnaye JF (ed) Brain mechanisms and learning. Oxford University Press, London Hebb DO (1961) Distinctive features of learning in the higher animal. In: Delafresnaye JF (ed) Brain mechanisms and learning. Oxford University Press, London
59.
go back to reference Drucker H, Burges CJ, Kaufman L, Smola A, Vapnik V (1997) Support vector regression machines. Neural Inf Process Syst 9:155–161 Drucker H, Burges CJ, Kaufman L, Smola A, Vapnik V (1997) Support vector regression machines. Neural Inf Process Syst 9:155–161
62.
go back to reference Smith JW, Everhart JE, Dickson WC, Knowler WC, Johannes RS (1988) Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. In: Proceedings/the annual symposium on computer application [sic] in medical care. symposium on computer applications in medical care, American Medical Informatics Association, pp 261–265 Smith JW, Everhart JE, Dickson WC, Knowler WC, Johannes RS (1988) Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. In: Proceedings/the annual symposium on computer application [sic] in medical care. symposium on computer applications in medical care, American Medical Informatics Association, pp 261–265
63.
64.
go back to reference Ramana BV, Babu MSP, Venkateswarlu NB (2012) A critical comparative study of liver patients from USA and INDIA: an exploratory analysis. Int J Comput Sci Issues IJCSI 9(3):506–516 Ramana BV, Babu MSP, Venkateswarlu NB (2012) A critical comparative study of liver patients from USA and INDIA: an exploratory analysis. Int J Comput Sci Issues IJCSI 9(3):506–516
65.
go back to reference Andrzejak RG, Lehnertz K, Mormann F, Rieke C, David P, Elger CE (2001) Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. Phys Rev E 64(6):061907-1–061907-8. doi:10.1103/PhysRevE.64.061907 CrossRef Andrzejak RG, Lehnertz K, Mormann F, Rieke C, David P, Elger CE (2001) Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. Phys Rev E 64(6):061907-1–061907-8. doi:10.​1103/​PhysRevE.​64.​061907 CrossRef
66.
go back to reference Wettschereck D, Dietterich TG (1995) An experimental comparison of the nearest-neighbor and nearest-hyperrectangle algorithms. Mach Learn 19(1):5–27. doi:10.1007/BF00994658 Wettschereck D, Dietterich TG (1995) An experimental comparison of the nearest-neighbor and nearest-hyperrectangle algorithms. Mach Learn 19(1):5–27. doi:10.​1007/​BF00994658
67.
go back to reference Read J, Bifet A, Pfahringer B, Holmes G (2012) Batch-incremental versus instance-incremental learning in dynamic and evolving data. In: Advances in intelligent data analysis XI, Springer, Berlin, pp 313–323. doi:10.1007/978-3-642-34156-4_29 Read J, Bifet A, Pfahringer B, Holmes G (2012) Batch-incremental versus instance-incremental learning in dynamic and evolving data. In: Advances in intelligent data analysis XI, Springer, Berlin, pp 313–323. doi:10.​1007/​978-3-642-34156-4_​29
68.
go back to reference Cunningham P, Delany SJ (2007) k-Nearest neighbour classifiers. Technical Report UCD-CSI-2007-4, Artificial Intelligence Group, Dublin, pp 1–17 Cunningham P, Delany SJ (2007) k-Nearest neighbour classifiers. Technical Report UCD-CSI-2007-4, Artificial Intelligence Group, Dublin, pp 1–17
Metadata
Title
A novel machine learning method based on generalized behavioral learning theory
Authors
Ömer Faruk Ertuğrul
Mehmet Emin Tağluk
Publication date
09-04-2016
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 12/2017
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-016-2314-8

Other articles of this Issue 12/2017

Neural Computing and Applications 12/2017 Go to the issue

Premium Partner