Skip to main content
Erschienen in: Neural Computing and Applications 12/2017

09.04.2016 | Original Article

A novel machine learning method based on generalized behavioral learning theory

verfasst von: Ömer Faruk Ertuğrul, Mehmet Emin Tağluk

Erschienen in: Neural Computing and Applications | Ausgabe 12/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Learning is an important talent for understanding the nature and accordingly controlling behavioral characteristics. Behavioral learning theories are one of the popular learning theories which are built on experimental findings. These theories are widely applied in psychotherapy, psychology, neurology as well as in advertisements and robotics. There is an abundant literature associated with understanding learning mechanism, and various models have been proposed for the realization of learning theories. Nevertheless, none of those models are able to satisfactorily simulate the concept of classical conditioning. In this study, popular behavioral learning theories were firstly simplified and the contentious issues with them were clarified by conducting intuitive experiments. The experimental results and information available in the literature were evaluated, and behavioral learning theories were jointly generalized accordingly. The proposed model, to our knowledge, is the first one that possesses not only modeling all features of classical conditioning but also including all features with behavioral theories such as Pavlov, Watson, Guthrie, Thorndike and Skinner. Also, a microcontroller card (Arduino Mega 2560) was used to validate the applicability of the proposed model in robotics. Obtained results showed that this generalized model has a high capacity for modeling human learning. Then, the proposed learning model was further improved to be utilized as a machine learning method that can continuously learn similar to human being. The result obtained from the use of this method, in terms of computational cost and accuracy, showed that the proposed method can be successfully employed in machine learning, especially for time ordered datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
10.
Zurück zum Zitat Pavlov IP (1927) Conditioned reflexes. Dover Publications, New York Pavlov IP (1927) Conditioned reflexes. Dover Publications, New York
12.
Zurück zum Zitat Schunk DH (2012) Learning theories an educational perspective, 6th edn. Pearson, London Schunk DH (2012) Learning theories an educational perspective, 6th edn. Pearson, London
15.
Zurück zum Zitat Clouse RL, Kim S, Waldron MB (1997) An adaptive threshold learning algorithm for classical conditioning. In: Proceedings of the 19th international conference of the IEEE/EMBS, Chicago, pp 1380–1382 Clouse RL, Kim S, Waldron MB (1997) An adaptive threshold learning algorithm for classical conditioning. In: Proceedings of the 19th international conference of the IEEE/EMBS, Chicago, pp 1380–1382
18.
Zurück zum Zitat Li G, Quirk GJ, Nair SS (2007) Modeling acquisition and extinction of conditioned fear in LA neurons using learning algorithm. In: Proceedings of the 2007 American control conference Marriott Marquis Hotel at Times Square New York City, USA, pp 552–557. doi:10.1109/acc.2007.4283135 Li G, Quirk GJ, Nair SS (2007) Modeling acquisition and extinction of conditioned fear in LA neurons using learning algorithm. In: Proceedings of the 2007 American control conference Marriott Marquis Hotel at Times Square New York City, USA, pp 552–557. doi:10.​1109/​acc.​2007.​4283135
19.
Zurück zum Zitat Prueckl R, Taub AH, Herreros I, Hogri R, Magal A, Bamford SA, Giovannucci A, Ofek R, Shacham-Diamand Y, Verschure PFMJ, Mintz M, Scharinger J, Silmon A, Guger C (2011) Behavioral rehabilitation of the eye closure reflex in senescent rats using a real-time biosignal acquisition system. In: 33rd annual international conference of the IEEE EMBS, Boston, Massachusetts, USA, pp 4211–4214. doi:10.1109/iembs.2011.6091045 Prueckl R, Taub AH, Herreros I, Hogri R, Magal A, Bamford SA, Giovannucci A, Ofek R, Shacham-Diamand Y, Verschure PFMJ, Mintz M, Scharinger J, Silmon A, Guger C (2011) Behavioral rehabilitation of the eye closure reflex in senescent rats using a real-time biosignal acquisition system. In: 33rd annual international conference of the IEEE EMBS, Boston, Massachusetts, USA, pp 4211–4214. doi:10.​1109/​iembs.​2011.​6091045
20.
Zurück zum Zitat Courville AC, Daw ND, Gordon GJ, Touretzky DS (2003) Model uncertainty in classical conditioning. In: 17th annual conference on advances in neural information processing systems (NIPS), Vancouver, BC, Canada Courville AC, Daw ND, Gordon GJ, Touretzky DS (2003) Model uncertainty in classical conditioning. In: 17th annual conference on advances in neural information processing systems (NIPS), Vancouver, BC, Canada
21.
Zurück zum Zitat Austermann A, Yamada S (2008) Learning to understand multimodal rewards for human–robot-interaction using hidden Markov Models and classical conditioning. In: 2008 IEEE congress on evolutionary computation (CEC), pp 4096–4103. doi:10.1109/CEC.2008.4631356 Austermann A, Yamada S (2008) Learning to understand multimodal rewards for human–robot-interaction using hidden Markov Models and classical conditioning. In: 2008 IEEE congress on evolutionary computation (CEC), pp 4096–4103. doi:10.​1109/​CEC.​2008.​4631356
22.
Zurück zum Zitat Hassan H, Watan M (2000) On mathematical analysis of Pavlovian conditioning learning process using artificial neural network model. In: 10th mediterranean electrotechnical conference, MEleCon, vol II, pp 578–581. doi:10.1109/MELCON.2000.879999 Hassan H, Watan M (2000) On mathematical analysis of Pavlovian conditioning learning process using artificial neural network model. In: 10th mediterranean electrotechnical conference, MEleCon, vol II, pp 578–581. doi:10.​1109/​MELCON.​2000.​879999
24.
Zurück zum Zitat Wagner AR (1981) SOP: a model of automatic memory processing in animal behavior. In: Spear NE, Miller RR (eds) Information processing in animals: memory mechanisms, chapter 1, vol 85. Erlbaum, New Jersey, pp 5–44 Wagner AR (1981) SOP: a model of automatic memory processing in animal behavior. In: Spear NE, Miller RR (eds) Information processing in animals: memory mechanisms, chapter 1, vol 85. Erlbaum, New Jersey, pp 5–44
25.
Zurück zum Zitat Sutton RS, Barto AG (1990) Time-derivative models of Pavlovian reinforcement. In: Gabriel A, Moore J (eds) Learning and computational neuroscience: foundations and adaptive networks, chapter 12. MIT Press, Cambridge, pp 497–537 Sutton RS, Barto AG (1990) Time-derivative models of Pavlovian reinforcement. In: Gabriel A, Moore J (eds) Learning and computational neuroscience: foundations and adaptive networks, chapter 12. MIT Press, Cambridge, pp 497–537
26.
Zurück zum Zitat Klopf AH (1989) Classical conditioning: phenomena predicted by a drive-reinforcement model of neural function. In: Byrne JH, Berry WO (eds) Neural models of plasticity: experimental and theoretical approaches, chapter 6. Academic Press, New York, pp 94–103. doi:10.1016/B978-0-12-148955-7.50011-4 Klopf AH (1989) Classical conditioning: phenomena predicted by a drive-reinforcement model of neural function. In: Byrne JH, Berry WO (eds) Neural models of plasticity: experimental and theoretical approaches, chapter 6. Academic Press, New York, pp 94–103. doi:10.​1016/​B978-0-12-148955-7.​50011-4
28.
Zurück zum Zitat Malaka R, Lange R, Hammer M (1995) A constant prediction model for classical conditioning. In: Elser N, Menzel R (eds) Learning and memory: proceedings of the 23rd Gottingen neurobiology conference, vol 1. Thieme-Verlag, Stuttgart, p 75 Malaka R, Lange R, Hammer M (1995) A constant prediction model for classical conditioning. In: Elser N, Menzel R (eds) Learning and memory: proceedings of the 23rd Gottingen neurobiology conference, vol 1. Thieme-Verlag, Stuttgart, p 75
29.
Zurück zum Zitat Balkenius C, Morén J (1998) Computational models of classical conditioning: a comparative study. In: Proceedings of the fifth international conference on simulation of adaptive behavior on from animals to animats, vol 5 Balkenius C, Morén J (1998) Computational models of classical conditioning: a comparative study. In: Proceedings of the fifth international conference on simulation of adaptive behavior on from animals to animats, vol 5
30.
Zurück zum Zitat Klopf AH (1988) A neuronal model of classical conditioning. Psychobiology 16(2):85–125 Klopf AH (1988) A neuronal model of classical conditioning. Psychobiology 16(2):85–125
31.
Zurück zum Zitat Liu S, Ding Y (2008) An adaptive network policy management framework based on classical conditioning. In: Proceedings of the 7th world congress on intelligent control and automation, Chongqing, China, pp 3336–3340. doi:10.1109/WCICA.2008.4593455 Liu S, Ding Y (2008) An adaptive network policy management framework based on classical conditioning. In: Proceedings of the 7th world congress on intelligent control and automation, Chongqing, China, pp 3336–3340. doi:10.​1109/​WCICA.​2008.​4593455
32.
Zurück zum Zitat Liu S, Ding Y (2009) A classical conditioning model for policy-based management. In: 2009 international conference on networks security, wireless communications and trusted computing, pp 249–252. doi:10.1109/NSWCTC.2009.129 Liu S, Ding Y (2009) A classical conditioning model for policy-based management. In: 2009 international conference on networks security, wireless communications and trusted computing, pp 249–252. doi:10.​1109/​NSWCTC.​2009.​129
33.
Zurück zum Zitat Ertugrul OF, Tagluk ME (2014) Learning with classical conditioning. In: Signal processing and communications applications conference (SIU), 2014 22nd. IEEE, pp 927–930. doi:10.1109/SIU.2014.6830382 Ertugrul OF, Tagluk ME (2014) Learning with classical conditioning. In: Signal processing and communications applications conference (SIU), 2014 22nd. IEEE, pp 927–930. doi:10.​1109/​SIU.​2014.​6830382
36.
Zurück zum Zitat Malaka R (1999) Models of classical conditioning models of classical conditioning. Bull Math Biol 61:33–83, Article No. bulm.1998.0074 Malaka R (1999) Models of classical conditioning models of classical conditioning. Bull Math Biol 61:33–83, Article No. bulm.1998.0074
38.
Zurück zum Zitat Watson JB (1959) Behaviorism. University of Chicago Press, Chicago, p 82 Watson JB (1959) Behaviorism. University of Chicago Press, Chicago, p 82
42.
Zurück zum Zitat Hassan HM, Al-Hamadi A (2008) On comparative evaluation of Thorndike’s psycho-learning experimental work versus an optimal swarm ıntelligent system. In: CIMCA 2008, IAWTIC 2008, and ISE 2008, IEEE Computer Society, syf., pp 1083–1088. doi:10.1109/CIMCA.2008.224 Hassan HM, Al-Hamadi A (2008) On comparative evaluation of Thorndike’s psycho-learning experimental work versus an optimal swarm ıntelligent system. In: CIMCA 2008, IAWTIC 2008, and ISE 2008, IEEE Computer Society, syf., pp 1083–1088. doi:10.​1109/​CIMCA.​2008.​224
43.
Zurück zum Zitat Skinner BF (2013) A life [paperback]. by Daniel W. Bjork: 9781557984166: Amazon.com: Books Skinner BF (2013) A life [paperback]. by Daniel W. Bjork: 9781557984166: Amazon.com: Books
46.
Zurück zum Zitat Gaudiano P, Chang C (1997) Adaptive obstacle avoidance with a neural network for operant conditioning: experiments with real robots. In: IEEE, pp 13–18. doi:10.1109/cira.1997.613832 Gaudiano P, Chang C (1997) Adaptive obstacle avoidance with a neural network for operant conditioning: experiments with real robots. In: IEEE, pp 13–18. doi:10.​1109/​cira.​1997.​613832
47.
Zurück zum Zitat Ruan X, Ren H (2009) Bionic learning algorithm based on Skinner’s operant conditioning and control of robot. In: IEEE Computer Society, 2009 WASE international conference on information engineering, pp 62–66. doi:10.1109/ICIE.2009.143 Ruan X, Ren H (2009) Bionic learning algorithm based on Skinner’s operant conditioning and control of robot. In: IEEE Computer Society, 2009 WASE international conference on information engineering, pp 62–66. doi:10.​1109/​ICIE.​2009.​143
48.
Zurück zum Zitat Ruan X, Dai L (2010) Skinner-rat experiment based on autonomous operant conditioning automata. In: Sixth international conference on natural computation (ICNC 2010), IEEE circuits and systems society, pp 1970-1973. doi:10.1109/ICNC.2010.5584702 Ruan X, Dai L (2010) Skinner-rat experiment based on autonomous operant conditioning automata. In: Sixth international conference on natural computation (ICNC 2010), IEEE circuits and systems society, pp 1970-1973. doi:10.​1109/​ICNC.​2010.​5584702
49.
Zurück zum Zitat Ren H, Ruan X (2009) Applying of recurrent network based on Skinner’s operant conditioning in robot. In: 2009 international conference on intelligent human-machine systems and cybernetics, IEEE, syf., pp 351–354. doi:10.1109/ihmsc.2009.96 Ren H, Ruan X (2009) Applying of recurrent network based on Skinner’s operant conditioning in robot. In: 2009 international conference on intelligent human-machine systems and cybernetics, IEEE, syf., pp 351–354. doi:10.​1109/​ihmsc.​2009.​96
50.
Zurück zum Zitat Cai J, Ruan X (2009) Self-balance control of inverted pendulum based on fuzzy skinner operant conditioning. Int Conf Inf Technol Comput Sci 2009:518–521. doi:10.1109/ITCS.2009.241 Cai J, Ruan X (2009) Self-balance control of inverted pendulum based on fuzzy skinner operant conditioning. Int Conf Inf Technol Comput Sci 2009:518–521. doi:10.​1109/​ITCS.​2009.​241
51.
52.
Zurück zum Zitat Morris MJ (2000) The Artie simulation of operant conditioning. Mex J Behav Anal 26:251–271 Morris MJ (2000) The Artie simulation of operant conditioning. Mex J Behav Anal 26:251–271
53.
Zurück zum Zitat Kamin LJ (1968) Attention-like processes in classical conditioning. In: Jones MR (ed) Miami symposium on the prediction of behavior: aversive stimulation. University of Miami Press, Miami, pp 9–31 Kamin LJ (1968) Attention-like processes in classical conditioning. In: Jones MR (ed) Miami symposium on the prediction of behavior: aversive stimulation. University of Miami Press, Miami, pp 9–31
54.
56.
Zurück zum Zitat Hughes JR (1958) Post-tetanic potentiation. Physiol Rev 38(1):91–113 Hughes JR (1958) Post-tetanic potentiation. Physiol Rev 38(1):91–113
58.
Zurück zum Zitat Hebb DO (1961) Distinctive features of learning in the higher animal. In: Delafresnaye JF (ed) Brain mechanisms and learning. Oxford University Press, London Hebb DO (1961) Distinctive features of learning in the higher animal. In: Delafresnaye JF (ed) Brain mechanisms and learning. Oxford University Press, London
59.
Zurück zum Zitat Drucker H, Burges CJ, Kaufman L, Smola A, Vapnik V (1997) Support vector regression machines. Neural Inf Process Syst 9:155–161 Drucker H, Burges CJ, Kaufman L, Smola A, Vapnik V (1997) Support vector regression machines. Neural Inf Process Syst 9:155–161
62.
Zurück zum Zitat Smith JW, Everhart JE, Dickson WC, Knowler WC, Johannes RS (1988) Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. In: Proceedings/the annual symposium on computer application [sic] in medical care. symposium on computer applications in medical care, American Medical Informatics Association, pp 261–265 Smith JW, Everhart JE, Dickson WC, Knowler WC, Johannes RS (1988) Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. In: Proceedings/the annual symposium on computer application [sic] in medical care. symposium on computer applications in medical care, American Medical Informatics Association, pp 261–265
63.
Zurück zum Zitat Ramana BV, Babu P, Surendra M, Venkateswarlu NB (2011) A critical study of selected classification algorithms for liver disease diagnosis. Int J Database Manag Syst 3(2):101–114. doi:10.5121/ijdms.2011.3207 CrossRef Ramana BV, Babu P, Surendra M, Venkateswarlu NB (2011) A critical study of selected classification algorithms for liver disease diagnosis. Int J Database Manag Syst 3(2):101–114. doi:10.​5121/​ijdms.​2011.​3207 CrossRef
64.
Zurück zum Zitat Ramana BV, Babu MSP, Venkateswarlu NB (2012) A critical comparative study of liver patients from USA and INDIA: an exploratory analysis. Int J Comput Sci Issues IJCSI 9(3):506–516 Ramana BV, Babu MSP, Venkateswarlu NB (2012) A critical comparative study of liver patients from USA and INDIA: an exploratory analysis. Int J Comput Sci Issues IJCSI 9(3):506–516
65.
Zurück zum Zitat Andrzejak RG, Lehnertz K, Mormann F, Rieke C, David P, Elger CE (2001) Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. Phys Rev E 64(6):061907-1–061907-8. doi:10.1103/PhysRevE.64.061907 CrossRef Andrzejak RG, Lehnertz K, Mormann F, Rieke C, David P, Elger CE (2001) Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. Phys Rev E 64(6):061907-1–061907-8. doi:10.​1103/​PhysRevE.​64.​061907 CrossRef
66.
Zurück zum Zitat Wettschereck D, Dietterich TG (1995) An experimental comparison of the nearest-neighbor and nearest-hyperrectangle algorithms. Mach Learn 19(1):5–27. doi:10.1007/BF00994658 Wettschereck D, Dietterich TG (1995) An experimental comparison of the nearest-neighbor and nearest-hyperrectangle algorithms. Mach Learn 19(1):5–27. doi:10.​1007/​BF00994658
67.
Zurück zum Zitat Read J, Bifet A, Pfahringer B, Holmes G (2012) Batch-incremental versus instance-incremental learning in dynamic and evolving data. In: Advances in intelligent data analysis XI, Springer, Berlin, pp 313–323. doi:10.1007/978-3-642-34156-4_29 Read J, Bifet A, Pfahringer B, Holmes G (2012) Batch-incremental versus instance-incremental learning in dynamic and evolving data. In: Advances in intelligent data analysis XI, Springer, Berlin, pp 313–323. doi:10.​1007/​978-3-642-34156-4_​29
68.
Zurück zum Zitat Cunningham P, Delany SJ (2007) k-Nearest neighbour classifiers. Technical Report UCD-CSI-2007-4, Artificial Intelligence Group, Dublin, pp 1–17 Cunningham P, Delany SJ (2007) k-Nearest neighbour classifiers. Technical Report UCD-CSI-2007-4, Artificial Intelligence Group, Dublin, pp 1–17
Metadaten
Titel
A novel machine learning method based on generalized behavioral learning theory
verfasst von
Ömer Faruk Ertuğrul
Mehmet Emin Tağluk
Publikationsdatum
09.04.2016
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 12/2017
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-016-2314-8

Weitere Artikel der Ausgabe 12/2017

Neural Computing and Applications 12/2017 Zur Ausgabe

Premium Partner