Top

Published in:

2018 | OriginalPaper | Chapter

Vygotsky Meets Backpropagation

Artificial Neural Models and the Development of Higher Forms of Thought

Author : Ilkka Tuomi

Published in: Artificial Intelligence in Education

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In this paper we revisit Vygotsky’s developmental model of concept formation, and use it to discuss learning in artificial neural networks. We study learning in neural networks from a learning science point of view, asking whether it is possible to construct systems that have developmental patterns that align with empirical studies on concept formation. We put the state-of-the-art Inception-v3 image recognition architecture in an experimental setting that highlights differences and similarities in algorithmic and human cognitive processes.

The Vygotskian model of cognitive development reveals important limitations in currently popular neural algorithms, and puts neural AI in the context of post-behavioristic science of learning. At the same time, the Vygotskian model of development of thought suggests new architectural principles for developing AI, machine learning, and systems that support human learning. In this context we can ask what would it take for machines to learn, and what could they learn from research on learning.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Do Preschoolers ‘Game the System’? A Case Study of Children’s Intelligent (Mis)Use of a Teachable Agent Based Play-&-Learn Game in Mathematics

next chapter Providing Automated Real-Time Technical Feedback for Virtual Reality Based Surgical Training: Is the Simpler the Better?

Vygotsky [29] discusses experiments done with the words mur, cev, bik, and lag. We use these in training the Inception network.

https://www.tensorflow.org/tutorials/image_recognition.

Relational information might, however, be captured using other network architectures, e.g., [3, 7, 13, 19].

Anderson, J.A., Rosenfeld, E. (eds.): Neurocomputing: Foundations for Research. The MIT Press, Cambridge (1988)

Bergson, H.: Creative Evolution (1st edn. 1907). University Press of America, Lanham (1983)

Carpenter, G., Grossberg, S.: A massively parallel architecture for self-organizing neural pattern recognition machine. Comput. Vis. Graph. Image Process. 37, 54–115 (1987)CrossRef

Davydov, V.V.: Types of Generalization in Instruction: Logical and Psychological Problems in the Structuring of School Curricula. National Council of Teachers of Mathematics, Reston (1990)

Hagan, M.T., Demuth, H.B., Beale, M.H., Jess, O.D.: Neural Network Design, 2nd edn. Martin Hagan, Boston (2014)

Hanfmann, E., Kasanin, J.: Conceptual Thinking in Schizophrenia. NMDM, New York (1942)CrossRef

Kohonen, T.: The self-organizing map. Neurocomputing 21(1), 1–6 (1998). https://doi.org/10.1016/S0925-2312(98)00030-7MathSciNetCrossRefMATH

Kozulin, A.: Vygotsky’s Psychology: A Biography of Ideas. Harvard University Press, Cambridge (1990)

Lakoff, G.: Women, Fire, and Dangerous Things: What Categories Reveal About the Mind. University of Chicago Press, Chicago (1987)CrossRef

10.

Lane, H.C., McCalla, G., Looi, C.K., Bull, S.: Preface to the IJAIED 25th anniversary issue, part 2. Int. J. Artif. Intell. Educ. 26(2), 539–543 (2016). https://doi.org/10.1007/s40593-016-0109-9CrossRef

11.

Louie, A.H.: The Reflection of Life: Functional Entailment and Imminence in Relational Biology. Springer, New York (2013). https://doi.org/10.1007/978-1-4614-6928-5CrossRefMATH

12.

Luria, A., Vygotsky, L.: Ape, Primitive Man, and Child: Essays in the History of Behavior. Harvester Wheatsheaf, Hemel Hempstead (1992)

13.

Mikolov, T., Karafiát, M., Burget, L., Černocký, J., Khudanpur, S.: Recurrent neural network based language model. In: Kobayashi, T., Hirose, K., Satoshi, N. (eds.) INTERSPEECH-2010. pp. 1045–1048. Makuhari, Chiba (2010). http://www.isca-speech-org/archive/interspeech_2010

14.

Morrison, D.M., Miller, K.B.: Teaching and learning in the pleistocene: a biocultural account of human pedagogy and its implications for AIED. Int. J. Artif. Intell. Educ., 1–31 (2017). https://doi.org/10.1007/s40593-017-0153-0

15.

Rashevsky, N.: Mathematical Biophysics: Physico-Mathematical Foundations of Biology, 3rd edn. Dover, New York (1960)

16.

Rosen, R.: Fundamentals of Measurement and Representation of Natural Systems. North-Holland, New York (1978)

17.

Rosen, R.: Life Itself: A Comprehensible Inquiry into the Nature, Origin and Fabrication of Life. Columbia University Press, New York (1991)

18.

Sakharov, L.: Methods for investigating concepts. In: van der Veer, R., Valsiner, J. (eds.) The Vygotsky Reader, pp. 73–98. Blackwell, Oxford (1994)

19.

Shimizu, H., Yamaguchi, Y.: Synergetic computer and holonics: information dynamics of a semantic computer. Phys. Scr. 36(6), 970–985 (1987)CrossRef

20.

Short, T.L.: Peirce’s Theory of Signs. Cambridge University Press, Cambridge (2009)

21.

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the Inception architecture for computer vision. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2818–2826 (2016). https://doi.org/10.1109/CVPR.2016.308

22.

Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions (2014). arXiv:1409.4842

23.

Tuomi, I.: Vygotsky in a TeamRoom: an exploratory study on collective concept formation in electronic environments. In: Nunamaker, J. (ed.) Proceedings of the 31st Annual Hawaii International Conference on System Sciences, vol. 1, pp. 68–75. IEEE Computer Society Press, Los Alamitos (1998). https://doi.org/10.1109/HICSS.1998.653085

24.

Tuomi, I.: Corporate Knowledge: Theory and Practice of Intelligent Organizations. Metaxis, Helsinki (1999)

25.

Tuomi, I.: Data is more than knowledge: implications of the reversed knowledge hierarchy to knowledge management and organizational memory. J. Manag. Inf. Syst. 6(3), 103–117 (2000). https://doi.org/10.1080/07421222.1999.11518258CrossRef

26.

Tuomi, I.: Ontological expansion. In: Poli, R. (ed.) Handbook of Anticipation, pp. 1–35. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-31737-3_4-1CrossRef

27.

van der Veer, R., Valsiner, J.: Understanding Vygotsky: A Quest for Synthesis. Blackwell Publishers, Cambridge (1994)

28.

Vygotsky, L.: Mind in Society: The Development of Higher Psychological Processes. Harvard University Press, Cambridge (1978)

29.

Vygotsky, L.: Thought and Language. The MIT Press, Cambridge (1986)

30.

Wertsch, J.: Vygotsky and the Social Formation of Mind. Harvard University Press, Cambridge (1985)

31.

Zueva, E.Y., Zuev, K.B.: The concept of dominance by A.A. Ukhtomsky and anticipation. In: Nadin, M. (ed.) Anticipation: Learning from the Past - The Russian/Soviet Contributions to the Science of Anticipation, pp. 13–35. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19446-2_2CrossRef

Title: Vygotsky Meets Backpropagation
Author: Ilkka Tuomi
Publisher: Springer International Publishing
Book: Artificial Intelligence in Education
Print ISBN: 978-3-319-93842-4

Electronic ISBN: 978-3-319-93843-1

Copyright Year: 2018
DOI: https://doi.org/10.1007/978-3-319-93843-1_42

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner