Skip to main content
Top
Published in: Soft Computing 11/2018

23-03-2018 | Focus

ELM-based convolutional neural networks making move prediction in Go

Authors: Xiangguo Zhao, Zhongyu Ma, Boyang Li, Zhen Zhang, Hengyu Liu

Published in: Soft Computing | Issue 11/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the rapid development of machine learning, artificial intelligence (AI) has drawn much more attention. Under this circumstances, abstract strategy games, such as chess, checkers and Go, have been a fascinating problem of AI research. Most of the existing state-of-the-art Go programs used deep neural network technology, like convolutional neural networks (CNNs). However, CNNs require multiple iterations to optimize weights and spend a lot of training time. Therefore, in this paper, in order to solve the above shortcomings, we propose a new learning algorithm ECNN, which integrates CNNs with extreme learning machine (ELM). We remove pooling layers of CNNs and insert ELM layers between convolutional layers. The newly added ELM layers will be updated in back-propagation process, and they accelerate the convergence of weights in CNNs. Therefore, our ECNN can reduce the training time of CNNs. Further, we propose ECNN-Go algorithm, which applies ECNN to Go game. Because of the advantage of ECNN, ECNN-Go algorithm has the fast learning speed to make move prediction in Go game. Finally, the experimental results show the efficiency and accuracy of ECNN algorithm and demonstrate the strength of ECNN-Go.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Chellapilla K, Fogel DB (1999) Evolving neural networks to play checkers without relying on expert knowledge. IEEE Trans Neural Netw 10(6):1382–91CrossRef Chellapilla K, Fogel DB (1999) Evolving neural networks to play checkers without relying on expert knowledge. IEEE Trans Neural Netw 10(6):1382–91CrossRef
go back to reference Cheng Y, Yuan Y, Chen L, Wang G, Giraud-Carrier CG, Sun Y (2016) Distr: a distributed method for the reachability query over large uncertain graphs. IEEE Trans Parallel Distrib Syst 27(11):3172–3185CrossRef Cheng Y, Yuan Y, Chen L, Wang G, Giraud-Carrier CG, Sun Y (2016) Distr: a distributed method for the reachability query over large uncertain graphs. IEEE Trans Parallel Distrib Syst 27(11):3172–3185CrossRef
go back to reference Cheng Y, Yuan Y, Chen L, Giraud-Carrier CG, Wang G (2017) Complex event-participant planning and its incremental variant. In: 33rd IEEE international conference on data engineering, ICDE 2017, San Diego, CA, USA, April 19–22, 2017, pp 859–870 Cheng Y, Yuan Y, Chen L, Giraud-Carrier CG, Wang G (2017) Complex event-participant planning and its incremental variant. In: 33rd IEEE international conference on data engineering, ICDE 2017, San Diego, CA, USA, April 19–22, 2017, pp 859–870
go back to reference Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: International conference, pp 160–167 Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: International conference, pp 160–167
go back to reference Cui D, Huang GB, Liu T (2016) Smile detection using pair-wise distance vector and extreme learning machine. In: International joint conference on neural networks, pp 2298–2305 Cui D, Huang GB, Liu T (2016) Smile detection using pair-wise distance vector and extreme learning machine. In: International joint conference on neural networks, pp 2298–2305
go back to reference Ding S, Zhang N, Zhang J, Xu X, Shi Z (2017) Unsupervised extreme learning machine with representational features. Int J Mach Learn Cybern 8(2):587–595CrossRef Ding S, Zhang N, Zhang J, Xu X, Shi Z (2017) Unsupervised extreme learning machine with representational features. Int J Mach Learn Cybern 8(2):587–595CrossRef
go back to reference Duc HH, Jihoon L, Keechul J (2016) Suggesting moving positions in go-game with convolutional neural networks trained data. Int J Hybrid Inf Technol 9(4):51–58CrossRef Duc HH, Jihoon L, Keechul J (2016) Suggesting moving positions in go-game with convolutional neural networks trained data. Int J Hybrid Inf Technol 9(4):51–58CrossRef
go back to reference Gelly S, Kocsis L, Schoenauer M, Sebag M, Silver D, Szepesvári C, Teytaud O (2012) The grand challenge of computer go: Monte carlo tree search and extensions. Commun ACM 55(3):106–113CrossRef Gelly S, Kocsis L, Schoenauer M, Sebag M, Silver D, Szepesvári C, Teytaud O (2012) The grand challenge of computer go: Monte carlo tree search and extensions. Commun ACM 55(3):106–113CrossRef
go back to reference Guo L, Ding S (2015) A hybrid deep learning CNN-ELM model and its application in handwritten numeral recognition. J Comput Inf Syst 11(7):2673–2680 Guo L, Ding S (2015) A hybrid deep learning CNN-ELM model and its application in handwritten numeral recognition. J Comput Inf Syst 11(7):2673–2680
go back to reference He K, Sun J (2015) Convolutional neural networks at constrained time cost. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5353–5360 He K, Sun J (2015) Convolutional neural networks at constrained time cost. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5353–5360
go back to reference Hu K, Yang W, Gao X (2017) Microcalcification diagnosis in digital mammography using extreme learning machine based on hidden Markov tree model of dual-tree complex wavelet transform. Exp Syst Appl 86:135–144CrossRef Hu K, Yang W, Gao X (2017) Microcalcification diagnosis in digital mammography using extreme learning machine based on hidden Markov tree model of dual-tree complex wavelet transform. Exp Syst Appl 86:135–144CrossRef
go back to reference Huang GB, Zhu QY, Siew CK (2005) Extreme learning machine: a new learning scheme of feedforward neural networks. In: IEEE international joint conference on neural networks, 2004. Proceedings, vol 2, pp 985–990 Huang GB, Zhu QY, Siew CK (2005) Extreme learning machine: a new learning scheme of feedforward neural networks. In: IEEE international joint conference on neural networks, 2004. Proceedings, vol 2, pp 985–990
go back to reference Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1):489–501CrossRef Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1):489–501CrossRef
go back to reference Liu M, Liu B, Zhang C, Wang W, Sun W (2017) Semi-supervised low rank kernel learning algorithm via extreme learning machine. Int J Mach Learn Cybern 8(3):1039–1052CrossRef Liu M, Liu B, Zhang C, Wang W, Sun W (2017) Semi-supervised low rank kernel learning algorithm via extreme learning machine. Int J Mach Learn Cybern 8(3):1039–1052CrossRef
go back to reference Mao W, Wang J, Xue Z (2017) An ELM-based model with sparse-weighting strategy for sequential data imbalance problem. Int J Mach Learn Cybern 8(4):1333–1345CrossRef Mao W, Wang J, Xue Z (2017) An ELM-based model with sparse-weighting strategy for sequential data imbalance problem. Int J Mach Learn Cybern 8(4):1333–1345CrossRef
go back to reference Matsugu M, Mori K, Mitari Y, Kaneda Y (2003) Subject independent facial expression recognition with robust face detection using a convolutional neural network. Neural Netw Off J Int Neural Netw Soc 16(5–6):555CrossRef Matsugu M, Mori K, Mitari Y, Kaneda Y (2003) Subject independent facial expression recognition with robust face detection using a convolutional neural network. Neural Netw Off J Int Neural Netw Soc 16(5–6):555CrossRef
go back to reference Oord A, Den RV, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: International conference on neural information processing systems, pp 2643–2651 Oord A, Den RV, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: International conference on neural information processing systems, pp 2643–2651
go back to reference Schaeffer J (2000) The games computers (and people) play. Adv Comput 52:189–266CrossRef Schaeffer J (2000) The games computers (and people) play. Adv Comput 52:189–266CrossRef
go back to reference Schaeffer J, Van den Herik HJ (2002) Games, computers, and artificial intelligence. Artif Intell 134(1–2):1–7CrossRefMATH Schaeffer J, Van den Herik HJ (2002) Games, computers, and artificial intelligence. Artif Intell 134(1–2):1–7CrossRefMATH
go back to reference Shan P, Yang X (2016) Deep convolutional extreme learning machine and its application in handwritten digit classification. Comput Intell Neurosci 2016(3):1–10MathSciNetCrossRef Shan P, Yang X (2016) Deep convolutional extreme learning machine and its application in handwritten digit classification. Comput Intell Neurosci 2016(3):1–10MathSciNetCrossRef
go back to reference Silver D, Huang A, Maddison CJ, Guez A, Sifre L, Van Den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529(7587):484CrossRef Silver D, Huang A, Maddison CJ, Guez A, Sifre L, Van Den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529(7587):484CrossRef
go back to reference Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M (2014) Striving for simplicity: the all convolutional net. arXiv preprint arXiv:1412.6806 Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M (2014) Striving for simplicity: the all convolutional net. arXiv preprint arXiv:​1412.​6806
go back to reference Stern D, Herbrich R, Graepel T (2006) Bayesian pattern ranking for move prediction in the game of go. In: International conference, pp 873–880 Stern D, Herbrich R, Graepel T (2006) Bayesian pattern ranking for move prediction in the game of go. In: International conference, pp 873–880
go back to reference Sutskever I, Nair V (2008) Mimicking go experts with convolutional neural networks. Artif Neural Netw ICANN 2008:101–110 Sutskever I, Nair V (2008) Mimicking go experts with convolutional neural networks. Artif Neural Netw ICANN 2008:101–110
go back to reference Tong Y, Chen L, Zhou Z, Jagadish HV, Shou L, Lv W (2018) Slade: a smart large-scale task decomposer in crowdsourcing. IEEE Trans Knowl Data Eng PP(99):1–1CrossRef Tong Y, Chen L, Zhou Z, Jagadish HV, Shou L, Lv W (2018) Slade: a smart large-scale task decomposer in crowdsourcing. IEEE Trans Knowl Data Eng PP(99):1–1CrossRef
go back to reference Wang XZ, Zhang T, Wang R (2017) Noniterative deep learning: incorporating restricted Boltzmann machine into multilayer random weight neural networks. IEEE Trans Syst Man Cybern Syst PP(99):1–10 Wang XZ, Zhang T, Wang R (2017) Noniterative deep learning: incorporating restricted Boltzmann machine into multilayer random weight neural networks. IEEE Trans Syst Man Cybern Syst PP(99):1–10
go back to reference Yen SJ, Yang TN, Chen C, Hsu SC (2007) Pattern matching in go game records. In: International conference on innovative computing, information and control, pp 297–297 Yen SJ, Yang TN, Chen C, Hsu SC (2007) Pattern matching in go game records. In: International conference on innovative computing, information and control, pp 297–297
go back to reference Zhai J, Zhang S, Wang C (2017) The classification of imbalanced large data sets based on mapreduce and ensemble of ELM classifiers. Int J Mach Learn Cybern 8(3):1009–1017CrossRef Zhai J, Zhang S, Wang C (2017) The classification of imbalanced large data sets based on mapreduce and ensemble of ELM classifiers. Int J Mach Learn Cybern 8(3):1009–1017CrossRef
go back to reference Zhu R, Wang B, Yang X, Zheng B, Wang G (2017) SAP: improving continuous top-k queries over streaming data. IEEE Trans Knowl Data Eng PP(99):1–1 Zhu R, Wang B, Yang X, Zheng B, Wang G (2017) SAP: improving continuous top-k queries over streaming data. IEEE Trans Knowl Data Eng PP(99):1–1
Metadata
Title
ELM-based convolutional neural networks making move prediction in Go
Authors
Xiangguo Zhao
Zhongyu Ma
Boyang Li
Zhen Zhang
Hengyu Liu
Publication date
23-03-2018
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 11/2018
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-018-3158-1

Other articles of this Issue 11/2018

Soft Computing 11/2018 Go to the issue

Premium Partner