Skip to main content
Erschienen in: Soft Computing 11/2018

23.03.2018 | Focus

ELM-based convolutional neural networks making move prediction in Go

verfasst von: Xiangguo Zhao, Zhongyu Ma, Boyang Li, Zhen Zhang, Hengyu Liu

Erschienen in: Soft Computing | Ausgabe 11/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the rapid development of machine learning, artificial intelligence (AI) has drawn much more attention. Under this circumstances, abstract strategy games, such as chess, checkers and Go, have been a fascinating problem of AI research. Most of the existing state-of-the-art Go programs used deep neural network technology, like convolutional neural networks (CNNs). However, CNNs require multiple iterations to optimize weights and spend a lot of training time. Therefore, in this paper, in order to solve the above shortcomings, we propose a new learning algorithm ECNN, which integrates CNNs with extreme learning machine (ELM). We remove pooling layers of CNNs and insert ELM layers between convolutional layers. The newly added ELM layers will be updated in back-propagation process, and they accelerate the convergence of weights in CNNs. Therefore, our ECNN can reduce the training time of CNNs. Further, we propose ECNN-Go algorithm, which applies ECNN to Go game. Because of the advantage of ECNN, ECNN-Go algorithm has the fast learning speed to make move prediction in Go game. Finally, the experimental results show the efficiency and accuracy of ECNN algorithm and demonstrate the strength of ECNN-Go.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Chellapilla K, Fogel DB (1999) Evolving neural networks to play checkers without relying on expert knowledge. IEEE Trans Neural Netw 10(6):1382–91CrossRef Chellapilla K, Fogel DB (1999) Evolving neural networks to play checkers without relying on expert knowledge. IEEE Trans Neural Netw 10(6):1382–91CrossRef
Zurück zum Zitat Cheng Y, Yuan Y, Chen L, Wang G, Giraud-Carrier CG, Sun Y (2016) Distr: a distributed method for the reachability query over large uncertain graphs. IEEE Trans Parallel Distrib Syst 27(11):3172–3185CrossRef Cheng Y, Yuan Y, Chen L, Wang G, Giraud-Carrier CG, Sun Y (2016) Distr: a distributed method for the reachability query over large uncertain graphs. IEEE Trans Parallel Distrib Syst 27(11):3172–3185CrossRef
Zurück zum Zitat Cheng Y, Yuan Y, Chen L, Giraud-Carrier CG, Wang G (2017) Complex event-participant planning and its incremental variant. In: 33rd IEEE international conference on data engineering, ICDE 2017, San Diego, CA, USA, April 19–22, 2017, pp 859–870 Cheng Y, Yuan Y, Chen L, Giraud-Carrier CG, Wang G (2017) Complex event-participant planning and its incremental variant. In: 33rd IEEE international conference on data engineering, ICDE 2017, San Diego, CA, USA, April 19–22, 2017, pp 859–870
Zurück zum Zitat Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: International conference, pp 160–167 Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: International conference, pp 160–167
Zurück zum Zitat Cui D, Huang GB, Liu T (2016) Smile detection using pair-wise distance vector and extreme learning machine. In: International joint conference on neural networks, pp 2298–2305 Cui D, Huang GB, Liu T (2016) Smile detection using pair-wise distance vector and extreme learning machine. In: International joint conference on neural networks, pp 2298–2305
Zurück zum Zitat Ding S, Zhang N, Zhang J, Xu X, Shi Z (2017) Unsupervised extreme learning machine with representational features. Int J Mach Learn Cybern 8(2):587–595CrossRef Ding S, Zhang N, Zhang J, Xu X, Shi Z (2017) Unsupervised extreme learning machine with representational features. Int J Mach Learn Cybern 8(2):587–595CrossRef
Zurück zum Zitat Duc HH, Jihoon L, Keechul J (2016) Suggesting moving positions in go-game with convolutional neural networks trained data. Int J Hybrid Inf Technol 9(4):51–58CrossRef Duc HH, Jihoon L, Keechul J (2016) Suggesting moving positions in go-game with convolutional neural networks trained data. Int J Hybrid Inf Technol 9(4):51–58CrossRef
Zurück zum Zitat Gelly S, Kocsis L, Schoenauer M, Sebag M, Silver D, Szepesvári C, Teytaud O (2012) The grand challenge of computer go: Monte carlo tree search and extensions. Commun ACM 55(3):106–113CrossRef Gelly S, Kocsis L, Schoenauer M, Sebag M, Silver D, Szepesvári C, Teytaud O (2012) The grand challenge of computer go: Monte carlo tree search and extensions. Commun ACM 55(3):106–113CrossRef
Zurück zum Zitat Guo L, Ding S (2015) A hybrid deep learning CNN-ELM model and its application in handwritten numeral recognition. J Comput Inf Syst 11(7):2673–2680 Guo L, Ding S (2015) A hybrid deep learning CNN-ELM model and its application in handwritten numeral recognition. J Comput Inf Syst 11(7):2673–2680
Zurück zum Zitat He K, Sun J (2015) Convolutional neural networks at constrained time cost. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5353–5360 He K, Sun J (2015) Convolutional neural networks at constrained time cost. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5353–5360
Zurück zum Zitat Hu K, Yang W, Gao X (2017) Microcalcification diagnosis in digital mammography using extreme learning machine based on hidden Markov tree model of dual-tree complex wavelet transform. Exp Syst Appl 86:135–144CrossRef Hu K, Yang W, Gao X (2017) Microcalcification diagnosis in digital mammography using extreme learning machine based on hidden Markov tree model of dual-tree complex wavelet transform. Exp Syst Appl 86:135–144CrossRef
Zurück zum Zitat Huang GB, Zhu QY, Siew CK (2005) Extreme learning machine: a new learning scheme of feedforward neural networks. In: IEEE international joint conference on neural networks, 2004. Proceedings, vol 2, pp 985–990 Huang GB, Zhu QY, Siew CK (2005) Extreme learning machine: a new learning scheme of feedforward neural networks. In: IEEE international joint conference on neural networks, 2004. Proceedings, vol 2, pp 985–990
Zurück zum Zitat Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1):489–501CrossRef Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1):489–501CrossRef
Zurück zum Zitat Liu M, Liu B, Zhang C, Wang W, Sun W (2017) Semi-supervised low rank kernel learning algorithm via extreme learning machine. Int J Mach Learn Cybern 8(3):1039–1052CrossRef Liu M, Liu B, Zhang C, Wang W, Sun W (2017) Semi-supervised low rank kernel learning algorithm via extreme learning machine. Int J Mach Learn Cybern 8(3):1039–1052CrossRef
Zurück zum Zitat Mao W, Wang J, Xue Z (2017) An ELM-based model with sparse-weighting strategy for sequential data imbalance problem. Int J Mach Learn Cybern 8(4):1333–1345CrossRef Mao W, Wang J, Xue Z (2017) An ELM-based model with sparse-weighting strategy for sequential data imbalance problem. Int J Mach Learn Cybern 8(4):1333–1345CrossRef
Zurück zum Zitat Matsugu M, Mori K, Mitari Y, Kaneda Y (2003) Subject independent facial expression recognition with robust face detection using a convolutional neural network. Neural Netw Off J Int Neural Netw Soc 16(5–6):555CrossRef Matsugu M, Mori K, Mitari Y, Kaneda Y (2003) Subject independent facial expression recognition with robust face detection using a convolutional neural network. Neural Netw Off J Int Neural Netw Soc 16(5–6):555CrossRef
Zurück zum Zitat Oord A, Den RV, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: International conference on neural information processing systems, pp 2643–2651 Oord A, Den RV, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: International conference on neural information processing systems, pp 2643–2651
Zurück zum Zitat Schaeffer J (2000) The games computers (and people) play. Adv Comput 52:189–266CrossRef Schaeffer J (2000) The games computers (and people) play. Adv Comput 52:189–266CrossRef
Zurück zum Zitat Schaeffer J, Van den Herik HJ (2002) Games, computers, and artificial intelligence. Artif Intell 134(1–2):1–7CrossRefMATH Schaeffer J, Van den Herik HJ (2002) Games, computers, and artificial intelligence. Artif Intell 134(1–2):1–7CrossRefMATH
Zurück zum Zitat Shan P, Yang X (2016) Deep convolutional extreme learning machine and its application in handwritten digit classification. Comput Intell Neurosci 2016(3):1–10MathSciNetCrossRef Shan P, Yang X (2016) Deep convolutional extreme learning machine and its application in handwritten digit classification. Comput Intell Neurosci 2016(3):1–10MathSciNetCrossRef
Zurück zum Zitat Silver D, Huang A, Maddison CJ, Guez A, Sifre L, Van Den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529(7587):484CrossRef Silver D, Huang A, Maddison CJ, Guez A, Sifre L, Van Den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529(7587):484CrossRef
Zurück zum Zitat Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M (2014) Striving for simplicity: the all convolutional net. arXiv preprint arXiv:1412.6806 Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M (2014) Striving for simplicity: the all convolutional net. arXiv preprint arXiv:​1412.​6806
Zurück zum Zitat Stern D, Herbrich R, Graepel T (2006) Bayesian pattern ranking for move prediction in the game of go. In: International conference, pp 873–880 Stern D, Herbrich R, Graepel T (2006) Bayesian pattern ranking for move prediction in the game of go. In: International conference, pp 873–880
Zurück zum Zitat Sutskever I, Nair V (2008) Mimicking go experts with convolutional neural networks. Artif Neural Netw ICANN 2008:101–110 Sutskever I, Nair V (2008) Mimicking go experts with convolutional neural networks. Artif Neural Netw ICANN 2008:101–110
Zurück zum Zitat Tong Y, Chen L, Zhou Z, Jagadish HV, Shou L, Lv W (2018) Slade: a smart large-scale task decomposer in crowdsourcing. IEEE Trans Knowl Data Eng PP(99):1–1CrossRef Tong Y, Chen L, Zhou Z, Jagadish HV, Shou L, Lv W (2018) Slade: a smart large-scale task decomposer in crowdsourcing. IEEE Trans Knowl Data Eng PP(99):1–1CrossRef
Zurück zum Zitat Wang XZ, Zhang T, Wang R (2017) Noniterative deep learning: incorporating restricted Boltzmann machine into multilayer random weight neural networks. IEEE Trans Syst Man Cybern Syst PP(99):1–10 Wang XZ, Zhang T, Wang R (2017) Noniterative deep learning: incorporating restricted Boltzmann machine into multilayer random weight neural networks. IEEE Trans Syst Man Cybern Syst PP(99):1–10
Zurück zum Zitat Yen SJ, Yang TN, Chen C, Hsu SC (2007) Pattern matching in go game records. In: International conference on innovative computing, information and control, pp 297–297 Yen SJ, Yang TN, Chen C, Hsu SC (2007) Pattern matching in go game records. In: International conference on innovative computing, information and control, pp 297–297
Zurück zum Zitat Zhai J, Zhang S, Wang C (2017) The classification of imbalanced large data sets based on mapreduce and ensemble of ELM classifiers. Int J Mach Learn Cybern 8(3):1009–1017CrossRef Zhai J, Zhang S, Wang C (2017) The classification of imbalanced large data sets based on mapreduce and ensemble of ELM classifiers. Int J Mach Learn Cybern 8(3):1009–1017CrossRef
Zurück zum Zitat Zhu R, Wang B, Yang X, Zheng B, Wang G (2017) SAP: improving continuous top-k queries over streaming data. IEEE Trans Knowl Data Eng PP(99):1–1 Zhu R, Wang B, Yang X, Zheng B, Wang G (2017) SAP: improving continuous top-k queries over streaming data. IEEE Trans Knowl Data Eng PP(99):1–1
Metadaten
Titel
ELM-based convolutional neural networks making move prediction in Go
verfasst von
Xiangguo Zhao
Zhongyu Ma
Boyang Li
Zhen Zhang
Hengyu Liu
Publikationsdatum
23.03.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 11/2018
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-018-3158-1

Weitere Artikel der Ausgabe 11/2018

Soft Computing 11/2018 Zur Ausgabe