Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 4/2021

28-10-2020 | Original Article

An algorithm based on valuation forecasting for game tree search

Authors: Guangyun Tan, Peipei Wei, Yongyi He, Huahu Xu, Xinxin Shi, Ping Yi

Published in: International Journal of Machine Learning and Cybernetics | Issue 4/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This study proposes a novel best-first search algorithm, called Valuation Increment Search Algorithm (VIS), which applies the increment of exploratory value change to predict the valuation and guide the selection of the game tree. The proposed method can effectively use node valuation and game tree size information to solve the game tree by fewer exploration steps. The relevant assumptions and search principles of the proposed algorithm are detailed. Moreover, comparative experiments with Alpha–Beta Search (α–β search), Proof-Number Search (PNS) and Monte-Carlo Tree Search (MCTS) in the domain of Dou Dizhu has been performed to verify the performance. Result demonstrate that VIS is superior to α–β search, PNS and MCTS algorithm in solving the game tree and finding the best move for some game scenarios by consuming less time and few memory resources. The improvement effect of the average Increment, magnitude of Increment, and the number of visits to node on the original VIS was validated. Also, a new selection strategy is defined for the improved VIS algorithm combined with these factors. The experimental comparison results show that improved VIS has a better performance in solving game tree with less nodes generated and expanded than original VIS.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Abderazek H, Yildiz AR, Mirjalili S (2020) Comparison of recent optimization algorithms for design optimization of a cam-follower mechanism. Knowl Based Syst 191:105237–105237CrossRef Abderazek H, Yildiz AR, Mirjalili S (2020) Comparison of recent optimization algorithms for design optimization of a cam-follower mechanism. Knowl Based Syst 191:105237–105237CrossRef
3.
go back to reference Berliner HJ, McConnell C (1996) B∗ probability based search. Artif Intell 86:97–156CrossRef Berliner HJ, McConnell C (1996) B∗ probability based search. Artif Intell 86:97–156CrossRef
4.
go back to reference Breuker DM, Uiterwijk JWHM, Herik HJ (1999) The PN2-search algorithm. Universiteit Maastricht, Department of Computer Science, Netherlands. Breuker DM, Uiterwijk JWHM, Herik HJ (1999) The PN2-search algorithm. Universiteit Maastricht, Department of Computer Science, Netherlands.
5.
go back to reference Browne CB et al (2012) A survey of Monte–Carlo tree search methods. IEEE Trans Comput Intell AI Games 4:1–43CrossRef Browne CB et al (2012) A survey of Monte–Carlo tree search methods. IEEE Trans Comput Intell AI Games 4:1–43CrossRef
6.
go back to reference Chaslot G, Bakkes S, Szita I, Spronck P (2008) Monte–Carlo tree search: a new framework for game AI. Fourth Artificial Intelligence and Interactive Digital Entertainment Conference, pp 216–217 Chaslot G, Bakkes S, Szita I, Spronck P (2008) Monte–Carlo tree search: a new framework for game AI. Fourth Artificial Intelligence and Interactive Digital Entertainment Conference, pp 216–217
8.
go back to reference Coulom R (2006) Efficient selectivity and backup operators in Monte-Carlo tree search. In: International conference on computers and games, Springer, pp 72–83 Coulom R (2006) Efficient selectivity and backup operators in Monte-Carlo tree search. In: International conference on computers and games, Springer, pp 72–83
9.
go back to reference Di Palma S, Lanzi PL (2018) Traditional wisdom and Monte–Carlo tree search face-to-face in the card game scopone. IEEE Trans Games 10(3):317–332CrossRef Di Palma S, Lanzi PL (2018) Traditional wisdom and Monte–Carlo tree search face-to-face in the card game scopone. IEEE Trans Games 10(3):317–332CrossRef
10.
go back to reference Ertel W (2018) Introduction to artificial intelligence. Springer, Berlin Ertel W (2018) Introduction to artificial intelligence. Springer, Berlin
11.
go back to reference Ghojogh B, Sharifian S, Mohammadzade H (2018) Tree-Based Optimization: A Meta-Algorithm for Metaheuristic Optimization arXiv: Neural and Evolutionary Computing Ghojogh B, Sharifian S, Mohammadzade H (2018) Tree-Based Optimization: A Meta-Algorithm for Metaheuristic Optimization arXiv: Neural and Evolutionary Computing
12.
go back to reference Heifets A, Jurisica I (2012) Construction of new medicines via game proof search. In: Twenty-Sixth AAAI Conference on Artificial Intelligence, pp 1564–1570 Heifets A, Jurisica I (2012) Construction of new medicines via game proof search. In: Twenty-Sixth AAAI Conference on Artificial Intelligence, pp 1564–1570
13.
go back to reference Khalifa A, Isaksen A, Togelius J, Nealen A (2016) Modifying MCTS for human-like general video game playing. In: IJCAI, pp 2514–2520 Khalifa A, Isaksen A, Togelius J, Nealen A (2016) Modifying MCTS for human-like general video game playing. In: IJCAI, pp 2514–2520
14.
go back to reference Kishimoto A, Müller M (2004) DF-PN in Go: an application to the one-eye problem. Springer, US Kishimoto A, Müller M (2004) DF-PN in Go: an application to the one-eye problem. Springer, US
15.
go back to reference Kishimoto A, Winands MH, Müller M, Saito J-T (2012) Game-tree search using proof numbers: The first twenty years. Icga Journal 35(3):131–156CrossRef Kishimoto A, Winands MH, Müller M, Saito J-T (2012) Game-tree search using proof numbers: The first twenty years. Icga Journal 35(3):131–156CrossRef
17.
go back to reference Mcdermott J (1980) Principles of artificial intelligence. Artif Intell 15:127–131CrossRef Mcdermott J (1980) Principles of artificial intelligence. Artif Intell 15:127–131CrossRef
18.
19.
go back to reference Nilsson NJ (1982) Principles of artificial intelligence. Morgan Kaufmann, San FranciscoCrossRef Nilsson NJ (1982) Principles of artificial intelligence. Morgan Kaufmann, San FranciscoCrossRef
20.
go back to reference Pearl J (1982) The solution for the branching factor of the alpha-beta pruning algorithm and its optimality. Commun ACM 25(8):559–564MathSciNetCrossRef Pearl J (1982) The solution for the branching factor of the alpha-beta pruning algorithm and its optimality. Commun ACM 25(8):559–564MathSciNetCrossRef
21.
go back to reference Pholdee N, Bureerat S, Yildiz AR (2017) Hybrid real-code population-based incremental learning and differential evolution for many-objective optimisation of an automotive floor-frame. Int J Veh Des 73:20CrossRef Pholdee N, Bureerat S, Yildiz AR (2017) Hybrid real-code population-based incremental learning and differential evolution for many-objective optimisation of an automotive floor-frame. Int J Veh Des 73:20CrossRef
22.
go back to reference Russell SJ, Norvig P (2016) Artificial intelligence: a modern approach. Pearson Education Limited, MalaysiaMATH Russell SJ, Norvig P (2016) Artificial intelligence: a modern approach. Pearson Education Limited, MalaysiaMATH
23.
go back to reference Saito J-T, Winands MH, Van Den Herik HJ (2009) Randomized parallel proof-number search. In: advances in computer games, Springer, pp 75–87 Saito J-T, Winands MH, Van Den Herik HJ (2009) Randomized parallel proof-number search. In: advances in computer games, Springer, pp 75–87
25.
go back to reference Seo M, Iida H, Uiterwijk JW (2001) The PN∗-search algorithm: Application to tsume-shogi Artificial Intelligence 129:253–277 Seo M, Iida H, Uiterwijk JW (2001) The PN∗-search algorithm: Application to tsume-shogi Artificial Intelligence 129:253–277
27.
go back to reference Silver D et al (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529:484CrossRef Silver D et al (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529:484CrossRef
28.
go back to reference Silver D et al (2017) Mastering the game of Go without human knowledge. Nature 550:354CrossRef Silver D et al (2017) Mastering the game of Go without human knowledge. Nature 550:354CrossRef
29.
go back to reference Van Den Herik HJ, Uiterwijk JW, Van Rijswijck J (2002) Games solved: Now and in the future. Artif Intell 134:277–311CrossRef Van Den Herik HJ, Uiterwijk JW, Van Rijswijck J (2002) Games solved: Now and in the future. Artif Intell 134:277–311CrossRef
30.
go back to reference Van Den Herik HJ, Winands MH (2008) Proof-number search and its variants. In: Oppositional concepts in computational intelligence. Springer, pp 91–118 Van Den Herik HJ, Winands MH (2008) Proof-number search and its variants. In: Oppositional concepts in computational intelligence. Springer, pp 91–118
31.
go back to reference Von Neumann J, Morgenstern O (2007) Theory of games and economic behavior (commemorative edition). Princeton university press. Von Neumann J, Morgenstern O (2007) Theory of games and economic behavior (commemorative edition). Princeton university press.
32.
go back to reference Winands MH, Uiterwijk JW, van den Herik J PDS-PN: A new proof-number search algorithm. In: International Conference on Computers and Games, 2002. Springer, pp 61–74 Winands MH, Uiterwijk JW, van den Herik J PDS-PN: A new proof-number search algorithm. In: International Conference on Computers and Games, 2002. Springer, pp 61–74
33.
go back to reference Xu C-M, Ma Z, Tao J-J, Xu X-H Enhancements of proof number search in connect6. In: Control and Decision Conference, 2009. CCDC'09. Chinese, 2009. IEEE, pp 4525–4529 Xu C-M, Ma Z, Tao J-J, Xu X-H Enhancements of proof number search in connect6. In: Control and Decision Conference, 2009. CCDC'09. Chinese, 2009. IEEE, pp 4525–4529
34.
go back to reference Yannakakis GN, Togelius J (2018) Artificial intelligence and games. Springer, BerlinCrossRef Yannakakis GN, Togelius J (2018) Artificial intelligence and games. Springer, BerlinCrossRef
Metadata
Title
An algorithm based on valuation forecasting for game tree search
Authors
Guangyun Tan
Peipei Wei
Yongyi He
Huahu Xu
Xinxin Shi
Ping Yi
Publication date
28-10-2020
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 4/2021
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-020-01222-3

Other articles of this Issue 4/2021

International Journal of Machine Learning and Cybernetics 4/2021 Go to the issue