Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 4/2021

28.10.2020 | Original Article

An algorithm based on valuation forecasting for game tree search

verfasst von: Guangyun Tan, Peipei Wei, Yongyi He, Huahu Xu, Xinxin Shi, Ping Yi

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 4/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This study proposes a novel best-first search algorithm, called Valuation Increment Search Algorithm (VIS), which applies the increment of exploratory value change to predict the valuation and guide the selection of the game tree. The proposed method can effectively use node valuation and game tree size information to solve the game tree by fewer exploration steps. The relevant assumptions and search principles of the proposed algorithm are detailed. Moreover, comparative experiments with Alpha–Beta Search (α–β search), Proof-Number Search (PNS) and Monte-Carlo Tree Search (MCTS) in the domain of Dou Dizhu has been performed to verify the performance. Result demonstrate that VIS is superior to α–β search, PNS and MCTS algorithm in solving the game tree and finding the best move for some game scenarios by consuming less time and few memory resources. The improvement effect of the average Increment, magnitude of Increment, and the number of visits to node on the original VIS was validated. Also, a new selection strategy is defined for the improved VIS algorithm combined with these factors. The experimental comparison results show that improved VIS has a better performance in solving game tree with less nodes generated and expanded than original VIS.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Abderazek H, Yildiz AR, Mirjalili S (2020) Comparison of recent optimization algorithms for design optimization of a cam-follower mechanism. Knowl Based Syst 191:105237–105237CrossRef Abderazek H, Yildiz AR, Mirjalili S (2020) Comparison of recent optimization algorithms for design optimization of a cam-follower mechanism. Knowl Based Syst 191:105237–105237CrossRef
3.
Zurück zum Zitat Berliner HJ, McConnell C (1996) B∗ probability based search. Artif Intell 86:97–156CrossRef Berliner HJ, McConnell C (1996) B∗ probability based search. Artif Intell 86:97–156CrossRef
4.
Zurück zum Zitat Breuker DM, Uiterwijk JWHM, Herik HJ (1999) The PN2-search algorithm. Universiteit Maastricht, Department of Computer Science, Netherlands. Breuker DM, Uiterwijk JWHM, Herik HJ (1999) The PN2-search algorithm. Universiteit Maastricht, Department of Computer Science, Netherlands.
5.
Zurück zum Zitat Browne CB et al (2012) A survey of Monte–Carlo tree search methods. IEEE Trans Comput Intell AI Games 4:1–43CrossRef Browne CB et al (2012) A survey of Monte–Carlo tree search methods. IEEE Trans Comput Intell AI Games 4:1–43CrossRef
6.
Zurück zum Zitat Chaslot G, Bakkes S, Szita I, Spronck P (2008) Monte–Carlo tree search: a new framework for game AI. Fourth Artificial Intelligence and Interactive Digital Entertainment Conference, pp 216–217 Chaslot G, Bakkes S, Szita I, Spronck P (2008) Monte–Carlo tree search: a new framework for game AI. Fourth Artificial Intelligence and Interactive Digital Entertainment Conference, pp 216–217
8.
Zurück zum Zitat Coulom R (2006) Efficient selectivity and backup operators in Monte-Carlo tree search. In: International conference on computers and games, Springer, pp 72–83 Coulom R (2006) Efficient selectivity and backup operators in Monte-Carlo tree search. In: International conference on computers and games, Springer, pp 72–83
9.
Zurück zum Zitat Di Palma S, Lanzi PL (2018) Traditional wisdom and Monte–Carlo tree search face-to-face in the card game scopone. IEEE Trans Games 10(3):317–332CrossRef Di Palma S, Lanzi PL (2018) Traditional wisdom and Monte–Carlo tree search face-to-face in the card game scopone. IEEE Trans Games 10(3):317–332CrossRef
10.
Zurück zum Zitat Ertel W (2018) Introduction to artificial intelligence. Springer, Berlin Ertel W (2018) Introduction to artificial intelligence. Springer, Berlin
11.
Zurück zum Zitat Ghojogh B, Sharifian S, Mohammadzade H (2018) Tree-Based Optimization: A Meta-Algorithm for Metaheuristic Optimization arXiv: Neural and Evolutionary Computing Ghojogh B, Sharifian S, Mohammadzade H (2018) Tree-Based Optimization: A Meta-Algorithm for Metaheuristic Optimization arXiv: Neural and Evolutionary Computing
12.
Zurück zum Zitat Heifets A, Jurisica I (2012) Construction of new medicines via game proof search. In: Twenty-Sixth AAAI Conference on Artificial Intelligence, pp 1564–1570 Heifets A, Jurisica I (2012) Construction of new medicines via game proof search. In: Twenty-Sixth AAAI Conference on Artificial Intelligence, pp 1564–1570
13.
Zurück zum Zitat Khalifa A, Isaksen A, Togelius J, Nealen A (2016) Modifying MCTS for human-like general video game playing. In: IJCAI, pp 2514–2520 Khalifa A, Isaksen A, Togelius J, Nealen A (2016) Modifying MCTS for human-like general video game playing. In: IJCAI, pp 2514–2520
14.
Zurück zum Zitat Kishimoto A, Müller M (2004) DF-PN in Go: an application to the one-eye problem. Springer, US Kishimoto A, Müller M (2004) DF-PN in Go: an application to the one-eye problem. Springer, US
15.
Zurück zum Zitat Kishimoto A, Winands MH, Müller M, Saito J-T (2012) Game-tree search using proof numbers: The first twenty years. Icga Journal 35(3):131–156CrossRef Kishimoto A, Winands MH, Müller M, Saito J-T (2012) Game-tree search using proof numbers: The first twenty years. Icga Journal 35(3):131–156CrossRef
17.
Zurück zum Zitat Mcdermott J (1980) Principles of artificial intelligence. Artif Intell 15:127–131CrossRef Mcdermott J (1980) Principles of artificial intelligence. Artif Intell 15:127–131CrossRef
18.
Zurück zum Zitat Newell A, Shaw JC, Simon HA (1958) Chess-playing programs and the problem of complexity. IBM J Res Dev 2:320–335MathSciNetCrossRef Newell A, Shaw JC, Simon HA (1958) Chess-playing programs and the problem of complexity. IBM J Res Dev 2:320–335MathSciNetCrossRef
19.
Zurück zum Zitat Nilsson NJ (1982) Principles of artificial intelligence. Morgan Kaufmann, San FranciscoCrossRef Nilsson NJ (1982) Principles of artificial intelligence. Morgan Kaufmann, San FranciscoCrossRef
20.
Zurück zum Zitat Pearl J (1982) The solution for the branching factor of the alpha-beta pruning algorithm and its optimality. Commun ACM 25(8):559–564MathSciNetCrossRef Pearl J (1982) The solution for the branching factor of the alpha-beta pruning algorithm and its optimality. Commun ACM 25(8):559–564MathSciNetCrossRef
21.
Zurück zum Zitat Pholdee N, Bureerat S, Yildiz AR (2017) Hybrid real-code population-based incremental learning and differential evolution for many-objective optimisation of an automotive floor-frame. Int J Veh Des 73:20CrossRef Pholdee N, Bureerat S, Yildiz AR (2017) Hybrid real-code population-based incremental learning and differential evolution for many-objective optimisation of an automotive floor-frame. Int J Veh Des 73:20CrossRef
22.
Zurück zum Zitat Russell SJ, Norvig P (2016) Artificial intelligence: a modern approach. Pearson Education Limited, MalaysiaMATH Russell SJ, Norvig P (2016) Artificial intelligence: a modern approach. Pearson Education Limited, MalaysiaMATH
23.
Zurück zum Zitat Saito J-T, Winands MH, Van Den Herik HJ (2009) Randomized parallel proof-number search. In: advances in computer games, Springer, pp 75–87 Saito J-T, Winands MH, Van Den Herik HJ (2009) Randomized parallel proof-number search. In: advances in computer games, Springer, pp 75–87
25.
Zurück zum Zitat Seo M, Iida H, Uiterwijk JW (2001) The PN∗-search algorithm: Application to tsume-shogi Artificial Intelligence 129:253–277 Seo M, Iida H, Uiterwijk JW (2001) The PN∗-search algorithm: Application to tsume-shogi Artificial Intelligence 129:253–277
27.
Zurück zum Zitat Silver D et al (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529:484CrossRef Silver D et al (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529:484CrossRef
28.
Zurück zum Zitat Silver D et al (2017) Mastering the game of Go without human knowledge. Nature 550:354CrossRef Silver D et al (2017) Mastering the game of Go without human knowledge. Nature 550:354CrossRef
29.
Zurück zum Zitat Van Den Herik HJ, Uiterwijk JW, Van Rijswijck J (2002) Games solved: Now and in the future. Artif Intell 134:277–311CrossRef Van Den Herik HJ, Uiterwijk JW, Van Rijswijck J (2002) Games solved: Now and in the future. Artif Intell 134:277–311CrossRef
30.
Zurück zum Zitat Van Den Herik HJ, Winands MH (2008) Proof-number search and its variants. In: Oppositional concepts in computational intelligence. Springer, pp 91–118 Van Den Herik HJ, Winands MH (2008) Proof-number search and its variants. In: Oppositional concepts in computational intelligence. Springer, pp 91–118
31.
Zurück zum Zitat Von Neumann J, Morgenstern O (2007) Theory of games and economic behavior (commemorative edition). Princeton university press. Von Neumann J, Morgenstern O (2007) Theory of games and economic behavior (commemorative edition). Princeton university press.
32.
Zurück zum Zitat Winands MH, Uiterwijk JW, van den Herik J PDS-PN: A new proof-number search algorithm. In: International Conference on Computers and Games, 2002. Springer, pp 61–74 Winands MH, Uiterwijk JW, van den Herik J PDS-PN: A new proof-number search algorithm. In: International Conference on Computers and Games, 2002. Springer, pp 61–74
33.
Zurück zum Zitat Xu C-M, Ma Z, Tao J-J, Xu X-H Enhancements of proof number search in connect6. In: Control and Decision Conference, 2009. CCDC'09. Chinese, 2009. IEEE, pp 4525–4529 Xu C-M, Ma Z, Tao J-J, Xu X-H Enhancements of proof number search in connect6. In: Control and Decision Conference, 2009. CCDC'09. Chinese, 2009. IEEE, pp 4525–4529
34.
Zurück zum Zitat Yannakakis GN, Togelius J (2018) Artificial intelligence and games. Springer, BerlinCrossRef Yannakakis GN, Togelius J (2018) Artificial intelligence and games. Springer, BerlinCrossRef
Metadaten
Titel
An algorithm based on valuation forecasting for game tree search
verfasst von
Guangyun Tan
Peipei Wei
Yongyi He
Huahu Xu
Xinxin Shi
Ping Yi
Publikationsdatum
28.10.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 4/2021
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-020-01222-3

Weitere Artikel der Ausgabe 4/2021

International Journal of Machine Learning and Cybernetics 4/2021 Zur Ausgabe

Neuer Inhalt