Skip to main content
Top
Published in: Artificial Life and Robotics 1/2017

23-09-2016 | Original Article

Worker’s knowledge evaluation with single-player Monte Carlo tree search for a practical reentrant scheduling problem

Authors: Ryota Furuoka, Shimpei Matsumoto

Published in: Artificial Life and Robotics | Issue 1/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper shows the application results of single-player Monte Carlo tree search (SP-MCTS), an alternative of MCTS, for a practical reentrant scheduling problem addressed by our previous works. Especially in this paper, worker’s IF-THEN knowledge evaluation method with SP-MCTS is proposed. SP-MCTS is thought to be a meta-heuristic algorithm for NP-completeness problems, because SP-MCTS is applicable for any types of problems, where the problem’s state changes determinately in each discrete time. Therefore, SP-MCTS might be useful for not only perfect-information one-player games, but also other problems, as long as search spaces are describable as a tree structure, and the solution is stoppable with the termination determinably. The authors have considered that SP-MCTS is useful for obtaining/evaluating knowledge. This paper first describes the basic idea of SP-MCTS, and second shows the detail of the scheduling problem, including formulation. After, this paper examines the availability of SP-MCTS for a practical problem. Especially, the potentiality of SP-MCTS for knowledge evaluation is discussed from the experimental results.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Browne C, Powley E, Whitehouse D, Lucas S et al (2012) A survey of Monte Carlo tree search methods. Comput Intell AI in Games IEEE Trans 4(1):1–43CrossRef Browne C, Powley E, Whitehouse D, Lucas S et al (2012) A survey of Monte Carlo tree search methods. Comput Intell AI in Games IEEE Trans 4(1):1–43CrossRef
2.
go back to reference Schadd M, Winands M, Heric H, Aldewereld H (2008) Addressing NP-complete puzzles with Monte-Carlo methods. In: Proc. of AISB 2008, vol 9, pp 55–61 Schadd M, Winands M, Heric H, Aldewereld H (2008) Addressing NP-complete puzzles with Monte-Carlo methods. In: Proc. of AISB 2008, vol 9, pp 55–61
3.
go back to reference Schadd M, Winands M, Tak M, Uiterwijk J (2012) Single-player Monte-Carlo tree search for SameGame. Knowl Based Syst 34:3–11CrossRef Schadd M, Winands M, Tak M, Uiterwijk J (2012) Single-player Monte-Carlo tree search for SameGame. Knowl Based Syst 34:3–11CrossRef
4.
go back to reference Sabar N, Kendall G (2015) Population based Monte Carlo tree search hyper-heuristic for combinatorial optimization problems. Inf Sci 314:225–239CrossRef Sabar N, Kendall G (2015) Population based Monte Carlo tree search hyper-heuristic for combinatorial optimization problems. Inf Sci 314:225–239CrossRef
5.
go back to reference Matsumoto S, Hirosue N, Itonaga K, Ueno N, Ishii H (2010) Monte-Carlo tree search for a reentrant scheduling problem. In: Proc. of The 40th International Conference on Computers and Industrial Engineering, CD-ROM, MP-Gc, cie125jp-1 Matsumoto S, Hirosue N, Itonaga K, Ueno N, Ishii H (2010) Monte-Carlo tree search for a reentrant scheduling problem. In: Proc. of The 40th International Conference on Computers and Industrial Engineering, CD-ROM, MP-Gc, cie125jp-1
6.
go back to reference Furuoka R, Matsumoto S, Iwai K (2015) A proposal of IF-THEN knowledge acquisition framework for a re-entrant scheduling problem to minimize the number of setup operation. In: Proc. of 2015 IEEJ Electronics, Information and Systems, pp 657–660 (in Japanese) Furuoka R, Matsumoto S, Iwai K (2015) A proposal of IF-THEN knowledge acquisition framework for a re-entrant scheduling problem to minimize the number of setup operation. In: Proc. of 2015 IEEJ Electronics, Information and Systems, pp 657–660 (in Japanese)
7.
go back to reference Coulom R (2007) Efficient selectivity and backup operators in Monte-Carlo tree search. Comput Games 4630:72–83CrossRef Coulom R (2007) Efficient selectivity and backup operators in Monte-Carlo tree search. Comput Games 4630:72–83CrossRef
8.
go back to reference Chaslot G, Winands M, Uiterwijk J, Van der Herik H (2007) Progressive strategies for Monte Carlo tree search. In: Proc. of the 10th Joint Conference on Information Sciences, pp 655–661 Chaslot G, Winands M, Uiterwijk J, Van der Herik H (2007) Progressive strategies for Monte Carlo tree search. In: Proc. of the 10th Joint Conference on Information Sciences, pp 655–661
9.
go back to reference Matsumoto S, Ueno N, Okuhara K, Ishii H (2009) Design of knowledge-based scheduling solution based on expert’s technical knowledge in printing process and proposal of its improvement. Int J Innov Comput Inf Control 5(11B):4125–4143 Matsumoto S, Ueno N, Okuhara K, Ishii H (2009) Design of knowledge-based scheduling solution based on expert’s technical knowledge in printing process and proposal of its improvement. Int J Innov Comput Inf Control 5(11B):4125–4143
Metadata
Title
Worker’s knowledge evaluation with single-player Monte Carlo tree search for a practical reentrant scheduling problem
Authors
Ryota Furuoka
Shimpei Matsumoto
Publication date
23-09-2016
Publisher
Springer Japan
Published in
Artificial Life and Robotics / Issue 1/2017
Print ISSN: 1433-5298
Electronic ISSN: 1614-7456
DOI
https://doi.org/10.1007/s10015-016-0325-2

Other articles of this Issue 1/2017

Artificial Life and Robotics 1/2017 Go to the issue