Skip to main content

2018 | OriginalPaper | Buchkapitel

A CBR Approach for Imitating Human Playing Style in Ms. Pac-Man Video Game

verfasst von : Maximiliano Miranda, Antonio A. Sánchez-Ruiz, Federico Peinado

Erschienen in: Case-Based Reasoning Research and Development

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Imitating video game players is considered one of the most stimulating challenges for the Game AI research community. The goal for a virtual player is not just to beat the game but to show some human-like playing style. In this work we describe a Case-Based Reasoning approach that learns to play the popular Ms. Pac-Man vs Ghosts video game from the traces of a human player. We evaluate the performance of our bot using both low level standard measures such as accuracy and recall, and high level measures such as recklessness (distance to the closest ghost, as it is mapped in our Ms. Pac-Man domain model), restlessness (changes of direction), aggressiveness (ghosts eaten), clumsiness (game steps the player is stuck) and survival (lives left). Results suggest that, although there is still a lot of room for improvement, some aspects of the human playing style are indeed captured in the cases and used by our bot.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bunian, S., Canossa, A., Colvin, R., El-Nasr, M.S.: Modeling individual differences in game behavior using hmm (2017) Bunian, S., Canossa, A., Colvin, R., El-Nasr, M.S.: Modeling individual differences in game behavior using hmm (2017)
2.
Zurück zum Zitat Floyd, M.W., Davoust, A., Esfandiari, B.: Considerations for real-time spatially-aware case-based reasoning: a case study in robotic soccer imitation. In: Althoff, K.-D., Bergmann, R., Minor, M., Hanft, A. (eds.) ECCBR 2008. LNCS (LNAI), vol. 5239, pp. 195–209. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-85502-6_13CrossRef Floyd, M.W., Davoust, A., Esfandiari, B.: Considerations for real-time spatially-aware case-based reasoning: a case study in robotic soccer imitation. In: Althoff, K.-D., Bergmann, R., Minor, M., Hanft, A. (eds.) ECCBR 2008. LNCS (LNAI), vol. 5239, pp. 195–209. Springer, Heidelberg (2008). https://​doi.​org/​10.​1007/​978-3-540-85502-6_​13CrossRef
3.
Zurück zum Zitat Floyd, M.W., Esfandiari, B., Lam, K.: A case-based reasoning approach to imitating robocup players. In: Proceedings of the Twenty-First International Florida Artificial Intelligence Research Society Conference, pp. 251–256, Coconut Grove, Florida, USA, 15–17 May 2008 Floyd, M.W., Esfandiari, B., Lam, K.: A case-based reasoning approach to imitating robocup players. In: Proceedings of the Twenty-First International Florida Artificial Intelligence Research Society Conference, pp. 251–256, Coconut Grove, Florida, USA, 15–17 May 2008
4.
Zurück zum Zitat Gallagher, M., Ledwich, M.: Evolving pac-man players: can we learn from raw input? In: Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007, pp. 282–287, Honolulu, Hawaii, USA, 1–5 April 2007 Gallagher, M., Ledwich, M.: Evolving pac-man players: can we learn from raw input? In: Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007, pp. 282–287, Honolulu, Hawaii, USA, 1–5 April 2007
5.
Zurück zum Zitat Geisler, B.: An empirical study of machine learning algorithms applied to modeling player behavior in a “first person shooter” video game. Ph.d. thesis, Citeseer (2002) Geisler, B.: An empirical study of machine learning algorithms applied to modeling player behavior in a “first person shooter” video game. Ph.d. thesis, Citeseer (2002)
6.
Zurück zum Zitat Goldberg, H.: All Your Base are Belong to Us: How 50 Years of Videogames Conquered Pop Culture Goldberg, H.: All Your Base are Belong to Us: How 50 Years of Videogames Conquered Pop Culture
7.
8.
Zurück zum Zitat Hingston, P.: A new design for a turing test for bots. In: Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games CIG 2010, pp. 345–350, Copenhagen, Denmark, 18–21 August 2010 Hingston, P.: A new design for a turing test for bots. In: Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games CIG 2010, pp. 345–350, Copenhagen, Denmark, 18–21 August 2010
9.
Zurück zum Zitat Kent, S.: The Ultimate History of Video Games: From Pong to Pokémon and Beyond : the Story Behind the Craze that Touched Our Lives and Changed the World Kent, S.: The Ultimate History of Video Games: From Pong to Pokémon and Beyond : the Story Behind the Craze that Touched Our Lives and Changed the World
10.
Zurück zum Zitat Lam, K., Esfandiari, B., Tudino, D.: A scene-based imitation framework for robocup clients. In: MOO-Modeling Other Agents from Observations (2006) Lam, K., Esfandiari, B., Tudino, D.: A scene-based imitation framework for robocup clients. In: MOO-Modeling Other Agents from Observations (2006)
11.
Zurück zum Zitat Livingstone, D.: Turing’s test and believable ai in games. Comput. Entertain. 4, 6 (2006)CrossRef Livingstone, D.: Turing’s test and believable ai in games. Comput. Entertain. 4, 6 (2006)CrossRef
12.
Zurück zum Zitat Lucas, S.M.: Ms pac-man versus ghost-team competition. In: Proceedings of the 2009 IEEE Symposium on Computational Intelligence and Games CIG 2009, Milano, Italy, 7–10 September 2009 Lucas, S.M.: Ms pac-man versus ghost-team competition. In: Proceedings of the 2009 IEEE Symposium on Computational Intelligence and Games CIG 2009, Milano, Italy, 7–10 September 2009
13.
Zurück zum Zitat Miranda, M., Sánchez-Ruiz, A.A., Peinado, F.: Pac-man or pac-bot? exploring subjective perception of players’ humanity in ms. pac-man. In: Proceedings of the 4th Congreso de la Sociedad Española para las Ciencias del Videojuego, pp. 163–175, Barcelona, Spain, 30 June 2017 Miranda, M., Sánchez-Ruiz, A.A., Peinado, F.: Pac-man or pac-bot? exploring subjective perception of players’ humanity in ms. pac-man. In: Proceedings of the 4th Congreso de la Sociedad Española para las Ciencias del Videojuego, pp. 163–175, Barcelona, Spain, 30 June 2017
14.
Zurück zum Zitat Ontañón, S., Montaña, J.L., Gonzalez, A.J.: A dynamic-bayesian network framework for modeling and evaluating learning from observation. Expert Syst. Appl. 41(11), 5212–5226 (2014)CrossRef Ontañón, S., Montaña, J.L., Gonzalez, A.J.: A dynamic-bayesian network framework for modeling and evaluating learning from observation. Expert Syst. Appl. 41(11), 5212–5226 (2014)CrossRef
15.
Zurück zum Zitat Ortega, J., Shaker, N., Togelius, J., Yannakakis, G.N.: Imitating human playing styles in super mario bros. Entertain. Comput. 4(2), 93–104 (2013)CrossRef Ortega, J., Shaker, N., Togelius, J., Yannakakis, G.N.: Imitating human playing styles in super mario bros. Entertain. Comput. 4(2), 93–104 (2013)CrossRef
16.
Zurück zum Zitat Ross, S., Gordon, G.J., Bagnell, D.: A reduction of imitation learning and structured prediction to no-regret online learning. In: Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics AISTATS 2011, pp. 627–635, Fort Lauderdale, USA, 11–13 April 2011 Ross, S., Gordon, G.J., Bagnell, D.: A reduction of imitation learning and structured prediction to no-regret online learning. In: Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics AISTATS 2011, pp. 627–635, Fort Lauderdale, USA, 11–13 April 2011
17.
Zurück zum Zitat Soni, B., Hingston, P.: Bots trained to play like a human are more fun. In: 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), pp. 363–369 (2008) Soni, B., Hingston, P.: Bots trained to play like a human are more fun. In: 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), pp. 363–369 (2008)
18.
Zurück zum Zitat Thurau, C., Bauckhage, C., Sagerer, G.: Learning human-like movement behavior for computer games. In: Proceedings of the Eighth International Conference on the Simulation of Adaptive Behavior (SAB04) (2004) Thurau, C., Bauckhage, C., Sagerer, G.: Learning human-like movement behavior for computer games. In: Proceedings of the Eighth International Conference on the Simulation of Adaptive Behavior (SAB04) (2004)
19.
Zurück zum Zitat Togelius, J., Nardi, R.D., Lucas, S.M.: Towards automatic personalised content creation for racing games. In: 2007 IEEE Symposium on Computational Intelligence and Games, pp. 252–259 (2007) Togelius, J., Nardi, R.D., Lucas, S.M.: Towards automatic personalised content creation for racing games. In: 2007 IEEE Symposium on Computational Intelligence and Games, pp. 252–259 (2007)
20.
Zurück zum Zitat Togelius, J., Yannakakis, G., Shaker, N., Karakovskiy, S.: Believable Bots, chap. Assessing believability, pp. 219–233 (2012). Hingston, p. (Ed.) Togelius, J., Yannakakis, G., Shaker, N., Karakovskiy, S.: Believable Bots, chap. Assessing believability, pp. 219–233 (2012). Hingston, p. (Ed.)
22.
Zurück zum Zitat Williams, P.R., Liebana, D.P., Lucas, S.M.: Ms. pac-man versus ghost team CIG 2016 competition. In: IEEE Conference on Computational Intelligence and Games CIG 2016, pp. 1–8, Santorini, Greece, 20–23 September 2016 Williams, P.R., Liebana, D.P., Lucas, S.M.: Ms. pac-man versus ghost team CIG 2016 competition. In: IEEE Conference on Computational Intelligence and Games CIG 2016, pp. 1–8, Santorini, Greece, 20–23 September 2016
23.
Zurück zum Zitat Wooldridge, M.: Introduction to multiagent systems. Cell 757(239), 8573 (2002) Wooldridge, M.: Introduction to multiagent systems. Cell 757(239), 8573 (2002)
Metadaten
Titel
A CBR Approach for Imitating Human Playing Style in Ms. Pac-Man Video Game
verfasst von
Maximiliano Miranda
Antonio A. Sánchez-Ruiz
Federico Peinado
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01081-2_20