Skip to main content
Erschienen in: Artificial Intelligence Review 12/2023

29.04.2023

Non-player character decision-making in computer games

verfasst von: Muhtar Çağkan Uludağlı, Kaya Oğuz

Erschienen in: Artificial Intelligence Review | Ausgabe 12/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

One of the most overlooked challenges in artificial intelligence (AI) for computer games is to create non-player game characters (NPCs) with human-like behavior. Modern NPCs determine their actions in different situations using certain decision-making methods, enabling them to change the current state of the game world. In this paper, we survey current decision-making methods used by NPCs in games, identifying five categories. We give detailed overview of these five categories and determine the previous studies that belong to each of these categories. We also discuss the hybrid methods which are the combinations of different decision-making methods and the frameworks that are created for NPC decision-making. As a result of this analysis, we create a taxonomy table based on these covered studies. Lastly, the challenges faced in our study and future possibilities for improvement are described.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Bourg DM, Seemann G (2004) AI for game developers. O’Reilly Media Inc, Sebastopol Bourg DM, Seemann G (2004) AI for game developers. O’Reilly Media Inc, Sebastopol
Zurück zum Zitat Charles D, McGlinchey S (2004) The past, present and future of artificial neural networks in digital games. In: Proceedings of the 5th international conference on computer games: artificial intelligence, design and education. The University of Wolverhampton, pp 163–169 Charles D, McGlinchey S (2004) The past, present and future of artificial neural networks in digital games. In: Proceedings of the 5th international conference on computer games: artificial intelligence, design and education. The University of Wolverhampton, pp 163–169
Zurück zum Zitat Colledanchise M, Ögren P (2018) Behavior trees in robotics and AI: an introduction. CRC Press, CambridgeCrossRef Colledanchise M, Ögren P (2018) Behavior trees in robotics and AI: an introduction. CRC Press, CambridgeCrossRef
Zurück zum Zitat Danielson M, Ekenberg L (2011) Decision making in intelligent agents. In: Sierra AP, Rabunal JR, Dorado J (eds) Encyclopedia of artificial intelligence. IGI Global, Pennsylvania, pp 431–436 Danielson M, Ekenberg L (2011) Decision making in intelligent agents. In: Sierra AP, Rabunal JR, Dorado J (eds) Encyclopedia of artificial intelligence. IGI Global, Pennsylvania, pp 431–436
Zurück zum Zitat Dell’Acqua P, Costantini S (2022) Emotional behavior trees for empathetic human-automation interaction. In: WOA 2022: 23rd workshop from objects to agents Dell’Acqua P, Costantini S (2022) Emotional behavior trees for empathetic human-automation interaction. In: WOA 2022: 23rd workshop from objects to agents
Zurück zum Zitat Dias J, Mascarenhas S, Paiva A (2014) FAtiMA modular: towards an agent architecture with a generic appraisal framework. In: Bosse T, Broekens J, Dias J et al (eds) Emotion modeling: towards pragmatic computational models of affective processes. Springer, Cham, pp 44–56CrossRef Dias J, Mascarenhas S, Paiva A (2014) FAtiMA modular: towards an agent architecture with a generic appraisal framework. In: Bosse T, Broekens J, Dias J et al (eds) Emotion modeling: towards pragmatic computational models of affective processes. Springer, Cham, pp 44–56CrossRef
Zurück zum Zitat Folkman S, Lazarus RS (1984) Stress, appraisal, and coping. Springer, New York Folkman S, Lazarus RS (1984) Stress, appraisal, and coping. Springer, New York
Zurück zum Zitat Forgy CL (1979) On the efficient implementation of production systems. PhD thesis, Carnegie Mellon University Forgy CL (1979) On the efficient implementation of production systems. PhD thesis, Carnegie Mellon University
Zurück zum Zitat Forgy CL (1989) Rete: a fast algorithm for the many pattern/many object pattern match problem. In: Mylopolous J, Brodie M (eds) Readings in artificial intelligence and databases. Morgan Kaufmann, San Francisco, pp 547–559 Forgy CL (1989) Rete: a fast algorithm for the many pattern/many object pattern match problem. In: Mylopolous J, Brodie M (eds) Readings in artificial intelligence and databases. Morgan Kaufmann, San Francisco, pp 547–559
Zurück zum Zitat Fu Y, Qin L, Yin Q (2016) A reinforcement learning behavior tree framework for game AI. In: 2016 international conference on economics, social science, arts, education and management engineering. Atlantis Press, pp 573–579 Fu Y, Qin L, Yin Q (2016) A reinforcement learning behavior tree framework for game AI. In: 2016 international conference on economics, social science, arts, education and management engineering. Atlantis Press, pp 573–579
Zurück zum Zitat Fujii S, Nakashima T, Ishibuchi H (2008) A study on constructing fuzzy systems for high-level decision making in a car racing game. In: 2008 IEEE congress on evolutionary computation, CEC 2008, IEEE. pp 3626–3633 Fujii S, Nakashima T, Ishibuchi H (2008) A study on constructing fuzzy systems for high-level decision making in a car racing game. In: 2008 IEEE congress on evolutionary computation, CEC 2008, IEEE. pp 3626–3633
Zurück zum Zitat Gupta N (2013) Artificial neural network. Netw Complex Syst 3(1):24–28 Gupta N (2013) Artificial neural network. Netw Complex Syst 3(1):24–28
Zurück zum Zitat Holba J, Huber G (2021) Open-world enemy AI in Mafia III. In: Game AI pro—online edition 2021. Game AI pro, chap 16 Holba J, Huber G (2021) Open-world enemy AI in Mafia III. In: Game AI pro—online edition 2021. Game AI pro, chap 16
Zurück zum Zitat Johansen NS, Kær LB, Stolberg JAB, et al. (2022) Towards believable non-player characters with domain-independent planning. In: 2022 workshop on scheduling and planning applications workshop Johansen NS, Kær LB, Stolberg JAB, et al. (2022) Towards believable non-player characters with domain-independent planning. In: 2022 workshop on scheduling and planning applications workshop
Zurück zum Zitat Kitchenham B (2004) Procedures for performing systematic reviews, vol 33. Keele University, Keele, pp 1–26 Kitchenham B (2004) Procedures for performing systematic reviews, vol 33. Keele University, Keele, pp 1–26
Zurück zum Zitat Kopel M, Hajas T (2018) Implementing AI for non-player characters in 3D video games. In: Nguyen NT, Hoang DH, Hong TP et al (eds) Intelligent information and database systems. Springer, Cham, pp 610–619CrossRef Kopel M, Hajas T (2018) Implementing AI for non-player characters in 3D video games. In: Nguyen NT, Hoang DH, Hong TP et al (eds) Intelligent information and database systems. Springer, Cham, pp 610–619CrossRef
Zurück zum Zitat Lie CSK, Istiono W (2022) How to make npc learn the strategy in fighting games using adaptive AI? Int J Sci Tech Res Eng 7:4 Lie CSK, Istiono W (2022) How to make npc learn the strategy in fighting games using adaptive AI? Int J Sci Tech Res Eng 7:4
Zurück zum Zitat Long E (2007) Enhanced NPC behaviour using goal oriented action planning. Master’s thesis, University of Abertay Dundee, Dundee Long E (2007) Enhanced NPC behaviour using goal oriented action planning. Master’s thesis, University of Abertay Dundee, Dundee
Zurück zum Zitat Loyall BA, Bates J (1991) Hap a reactive, adaptive architecture for agents. In: Citeseer Loyall BA, Bates J (1991) Hap a reactive, adaptive architecture for agents. In: Citeseer
Zurück zum Zitat Madsen CABCW, Adamatti DF (2013) Using artificial neural networks in NPC decision-making process. Int J Comput Inf Technol 2(6):1009–1013 Madsen CABCW, Adamatti DF (2013) Using artificial neural networks in NPC decision-making process. Int J Comput Inf Technol 2(6):1009–1013
Zurück zum Zitat Mascarenhas S, Guimarães M, Santos PA et al (2021) FAtiMA Toolkit—toward an effective and accessible tool for the development of intelligent virtual agents and social robots. Preprint at http://arxiv.org/abs/2103.03020 Mascarenhas S, Guimarães M, Santos PA et al (2021) FAtiMA Toolkit—toward an effective and accessible tool for the development of intelligent virtual agents and social robots. Preprint at http://​arxiv.​org/​abs/​2103.​03020
Zurück zum Zitat McCoy J, Treanor M, Samuel B et al (2010) Comme il Faut 2: a fully realized model for socially-oriented gameplay. In: Proceedings of the intelligent narrative technologies III workshop. Association for Computing Machinery, New York, pp 1–8. https://doi.org/10.1145/1822309.1822319 McCoy J, Treanor M, Samuel B et al (2010) Comme il Faut 2: a fully realized model for socially-oriented gameplay. In: Proceedings of the intelligent narrative technologies III workshop. Association for Computing Machinery, New York, pp 1–8. https://​doi.​org/​10.​1145/​1822309.​1822319
Zurück zum Zitat McCoy J, Treanor M, Samuel B et al (2011) Comme il Faut: a system for authoring playable social models. In: Proceedings of the AAAI conference on artificial intelligence and interactive digital entertainment McCoy J, Treanor M, Samuel B et al (2011) Comme il Faut: a system for authoring playable social models. In: Proceedings of the AAAI conference on artificial intelligence and interactive digital entertainment
Zurück zum Zitat Millington I (2019) Artificial intelligence for games, 3rd edn. CRC Press, Cambridge Millington I (2019) Artificial intelligence for games, 3rd edn. CRC Press, Cambridge
Zurück zum Zitat Miyake Y, Shirakami Y, Shimokawa K et al (2019) A character decision-making system for FINAL FANTASY XV by combining behavior trees and state machines. In: Game AI pro 360: guide to architecture. CRC Press, p 339. https://doi.org/10.4324/9781315151700 Miyake Y, Shirakami Y, Shimokawa K et al (2019) A character decision-making system for FINAL FANTASY XV by combining behavior trees and state machines. In: Game AI pro 360: guide to architecture. CRC Press, p 339. https://​doi.​org/​10.​4324/​9781315151700
Zurück zum Zitat Moher D, Liberati A, Tetzlaff J et al (2009) Preferred reporting items for systematic reviews and meta-analyses: the prisma statement. Ann Intern Med 151(4):264–269CrossRef Moher D, Liberati A, Tetzlaff J et al (2009) Preferred reporting items for systematic reviews and meta-analyses: the prisma statement. Ann Intern Med 151(4):264–269CrossRef
Zurück zum Zitat Niewiadomski A, Renkas K (2014) Hierarchical fuzzy logic systems and controlling vehicles in computer games. J Appl Comput Sci 22(1):201–212 Niewiadomski A, Renkas K (2014) Hierarchical fuzzy logic systems and controlling vehicles in computer games. J Appl Comput Sci 22(1):201–212
Zurück zum Zitat Novák V, Perfilieva I, Mockor J (1999) Mathematical principles of fuzzy logic, vol 517. Springer, New YorkCrossRefMATH Novák V, Perfilieva I, Mockor J (1999) Mathematical principles of fuzzy logic, vol 517. Springer, New YorkCrossRefMATH
Zurück zum Zitat OBrien L (1996) Fuzzy logic in games. Game Dev Mag 3(2):52–55 OBrien L (1996) Fuzzy logic in games. Game Dev Mag 3(2):52–55
Zurück zum Zitat Orkin J (2003) Applying goal-oriented action planning to games. In: Rabin S (ed) AI game programming wisdom, vol 2. Charles River Media Inc, New York Orkin J (2003) Applying goal-oriented action planning to games. In: Rabin S (ed) AI game programming wisdom, vol 2. Charles River Media Inc, New York
Zurück zum Zitat Orkin J (2006) Three states and a plan: the AI of FEAR. In: Game developers conference 2006. CMP Game Group, San Jose, p 4 Orkin J (2006) Three states and a plan: the AI of FEAR. In: Game developers conference 2006. CMP Game Group, San Jose, p 4
Zurück zum Zitat Partlan N, Soto L, Howe J et al (2022) EvolvingBehavior: towards co-creative evolution of behavior trees for game NPCs. In: Proceedings of the 17th international conference on the foundations of digital games. Association for Computing Machinery, New York. https://doi.org/10.1145/3555858.3555896 Partlan N, Soto L, Howe J et al (2022) EvolvingBehavior: towards co-creative evolution of behavior trees for game NPCs. In: Proceedings of the 17th international conference on the foundations of digital games. Association for Computing Machinery, New York. https://​doi.​org/​10.​1145/​3555858.​3555896
Zurück zum Zitat Perez D, Nicolau M, O’Neill M et al (2011) Evolving behaviour trees for the mario AI competition using grammatical evolution. In: Kaufmann P, Castillo PA (eds) Applications of evolutionary computation. Springer, Berlin, pp 123–132CrossRef Perez D, Nicolau M, O’Neill M et al (2011) Evolving behaviour trees for the mario AI competition using grammatical evolution. In: Kaufmann P, Castillo PA (eds) Applications of evolutionary computation. Springer, Berlin, pp 123–132CrossRef
Zurück zum Zitat Pirovano M (2012) The use of fuzzy logic for artificial intelligence in games. University of Milano, Milan Pirovano M (2012) The use of fuzzy logic for artificial intelligence in games. University of Milano, Milan
Zurück zum Zitat Pittman DL (2007) Practical development of goal-oriented action planning AI. Master’s thesis, Southern Methodist University, Dallas Pittman DL (2007) Practical development of goal-oriented action planning AI. Master’s thesis, Southern Methodist University, Dallas
Zurück zum Zitat Russell S, Norvig P (2002) Artificial intelligence: a modern approach. Prentice Hall, HobokenMATH Russell S, Norvig P (2002) Artificial intelligence: a modern approach. Prentice Hall, HobokenMATH
Zurück zum Zitat Schwab P, Hlavacs H (2015) Capturing the essence: towards the automated generation of transparent behavior models. In: Proceedings of the AAAI conference on artificial intelligence and interactive digital entertainment Schwab P, Hlavacs H (2015) Capturing the essence: towards the automated generation of transparent behavior models. In: Proceedings of the AAAI conference on artificial intelligence and interactive digital entertainment
Zurück zum Zitat Shaout A, King BW, Reisner LA (2006) Real-time game design of Pac-Man using fuzzy logic. Int Arab J Inf Technol 3(4):315–325 Shaout A, King BW, Reisner LA (2006) Real-time game design of Pac-Man using fuzzy logic. Int Arab J Inf Technol 3(4):315–325
Zurück zum Zitat Sielicki M, Daszuta M, Szajerman D (2018) Adaptation and application of goal oriented action planning in unreal engine. Comput Game Innov 1:103 Sielicki M, Daszuta M, Szajerman D (2018) Adaptation and application of goal oriented action planning in unreal engine. Comput Game Innov 1:103
Zurück zum Zitat Sloan C, Mac Namee B, Kelleher JD (2011) Utility-directed goal-oriented action planning: a utility-based control system for computer game agents. University of Ulster, MartinMcGinnity Intelligent Systems Research Centre, Coleraine Sloan C, Mac Namee B, Kelleher JD (2011) Utility-directed goal-oriented action planning: a utility-based control system for computer game agents. University of Ulster, MartinMcGinnity Intelligent Systems Research Centre, Coleraine
Zurück zum Zitat Steunebrink BR, Dastani M, Meyer JJC (2009) The occ model revisited. In: Proc 4th workshop on emotion and computing. Association for the Advancement of Artificial Intelligence Steunebrink BR, Dastani M, Meyer JJC (2009) The occ model revisited. In: Proc 4th workshop on emotion and computing. Association for the Advancement of Artificial Intelligence
Zurück zum Zitat Sweetser P, Wiles J (2002) Current AI in games: a review. Austral J Intell Inf Process Syst 8(1):24–42 Sweetser P, Wiles J (2002) Current AI in games: a review. Austral J Intell Inf Process Syst 8(1):24–42
Zurück zum Zitat Van Waveren JMP (2001) The quake III arena bot. Master’s thesis. Delft University of Technology, Delft Van Waveren JMP (2001) The quake III arena bot. Master’s thesis. Delft University of Technology, Delft
Zurück zum Zitat Wexler J (2002) Artificial intelligence in games. University of Rochester, Rochester Wexler J (2002) Artificial intelligence in games. University of Rochester, Rochester
Zurück zum Zitat Yannakakis GN, Togelius J (2018) Artificial intelligence and games. Springer, New YorkCrossRef Yannakakis GN, Togelius J (2018) Artificial intelligence and games. Springer, New YorkCrossRef
Zurück zum Zitat Zarozinski M, Than L (2001) Imploding combinatorial explosion in a fuzzy system. In: AI game programming wisdom, Vol. 2. Charles River Media, Inc., pp 342–350 Zarozinski M, Than L (2001) Imploding combinatorial explosion in a fuzzy system. In: AI game programming wisdom, Vol. 2. Charles River Media, Inc., pp 342–350
Zurück zum Zitat Zhu M, Feng L (2022) Design and implementation of NPC AI based on genetic algorithm and BP neural network. In: Proceedings of the 14th international conference on computer modeling and simulation. Association for Computing Machinery, New York, pp 168–173. https://doi.org/10.1145/3547578.3547604 Zhu M, Feng L (2022) Design and implementation of NPC AI based on genetic algorithm and BP neural network. In: Proceedings of the 14th international conference on computer modeling and simulation. Association for Computing Machinery, New York, pp 168–173. https://​doi.​org/​10.​1145/​3547578.​3547604
Zurück zum Zitat Zijie W, Tongyu W, Hang G (2021) A survey: development and application of behavior trees. In: Liang Q, Wang W, Liu X et al (eds) Communications, signal processing, and systems. Springer, Singapore, pp 1581–1589CrossRef Zijie W, Tongyu W, Hang G (2021) A survey: development and application of behavior trees. In: Liang Q, Wang W, Liu X et al (eds) Communications, signal processing, and systems. Springer, Singapore, pp 1581–1589CrossRef
Metadaten
Titel
Non-player character decision-making in computer games
verfasst von
Muhtar Çağkan Uludağlı
Kaya Oğuz
Publikationsdatum
29.04.2023
Verlag
Springer Netherlands
Erschienen in
Artificial Intelligence Review / Ausgabe 12/2023
Print ISSN: 0269-2821
Elektronische ISSN: 1573-7462
DOI
https://doi.org/10.1007/s10462-023-10491-7

Weitere Artikel der Ausgabe 12/2023

Artificial Intelligence Review 12/2023 Zur Ausgabe

Premium Partner