Skip to main content
Erschienen in: Cluster Computing 1/2018

13.06.2017

Zombies Arena: fusion of reinforcement learning with augmented reality on NPC

verfasst von: Saad Razzaq, Fahad Maqbool, Maham Khalid, Iram Tariq, Aqsa Zahoor, Muhammad Ilyas

Erschienen in: Cluster Computing | Ausgabe 1/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Augmented reality (AR) is a discipline having less cognizance but it is the door to new advance technologies. Accustomed games doesn’t facilitate user to physically interact with the surroundings which resulted into reduced learning capabilities. Our objective is to develop AR based first person shooter game empowering reinforcement learning. This act as a building block to capacitate users to interact with the physical environment. Non-player characters will be able to learn and adopt strategy more wisely after each move to capacitate players. Game is played by hundred users at different stages. Reported results are summarized in experiment section.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hou, Y., Feng, L., Ong, Y.S.: Creating human-like non-player game characters using a memetic multi-agent system. In: 2016 International Joint Conference on Neural Networks (IJCNN), pp. 177–184. IEEE (2016) Hou, Y., Feng, L., Ong, Y.S.: Creating human-like non-player game characters using a memetic multi-agent system. In: 2016 International Joint Conference on Neural Networks (IJCNN), pp. 177–184. IEEE (2016)
2.
Zurück zum Zitat Glavin, Frank G., Madden, Michael G.: Adaptive shooting for bots in first person shooter games using reinforcement learning. IEEE Trans. Comput. Intell. AI Games 7(2), 180–192 (2015)CrossRef Glavin, Frank G., Madden, Michael G.: Adaptive shooting for bots in first person shooter games using reinforcement learning. IEEE Trans. Comput. Intell. AI Games 7(2), 180–192 (2015)CrossRef
3.
Zurück zum Zitat McPartland, Michelle, Gallagher, Marcus: Reinforcement learning in first person shooter games. IEEE Trans. Comput. Intell. AI Games 3(1), 43–56 (2011)CrossRef McPartland, Michelle, Gallagher, Marcus: Reinforcement learning in first person shooter games. IEEE Trans. Comput. Intell. AI Games 3(1), 43–56 (2011)CrossRef
4.
Zurück zum Zitat Glavin, Frank, G., Madden, M.G.: Learning to shoot in first person shooter games by stabilizing actions and clustering rewards for reinforcement learning. In: 2015 IEEE Conference on Computational Intelligence and Games (CIG), pp. 344–351. IEEE (2015) Glavin, Frank, G., Madden, M.G.: Learning to shoot in first person shooter games by stabilizing actions and clustering rewards for reinforcement learning. In: 2015 IEEE Conference on Computational Intelligence and Games (CIG), pp. 344–351. IEEE (2015)
5.
Zurück zum Zitat Makarov, I., et al.: Modelling human-like behavior through reward-based approach in a first-person shooter game. In: Proceedings of the Third Workshop on Experimental Economics and Machine Learning (EEML 2016), pp. 24–33. Moscow, 18 July 2016 Makarov, I., et al.: Modelling human-like behavior through reward-based approach in a first-person shooter game. In: Proceedings of the Third Workshop on Experimental Economics and Machine Learning (EEML 2016), pp. 24–33. Moscow, 18 July 2016
6.
Zurück zum Zitat Overholtzer, C.A., Simon D.L.: Evolving AI opponents in a first-person-shooter video game. In: Proceedings of the National Conference on Artificial Intelligence, Vol. 20. No. 4, Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press 1999, 2005: 1620 Overholtzer, C.A., Simon D.L.: Evolving AI opponents in a first-person-shooter video game. In: Proceedings of the National Conference on Artificial Intelligence, Vol. 20. No. 4, Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press 1999, 2005: 1620
7.
Zurück zum Zitat Jones, Jason: Benefits of Genetic Algorithms in Simulations for Game Designers. School of Informatics, University of Buffalo, Buffalo (2003) Jones, Jason: Benefits of Genetic Algorithms in Simulations for Game Designers. School of Informatics, University of Buffalo, Buffalo (2003)
8.
Zurück zum Zitat Laird, John, VanLent, Michael: Human-level AI’s killer application: interactive computer games. AI Mag. 22(2), 15 (2001) Laird, John, VanLent, Michael: Human-level AI’s killer application: interactive computer games. AI Mag. 22(2), 15 (2001)
9.
Zurück zum Zitat Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237–285 (1996) Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237–285 (1996)
10.
Zurück zum Zitat Li, J., Fan, X.: Outdoor augmented reality tracking using 3d city models and game engine. In: 7th International Congress on Image and Signal Processing (CISP), vol. 2014, pp. 104–108. IEEE (2014) Li, J., Fan, X.: Outdoor augmented reality tracking using 3d city models and game engine. In: 7th International Congress on Image and Signal Processing (CISP), vol. 2014, pp. 104–108. IEEE (2014)
11.
Zurück zum Zitat Kim, S.L., et al.: Using Unity 3D to facilitate mobile augmented reality game development. In: IEEE World Forum on Internet of Things (WF-IoT), vol. 2014, pp. 21–26. IEEE (2014) Kim, S.L., et al.: Using Unity 3D to facilitate mobile augmented reality game development. In: IEEE World Forum on Internet of Things (WF-IoT), vol. 2014, pp. 21–26. IEEE (2014)
12.
Zurück zum Zitat Koutromanos, G., Styliaras, G: The buildings speak about our city: a location based augmented reality game. In: 2015 6th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1–6. IEEE (2015) Koutromanos, G., Styliaras, G: The buildings speak about our city: a location based augmented reality game. In: 2015 6th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1–6. IEEE (2015)
13.
Zurück zum Zitat Maskott, G.K., Maskott, M.B, Vrysis, L.: Serious+: a technology assisted learning space based on gaming. In: 2015 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL), pp. 430–432. IEEE, (2015) Maskott, G.K., Maskott, M.B, Vrysis, L.: Serious+: a technology assisted learning space based on gaming. In: 2015 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL), pp. 430–432. IEEE, (2015)
14.
Zurück zum Zitat Emigh, M.S., et al.: Reinforcement learning in video games using nearest neighbor interpolation and metric learning. IEEE Trans. Comput. Intell. AI Games 8(1), 56–66 (2016)CrossRef Emigh, M.S., et al.: Reinforcement learning in video games using nearest neighbor interpolation and metric learning. IEEE Trans. Comput. Intell. AI Games 8(1), 56–66 (2016)CrossRef
15.
Zurück zum Zitat Wang, Di, Tan, Ah-Hwee: Creating autonomous adaptive agents in a real-time first-person shooter computer game. IEEE Trans. Comput. Intell. AI Games 7(2), 123–138 (2015)CrossRef Wang, Di, Tan, Ah-Hwee: Creating autonomous adaptive agents in a real-time first-person shooter computer game. IEEE Trans. Comput. Intell. AI Games 7(2), 123–138 (2015)CrossRef
16.
Zurück zum Zitat Tastan, B., Chang, Y., Sukthankar, G.: Learning to intercept opponents in first person shooter games. In: 2012 IEEE Conference on Computational Intelligence and Games (CIG), pp. 100–107. IEEE (2012) Tastan, B., Chang, Y., Sukthankar, G.: Learning to intercept opponents in first person shooter games. In: 2012 IEEE Conference on Computational Intelligence and Games (CIG), pp. 100–107. IEEE (2012)
17.
Zurück zum Zitat Hladky, S., Bulitko, V.: An evaluation of models for predicting opponent positions in first-person shooter video games. In: CIG’08. IEEE Symposium on Computational Intelligence and Games, vol. 2008, pp. 39–46. IEEE (2008) Hladky, S., Bulitko, V.: An evaluation of models for predicting opponent positions in first-person shooter video games. In: CIG’08. IEEE Symposium on Computational Intelligence and Games, vol. 2008, pp. 39–46. IEEE (2008)
18.
Zurück zum Zitat Nilsen, Trond, Linton, Steven, Looser, Julian: Motivations for augmented reality gaming. Proc. FUSE 4, 86–93 (2004) Nilsen, Trond, Linton, Steven, Looser, Julian: Motivations for augmented reality gaming. Proc. FUSE 4, 86–93 (2004)
19.
Zurück zum Zitat Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction, vol. 1, 1st edn. MIT press, Cambridge (1998) Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction, vol. 1, 1st edn. MIT press, Cambridge (1998)
20.
Zurück zum Zitat Manslow, J.: Using reinforcement learning to solve AI control problems. AI Game Program Wisdom 2, 591–601 (2004) Manslow, J.: Using reinforcement learning to solve AI control problems. AI Game Program Wisdom 2, 591–601 (2004)
21.
Zurück zum Zitat Merrick, K., Maher, M.L.: Motivated reinforcement learning for non-player characters in persistent computer game worlds. In: Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, p. 3. ACM (2006) Merrick, K., Maher, M.L.: Motivated reinforcement learning for non-player characters in persistent computer game worlds. In: Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, p. 3. ACM (2006)
Metadaten
Titel
Zombies Arena: fusion of reinforcement learning with augmented reality on NPC
verfasst von
Saad Razzaq
Fahad Maqbool
Maham Khalid
Iram Tariq
Aqsa Zahoor
Muhammad Ilyas
Publikationsdatum
13.06.2017
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 1/2018
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-0969-2

Weitere Artikel der Ausgabe 1/2018

Cluster Computing 1/2018 Zur Ausgabe