Skip to main content

2016 | OriginalPaper | Buchkapitel

Design and Evaluation of an Extended Learning Classifier-Based StarCraft Micro AI

verfasst von : Stefan Rudolph, Sebastian von Mammen, Johannes Jungbluth, Jörg Hähner

Erschienen in: Applications of Evolutionary Computation

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Due to the manifold challenges that arise when developing an artificial intelligence that can compete with human players, the popular realtime-strategy game Starcraft: Broodwar (BW) has received attention from the computational intelligence research community. It is an ideal testbed for methods for self-adaption at runtime designed to work in complex technical systems. In this work, we utilize the broadlys-used Extended Classifier System (XCS) as a basis to develop different models of BW micro AIs: the Defender, the Attacker, the Explorer and the Strategist. We evaluate theses AIs with a focus on their adaptive and co-evolutionary behaviors. To this end, we stage and analyze the outcomes of a tournament among the proposed AIs and we also test them against a non-adaptive player to provide a proper baseline for comparison and learning evolution. Of the proposed AIs, we found the Explorer to be the best performing design, but, also that the Strategist shows an interesting behavioral evolution.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Starcraft and Starcraft: Broodwar are trademarks of Blizzard Entertainment.
 
3
Starcraft Micro AI Tournament.
 
Literatur
1.
Zurück zum Zitat Müller-Schloer, C., Schmeck, H.: Organic computing - quo vadis? In: Müller-Schloer, C., Schmeck, H., Ungerer, T. (eds.) Organic Computing - A Paradigm Shift for Complex Systems, pp. 615–625. Birkhäuser, Verlag (2011)CrossRef Müller-Schloer, C., Schmeck, H.: Organic computing - quo vadis? In: Müller-Schloer, C., Schmeck, H., Ungerer, T. (eds.) Organic Computing - A Paradigm Shift for Complex Systems, pp. 615–625. Birkhäuser, Verlag (2011)CrossRef
2.
Zurück zum Zitat Ontañón, S., Synnaeve, G., Uriarte, A., Richoux, F., Churchill, D., Preuss, M.: A survey of real-time strategy game AI research and competition in StarCraft. IEEE Trans. Comput. Intell. AI Games 5(4), 293–311 (2013)CrossRef Ontañón, S., Synnaeve, G., Uriarte, A., Richoux, F., Churchill, D., Preuss, M.: A survey of real-time strategy game AI research and competition in StarCraft. IEEE Trans. Comput. Intell. AI Games 5(4), 293–311 (2013)CrossRef
3.
Zurück zum Zitat Synnaeve, G., Bessière, P.: A Bayesian model for opening prediction in RTS games with application to StarCraft. In: Cho, S.B., Lucas, S.M., Hingston, P. (eds.) CIG, pp. 281–288. IEEE (2011) Synnaeve, G., Bessière, P.: A Bayesian model for opening prediction in RTS games with application to StarCraft. In: Cho, S.B., Lucas, S.M., Hingston, P. (eds.) CIG, pp. 281–288. IEEE (2011)
4.
Zurück zum Zitat Weber, B.G., Mateas, M., Jhala, A.: Applying goal-driven autonomy to StarCraft. In: Youngblood, G.M., Bulitko, V. (eds.) AIIDE. The AAAI Press (2010) Weber, B.G., Mateas, M., Jhala, A.: Applying goal-driven autonomy to StarCraft. In: Youngblood, G.M., Bulitko, V. (eds.) AIIDE. The AAAI Press (2010)
6.
Zurück zum Zitat Blackadar, M., Denzinger, J.: Behavior learning-based testing of StarCraft competition entries. In: Bulitko, V., Riedl, M.O. (eds.) AIIDE. The AAAI Press (2011) Blackadar, M., Denzinger, J.: Behavior learning-based testing of StarCraft competition entries. In: Bulitko, V., Riedl, M.O. (eds.) AIIDE. The AAAI Press (2011)
7.
Zurück zum Zitat Robertson, G., Watson, I.: An improved dataset and extraction process for StarCraft AI. In: The Twenty-Seventh International Flairs Conference (2014) Robertson, G., Watson, I.: An improved dataset and extraction process for StarCraft AI. In: The Twenty-Seventh International Flairs Conference (2014)
8.
Zurück zum Zitat Weber, B.G., Ontañón, S.: Using automated replay annotation for case-based planning in games. In: ICCBR Workshop on CBR for Computer Games (ICCBR-Games) (2010) Weber, B.G., Ontañón, S.: Using automated replay annotation for case-based planning in games. In: ICCBR Workshop on CBR for Computer Games (ICCBR-Games) (2010)
9.
Zurück zum Zitat Churchill, D., Buro, M.: Build order optimization in StarCraft. In: Bulitko, V., Riedl, M.O. (eds.) AIIDE. The AAAI Press (2011) Churchill, D., Buro, M.: Build order optimization in StarCraft. In: Bulitko, V., Riedl, M.O. (eds.) AIIDE. The AAAI Press (2011)
10.
Zurück zum Zitat Hagelback, J.: Potential-field based navigation in StarCraft. In: IEEE Conference on Computational Intelligence and Games (CIG), Sep 2012, pp. 388–393 (2012) Hagelback, J.: Potential-field based navigation in StarCraft. In: IEEE Conference on Computational Intelligence and Games (CIG), Sep 2012, pp. 388–393 (2012)
11.
Zurück zum Zitat Yi, S.: Adaptive strategy decision mechanism for StarCraft AI. In: Han, M.-W., Lee, J. (eds.) EKC 2010. SPPHY, vol. 138, pp. 47–57. Springer, Heidelberg (2011)CrossRef Yi, S.: Adaptive strategy decision mechanism for StarCraft AI. In: Han, M.-W., Lee, J. (eds.) EKC 2010. SPPHY, vol. 138, pp. 47–57. Springer, Heidelberg (2011)CrossRef
12.
Zurück zum Zitat Synnaeve, G., Bessière, P.: A Bayesian tactician. In: Proceedings of the Computer Games Workshop at the European Conference of Artificial Intelligence 2012, pp. 114–125 (2012) Synnaeve, G., Bessière, P.: A Bayesian tactician. In: Proceedings of the Computer Games Workshop at the European Conference of Artificial Intelligence 2012, pp. 114–125 (2012)
13.
Zurück zum Zitat Garcia-Sanchez, P., Tonda, A., Mora, A., Squillero, G., Merelo, J.: Towards automatic StarCraft strategy generation using genetic programming. In: 2015 IEEE Conference on Computational Intelligence and Games (CIG), pp. 284–291, August 2015 Garcia-Sanchez, P., Tonda, A., Mora, A., Squillero, G., Merelo, J.: Towards automatic StarCraft strategy generation using genetic programming. In: 2015 IEEE Conference on Computational Intelligence and Games (CIG), pp. 284–291, August 2015
14.
Zurück zum Zitat Parra, R., Garrido, L.: Bayesian networks for micromanagement decision imitation in the RTS game StarCraft. In: Batyrshin, I., Mendoza, M.G. (eds.) MICAI 2012, Part II. LNCS, vol. 7630, pp. 433–443. Springer, Heidelberg (2013)CrossRef Parra, R., Garrido, L.: Bayesian networks for micromanagement decision imitation in the RTS game StarCraft. In: Batyrshin, I., Mendoza, M.G. (eds.) MICAI 2012, Part II. LNCS, vol. 7630, pp. 433–443. Springer, Heidelberg (2013)CrossRef
15.
Zurück zum Zitat Wender, S., Watson, I.D.: Applying reinforcement learning to small scale combat in the real-time strategy game StarCraft: Broodwar. In: CIG, pp. 402–408. IEEE (2012) Wender, S., Watson, I.D.: Applying reinforcement learning to small scale combat in the real-time strategy game StarCraft: Broodwar. In: CIG, pp. 402–408. IEEE (2012)
16.
Zurück zum Zitat Holland, J.H.: Adaptation*. In: Rosen, R., Snell, F.M. (eds.) Progress in Theoretical Biology, pp. 263–293. Academic Press, New York (1976)CrossRef Holland, J.H.: Adaptation*. In: Rosen, R., Snell, F.M. (eds.) Progress in Theoretical Biology, pp. 263–293. Academic Press, New York (1976)CrossRef
17.
Zurück zum Zitat Holland, J.H., Reitman, J.S.: Cognitive systems based on adaptive algorithms. SIGART Bull. 63, 49–49 (1977)CrossRef Holland, J.H., Reitman, J.S.: Cognitive systems based on adaptive algorithms. SIGART Bull. 63, 49–49 (1977)CrossRef
18.
Zurück zum Zitat Wilson, S.W.: Classifier fitness based on accuracy. Evol. Comput. 3(2), 149–175 (1995)CrossRef Wilson, S.W.: Classifier fitness based on accuracy. Evol. Comput. 3(2), 149–175 (1995)CrossRef
19.
Zurück zum Zitat Reynolds, C.W.: Flocks, herds, and schools: a distributed behavioral model. Comput. Graph. 21(4), 25–34 (1987)CrossRef Reynolds, C.W.: Flocks, herds, and schools: a distributed behavioral model. Comput. Graph. 21(4), 25–34 (1987)CrossRef
20.
Zurück zum Zitat Lin, C.S., Ting, C.K.: Emergent tactical formation using genetic algorithm in real-time strategy games. In: Proceedings of the 2011 International Conference on Technologies and Applications of Artificial Intelligence, TAAI 2011, Computer Society, pp. 325–330. IEEE, Washington (2011) Lin, C.S., Ting, C.K.: Emergent tactical formation using genetic algorithm in real-time strategy games. In: Proceedings of the 2011 International Conference on Technologies and Applications of Artificial Intelligence, TAAI 2011, Computer Society, pp. 325–330. IEEE, Washington (2011)
21.
Zurück zum Zitat Rudolph, S., Tomforde, S., Sick, B., Hähner, J.: A mutual influence detection algorithm for systems with local performance measurement. In: Proceedings of the 9th IEEE International Conference on Self-adapting and Self-organising Systems (SASO15), held September 21st to September 25th in Boston, USA, pp. 144–150 (2015) Rudolph, S., Tomforde, S., Sick, B., Hähner, J.: A mutual influence detection algorithm for systems with local performance measurement. In: Proceedings of the 9th IEEE International Conference on Self-adapting and Self-organising Systems (SASO15), held September 21st to September 25th in Boston, USA, pp. 144–150 (2015)
22.
Zurück zum Zitat Fisch, D., Jänicke, M., Sick, B., Müller-Schloer, C.: Quantitative emergence - a refined approach based on divergence measures. In: 4th IEEE International Conference on Self-Adaptive and Self-Organizing Systems (SASO), Sep 2010, pp. 94–103 (2010) Fisch, D., Jänicke, M., Sick, B., Müller-Schloer, C.: Quantitative emergence - a refined approach based on divergence measures. In: 4th IEEE International Conference on Self-Adaptive and Self-Organizing Systems (SASO), Sep 2010, pp. 94–103 (2010)
Metadaten
Titel
Design and Evaluation of an Extended Learning Classifier-Based StarCraft Micro AI
verfasst von
Stefan Rudolph
Sebastian von Mammen
Johannes Jungbluth
Jörg Hähner
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-31204-0_43

Premium Partner