Skip to main content
Top
Published in: Soft Computing 9/2012

01-09-2012 | Focus

RTS game strategy evaluation using extreme learning machine

Authors: Yingjie Li, Yan Li, Junhai Zhai, Simon Shiu

Published in: Soft Computing | Issue 9/2012

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The fundamental game of real-time strategy (RTS) is collecting resources to build an army with military units to kill and destroy enemy units. In this research, an extreme learning machine (ELM) model is proposed for RTS game strategy evaluation. Due to the complicated game rules and numerous playable items, the commonly used tree-based decision models become complex, sometimes even unmanageable. Since complex interactions exist among unit types, the weighted average model usually cannot be well used to compute the combined power of unit groups, which results in misleading unit generation strategy. Fuzzy measures and integrals are often used to handle interactions among attributes, but they cannot handle the predefined unit production sequence which is strictly required in RTS games. In this paper, an ELM model is trained based on real data to obtain the combined power of units in different types. Both the unit interactions and the production sequence can be implicitly and simultaneously handled by this model. Warcraft III battle data from real players are collected and used in our experiments. Experimental results show that ELM is fast and effective in evaluating the unit generation strategies.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Aha D, Molineaux M, Ponsen M (2005) Learning to win: Case-based plan selection in a real-time strategy game. In: Case-based reasoning research and development, pp 5–20 Aha D, Molineaux M, Ponsen M (2005) Learning to win: Case-based plan selection in a real-time strategy game. In: Case-based reasoning research and development, pp 5–20
go back to reference Chacko BP, Vimal Krishnan VR, Raju G, Babu Anto P (2011) Handwritten character recognition using wavelet energy and extreme learning machine. Int J Mach Learn Cybern. doi:10.1007/s13042-011-0049-5 Chacko BP, Vimal Krishnan VR, Raju G, Babu Anto P (2011) Handwritten character recognition using wavelet energy and extreme learning machine. Int J Mach Learn Cybern. doi:10.​1007/​s13042-011-0049-5
go back to reference Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297MATH
go back to reference Dodge Y (2003) The Oxford dictionary of statistical terms. Oxford University Press, Oxford. ISBN: 0-19-920613-9 Dodge Y (2003) The Oxford dictionary of statistical terms. Oxford University Press, Oxford. ISBN: 0-19-920613-9
go back to reference Feng G, Huang G-B, Lin Q, Gay R (2009) Error minimized extreme learning machine with growth of hidden nodes and incremental learning. Neural Netw 20:1352–1357CrossRef Feng G, Huang G-B, Lin Q, Gay R (2009) Error minimized extreme learning machine with growth of hidden nodes and incremental learning. Neural Netw 20:1352–1357CrossRef
go back to reference Frenay B, Verleysen M (2010) Using svms with randomised feature spaces: an extreme learning approach. In: Proceedings of the 18th European symposium on artificial neural networks (ESANN), (Bruges, Belgium), 28–30 April 2010, pp 315–320 Frenay B, Verleysen M (2010) Using svms with randomised feature spaces: an extreme learning approach. In: Proceedings of the 18th European symposium on artificial neural networks (ESANN), (Bruges, Belgium), 28–30 April 2010, pp 315–320
go back to reference Hagelback J, Johansson S (2008) Using multi-agent potential fields in real-time strategy games. In: Proceedings of the 7th international joint conference on autonomous agents and multiagent systems, vol 2, pp 631–638 Hagelback J, Johansson S (2008) Using multi-agent potential fields in real-time strategy games. In: Proceedings of the 7th international joint conference on autonomous agents and multiagent systems, vol 2, pp 631–638
go back to reference Hagelback J, Johansson S (2008) Demonstration of multi-agent potential fields in real-time strategy games. In: International foundation for autonomous agents and multiagent systems, Richland, SC Hagelback J, Johansson S (2008) Demonstration of multi-agent potential fields in real-time strategy games. In: International foundation for autonomous agents and multiagent systems, Richland, SC
go back to reference Hsieh JL, Sun CT (2008) Building a player strategy model by analyzing replays of real-time strategy games. In: Proceedings of IEEE international joint conference on neural networks, Hongkong, China, June 2008, pp 3106–3111 Hsieh JL, Sun CT (2008) Building a player strategy model by analyzing replays of real-time strategy games. In: Proceedings of IEEE international joint conference on neural networks, Hongkong, China, June 2008, pp 3106–3111
go back to reference Huang G-B, Chen L (2007) Convex incremental extreme learning machine. Neurocomputing 70:3056–3062CrossRef Huang G-B, Chen L (2007) Convex incremental extreme learning machine. Neurocomputing 70:3056–3062CrossRef
go back to reference Huang G-B, Chen L (2008) Enhanced random search based incremental extreme learning machine. Neurocomputing 71:3460–3468CrossRef Huang G-B, Chen L (2008) Enhanced random search based incremental extreme learning machine. Neurocomputing 71:3460–3468CrossRef
go back to reference Huang G-B, Zhu QY, Siew CK (2006a) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501CrossRef Huang G-B, Zhu QY, Siew CK (2006a) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501CrossRef
go back to reference Huang G-B, Chen L, Siew C-K (2006b) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17(4):879–892CrossRef Huang G-B, Chen L, Siew C-K (2006b) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17(4):879–892CrossRef
go back to reference Huang G-B, Li M-B, Chen L, Siew C-K (2008) Incremental extreme learning machine with fully complex hidden nodes. Neurocomputing 71:576–583CrossRef Huang G-B, Li M-B, Chen L, Siew C-K (2008) Incremental extreme learning machine with fully complex hidden nodes. Neurocomputing 71:576–583CrossRef
go back to reference Huang G-B, Ding X, Zhou H (2010) Optimization method based extreme learning machine for classification. Neurocomputing 74:155–163CrossRef Huang G-B, Ding X, Zhou H (2010) Optimization method based extreme learning machine for classification. Neurocomputing 74:155–163CrossRef
go back to reference Huang G-B, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122CrossRef Huang G-B, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122CrossRef
go back to reference Ishii K, Sugeno M (1985) A model of human evaluation process using fuzzy measure. Int J Man Mach Stud 22:19–38MATHCrossRef Ishii K, Sugeno M (1985) A model of human evaluation process using fuzzy measure. Int J Man Mach Stud 22:19–38MATHCrossRef
go back to reference Jang S-H, Cho S-B (2008) Evolving neural NPCs with layered influence map in the real-time simulation game ‘Conqueror’. In: IEEE symposium on computational intelligence and games. pp 385–388 Jang S-H, Cho S-B (2008) Evolving neural NPCs with layered influence map in the real-time simulation game ‘Conqueror’. In: IEEE symposium on computational intelligence and games. pp 385–388
go back to reference Jun W, Shitong W, Chung F-l (2011) Positive and negative fuzzy rule system, extreme learning machine and image classification. Int J M Learn Cybern 2(4):261–271CrossRef Jun W, Shitong W, Chung F-l (2011) Positive and negative fuzzy rule system, extreme learning machine and image classification. Int J M Learn Cybern 2(4):261–271CrossRef
go back to reference Kwon S, Sugeno M (2000) A hierarchical subjective evaluation model using non-monotonic fuzzy measures and the Choquet integral. In: Fuzzy measures and integrals—theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 375–391 Kwon S, Sugeno M (2000) A hierarchical subjective evaluation model using non-monotonic fuzzy measures and the Choquet integral. In: Fuzzy measures and integrals—theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 375–391
go back to reference Li M-B, Huang G-B, Saratchandran P, Sundararajan N (2005) Fully complex extreme learning machine. Neurocomputing 68:306–314CrossRef Li M-B, Huang G-B, Saratchandran P, Sundararajan N (2005) Fully complex extreme learning machine. Neurocomputing 68:306–314CrossRef
go back to reference Li YJ, Peter H, Ng F, Wang HB, Li Y, Simon C, Shiu K (2010) Applying fuzzy integral for performance evaluation in real time strategy game. In: Proceedings of 2010 2nd international conference on information and multimedia technology (ICIMT 2010), Hong Kong, China, December 28–30, vol 1, pp 168–172 Li YJ, Peter H, Ng F, Wang HB, Li Y, Simon C, Shiu K (2010) Applying fuzzy integral for performance evaluation in real time strategy game. In: Proceedings of 2010 2nd international conference on information and multimedia technology (ICIMT 2010), Hong Kong, China, December 28–30, vol 1, pp 168–172
go back to reference Li YJ, Peter H, Ng F, Wang HB, Shiu SCK, Li Y (2011) Apply different fuzzy integrals in unit selection problem of real time strategy game. In: Proceedings of 2011 international conference on fuzzy system, Taiwan, China, June 27–30 Li YJ, Peter H, Ng F, Wang HB, Shiu SCK, Li Y (2011) Apply different fuzzy integrals in unit selection problem of real time strategy game. In: Proceedings of 2011 international conference on fuzzy system, Taiwan, China, June 27–30
go back to reference Liang N-Y, Huang G-B, Saratchandran P, Sundararajan N (2006) A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17(6):1411–1423CrossRef Liang N-Y, Huang G-B, Saratchandran P, Sundararajan N (2006) A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17(6):1411–1423CrossRef
go back to reference Liu Q, He Q, Shi Z (2008) Extreme support vector machine classifier. Lect Notes Comput Sci 5012:222–233CrossRef Liu Q, He Q, Shi Z (2008) Extreme support vector machine classifier. Lect Notes Comput Sci 5012:222–233CrossRef
go back to reference Miller R (1997) Beyond ANOVA: basics of applied statistics. Chapman & Hall/CRC, Boca Raton Miller R (1997) Beyond ANOVA: basics of applied statistics. Chapman & Hall/CRC, Boca Raton
go back to reference Murofushi Michio T, Machida M (1994) Non-monotonic fuzzy measures and the Choquet integral. Fuzzy Sets Syst 64(1):73–86MATHCrossRef Murofushi Michio T, Machida M (1994) Non-monotonic fuzzy measures and the Choquet integral. Fuzzy Sets Syst 64(1):73–86MATHCrossRef
go back to reference Murofushi T, Sugeno M (2000a) The Choquet integral in multiattribute decision making. In: Fuzzy measures and integrals: theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 333–347 Murofushi T, Sugeno M (2000a) The Choquet integral in multiattribute decision making. In: Fuzzy measures and integrals: theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 333–347
go back to reference Murofushi T, Sugeno M (2000b) Fuzzy measures and fuzzy integrals. In: Fuzzy measures and integrals: theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 3–41 Murofushi T, Sugeno M (2000b) Fuzzy measures and fuzzy integrals. In: Fuzzy measures and integrals: theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 3–41
go back to reference Niu B, Wang H, Peter H, Ng F, Simon C, Shiu K (2009) A neural-evolutionary model of case-based planning in real time strategy games. In: Lecture notes in computer science, vol 5579/2009, pp 291–300. doi:10.1007/978-3-642-02568-6_30 Niu B, Wang H, Peter H, Ng F, Simon C, Shiu K (2009) A neural-evolutionary model of case-based planning in real time strategy games. In: Lecture notes in computer science, vol 5579/2009, pp 291–300. doi:10.​1007/​978-3-642-02568-6_​30
go back to reference Ontanon S, Mishra K, Ram A (2008) Learning from demonstration and case-based planning for real-time strategy games. In: Studies in fuzziness and soft computing, vol 226, pp 293–310. doi:10.1007/978-3-540-77465-5_15 Ontanon S, Mishra K, Ram A (2008) Learning from demonstration and case-based planning for real-time strategy games. In: Studies in fuzziness and soft computing, vol 226, pp 293–310. doi:10.​1007/​978-3-540-77465-5_​15
go back to reference Peter H, Ng F, Simon C, Shiu K, Haibo Wang (2009) Learning player behaviors in real time strategy games from real data. In: Twelve rough sets, fuzzy sets, data mining, and granular-soft computing (RSFDGrC), pp 321–327 Peter H, Ng F, Simon C, Shiu K, Haibo Wang (2009) Learning player behaviors in real time strategy games from real data. In: Twelve rough sets, fuzzy sets, data mining, and granular-soft computing (RSFDGrC), pp 321–327
go back to reference Peters J, Han L, Ramanna S (1999) The Choquet integral in a rough software cost decision system. Fuzzy measures and integrals: theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 392–414 Peters J, Han L, Ramanna S (1999) The Choquet integral in a rough software cost decision system. Fuzzy measures and integrals: theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 392–414
go back to reference Sharma M, Holmes M, Santamaria J, Irani A, Isbell C, Ram A (2007) Transfer learning in real-time strategy games using hybrid CBR/RL. In: Proceedings of the twentieth international joint conference on artificial intelligence Sharma M, Holmes M, Santamaria J, Irani A, Isbell C, Ram A (2007) Transfer learning in real-time strategy games using hybrid CBR/RL. In: Proceedings of the twentieth international joint conference on artificial intelligence
go back to reference Wang X-Z, Dong C-R (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Trans Fuzzy Syst 17(3):556–567CrossRef Wang X-Z, Dong C-R (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Trans Fuzzy Syst 17(3):556–567CrossRef
go back to reference Wang J, Wang Z (1997) Using neural networks to determine Sugeno measures by statistics. Neural Netw 10(1):183–195CrossRef Wang J, Wang Z (1997) Using neural networks to determine Sugeno measures by statistics. Neural Netw 10(1):183–195CrossRef
go back to reference Wang Z, Leung KS, Wang J (1997) Genetic algorithms used for determining nonadditive set functions in information fusion. Proc IFSA’97 1:518–521 Wang Z, Leung KS, Wang J (1997) Genetic algorithms used for determining nonadditive set functions in information fusion. Proc IFSA’97 1:518–521
go back to reference Wang ZY, Xu K, Wang J (1999) Using genetic algorithm to determine non-negative monotone set functions for information fusion in environments with random perturbation. Int J Intell Syst 14:949–962MATHCrossRef Wang ZY, Xu K, Wang J (1999) Using genetic algorithm to determine non-negative monotone set functions for information fusion in environments with random perturbation. Int J Intell Syst 14:949–962MATHCrossRef
go back to reference Wang X, Shao Q, Miao Q, Zhai J (2011a) Architecture selection for networks trained with extreme learning machine using localized generalization error model. Neurocomputing (submitted) Wang X, Shao Q, Miao Q, Zhai J (2011a) Architecture selection for networks trained with extreme learning machine using localized generalization error model. Neurocomputing (submitted)
Metadata
Title
RTS game strategy evaluation using extreme learning machine
Authors
Yingjie Li
Yan Li
Junhai Zhai
Simon Shiu
Publication date
01-09-2012
Publisher
Springer-Verlag
Published in
Soft Computing / Issue 9/2012
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-012-0831-7

Other articles of this Issue 9/2012

Soft Computing 9/2012 Go to the issue

Premium Partner