Skip to main content

2015 | OriginalPaper | Buchkapitel

Simulation Leagues: Analysis of Competition Formats

verfasst von : David Budden, Peter Wang, Oliver Obst, Mikhail Prokopenko

Erschienen in: RoboCup 2014: Robot World Cup XVIII

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The selection of an appropriate competition format is critical for both the success and credibility of any competition, both real and simulated. In this paper, the automated parallelism offered by the RoboCupSoccer 2D simulation league is leveraged to conduct a 28,000 game round-robin between the top 8 teams from RoboCup 2012 and 2013. A proposed new competition format is found to reduce variation from the resultant statistically significant team performance rankings by 75 % and 67 %, when compared to the actual competition results from RoboCup 2012 and 2013 respectively. These results are statistically validated by generating 10,000 random tournaments for each of the three considered formats and comparing the respective distributions of ranking discrepancy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawa, E.: RoboCup: the robot world cup initiative. In: Proceedings of the First International Conference On Autonomous Agents, pp. 340–347. ACM (1997) Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawa, E.: RoboCup: the robot world cup initiative. In: Proceedings of the First International Conference On Autonomous Agents, pp. 340–347. ACM (1997)
2.
Zurück zum Zitat Kitano, H., Asada, M.: The robocup humanoid challenge as the millennium challenge for advanced robotics. Adv. Robot. 13(8), 723–736 (1998)CrossRef Kitano, H., Asada, M.: The robocup humanoid challenge as the millennium challenge for advanced robotics. Adv. Robot. 13(8), 723–736 (1998)CrossRef
7.
Zurück zum Zitat Ha, I., Tamura, Y., Asama, H., Han, J., Hong, D.W.: Development of open humanoid platform DARwIn-OP. In: Proceedings of SICE Annual Conference (SICE) 2011, pp. 2178–2181. IEEE (2011) Ha, I., Tamura, Y., Asama, H., Han, J., Hong, D.W.: Development of open humanoid platform DARwIn-OP. In: Proceedings of SICE Annual Conference (SICE) 2011, pp. 2178–2181. IEEE (2011)
8.
Zurück zum Zitat Fountain, J., Walker, J., Budden, D., Mendes, A., Chalup, S.K.: Motivated reinforcement learning for improved head actuation of humanoid robots. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 268–279. Springer, Heidelberg (2014) CrossRef Fountain, J., Walker, J., Budden, D., Mendes, A., Chalup, S.K.: Motivated reinforcement learning for improved head actuation of humanoid robots. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 268–279. Springer, Heidelberg (2014) CrossRef
9.
Zurück zum Zitat Budden, D., Walker, J., Flannery, M., Mendes, A.: Probabilistic gradient ascent with applications to bipedal robot locomotion. In: Australasian Conference on Robotics and Automation (ACRA). (2013) Budden, D., Walker, J., Flannery, M., Mendes, A.: Probabilistic gradient ascent with applications to bipedal robot locomotion. In: Australasian Conference on Robotics and Automation (ACRA). (2013)
10.
Zurück zum Zitat Annable, B., Budden, D., Mendes, A.: NUbugger: A visual real-time robot debugging system. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 544–551. Springer, Heidelberg (2014) CrossRef Annable, B., Budden, D., Mendes, A.: NUbugger: A visual real-time robot debugging system. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 544–551. Springer, Heidelberg (2014) CrossRef
11.
Zurück zum Zitat Budden, D., Prokopenko, M.: Improved particle filtering for pseudo-uniform belief distributions in robot localisation. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 385–395. Springer, Heidelberg (2014) CrossRef Budden, D., Prokopenko, M.: Improved particle filtering for pseudo-uniform belief distributions in robot localisation. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 385–395. Springer, Heidelberg (2014) CrossRef
12.
Zurück zum Zitat Budden, D., Fenn, S., Walker, J., Mendes, A.: A novel approach to ball detection for humanoid robot soccer. In: Thielscher, M., Zhang, D. (eds.) AI 2012. LNCS, vol. 7691, pp. 827–838. Springer, Heidelberg (2012) CrossRef Budden, D., Fenn, S., Walker, J., Mendes, A.: A novel approach to ball detection for humanoid robot soccer. In: Thielscher, M., Zhang, D. (eds.) AI 2012. LNCS, vol. 7691, pp. 827–838. Springer, Heidelberg (2012) CrossRef
13.
Zurück zum Zitat Budden, D., Fenn, S., Mendes, A., Chalup, S.: Evaluation of colour models for computer vision using cluster validation techniques. In: Chen, X., Stone, P., Sucar, L.E., van der Zant, T. (eds.) RoboCup 2012. LNCS, vol. 7500, pp. 261–272. Springer, Heidelberg (2013) CrossRef Budden, D., Fenn, S., Mendes, A., Chalup, S.: Evaluation of colour models for computer vision using cluster validation techniques. In: Chen, X., Stone, P., Sucar, L.E., van der Zant, T. (eds.) RoboCup 2012. LNCS, vol. 7500, pp. 261–272. Springer, Heidelberg (2013) CrossRef
14.
Zurück zum Zitat Budden, D., Mendes, A.: Unsupervised recognition of salient colour for real-time image processing. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 373–384. Springer, Heidelberg (2014) CrossRef Budden, D., Mendes, A.: Unsupervised recognition of salient colour for real-time image processing. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 373–384. Springer, Heidelberg (2014) CrossRef
16.
Zurück zum Zitat Prokopenko, M., Obst, O., Wang, P., Budden, D., Cliff, O.: Gliders 2013: Tactical analysis with information dynamics. In: RoboCup 2013 Symposium and Competitions: Team Description Papers, Eindhoven, The Netherlands, June 2013. (2013) Prokopenko, M., Obst, O., Wang, P., Budden, D., Cliff, O.: Gliders 2013: Tactical analysis with information dynamics. In: RoboCup 2013 Symposium and Competitions: Team Description Papers, Eindhoven, The Netherlands, June 2013. (2013)
17.
Zurück zum Zitat Prokopenko, M., Wang, P., Obst, O.: Gliders 2014: Dynamic tactics with voronoi diagrams. In: Robocup 2014 Symposium And Competitions: Team Description Papers, Joo Pessoa, Brazil, July 2014. (2014) Prokopenko, M., Wang, P., Obst, O.: Gliders 2014: Dynamic tactics with voronoi diagrams. In: Robocup 2014 Symposium And Competitions: Team Description Papers, Joo Pessoa, Brazil, July 2014. (2014)
20.
Zurück zum Zitat Kitano, H., et al.: The RoboCup synthetic agent challenge 97. In: Kitano, Hiroaki (ed.) RoboCup 1997. LNCS, vol. 1395, pp. 62–73. Springer, Heidelberg (1998) CrossRef Kitano, H., et al.: The RoboCup synthetic agent challenge 97. In: Kitano, Hiroaki (ed.) RoboCup 1997. LNCS, vol. 1395, pp. 62–73. Springer, Heidelberg (1998) CrossRef
21.
Zurück zum Zitat Kitano, H., Tadokoro, S.: Robocup rescue: A grand challenge for multiagent and intelligent systems. AI Mag. 22(1), 39 (2001) Kitano, H., Tadokoro, S.: Robocup rescue: A grand challenge for multiagent and intelligent systems. AI Mag. 22(1), 39 (2001)
22.
Zurück zum Zitat Bai, A., Chen, X., MacAlpine, P., Urieli, D., Barrett, S., Stone, P.: Wrighteagle and ut austin villa: robocup 2011 simulation league champions. In: Röfer, T., Mayer, N.M., Savage, J., Saranlı, U. (eds.) RoboCup 2011. LNCS, vol. 7416, pp. 1–12. Springer, Heidelberg (2012) CrossRef Bai, A., Chen, X., MacAlpine, P., Urieli, D., Barrett, S., Stone, P.: Wrighteagle and ut austin villa: robocup 2011 simulation league champions. In: Röfer, T., Mayer, N.M., Savage, J., Saranlı, U. (eds.) RoboCup 2011. LNCS, vol. 7416, pp. 1–12. Springer, Heidelberg (2012) CrossRef
25.
Zurück zum Zitat Vilar, L., Araújo, D., Davids, K., Bar-Yam, Y.: Science of winning soccer: emergent pattern-forming dynamics in association football. J. Syst. Sci. Complex. 26(1), 73–84 (2013)CrossRef Vilar, L., Araújo, D., Davids, K., Bar-Yam, Y.: Science of winning soccer: emergent pattern-forming dynamics in association football. J. Syst. Sci. Complex. 26(1), 73–84 (2013)CrossRef
27.
Zurück zum Zitat Fewell, J., Armbruster, D., Ingraham, J., Petersen, A., Waters, J.: Basketball teams as strategic networks. PloS one 7(11), e47445 (2012)CrossRef Fewell, J., Armbruster, D., Ingraham, J., Petersen, A., Waters, J.: Basketball teams as strategic networks. PloS one 7(11), e47445 (2012)CrossRef
28.
Zurück zum Zitat Cliff, O.M., Lizier, J.T., Wang, X.R., Wang, P., Obst, O., Prokopenko, M.: Towards quantifying interaction networks in a football match. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 1–12. Springer, Heidelberg (2014) CrossRef Cliff, O.M., Lizier, J.T., Wang, X.R., Wang, P., Obst, O., Prokopenko, M.: Towards quantifying interaction networks in a football match. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 1–12. Springer, Heidelberg (2014) CrossRef
29.
Zurück zum Zitat David, H.A.: The method of paired comparisons. DTIC Document, vol. 12 (1963) David, H.A.: The method of paired comparisons. DTIC Document, vol. 12 (1963)
30.
Zurück zum Zitat Edwards, C.T.: Double-elimination tournaments: counting and calculating. Am. Stat. 50(1), 27–33 (1996) Edwards, C.T.: Double-elimination tournaments: counting and calculating. Am. Stat. 50(1), 27–33 (1996)
Metadaten
Titel
Simulation Leagues: Analysis of Competition Formats
verfasst von
David Budden
Peter Wang
Oliver Obst
Mikhail Prokopenko
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-18615-3_15