Skip to main content
Top

2015 | OriginalPaper | Chapter

Simulation Leagues: Analysis of Competition Formats

Authors : David Budden, Peter Wang, Oliver Obst, Mikhail Prokopenko

Published in: RoboCup 2014: Robot World Cup XVIII

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The selection of an appropriate competition format is critical for both the success and credibility of any competition, both real and simulated. In this paper, the automated parallelism offered by the RoboCupSoccer 2D simulation league is leveraged to conduct a 28,000 game round-robin between the top 8 teams from RoboCup 2012 and 2013. A proposed new competition format is found to reduce variation from the resultant statistically significant team performance rankings by 75 % and 67 %, when compared to the actual competition results from RoboCup 2012 and 2013 respectively. These results are statistically validated by generating 10,000 random tournaments for each of the three considered formats and comparing the respective distributions of ranking discrepancy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawa, E.: RoboCup: the robot world cup initiative. In: Proceedings of the First International Conference On Autonomous Agents, pp. 340–347. ACM (1997) Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawa, E.: RoboCup: the robot world cup initiative. In: Proceedings of the First International Conference On Autonomous Agents, pp. 340–347. ACM (1997)
2.
go back to reference Kitano, H., Asada, M.: The robocup humanoid challenge as the millennium challenge for advanced robotics. Adv. Robot. 13(8), 723–736 (1998)CrossRef Kitano, H., Asada, M.: The robocup humanoid challenge as the millennium challenge for advanced robotics. Adv. Robot. 13(8), 723–736 (1998)CrossRef
7.
go back to reference Ha, I., Tamura, Y., Asama, H., Han, J., Hong, D.W.: Development of open humanoid platform DARwIn-OP. In: Proceedings of SICE Annual Conference (SICE) 2011, pp. 2178–2181. IEEE (2011) Ha, I., Tamura, Y., Asama, H., Han, J., Hong, D.W.: Development of open humanoid platform DARwIn-OP. In: Proceedings of SICE Annual Conference (SICE) 2011, pp. 2178–2181. IEEE (2011)
8.
go back to reference Fountain, J., Walker, J., Budden, D., Mendes, A., Chalup, S.K.: Motivated reinforcement learning for improved head actuation of humanoid robots. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 268–279. Springer, Heidelberg (2014) CrossRef Fountain, J., Walker, J., Budden, D., Mendes, A., Chalup, S.K.: Motivated reinforcement learning for improved head actuation of humanoid robots. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 268–279. Springer, Heidelberg (2014) CrossRef
9.
go back to reference Budden, D., Walker, J., Flannery, M., Mendes, A.: Probabilistic gradient ascent with applications to bipedal robot locomotion. In: Australasian Conference on Robotics and Automation (ACRA). (2013) Budden, D., Walker, J., Flannery, M., Mendes, A.: Probabilistic gradient ascent with applications to bipedal robot locomotion. In: Australasian Conference on Robotics and Automation (ACRA). (2013)
10.
go back to reference Annable, B., Budden, D., Mendes, A.: NUbugger: A visual real-time robot debugging system. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 544–551. Springer, Heidelberg (2014) CrossRef Annable, B., Budden, D., Mendes, A.: NUbugger: A visual real-time robot debugging system. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 544–551. Springer, Heidelberg (2014) CrossRef
11.
go back to reference Budden, D., Prokopenko, M.: Improved particle filtering for pseudo-uniform belief distributions in robot localisation. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 385–395. Springer, Heidelberg (2014) CrossRef Budden, D., Prokopenko, M.: Improved particle filtering for pseudo-uniform belief distributions in robot localisation. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 385–395. Springer, Heidelberg (2014) CrossRef
12.
go back to reference Budden, D., Fenn, S., Walker, J., Mendes, A.: A novel approach to ball detection for humanoid robot soccer. In: Thielscher, M., Zhang, D. (eds.) AI 2012. LNCS, vol. 7691, pp. 827–838. Springer, Heidelberg (2012) CrossRef Budden, D., Fenn, S., Walker, J., Mendes, A.: A novel approach to ball detection for humanoid robot soccer. In: Thielscher, M., Zhang, D. (eds.) AI 2012. LNCS, vol. 7691, pp. 827–838. Springer, Heidelberg (2012) CrossRef
13.
go back to reference Budden, D., Fenn, S., Mendes, A., Chalup, S.: Evaluation of colour models for computer vision using cluster validation techniques. In: Chen, X., Stone, P., Sucar, L.E., van der Zant, T. (eds.) RoboCup 2012. LNCS, vol. 7500, pp. 261–272. Springer, Heidelberg (2013) CrossRef Budden, D., Fenn, S., Mendes, A., Chalup, S.: Evaluation of colour models for computer vision using cluster validation techniques. In: Chen, X., Stone, P., Sucar, L.E., van der Zant, T. (eds.) RoboCup 2012. LNCS, vol. 7500, pp. 261–272. Springer, Heidelberg (2013) CrossRef
14.
go back to reference Budden, D., Mendes, A.: Unsupervised recognition of salient colour for real-time image processing. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 373–384. Springer, Heidelberg (2014) CrossRef Budden, D., Mendes, A.: Unsupervised recognition of salient colour for real-time image processing. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 373–384. Springer, Heidelberg (2014) CrossRef
16.
go back to reference Prokopenko, M., Obst, O., Wang, P., Budden, D., Cliff, O.: Gliders 2013: Tactical analysis with information dynamics. In: RoboCup 2013 Symposium and Competitions: Team Description Papers, Eindhoven, The Netherlands, June 2013. (2013) Prokopenko, M., Obst, O., Wang, P., Budden, D., Cliff, O.: Gliders 2013: Tactical analysis with information dynamics. In: RoboCup 2013 Symposium and Competitions: Team Description Papers, Eindhoven, The Netherlands, June 2013. (2013)
17.
go back to reference Prokopenko, M., Wang, P., Obst, O.: Gliders 2014: Dynamic tactics with voronoi diagrams. In: Robocup 2014 Symposium And Competitions: Team Description Papers, Joo Pessoa, Brazil, July 2014. (2014) Prokopenko, M., Wang, P., Obst, O.: Gliders 2014: Dynamic tactics with voronoi diagrams. In: Robocup 2014 Symposium And Competitions: Team Description Papers, Joo Pessoa, Brazil, July 2014. (2014)
20.
go back to reference Kitano, H., et al.: The RoboCup synthetic agent challenge 97. In: Kitano, Hiroaki (ed.) RoboCup 1997. LNCS, vol. 1395, pp. 62–73. Springer, Heidelberg (1998) CrossRef Kitano, H., et al.: The RoboCup synthetic agent challenge 97. In: Kitano, Hiroaki (ed.) RoboCup 1997. LNCS, vol. 1395, pp. 62–73. Springer, Heidelberg (1998) CrossRef
21.
go back to reference Kitano, H., Tadokoro, S.: Robocup rescue: A grand challenge for multiagent and intelligent systems. AI Mag. 22(1), 39 (2001) Kitano, H., Tadokoro, S.: Robocup rescue: A grand challenge for multiagent and intelligent systems. AI Mag. 22(1), 39 (2001)
22.
go back to reference Bai, A., Chen, X., MacAlpine, P., Urieli, D., Barrett, S., Stone, P.: Wrighteagle and ut austin villa: robocup 2011 simulation league champions. In: Röfer, T., Mayer, N.M., Savage, J., Saranlı, U. (eds.) RoboCup 2011. LNCS, vol. 7416, pp. 1–12. Springer, Heidelberg (2012) CrossRef Bai, A., Chen, X., MacAlpine, P., Urieli, D., Barrett, S., Stone, P.: Wrighteagle and ut austin villa: robocup 2011 simulation league champions. In: Röfer, T., Mayer, N.M., Savage, J., Saranlı, U. (eds.) RoboCup 2011. LNCS, vol. 7416, pp. 1–12. Springer, Heidelberg (2012) CrossRef
25.
go back to reference Vilar, L., Araújo, D., Davids, K., Bar-Yam, Y.: Science of winning soccer: emergent pattern-forming dynamics in association football. J. Syst. Sci. Complex. 26(1), 73–84 (2013)CrossRef Vilar, L., Araújo, D., Davids, K., Bar-Yam, Y.: Science of winning soccer: emergent pattern-forming dynamics in association football. J. Syst. Sci. Complex. 26(1), 73–84 (2013)CrossRef
27.
go back to reference Fewell, J., Armbruster, D., Ingraham, J., Petersen, A., Waters, J.: Basketball teams as strategic networks. PloS one 7(11), e47445 (2012)CrossRef Fewell, J., Armbruster, D., Ingraham, J., Petersen, A., Waters, J.: Basketball teams as strategic networks. PloS one 7(11), e47445 (2012)CrossRef
28.
go back to reference Cliff, O.M., Lizier, J.T., Wang, X.R., Wang, P., Obst, O., Prokopenko, M.: Towards quantifying interaction networks in a football match. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 1–12. Springer, Heidelberg (2014) CrossRef Cliff, O.M., Lizier, J.T., Wang, X.R., Wang, P., Obst, O., Prokopenko, M.: Towards quantifying interaction networks in a football match. In: Behnke, S., Veloso, M., Visser, A., Xiong, R. (eds.) RoboCup 2013. LNCS, vol. 8371, pp. 1–12. Springer, Heidelberg (2014) CrossRef
29.
go back to reference David, H.A.: The method of paired comparisons. DTIC Document, vol. 12 (1963) David, H.A.: The method of paired comparisons. DTIC Document, vol. 12 (1963)
30.
go back to reference Edwards, C.T.: Double-elimination tournaments: counting and calculating. Am. Stat. 50(1), 27–33 (1996) Edwards, C.T.: Double-elimination tournaments: counting and calculating. Am. Stat. 50(1), 27–33 (1996)
Metadata
Title
Simulation Leagues: Analysis of Competition Formats
Authors
David Budden
Peter Wang
Oliver Obst
Mikhail Prokopenko
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-18615-3_15

Premium Partner