Skip to main content

2016 | OriginalPaper | Buchkapitel

Qualitative Case-Based Reasoning for Humanoid Robot Soccer: A New Retrieval and Reuse Algorithm

verfasst von : Thiago P. D. Homem, Danilo H. Perico, Paulo E. Santos, Reinaldo A. C. Bianchi, Ramon L. de Mantaras

Erschienen in: Case-Based Reasoning Research and Development

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a new Case-Based Reasoning (CBR) approach, named Q-CBR, that uses a Qualitative Spatial Reasoning theory to model, retrieve and reuse cases by means of spatial relations. A qualitative distance and orientation calculus (\(\mathcal {EOPRA}\)) is used to model cases using qualitative relations between the objects in a case. A new retrieval algorithm is proposed that uses the Conceptual Neighborhood Diagram to compute the similarity measure between a new problem and the cases in the case base. A reuse algorithm is also introduced that selects the most similar case and shares it with other agents, based on their qualitative position. The proposed approach was evaluated on simulation and on real humanoid robots. Preliminary results suggest that the proposed approach is faster than using a quantitative model and other similarity measure such as the Euclidean distance. As a result of running Q-CBR, the robots obtained a higher average number of goals than those obtained when running a metric CBR approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The distance matrix for \(\mathcal {EOPRA}_6\) is available at the URL https://​goo.​gl/​photos/​nJ83KngMH6i789xz​7.
 
Literatur
1.
Zurück zum Zitat Aamodt, A., Plaza, E.: Case-based reasoning: foundational issues, methodological variations, and system approaches. AI Commun. 7, 39–59 (1994) Aamodt, A., Plaza, E.: Case-based reasoning: foundational issues, methodological variations, and system approaches. AI Commun. 7, 39–59 (1994)
2.
Zurück zum Zitat Altaf, M.M., Elbagoury, B.M., Alraddady, F., Roushdy, M.: Extended case-based behavior control for multi-humanoid robots. Int. J. Hum. Robot. 13, 1550035 (2015)CrossRef Altaf, M.M., Elbagoury, B.M., Alraddady, F., Roushdy, M.: Extended case-based behavior control for multi-humanoid robots. Int. J. Hum. Robot. 13, 1550035 (2015)CrossRef
3.
Zurück zum Zitat Cormen, T.H., Leiserson, C.E., Rivest, R.L., Stein, C.: Introduction to Algorithms, 2nd edn. MIT Press, Cambridge (2001)MATH Cormen, T.H., Leiserson, C.E., Rivest, R.L., Stein, C.: Introduction to Algorithms, 2nd edn. MIT Press, Cambridge (2001)MATH
4.
Zurück zum Zitat Davoust, A., Floyd, M.W., Esfandiari, B.: Use of fuzzy histograms to model the spatial distribution of objects in case-based reasoning. In: Bergler, S. (ed.) AI 2008. LNCS (LNAI), vol. 5032, pp. 72–83. Springer, Heidelberg (2008). doi:10.1007/978-3-540-68825-9_8 CrossRef Davoust, A., Floyd, M.W., Esfandiari, B.: Use of fuzzy histograms to model the spatial distribution of objects in case-based reasoning. In: Bergler, S. (ed.) AI 2008. LNCS (LNAI), vol. 5032, pp. 72–83. Springer, Heidelberg (2008). doi:10.​1007/​978-3-540-68825-9_​8 CrossRef
5.
Zurück zum Zitat de Mantaras, R.L., McSherry, D., Bridge, D., Smyth, B., Craw, S., Faltings, B., Maher, M.L., Cox, M., Forbus, K., Keane, M., Aamodt, A., Watson, I.: Retrieval, reuse, revision, and retention in CBR. Knowl. Eng. Rev. 20, 215–240 (2006)CrossRef de Mantaras, R.L., McSherry, D., Bridge, D., Smyth, B., Craw, S., Faltings, B., Maher, M.L., Cox, M., Forbus, K., Keane, M., Aamodt, A., Watson, I.: Retrieval, reuse, revision, and retention in CBR. Knowl. Eng. Rev. 20, 215–240 (2006)CrossRef
6.
Zurück zum Zitat Weghe, N., Maeyer, P.: Conceptual neighbourhood diagrams for representing moving objects. In: Akoka, J., Liddle, S.W., Song, I.-Y., Bertolotto, M., Comyn-Wattiau, I., Heuvel, W.-J., Kolp, M., Trujillo, J., Kop, C., Mayr, H.C. (eds.) ER 2005. LNCS, vol. 3770, pp. 228–238. Springer, Heidelberg (2005). doi:10.1007/11568346_25 CrossRef Weghe, N., Maeyer, P.: Conceptual neighbourhood diagrams for representing moving objects. In: Akoka, J., Liddle, S.W., Song, I.-Y., Bertolotto, M., Comyn-Wattiau, I., Heuvel, W.-J., Kolp, M., Trujillo, J., Kop, C., Mayr, H.C. (eds.) ER 2005. LNCS, vol. 3770, pp. 228–238. Springer, Heidelberg (2005). doi:10.​1007/​11568346_​25 CrossRef
7.
Zurück zum Zitat Dorr, C.H., Latecki, L.J., Moratz, R.: Shape similarity based on the qualitative spatial reasoning calculus eOPRAm. In: Fabrikant, S.I., Raubal, M., Bertolotto, M., Davies, C., Freundschuh, S., Bell, S. (eds.) COSIT 2015. LNCS, vol. 9368, pp. 130–150. Springer, Heidelberg (2015). doi:10.1007/978-3-319-23374-1_7 CrossRef Dorr, C.H., Latecki, L.J., Moratz, R.: Shape similarity based on the qualitative spatial reasoning calculus eOPRAm. In: Fabrikant, S.I., Raubal, M., Bertolotto, M., Davies, C., Freundschuh, S., Bell, S. (eds.) COSIT 2015. LNCS, vol. 9368, pp. 130–150. Springer, Heidelberg (2015). doi:10.​1007/​978-3-319-23374-1_​7 CrossRef
8.
Zurück zum Zitat Du, Y., Liang, F., Sun, Y.: Integrating spatial relations into case-based reasoning to solve geographic problems. Knowl. Based Syst. 33, 111–123 (2012)CrossRef Du, Y., Liang, F., Sun, Y.: Integrating spatial relations into case-based reasoning to solve geographic problems. Knowl. Based Syst. 33, 111–123 (2012)CrossRef
9.
Zurück zum Zitat Dufour-Lussier, V., Le Ber, F., Lieber, J., Martin, L.: Adapting spatial and temporal cases. In: Agudo, B.D., Watson, I. (eds.) ICCBR 2012. LNCS (LNAI), vol. 7466, pp. 77–91. Springer, Heidelberg (2012). doi:10.1007/978-3-642-32986-9_8 CrossRef Dufour-Lussier, V., Le Ber, F., Lieber, J., Martin, L.: Adapting spatial and temporal cases. In: Agudo, B.D., Watson, I. (eds.) ICCBR 2012. LNCS (LNAI), vol. 7466, pp. 77–91. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-32986-9_​8 CrossRef
10.
Zurück zum Zitat Floyd, M.W., Esfandiari, B., Lam, K.: A case-based reasoning approach to imitating robocup players. In: Proceedings of the Twenty-First FLAIRS, Florida, USA, pp. 251–256. AAAI Press (2008) Floyd, M.W., Esfandiari, B., Lam, K.: A case-based reasoning approach to imitating robocup players. In: Proceedings of the Twenty-First FLAIRS, Florida, USA, pp. 251–256. AAAI Press (2008)
11.
Zurück zum Zitat Freksa, C.: Conceptual neighborhood and its role in temporal and spatial reasoning. In: Decision Support Systems and Qualitative Reasoning, pp. 181–187 (1991) Freksa, C.: Conceptual neighborhood and its role in temporal and spatial reasoning. In: Decision Support Systems and Qualitative Reasoning, pp. 181–187 (1991)
12.
Zurück zum Zitat Jære, M.D., Aamodt, A., Skalle, P.: ECCBR 2002. Springer, Heidelberg (2002)MATH Jære, M.D., Aamodt, A., Skalle, P.: ECCBR 2002. Springer, Heidelberg (2002)MATH
13.
Zurück zum Zitat Karol, A., Nebel, B., Stanton, C., Williams, M.-A.: Case based game play in the RoboCup four-legged league Part I the theoretical model. In: Polani, D., Browning, B., Bonarini, A., Yoshida, K. (eds.) RoboCup 2003. LNCS (LNAI), vol. 3020, pp. 739–747. Springer, Heidelberg (2004). doi:10.1007/978-3-540-25940-4_73 CrossRef Karol, A., Nebel, B., Stanton, C., Williams, M.-A.: Case based game play in the RoboCup four-legged league Part I the theoretical model. In: Polani, D., Browning, B., Bonarini, A., Yoshida, K. (eds.) RoboCup 2003. LNCS (LNAI), vol. 3020, pp. 739–747. Springer, Heidelberg (2004). doi:10.​1007/​978-3-540-25940-4_​73 CrossRef
14.
Zurück zum Zitat Kolodner, J.: Case-Based Reasoning. Morgan Kaufmann Publishers Inc., San Francisco (1993)CrossRefMATH Kolodner, J.: Case-Based Reasoning. Morgan Kaufmann Publishers Inc., San Francisco (1993)CrossRefMATH
15.
Zurück zum Zitat Lin, Y., Liu, A., Chen, K.: A hybrid architecture of case-based reasoning and fuzzy behavioral control applied to robot soccer. In: Workshop on Artificial Intelligence (ICS2002), Hualien, Taiwan, National Dong Hwa University (2002) Lin, Y., Liu, A., Chen, K.: A hybrid architecture of case-based reasoning and fuzzy behavioral control applied to robot soccer. In: Workshop on Artificial Intelligence (ICS2002), Hualien, Taiwan, National Dong Hwa University (2002)
16.
Zurück zum Zitat Liu, Z., Fu, L., Zhou, Y.: Case-based reasoning algorithm based on qualitative causality. In: 7th International Joint Conference on CSO, pp. 519–523. IEEE, July 2014 Liu, Z., Fu, L., Zhou, Y.: Case-based reasoning algorithm based on qualitative causality. In: 7th International Joint Conference on CSO, pp. 519–523. IEEE, July 2014
17.
Zurück zum Zitat Marling, C., Tomko, M., Gillen, M., Alex, D., Chelberg, D.: Case-based reasoning for planning, world modeling in the robocup small sized league. In: Workshop on Issues in Designing Physical Agents for Dynamic Real-Time Environments: World Modeling, Planning, Learning, and Communicating (IJCAI) (2003) Marling, C., Tomko, M., Gillen, M., Alex, D., Chelberg, D.: Case-based reasoning for planning, world modeling in the robocup small sized league. In: Workshop on Issues in Designing Physical Agents for Dynamic Real-Time Environments: World Modeling, Planning, Learning, and Communicating (IJCAI) (2003)
18.
Zurück zum Zitat Moratz, R., Wallgrün, J.O.: Spatial reasoning with augmented points: extending cardinal directions with local distances. J. Spat. Inf. Sci. 5(5), 1–30 (2012) Moratz, R., Wallgrün, J.O.: Spatial reasoning with augmented points: extending cardinal directions with local distances. J. Spat. Inf. Sci. 5(5), 1–30 (2012)
19.
Zurück zum Zitat Mossakowski, T., Moratz, R.: Qualitative reasoning about relative direction of oriented points. Artif. Intell. 180–181, 34–45 (2012)MathSciNetCrossRefMATH Mossakowski, T., Moratz, R.: Qualitative reasoning about relative direction of oriented points. Artif. Intell. 180–181, 34–45 (2012)MathSciNetCrossRefMATH
20.
Zurück zum Zitat Nehmzow, U.: Scientific Methods in Mobile Robotics: Quantitative Analysis of Agent Behaviour. Springer, London (2006) Nehmzow, U.: Scientific Methods in Mobile Robotics: Quantitative Analysis of Agent Behaviour. Springer, London (2006)
21.
Zurück zum Zitat Perico, D.H., Bianchi, R.A.C., Santos, P.E., de Mántaras. R.L.: Collaborative communication of qualitative spatial perceptions for multi-robot systems. In: Proceedings of 29th International Workshop on Qualitative Reasoning (IJCAI), pp. 77–84, New York, NY, USA (2016) Perico, D.H., Bianchi, R.A.C., Santos, P.E., de Mántaras. R.L.: Collaborative communication of qualitative spatial perceptions for multi-robot systems. In: Proceedings of 29th International Workshop on Qualitative Reasoning (IJCAI), pp. 77–84, New York, NY, USA (2016)
22.
Zurück zum Zitat Perico, D.H., Silva, I.J., Homem, T.P.D., Destro, R.C., Bianchi, R.A.C.: Hardware, software aspects of the design, assembly of a new humanoid robot for robocup soccer. In: 2014 Joint Conference on Robotics (2011). Observation of strains. Infect Dis Ther. 3(1), 35–43.: SBR-LARS, pp. 73–78. IEEE, October 2014 Perico, D.H., Silva, I.J., Homem, T.P.D., Destro, R.C., Bianchi, R.A.C.: Hardware, software aspects of the design, assembly of a new humanoid robot for robocup soccer. In: 2014 Joint Conference on Robotics (2011). Observation of strains. Infect Dis Ther. 3(1), 35–43.: SBR-LARS, pp. 73–78. IEEE, October 2014
23.
Zurück zum Zitat Randell, D.A., Witkowski, M.: Tracking regions using conceptual neighbourhoods. In: Proceedings of the Workshop on Spatial and Temporal Reasoning ECAI 2004, pp. 63–71 (2004) Randell, D.A., Witkowski, M.: Tracking regions using conceptual neighbourhoods. In: Proceedings of the Workshop on Spatial and Temporal Reasoning ECAI 2004, pp. 63–71 (2004)
25.
Zurück zum Zitat Ros, R., Arcos, J.L., de Mantaras, R.L., Veloso, M.: A case-based approach for coordinated action selection in robot soccer. Artif. Intell. 173(9–10), 1014–1039 (2009)CrossRef Ros, R., Arcos, J.L., de Mantaras, R.L., Veloso, M.: A case-based approach for coordinated action selection in robot soccer. Artif. Intell. 173(9–10), 1014–1039 (2009)CrossRef
26.
Zurück zum Zitat Southey, T., Little, J.J.: Relations, learning qualitative spatial for object classification. In: IROS: From Sensors to Human Spatial Concepts (2007) Southey, T., Little, J.J.: Relations, learning qualitative spatial for object classification. In: IROS: From Sensors to Human Spatial Concepts (2007)
27.
Zurück zum Zitat Stone, P., Sutton, R.S., Kuhlmann, G.: Reinforcement learning for RoboCup soccer keepaway. Adap. Behav. 13(3), 165–188 (2005)CrossRef Stone, P., Sutton, R.S., Kuhlmann, G.: Reinforcement learning for RoboCup soccer keepaway. Adap. Behav. 13(3), 165–188 (2005)CrossRef
28.
Zurück zum Zitat Wolter, D., Wallgrün, J.: Qualitative spatial reasoning for applications: new challenges and the SparQ toolbox. In: Qualitative Spatio-temporal Representation and Reasoning: Trends and Future Directions, pp. 336–362 (2012) Wolter, D., Wallgrün, J.: Qualitative spatial reasoning for applications: new challenges and the SparQ toolbox. In: Qualitative Spatio-temporal Representation and Reasoning: Trends and Future Directions, pp. 336–362 (2012)
29.
Zurück zum Zitat Young, J., Hawes, N.: Predicting situated behaviour using sequences of abstract spatial relations. In: AAAI 2013 Proceedings, Fall Symposium Series (2013) Young, J., Hawes, N.: Predicting situated behaviour using sequences of abstract spatial relations. In: AAAI 2013 Proceedings, Fall Symposium Series (2013)
30.
Zurück zum Zitat Young, J., Hawes, N.: Learning by observation using qualitative spatial relations. In: Proceedings of the 2015 AAMAS, pp. 745–751, Richland, SC (2015) Young, J., Hawes, N.: Learning by observation using qualitative spatial relations. In: Proceedings of the 2015 AAMAS, pp. 745–751, Richland, SC (2015)
Metadaten
Titel
Qualitative Case-Based Reasoning for Humanoid Robot Soccer: A New Retrieval and Reuse Algorithm
verfasst von
Thiago P. D. Homem
Danilo H. Perico
Paulo E. Santos
Reinaldo A. C. Bianchi
Ramon L. de Mantaras
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-47096-2_12