Skip to main content
Top
Published in: Cognitive Processing 3/2007

01-09-2007 | Review

Prediction of intent in robotics and multi-agent systems

Author: Yiannis Demiris

Published in: Cognitive Processing | Issue 3/2007

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Moving beyond the stimulus contained in observable agent behaviour, i.e. understanding the underlying intent of the observed agent is of immense interest in a variety of domains that involve collaborative and competitive scenarios, for example assistive robotics, computer games, robot–human interaction, decision support and intelligent tutoring. This review paper examines approaches for performing action recognition and prediction of intent from a multi-disciplinary perspective, in both single robot and multi-agent scenarios, and analyses the underlying challenges, focusing mainly on generative approaches.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Acosta-Calderon CA, Hu H (2005) Robot imitation: body schema and body percept. J Appl Bionics Biomech 2(3–):131–48. ISSN 1176–322 Acosta-Calderon CA, Hu H (2005) Robot imitation: body schema and body percept. J Appl Bionics Biomech 2(3–):131–48. ISSN 1176–322
go back to reference Aggarwal A, Cai Q (1999) Human motion analysis: a review. Comput Vis Image Underst 73(3):428–440CrossRef Aggarwal A, Cai Q (1999) Human motion analysis: a review. Comput Vis Image Underst 73(3):428–440CrossRef
go back to reference Anderson JR, Boyle CF, Corbett AT, Lewis MW (1990) Cognitive modelling and intelligent tutoring. Artif Intell 42:7–49CrossRef Anderson JR, Boyle CF, Corbett AT, Lewis MW (1990) Cognitive modelling and intelligent tutoring. Artif Intell 42:7–49CrossRef
go back to reference Arkin RC (1998) Behavior based robotics. MIT Press, Cambridge Arkin RC (1998) Behavior based robotics. MIT Press, Cambridge
go back to reference Beetz M, Kirchlechner B, Lames M (2005) Computerised real-time analysis of football games. Pervasive Comput 4(3):33–39CrossRef Beetz M, Kirchlechner B, Lames M (2005) Computerised real-time analysis of football games. Pervasive Comput 4(3):33–39CrossRef
go back to reference Bekkering H, Wohlschläger A, Gattis M (2000) Imitation of gestures in children is goal-directed. Q J Exp Psychol 53A:153–164CrossRef Bekkering H, Wohlschläger A, Gattis M (2000) Imitation of gestures in children is goal-directed. Q J Exp Psychol 53A:153–164CrossRef
go back to reference Bishop C (2006) Pattern recognition and machine learning. Springer, Heidelberg Bishop C (2006) Pattern recognition and machine learning. Springer, Heidelberg
go back to reference Blakemore S-J, Decety J (2001) From the perception of action to the understanding of intention. Nat Rev Neurosci 2:561–567PubMed Blakemore S-J, Decety J (2001) From the perception of action to the understanding of intention. Nat Rev Neurosci 2:561–567PubMed
go back to reference Bratman ME (1990) What is Intention? In: Cohen PR, Morgan JL, Pollack ME (eds) Intentions in communication, MIT Press, Cambridge, pp 15–32 Bratman ME (1990) What is Intention? In: Cohen PR, Morgan JL, Pollack ME (eds) Intentions in communication, MIT Press, Cambridge, pp 15–32
go back to reference Breazeal C, Berlin M, Brooks A, Gray J, Thomaz A (2006) Using perspective taking to learn from ambiguous demonstrations. Rob Auton Syst 54(5):385–393CrossRef Breazeal C, Berlin M, Brooks A, Gray J, Thomaz A (2006) Using perspective taking to learn from ambiguous demonstrations. Rob Auton Syst 54(5):385–393CrossRef
go back to reference Brooks (1986) A robust layered control system for a mobile robot. IEEE J Robot Autom RA-2, pp 14–3 Brooks (1986) A robust layered control system for a mobile robot. IEEE J Robot Autom RA-2, pp 14–3
go back to reference Brooks R, Meltzoff AN (2002) The importance of eyes: how infants interpret adult looking behavior. Dev Psychol 38:958–966CrossRefPubMed Brooks R, Meltzoff AN (2002) The importance of eyes: how infants interpret adult looking behavior. Dev Psychol 38:958–966CrossRefPubMed
go back to reference Brooks R, Meltzoff AN (2005) The development of gaze following and its relation to language. Dev Sci 8:535–543CrossRefPubMed Brooks R, Meltzoff AN (2005) The development of gaze following and its relation to language. Dev Sci 8:535–543CrossRefPubMed
go back to reference Buxton H (2003) Learning and understanding dynamic scene activity: a review. Image Vis Comput 21:125–136CrossRef Buxton H (2003) Learning and understanding dynamic scene activity: a review. Image Vis Comput 21:125–136CrossRef
go back to reference Byrne RW, Russon AE (1998) Learning by imitation: a hierarchical approach. Behav Brain Sci 21(5):667–684PubMed Byrne RW, Russon AE (1998) Learning by imitation: a hierarchical approach. Behav Brain Sci 21(5):667–684PubMed
go back to reference Cohen PR, Levesque HJ (1990) Intention is choice with commitment. Artif Intell 42:213–261CrossRef Cohen PR, Levesque HJ (1990) Intention is choice with commitment. Artif Intell 42:213–261CrossRef
go back to reference Csibra G, Gergely G (1998) The teleological origins of mentalistic action explanations: a developmental hypothesis. Dev Sci 1:255–259CrossRef Csibra G, Gergely G (1998) The teleological origins of mentalistic action explanations: a developmental hypothesis. Dev Sci 1:255–259CrossRef
go back to reference Csibra G, Gergely G (2007) ‘Obsessed with goals– functions and mechanisms of teleological interpretation of actions in humans. Acta Psychologica 124:60–78CrossRefPubMed Csibra G, Gergely G (2007) ‘Obsessed with goals– functions and mechanisms of teleological interpretation of actions in humans. Acta Psychologica 124:60–78CrossRefPubMed
go back to reference Dearden A, Demiris Y (2005) Learning forward models for robots. In: Proceedings of the international joint conference on artificial intelligence (IJCAI), Edinburgh, pp 1440–445 Dearden A, Demiris Y (2005) Learning forward models for robots. In: Proceedings of the international joint conference on artificial intelligence (IJCAI), Edinburgh, pp 1440–445
go back to reference Demiris Y, Hayes G (2002) Imitation as a dual-route process featuring predictive and learning components: a biologically plausible computational model. In: Dautenhahn K, Nehaniv CL (eds) Imitation in animals and artifacts. MIT Press, Cambridge, pp 327–361 Demiris Y, Hayes G (2002) Imitation as a dual-route process featuring predictive and learning components: a biologically plausible computational model. In: Dautenhahn K, Nehaniv CL (eds) Imitation in animals and artifacts. MIT Press, Cambridge, pp 327–361
go back to reference Demiris Y, Johnson M (2003) Distributed, predictive perception of actions: a biologically inspired robotics architecture for imitation and learning. Connect Sci 15:231–243CrossRef Demiris Y, Johnson M (2003) Distributed, predictive perception of actions: a biologically inspired robotics architecture for imitation and learning. Connect Sci 15:231–243CrossRef
go back to reference Demiris Y, Khadhouri B (2006) Hierarchical attentive multiple models for execution and recognition of actions. Rob Auton Syst 54:361–369CrossRef Demiris Y, Khadhouri B (2006) Hierarchical attentive multiple models for execution and recognition of actions. Rob Auton Syst 54:361–369CrossRef
go back to reference Demiris Y, Simmons G (2006) Perceiving the unusual: temporal properties of hierarchical motor representations for action perception. Neural Netw 19:272–284CrossRefPubMed Demiris Y, Simmons G (2006) Perceiving the unusual: temporal properties of hierarchical motor representations for action perception. Neural Netw 19:272–284CrossRefPubMed
go back to reference Devaney M, Ram A (1998) Needles in a haystack: plan recognition in large spatial domains involving multiple agents. In: Proceedings of the 15th national conference on artificial intelligence, AAAI-98, pp 942–47 Devaney M, Ram A (1998) Needles in a haystack: plan recognition in large spatial domains involving multiple agents. In: Proceedings of the 15th national conference on artificial intelligence, AAAI-98, pp 942–47
go back to reference Gallese V, Fadiga L, Fogassi L, Rizzolatti G (1996) Action recognition in the premotor cortex. Brain 119:593–609CrossRefPubMed Gallese V, Fadiga L, Fogassi L, Rizzolatti G (1996) Action recognition in the premotor cortex. Brain 119:593–609CrossRefPubMed
go back to reference Gleissner B, Meltzoff AN, Bekkering H (2000) Children’s coding of human action: cognitive factors influencing imitation in 3-year-olds. Dev Sci 3:405–414CrossRef Gleissner B, Meltzoff AN, Bekkering H (2000) Children’s coding of human action: cognitive factors influencing imitation in 3-year-olds. Dev Sci 3:405–414CrossRef
go back to reference Grosz BJ, Hunsberger L (2006) The dynamics of intention in collaborative activity. Cogn Syst Res 7:259–272CrossRef Grosz BJ, Hunsberger L (2006) The dynamics of intention in collaborative activity. Cogn Syst Res 7:259–272CrossRef
go back to reference Hamilton A, Grafton ST (2007) The motor hierarchy: from kinematics to goals and intentions. In: Haggard P, Rossetti Y, Kawato M (eds) Sensorimotor foundations of higher cognition, attention and performance XXII, chap 18 (in press) Hamilton A, Grafton ST (2007) The motor hierarchy: from kinematics to goals and intentions. In: Haggard P, Rossetti Y, Kawato M (eds) Sensorimotor foundations of higher cognition, attention and performance XXII, chap 18 (in press)
go back to reference Hesslow G (2002) Conscious thought as simulation of behaviour and perception. Trends Cogn Sci 6(6):242–247CrossRefPubMed Hesslow G (2002) Conscious thought as simulation of behaviour and perception. Trends Cogn Sci 6(6):242–247CrossRefPubMed
go back to reference Hommel B, Musseler J, Aschersleben G, Prinz W (2001) The theory of event coding (TEC): a framework for perception and action planning. Behav Brain Sci 24:849–937PubMedCrossRef Hommel B, Musseler J, Aschersleben G, Prinz W (2001) The theory of event coding (TEC): a framework for perception and action planning. Behav Brain Sci 24:849–937PubMedCrossRef
go back to reference Isham V (1981) An introduction to spatial point processes and markov random fields. Int Stat Rev 49:21–43CrossRef Isham V (1981) An introduction to spatial point processes and markov random fields. Int Stat Rev 49:21–43CrossRef
go back to reference Jackson PL, Meltzoff AN, Decety J (2006) Neural circuits involved in imitation and perspective-taking. Neuroimage 31:429–439CrossRefPubMed Jackson PL, Meltzoff AN, Decety J (2006) Neural circuits involved in imitation and perspective-taking. Neuroimage 31:429–439CrossRefPubMed
go back to reference Jain AK, Zhong Y, Dubuisson-Jolly M-P (1998) Deformable template models: a review. Signal Processing 71:109–129CrossRef Jain AK, Zhong Y, Dubuisson-Jolly M-P (1998) Deformable template models: a review. Signal Processing 71:109–129CrossRef
go back to reference Jansen B, Belpaeme T (2006) A computational model of intention reading in imitation. Rob Auton Syst 54(5):394–402CrossRef Jansen B, Belpaeme T (2006) A computational model of intention reading in imitation. Rob Auton Syst 54(5):394–402CrossRef
go back to reference Johnson MR, Demiris Y (2005) Perceptual perspective taking and action recognition. Int J Adv Rob Syst 2:301–308 Johnson MR, Demiris Y (2005) Perceptual perspective taking and action recognition. Int J Adv Rob Syst 2:301–308
go back to reference Kanno T, Nakata K, Furuta K (2003) A method for team intention inference. Int J Hum Comput Stud 58:393–413CrossRef Kanno T, Nakata K, Furuta K (2003) A method for team intention inference. Int J Hum Comput Stud 58:393–413CrossRef
go back to reference Kott A, McEneaney WM (eds) (2006) Adversarial reasoning: computational approaches to reading the opponent’s mind. Chapman & Hall/CRC, London Kott A, McEneaney WM (eds) (2006) Adversarial reasoning: computational approaches to reading the opponent’s mind. Chapman & Hall/CRC, London
go back to reference Liberman AM, Cooper FS, Shankweiler DP, Studdert-Kennedy M (1967) Perception of the speech code. Psychol Rev 74:431–361CrossRefPubMed Liberman AM, Cooper FS, Shankweiler DP, Studdert-Kennedy M (1967) Perception of the speech code. Psychol Rev 74:431–361CrossRefPubMed
go back to reference Meltzoff AN (1995) Understanding the intentions of others: re-enactment of intended acts by 18-month-old children. Dev Psychol 31:838–850CrossRef Meltzoff AN (1995) Understanding the intentions of others: re-enactment of intended acts by 18-month-old children. Dev Psychol 31:838–850CrossRef
go back to reference Meltzoff AN (2005) Imitation and other minds: the “Like Me–hypothesis. In: Hurley S, Chater N (eds) Perspectives on imitation: from neuroscience to social science. MIT Press, Cambridge, vol 2, pp 55–7 Meltzoff AN (2005) Imitation and other minds: the “Like Me–hypothesis. In: Hurley S, Chater N (eds) Perspectives on imitation: from neuroscience to social science. MIT Press, Cambridge, vol 2, pp 55–7
go back to reference Meltzoff AN (2007b) The ‘like me–framework for recognizing and becoming an intentional agent. Acta Psychologica 124:26–43CrossRefPubMed Meltzoff AN (2007b) The ‘like me–framework for recognizing and becoming an intentional agent. Acta Psychologica 124:26–43CrossRefPubMed
go back to reference Meltzoff AN, Brooks R (2004) Developmental changes in social cognition with an eye towards gaze following. In: Carpenter M, Tomasello M (eds) Action-based measures of infants–understanding of others–intentions and attention. Symposium conducted at the Biennial meeting of the International Conference on Infant Studies, Chicago Meltzoff AN, Brooks R (2004) Developmental changes in social cognition with an eye towards gaze following. In: Carpenter M, Tomasello M (eds) Action-based measures of infants–understanding of others–intentions and attention. Symposium conducted at the Biennial meeting of the International Conference on Infant Studies, Chicago
go back to reference Miall RC, Wolpert DM (1996) Forward models for physiological motor control. Neural Netw 9:1265–1279CrossRefPubMed Miall RC, Wolpert DM (1996) Forward models for physiological motor control. Neural Netw 9:1265–1279CrossRefPubMed
go back to reference Moeslund TB, Granum E (2000) A survey of computer vision-based human motion capture. Comput Vis Image Underst 81(3):231–268CrossRef Moeslund TB, Granum E (2000) A survey of computer vision-based human motion capture. Comput Vis Image Underst 81(3):231–268CrossRef
go back to reference Moeslund TB, Hilton A, Kruger V (2006) A survey of advances in vision-based human motion capture and analysis. Comput Vis Image Underst 104:90–126CrossRef Moeslund TB, Hilton A, Kruger V (2006) A survey of advances in vision-based human motion capture and analysis. Comput Vis Image Underst 104:90–126CrossRef
go back to reference Narendra KS, Balakrishnan J (1997) Adaptive control using multiple models. IEEE Trans Autom Control 42(2):171–187CrossRef Narendra KS, Balakrishnan J (1997) Adaptive control using multiple models. IEEE Trans Autom Control 42(2):171–187CrossRef
go back to reference Pezzulo G, Calvi G (2006) A schema based model of the praying mantis. From animals to animats. In: Proceedings of the 9th international conference on simulation of adaptive behaviour. Springer LNAI, vol 4095, pp 211–23 Pezzulo G, Calvi G (2006) A schema based model of the praying mantis. From animals to animats. In: Proceedings of the 9th international conference on simulation of adaptive behaviour. Springer LNAI, vol 4095, pp 211–23
go back to reference Roweis S, Ghahramani Z (1999) A unifying review of linear Gaussian models. Neural Comput 11(2):305–345CrossRefPubMed Roweis S, Ghahramani Z (1999) A unifying review of linear Gaussian models. Neural Comput 11(2):305–345CrossRefPubMed
go back to reference Schaal S, Ijspeert A, Billard A (2003) Computational approaches to motor learning by imitation. Philos Trans R Soc Lond B Biol Sci 358:537–547CrossRefPubMed Schaal S, Ijspeert A, Billard A (2003) Computational approaches to motor learning by imitation. Philos Trans R Soc Lond B Biol Sci 358:537–547CrossRefPubMed
go back to reference Scott SK, Johnsrude IS (2003) The neuroanatomical and functional organisation of speech perception. Trends Neurosci 26(2):100–107CrossRefPubMed Scott SK, Johnsrude IS (2003) The neuroanatomical and functional organisation of speech perception. Trends Neurosci 26(2):100–107CrossRefPubMed
go back to reference Sonenberg L, Tidhar G (1999) Observations on team-oriented mental state recognition. In: Proceedings of the IJCAI-1999 workshop on team modelling and plan recognition Sonenberg L, Tidhar G (1999) Observations on team-oriented mental state recognition. In: Proceedings of the IJCAI-1999 workshop on team modelling and plan recognition
go back to reference Sukthankar G, Sycara K (2006) Simultaneous team assignment and behavior recognition from spatio-temporal agent traces. In: Proceedings of 21st national conference on artificial intelligence (AAAI-06) Sukthankar G, Sycara K (2006) Simultaneous team assignment and behavior recognition from spatio-temporal agent traces. In: Proceedings of 21st national conference on artificial intelligence (AAAI-06)
go back to reference Tambe M (1996) Tracking dynamic team activity. In: Proceedings of the national conference on artificial intelligence (AAAI) Tambe M (1996) Tracking dynamic team activity. In: Proceedings of the national conference on artificial intelligence (AAAI)
go back to reference Tani J, Nolfi S (1999) Learning to perceive the world as articulated: an approach for hierarchical learning in sensory motor systems. Neural Netw 12:1131–1141CrossRefPubMed Tani J, Nolfi S (1999) Learning to perceive the world as articulated: an approach for hierarchical learning in sensory motor systems. Neural Netw 12:1131–1141CrossRefPubMed
go back to reference Tomasello M, Carpenter M, Call K, Behne T, Moll H (2005) Understanding and sharing intentions: the origins of cultural cognition. Behav Brain Sci 28:675–735PubMed Tomasello M, Carpenter M, Call K, Behne T, Moll H (2005) Understanding and sharing intentions: the origins of cultural cognition. Behav Brain Sci 28:675–735PubMed
go back to reference Trafton J, Cassimatis N, Bugajska M, Brock D, Mintz F, Schultz A (2005) Enabling effective human–robot interaction using perspective taking in robots. IEEE Trans Syst Man Cybern A Syst Hum 35(4):460–470CrossRef Trafton J, Cassimatis N, Bugajska M, Brock D, Mintz F, Schultz A (2005) Enabling effective human–robot interaction using perspective taking in robots. IEEE Trans Syst Man Cybern A Syst Hum 35(4):460–470CrossRef
go back to reference Wohlschlager A, Gattis M, Bekkering H (2003) Action generation and action perception in imitation: an instance of the ideomotor principle. Philos Trans R Soc Lond B Biol Sci 358:501–515CrossRefPubMed Wohlschlager A, Gattis M, Bekkering H (2003) Action generation and action perception in imitation: an instance of the ideomotor principle. Philos Trans R Soc Lond B Biol Sci 358:501–515CrossRefPubMed
go back to reference Wolpert DM, Kawato M (1998) Multiple paired forward and inverse models for motor control. Neural Netw 11:1317–1329CrossRefPubMed Wolpert DM, Kawato M (1998) Multiple paired forward and inverse models for motor control. Neural Netw 11:1317–1329CrossRefPubMed
go back to reference Wolpert DM, Doya K, Kawato M (2003) A unifying computational framework for motor control and social interaction. Philos Trans R Soc Lond B Biol Sci 358:593–602CrossRefPubMed Wolpert DM, Doya K, Kawato M (2003) A unifying computational framework for motor control and social interaction. Philos Trans R Soc Lond B Biol Sci 358:593–602CrossRefPubMed
Metadata
Title
Prediction of intent in robotics and multi-agent systems
Author
Yiannis Demiris
Publication date
01-09-2007
Publisher
Springer-Verlag
Published in
Cognitive Processing / Issue 3/2007
Print ISSN: 1612-4782
Electronic ISSN: 1612-4790
DOI
https://doi.org/10.1007/s10339-007-0168-9

Other articles of this Issue 3/2007

Cognitive Processing 3/2007 Go to the issue