Skip to main content
Erschienen in: International Journal of Social Robotics 4/2013

01.11.2013

Effects of Eye Contact and Iconic Gestures on Message Retention in Human-Robot Interaction

verfasst von: Elisabeth T. van Dijk, Elena Torta, Raymond H. Cuijpers

Erschienen in: International Journal of Social Robotics | Ausgabe 4/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The effects of iconic gestures and eye contact on message retention in human-robot interaction were investigated in a series of experiments. A humanoid robot gave short verbal messages to participants, accompanied either by iconic gestures or no gestures while making eye contact with the participant or looking away. Results show that the use of iconic gestures aids retention of the verb to which the action-depicting gestures pertain. The various expected effects of eye contact were not supported by the data. Implications of these results for the design of interaction modalities between robots and people are discussed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
Participants were elderly people because the research conducted in this study is part of the KSERA project which aims at introducing socially-assistive robots in seniors homes (http://​www.​ksera.​ieis.​tue.​nl).
 
2
Translated from the original Dutch “De docent wenkte de lange leerling naar het bedompte kantoor”.
 
3
Synoniemen.net is an online Dutch dictionary which provides synonyms. URL: http://​synoniemen.​net/​.
 
Literatur
1.
Zurück zum Zitat Adams RB, Pauker K, Weisbuch M (2010) Looking the other way: the role of gaze direction in the cross-race memory effect. J Exp Soc Psychol 46(2):478–481 CrossRef Adams RB, Pauker K, Weisbuch M (2010) Looking the other way: the role of gaze direction in the cross-race memory effect. J Exp Soc Psychol 46(2):478–481 CrossRef
2.
Zurück zum Zitat Aldebaran Robotics (2012) NAO Datasheet H25—Corporate—Aldebaran Robotics|Discover NAO Aldebaran Robotics (2012) NAO Datasheet H25—Corporate—Aldebaran Robotics|Discover NAO
3.
Zurück zum Zitat Aldebaran Robotics (2012) ALFaceTracker API—NAO Software 1.12.5 documentation Aldebaran Robotics (2012) ALFaceTracker API—NAO Software 1.12.5 documentation
5.
Zurück zum Zitat Bartneck C, Kuliç D, Croft E, Zoghbi S (2009) Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int J Soc Robot 1(1):71–81 CrossRef Bartneck C, Kuliç D, Croft E, Zoghbi S (2009) Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int J Soc Robot 1(1):71–81 CrossRef
6.
Zurück zum Zitat Begg I (1971) Recognition memory for sentence meaning and wording. J Verbal Learn Verbal Behav 10(2):176–181 CrossRef Begg I (1971) Recognition memory for sentence meaning and wording. J Verbal Learn Verbal Behav 10(2):176–181 CrossRef
7.
Zurück zum Zitat Begg I, Paivio A (1969) Concreteness and imagery in sentence meaning. J Verbal Learn Verbal Behav 8(6):821–827 CrossRef Begg I, Paivio A (1969) Concreteness and imagery in sentence meaning. J Verbal Learn Verbal Behav 8(6):821–827 CrossRef
8.
Zurück zum Zitat Chovil N (1991) Discourse-oriented facial displays in conversation. Res Lang Soc Interact 25(1–4):163–194 CrossRef Chovil N (1991) Discourse-oriented facial displays in conversation. Res Lang Soc Interact 25(1–4):163–194 CrossRef
9.
Zurück zum Zitat Cohen J (1988) Statistical power analysis for the behavioral sciences, 2nd edn. Routledge, London MATH Cohen J (1988) Statistical power analysis for the behavioral sciences, 2nd edn. Routledge, London MATH
10.
Zurück zum Zitat Fullwood C, Doherty-Sneddon G (2006) Effect of gazing at the camera during a video link on recall. Appl Ergon 37(2):167–175 CrossRef Fullwood C, Doherty-Sneddon G (2006) Effect of gazing at the camera during a video link on recall. Appl Ergon 37(2):167–175 CrossRef
11.
Zurück zum Zitat Holmes VM, Langford J (1976) Comprehension and recall of abstract and concrete sentences. J Verbal Learn Verbal Behav 15(5):559–566 CrossRef Holmes VM, Langford J (1976) Comprehension and recall of abstract and concrete sentences. J Verbal Learn Verbal Behav 15(5):559–566 CrossRef
12.
Zurück zum Zitat Carlton TJ, Abrahamson AA (1977) Recognition memory for active and passive sentences. J Psycholinguist Res 6(1):37–47 CrossRef Carlton TJ, Abrahamson AA (1977) Recognition memory for active and passive sentences. J Psycholinguist Res 6(1):37–47 CrossRef
13.
Zurück zum Zitat Jansen E (2011) The effect of natural head and iconic hand gestures on message recall in human-robot interaction. HTI Research Project Thesis Jansen E (2011) The effect of natural head and iconic hand gestures on message recall in human-robot interaction. HTI Research Project Thesis
14.
Zurück zum Zitat Murdock BB Jr. (1960) The distinctiveness of stimuli. Psychol Rev 67:16–31 CrossRef Murdock BB Jr. (1960) The distinctiveness of stimuli. Psychol Rev 67:16–31 CrossRef
15.
Zurück zum Zitat Kanda T, Ishiguro H, Ono T, Imai M, Nakatsu R (2002) Development and evaluation of an interactive humanoid robot “robovie”. In: Proceedings of the IEEE international conference on robotics and automation, ICRA’02, vol 2, pp 1848–1855 Kanda T, Ishiguro H, Ono T, Imai M, Nakatsu R (2002) Development and evaluation of an interactive humanoid robot “robovie”. In: Proceedings of the IEEE international conference on robotics and automation, ICRA’02, vol 2, pp 1848–1855
16.
Zurück zum Zitat Kelly SD, Barr DJ, Church RB, Lynch K (1999) Offering a hand to pragmatic understanding: the role of speech and gesture in comprehension and memory. J Mem Lang 40(4):577–592 CrossRef Kelly SD, Barr DJ, Church RB, Lynch K (1999) Offering a hand to pragmatic understanding: the role of speech and gesture in comprehension and memory. J Mem Lang 40(4):577–592 CrossRef
17.
Zurück zum Zitat Kita S, Ozyurek A (2003) What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. J Mem Lang 48(1):16–32 CrossRef Kita S, Ozyurek A (2003) What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. J Mem Lang 48(1):16–32 CrossRef
18.
Zurück zum Zitat Kleinke CL (1986) Gaze and eye contact: a research review. Psychol Bull 100(1):78 CrossRef Kleinke CL (1986) Gaze and eye contact: a research review. Psychol Bull 100(1):78 CrossRef
19.
Zurück zum Zitat Krämer NC, Bente G (2010) Personalizing e-learning. The social effects of pedagogical agents. Educ Psychol Rev 22(1):71–87 CrossRef Krämer NC, Bente G (2010) Personalizing e-learning. The social effects of pedagogical agents. Educ Psychol Rev 22(1):71–87 CrossRef
20.
Zurück zum Zitat Martin E, Roberts KH (1966) Grammatical factors in sentence retention. J Verbal Learn Verbal Behav 5(3):211–218 CrossRef Martin E, Roberts KH (1966) Grammatical factors in sentence retention. J Verbal Learn Verbal Behav 5(3):211–218 CrossRef
21.
Zurück zum Zitat Martin E, Roberts KH, Collins AM (1968) Short-term memory for sentences. J Verbal Learn Verbal Behav 7:560–566 CrossRef Martin E, Roberts KH, Collins AM (1968) Short-term memory for sentences. J Verbal Learn Verbal Behav 7:560–566 CrossRef
22.
Zurück zum Zitat Moreno R, Mayer RE, Spires HA, Lester JC (2001) The case for social agency in computer-based teaching: do students learn more deeply when they interact with animated pedagogical agents? Cogn Instr 19(2):177–213 CrossRef Moreno R, Mayer RE, Spires HA, Lester JC (2001) The case for social agency in computer-based teaching: do students learn more deeply when they interact with animated pedagogical agents? Cogn Instr 19(2):177–213 CrossRef
23.
Zurück zum Zitat Mutlu B, Forlizzi J, Hodgins J (2006) A storytelling robot: modeling and evaluation of human-like gaze behavior. In: 6th IEEE-RAS international conference on humanoid robots, pp 518–523 Mutlu B, Forlizzi J, Hodgins J (2006) A storytelling robot: modeling and evaluation of human-like gaze behavior. In: 6th IEEE-RAS international conference on humanoid robots, pp 518–523
24.
Zurück zum Zitat Mutlu B, Shiwa T, Kanda T, Ishiguro H, Hagita N (2009) Footing in human-robot conversations: how robots might shape participant roles using gaze cues. In: Proceedings of the 4th ACM/IEEE international conference on human robot interaction, HRI’09, pp 61–68 CrossRef Mutlu B, Shiwa T, Kanda T, Ishiguro H, Hagita N (2009) Footing in human-robot conversations: how robots might shape participant roles using gaze cues. In: Proceedings of the 4th ACM/IEEE international conference on human robot interaction, HRI’09, pp 61–68 CrossRef
25.
Zurück zum Zitat Neath I (1993) Distinctiveness and serial position effects in recognition. Mem Cogn 21:689–698 CrossRef Neath I (1993) Distinctiveness and serial position effects in recognition. Mem Cogn 21:689–698 CrossRef
26.
Zurück zum Zitat Neath I, Brown GDA (2006) SIMPLE: further applications of a local distinctiveness model of memory. Psychol Learn Motiv 46:201–243 CrossRef Neath I, Brown GDA (2006) SIMPLE: further applications of a local distinctiveness model of memory. Psychol Learn Motiv 46:201–243 CrossRef
27.
Zurück zum Zitat Perfetti CA (1969) Lexical density and phrase structure depth as variables in sentence retention. J Verbal Learn Verbal Behav 8(6):719–724 CrossRef Perfetti CA (1969) Lexical density and phrase structure depth as variables in sentence retention. J Verbal Learn Verbal Behav 8(6):719–724 CrossRef
28.
Zurück zum Zitat Riek LD, Rabinowitch T-C, Bremner P, Pipe AG, Fraser M, Robinson P (2010) Cooperative gestures: effective signaling for humanoid robots. In: Proceedings of the 5th ACM/IEEE international conference on human-robot interaction, HRI’10, pp 61–68 Riek LD, Rabinowitch T-C, Bremner P, Pipe AG, Fraser M, Robinson P (2010) Cooperative gestures: effective signaling for humanoid robots. In: Proceedings of the 5th ACM/IEEE international conference on human-robot interaction, HRI’10, pp 61–68
29.
Zurück zum Zitat Patricia R (1996) The effects of vocal variation on listener recall. J Psycholinguist Res 25:431–441 CrossRef Patricia R (1996) The effects of vocal variation on listener recall. J Psycholinguist Res 25:431–441 CrossRef
30.
Zurück zum Zitat Salem M, Rohlfing K, Kopp S, Joublin F (2011) A friendly gesture: investigating the effect of multimodal robot behavior in human-robot interaction. In: IEEE, RO-MAN, pp 247–252 Salem M, Rohlfing K, Kopp S, Joublin F (2011) A friendly gesture: investigating the effect of multimodal robot behavior in human-robot interaction. In: IEEE, RO-MAN, pp 247–252
31.
Zurück zum Zitat Sidner CL, Kidd CD, Lee C, Lesh N (2004) Where to look: a study of human-robot engagement. In: Proceedings of the 9th international conference on intelligent user interfaces, IUI’04, pp 78–84 Sidner CL, Kidd CD, Lee C, Lesh N (2004) Where to look: a study of human-robot engagement. In: Proceedings of the 9th international conference on intelligent user interfaces, IUI’04, pp 78–84
32.
Zurück zum Zitat Sidner CL, Lee C, Kidd CD, Lesh N (2005) Explorations in engagement for humans and robots. Artif Intell 166(1–2):140–164 CrossRef Sidner CL, Lee C, Kidd CD, Lesh N (2005) Explorations in engagement for humans and robots. Artif Intell 166(1–2):140–164 CrossRef
33.
Zurück zum Zitat Singer MA, Goldin-Meadow S (2005) Children learn when their teacher’s gestures and speech differ. Psychol Sci 16(2):85–89 CrossRef Singer MA, Goldin-Meadow S (2005) Children learn when their teacher’s gestures and speech differ. Psychol Sci 16(2):85–89 CrossRef
34.
Zurück zum Zitat Staudte M, Crocker MW (2011) Investigating joint attention mechanisms through spoken human–robot interaction. Cognition 120(2):268–291 CrossRef Staudte M, Crocker MW (2011) Investigating joint attention mechanisms through spoken human–robot interaction. Cognition 120(2):268–291 CrossRef
35.
Zurück zum Zitat Valenzeno L, Alibali MW, Klatzky R (2003) Teachers’ gestures facilitate students’ learning: a lesson in symmetry. Contemp Educ Psychol 28(2):187–204 CrossRef Valenzeno L, Alibali MW, Klatzky R (2003) Teachers’ gestures facilitate students’ learning: a lesson in symmetry. Contemp Educ Psychol 28(2):187–204 CrossRef
36.
Zurück zum Zitat Zimmerman BJ, Pons MM (1986) Development of a structured interview for assessing student use of self-regulated learning strategies. Am Educ Res J 23(4):614–628 CrossRef Zimmerman BJ, Pons MM (1986) Development of a structured interview for assessing student use of self-regulated learning strategies. Am Educ Res J 23(4):614–628 CrossRef
Metadaten
Titel
Effects of Eye Contact and Iconic Gestures on Message Retention in Human-Robot Interaction
verfasst von
Elisabeth T. van Dijk
Elena Torta
Raymond H. Cuijpers
Publikationsdatum
01.11.2013
Verlag
Springer Netherlands
Erschienen in
International Journal of Social Robotics / Ausgabe 4/2013
Print ISSN: 1875-4791
Elektronische ISSN: 1875-4805
DOI
https://doi.org/10.1007/s12369-013-0214-y

Weitere Artikel der Ausgabe 4/2013

International Journal of Social Robotics 4/2013 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.