Skip to main content
Top
Published in: International Journal of Social Robotics 1/2017

17-03-2016

A Model for Generating Socially-Appropriate Deictic Behaviors Towards People

Authors: Phoebe Liu, Dylan F. Glas, Takayuki Kanda, Hiroshi Ishiguro, Norihiro Hagita

Published in: International Journal of Social Robotics | Issue 1/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Pointing behaviors are essential in enabling social robots to communicate about a particular object, person, or space. Yet, pointing to a person can be considered rude in many cultures, and as robots collaborate with humans in increasingly diverse environments, they will need to effectively refer to people in a socially-appropriate way. We confirmed in an empirical study that although people would point precisely to an object to indicate where it is, they were reluctant to do so when pointing to another person. We propose a model for selecting utterances and pointing behaviors towards people in terms of a balance between understandability and social appropriateness. Calibrating our proposed model based on empirical human behavior, we developed a system able to autonomously select among six deictic behaviors and execute them on a humanoid robot. We evaluated the system in an experiment in a shopping mall, and the results show that the robot’s deictic behavior was perceived by both the listener and the referent as more polite, more natural, and better overall when using our model, as compared with a model considering understandability alone.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Footnotes
1
This paper is an extended version of our conference paper [1] with integrated technical details, additional discussions, expanded explanations, and supplementary analysis of the experiment.
 
2
 
Literature
1.
go back to reference Liu P, Glas DF, Kanda T, Ishiguro H, Hagita N (2013) It’s not polite to point: generating socially-appropriate deictic behaviors towards people. In: 8th ACM/IEEE international conference on human–robot interaction, pp 267–274 Liu P, Glas DF, Kanda T, Ishiguro H, Hagita N (2013) It’s not polite to point: generating socially-appropriate deictic behaviors towards people. In: 8th ACM/IEEE international conference on human–robot interaction, pp 267–274
2.
go back to reference Bennewitz M, Faber F, Joho D, Schreiber M, Behnke S (2005) Towards a humanoid museum guide robot that interacts with multiple persons. In: 2005 5th IEEE-RAS international conference on humanoid robots, pp 418–423 Bennewitz M, Faber F, Joho D, Schreiber M, Behnke S (2005) Towards a humanoid museum guide robot that interacts with multiple persons. In: 2005 5th IEEE-RAS international conference on humanoid robots, pp 418–423
3.
go back to reference Shiomi M, Kanda T, Ishiguro H, Hagita N (2007) Interactive humanoid robots for a science museum. IEEE Intell Syst 22:25–32CrossRef Shiomi M, Kanda T, Ishiguro H, Hagita N (2007) Interactive humanoid robots for a science museum. IEEE Intell Syst 22:25–32CrossRef
4.
go back to reference Nieuwenhuisen M, Behnke S (2013) Human-like interaction skills for the mobile communication robot robotinho. Int J Soc Robot 5:549–561CrossRef Nieuwenhuisen M, Behnke S (2013) Human-like interaction skills for the mobile communication robot robotinho. Int J Soc Robot 5:549–561CrossRef
5.
go back to reference Kanda T, Sato R, Saiwaki N, Ishiguro H (2007) A two-month field trial in an elementary school for long-term human–robot interaction. IEEE Trans Robot 23:962–971CrossRef Kanda T, Sato R, Saiwaki N, Ishiguro H (2007) A two-month field trial in an elementary school for long-term human–robot interaction. IEEE Trans Robot 23:962–971CrossRef
6.
go back to reference Berns K, Mehdi SA (2010) Use of an autonomous mobile robot for elderly care. In: Advanced technologies for enhancing quality of life (AT-EQUAL), pp 121–126 Berns K, Mehdi SA (2010) Use of an autonomous mobile robot for elderly care. In: Advanced technologies for enhancing quality of life (AT-EQUAL), pp 121–126
7.
go back to reference Sabelli AM, Kanda T, Hagita N (2011) A conversational robot in an elderly care center: an ethnographic study. In: 2011 6th ACM/IEEE international conference on Human–robot interaction (HRI), pp 37–44 Sabelli AM, Kanda T, Hagita N (2011) A conversational robot in an elderly care center: an ethnographic study. In: 2011 6th ACM/IEEE international conference on Human–robot interaction (HRI), pp 37–44
8.
go back to reference Semwal VB, Katiyar SA, Chakraborty R, Nandi G (2015) Biologically-inspired push recovery capable bipedal locomotion modeling through hybrid automata. Robot Auton Syst 70:181–190CrossRef Semwal VB, Katiyar SA, Chakraborty R, Nandi G (2015) Biologically-inspired push recovery capable bipedal locomotion modeling through hybrid automata. Robot Auton Syst 70:181–190CrossRef
9.
go back to reference Sugiyama O, Kanda T, Imai M, Ishiguro H, Hagita N, Anzai Y (2006) Humanlike conversation with gestures and verbal cues based on a three-layer attention-drawing model. Connect Sci 18:379–402CrossRef Sugiyama O, Kanda T, Imai M, Ishiguro H, Hagita N, Anzai Y (2006) Humanlike conversation with gestures and verbal cues based on a three-layer attention-drawing model. Connect Sci 18:379–402CrossRef
10.
go back to reference Schmidt J, Hofemann N, Haasch A, Fritsch J, Sagerer G (2008) Interacting with a mobile robot: evaluating gestural object references. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 3804–3809 Schmidt J, Hofemann N, Haasch A, Fritsch J, Sagerer G (2008) Interacting with a mobile robot: evaluating gestural object references. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 3804–3809
11.
go back to reference Sakurai S, Sato E, Yamaguchi T (2007) Recognizing pointing behavior using image processing for human–robot interaction. In: 2007 IEEE/ASME international conference on advanced intelligent mechatronics, pp 1–6 Sakurai S, Sato E, Yamaguchi T (2007) Recognizing pointing behavior using image processing for human–robot interaction. In: 2007 IEEE/ASME international conference on advanced intelligent mechatronics, pp 1–6
12.
go back to reference Holladay RM, Dragan AD, Srinivasa SS (2014) Legible robot pointing. In: 2014 RO-MAN: the 23rd IEEE international symposium on robot and human interactive communication, pp 217–223 Holladay RM, Dragan AD, Srinivasa SS (2014) Legible robot pointing. In: 2014 RO-MAN: the 23rd IEEE international symposium on robot and human interactive communication, pp 217–223
13.
go back to reference Salem M, Kopp S, Wachsmuth I, Rohlfing K, Joublin F (2012) Generation and evaluation of communicative robot gesture. Int J Soc Robot 4:201–217CrossRef Salem M, Kopp S, Wachsmuth I, Rohlfing K, Joublin F (2012) Generation and evaluation of communicative robot gesture. Int J Soc Robot 4:201–217CrossRef
14.
go back to reference Spexard T, Li S, Wrede B, Fritsch J, Sagerer G, Booij O et al (2006) BIRON, where are you? Enabling a robot to learn new places in a real home environment by integrating spoken dialog and visual localization. In: 2006 IEEE/RSJ international conference on intelligent robots and systems, pp 934–940 Spexard T, Li S, Wrede B, Fritsch J, Sagerer G, Booij O et al (2006) BIRON, where are you? Enabling a robot to learn new places in a real home environment by integrating spoken dialog and visual localization. In: 2006 IEEE/RSJ international conference on intelligent robots and systems, pp 934–940
15.
go back to reference Hato Y, Satake S, Kanda T, Imai M, Hagita N (2010) Pointing to space: modeling of deictic interaction referring to regions. In: 2010 5th ACM/IEEE international conference on human–robot interaction (HRI), pp 301–308 Hato Y, Satake S, Kanda T, Imai M, Hagita N (2010) Pointing to space: modeling of deictic interaction referring to regions. In: 2010 5th ACM/IEEE international conference on human–robot interaction (HRI), pp 301–308
16.
go back to reference Kendon A (2004) Gesture: visible action as utterance. Cambridge University Press, CambridgeCrossRef Kendon A (2004) Gesture: visible action as utterance. Cambridge University Press, CambridgeCrossRef
17.
go back to reference Van Der Sluis I, Krahmer E (2001) Generating referring expressions in a multimodal context an empirically oriented approach. Lang Comput 37:158–176 Van Der Sluis I, Krahmer E (2001) Generating referring expressions in a multimodal context an empirically oriented approach. Lang Comput 37:158–176
18.
go back to reference Haywood SL, Pickering MJ, Branigan HP (2005) Do speakers avoid ambiguities during dialogue? Psychol Sci 16:362–366CrossRef Haywood SL, Pickering MJ, Branigan HP (2005) Do speakers avoid ambiguities during dialogue? Psychol Sci 16:362–366CrossRef
19.
go back to reference Paraboni I, van Deemter K, Masthoff J (2007) Generating referring expressions: making referents easy to identify. Comput Linguist 33:229–254CrossRef Paraboni I, van Deemter K, Masthoff J (2007) Generating referring expressions: making referents easy to identify. Comput Linguist 33:229–254CrossRef
20.
go back to reference Vaish A, Kumari P (2014) A comparative study on machine learning algorithms in emotion state recognition using ECG. In: Proceedings of the second international conference on soft computing for problem solving (SocProS 2012), 28–30 December 2012, pp 1467–1476 Vaish A, Kumari P (2014) A comparative study on machine learning algorithms in emotion state recognition using ECG. In: Proceedings of the second international conference on soft computing for problem solving (SocProS 2012), 28–30 December 2012, pp 1467–1476
21.
go back to reference Kumari P, Vaish A (2015) Information-theoretic measures on intrinsic mode function for the individual identification using EEG sensors. IEEE Sens J 15:4950–4960 Kumari P, Vaish A (2015) Information-theoretic measures on intrinsic mode function for the individual identification using EEG sensors. IEEE Sens J 15:4950–4960
22.
go back to reference Bangerter A., Chevalley, E (2007) Pointing and describing in referential communication: When are pointing gestures used to communicate? In: MOG 2007 workshop on multimodal output generation, p 17 Bangerter A., Chevalley, E (2007) Pointing and describing in referential communication: When are pointing gestures used to communicate? In: MOG 2007 workshop on multimodal output generation, p 17
23.
go back to reference Brooks AG, Breazeal C (2006) Working with robots and objects: Revisiting deictic reference for achieving spatial common ground. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on human–robot interaction, pp 297–304 Brooks AG, Breazeal C (2006) Working with robots and objects: Revisiting deictic reference for achieving spatial common ground. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on human–robot interaction, pp 297–304
24.
go back to reference Schultz AC, Trafton JG (2005) Towards collaboration with robots in shared space: spatial perspective and frames of reference. Interactions 12:22–24CrossRef Schultz AC, Trafton JG (2005) Towards collaboration with robots in shared space: spatial perspective and frames of reference. Interactions 12:22–24CrossRef
25.
go back to reference Glas DF, Miyashita T, Ishiguro H, Hagita N (2012) Human–robot interaction in social robotics. In: Kanda T, Ishiguro H (eds) Laser-based tracking of human position and orientation using parametric shape modeling. CRC Press, Boca Raton, pp 158–236 Glas DF, Miyashita T, Ishiguro H, Hagita N (2012) Human–robot interaction in social robotics. In: Kanda T, Ishiguro H (eds) Laser-based tracking of human position and orientation using parametric shape modeling. CRC Press, Boca Raton, pp 158–236
26.
go back to reference Burgoon JK, Buller DB, Hale JL, Turck MA (1984) Relational messages associated with nonverbal behaviors. Hum Commun Res 10:351–378CrossRef Burgoon JK, Buller DB, Hale JL, Turck MA (1984) Relational messages associated with nonverbal behaviors. Hum Commun Res 10:351–378CrossRef
27.
go back to reference Trout DL, Rosenfeld HM (1980) The effect of postural lean and body congruence on the judgment of psychotherapeutic rapport. J Nonverbal Behav 4:176–190CrossRef Trout DL, Rosenfeld HM (1980) The effect of postural lean and body congruence on the judgment of psychotherapeutic rapport. J Nonverbal Behav 4:176–190CrossRef
28.
go back to reference Edelmann RJ (1982) The effect of embarrassed reactions upon others. Aust J Psychol 34:359–367CrossRef Edelmann RJ (1982) The effect of embarrassed reactions upon others. Aust J Psychol 34:359–367CrossRef
29.
go back to reference Wolfe JM (1994) Guided search 2.0 A revised model of visual search. Psychon Bull Rev 1:202–238CrossRef Wolfe JM (1994) Guided search 2.0 A revised model of visual search. Psychon Bull Rev 1:202–238CrossRef
30.
go back to reference Sternberg S (1966) High-speed scanning in human memory. Science 153:652–654CrossRef Sternberg S (1966) High-speed scanning in human memory. Science 153:652–654CrossRef
31.
go back to reference Treisman AM, Gelade G (1980) A feature-integration theory of attention. Cogn Psychol 12:97–136CrossRef Treisman AM, Gelade G (1980) A feature-integration theory of attention. Cogn Psychol 12:97–136CrossRef
32.
go back to reference Kranstedt, A, Lücking A, Pfeiffer T, Rieser H, Wachsmuth I (2006) Deixis: how to determine demonstrated objects using a pointing cone. In: Gesture in human–computer interaction and simulation. Springer, Heidelberg, pp 300–311 Kranstedt, A, Lücking A, Pfeiffer T, Rieser H, Wachsmuth I (2006) Deixis: how to determine demonstrated objects using a pointing cone. In: Gesture in human–computer interaction and simulation. Springer, Heidelberg, pp 300–311
33.
go back to reference Kühnlein P, Stegmann J (2003) Empirical issues in deictic gesture: referring to objects in simple identification tasks. Report 2003/3, SFB, vol 360 Kühnlein P, Stegmann J (2003) Empirical issues in deictic gesture: referring to objects in simple identification tasks. Report 2003/3, SFB, vol 360
34.
go back to reference Wolfe JM, Horowitz TS, Kenner N, Hyle M, Vasan N (2004) How fast can you change your mind? The speed of top-down guidance in visual search. Vis Res 44:1411–1426CrossRef Wolfe JM, Horowitz TS, Kenner N, Hyle M, Vasan N (2004) How fast can you change your mind? The speed of top-down guidance in visual search. Vis Res 44:1411–1426CrossRef
35.
go back to reference Wang Q, Cavanagh P, Green M (1994) Familiarity and pop-out in visual search. Percept Psychophys 56:495–500CrossRef Wang Q, Cavanagh P, Green M (1994) Familiarity and pop-out in visual search. Percept Psychophys 56:495–500CrossRef
36.
go back to reference Glas DF, Miyashita T, Ishiguro H, Hagita N (2009) Laser-based tracking of human position and orientation using parametric shape modeling. Adv Robot 23:405–428CrossRef Glas DF, Miyashita T, Ishiguro H, Hagita N (2009) Laser-based tracking of human position and orientation using parametric shape modeling. Adv Robot 23:405–428CrossRef
37.
go back to reference Müller C (2004) Forms and uses of the Palm Up Open Hand: a case of a gesture family. In: Posner R, Müller C (eds) The semantics and pragmatics of everyday gestures. Weidler Buchverlag, Berlin, pp 234–256 Müller C (2004) Forms and uses of the Palm Up Open Hand: a case of a gesture family. In: Posner R, Müller C (eds) The semantics and pragmatics of everyday gestures. Weidler Buchverlag, Berlin, pp 234–256
38.
go back to reference Ishii S (1973) Characteristics of Japanese nonverbal communicative behavior. J Commun Assoc Pacific 2:43–60 Ishii S (1973) Characteristics of Japanese nonverbal communicative behavior. J Commun Assoc Pacific 2:43–60
39.
go back to reference Richie D (1998) A lateral view: essays on culture and style in contemporary Japan. Stone Bridge Press, Berkeley Richie D (1998) A lateral view: essays on culture and style in contemporary Japan. Stone Bridge Press, Berkeley
Metadata
Title
A Model for Generating Socially-Appropriate Deictic Behaviors Towards People
Authors
Phoebe Liu
Dylan F. Glas
Takayuki Kanda
Hiroshi Ishiguro
Norihiro Hagita
Publication date
17-03-2016
Publisher
Springer Netherlands
Published in
International Journal of Social Robotics / Issue 1/2017
Print ISSN: 1875-4791
Electronic ISSN: 1875-4805
DOI
https://doi.org/10.1007/s12369-016-0348-9

Other articles of this Issue 1/2017

International Journal of Social Robotics 1/2017 Go to the issue

Editorial

Editorial

Premium Partners