Skip to main content
Erschienen in: International Journal of Social Robotics 5/2015

01.11.2015

Emotion-Age-Gender-Nationality Based Intention Understanding in Human–Robot Interaction Using Two-Layer Fuzzy Support Vector Regression

verfasst von: Lue-Feng Chen, Zhen-Tao Liu, Min Wu, Min Ding, Fang-Yan Dong, Kaoru Hirota

Erschienen in: International Journal of Social Robotics | Ausgabe 5/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

An intention understanding model based on two-layer fuzzy support vector regression is proposed in human–robot interaction, where fuzzy c-means clustering is used to classify the input data, and intention understanding is mainly obtained by emotion, with identification information such as age, gender, and nationality. It aims to realize the transparent communication by understanding customers’ order intentions at a bar, in such a way that the social relationship between bar staffs and customers becomes smooth. To demonstrate the aptness of intention understanding model, experiments are designed in term of relationship between emotion-age-gender-nationality and order intention. Results show that the proposal obtains an intention understanding accuracy of 70 %/72 %/80 % with clusters number \(C= \) 2/3/6 (according to different genders/ages/nationalities), which is 23 %/26 %/33 % and 35.5 %/37.5 %/45.5 % higher than that of support vector regression (SVR) and back propagation neural networks (BPNN), respectively; the computational time of proposal is about 0.976 s/0.935 s/0.67 s with clusters number \(C=\) 2/3/6, while 1.889 s for SVR and 3.505 s for BPNN. Additionally, the preliminary application experiment is performed in the developing human–robot interaction system, called mascot robot system, where the experiment is performed in a scenario of “drinking at a bar”, result shows that the bar lady robot obtains an accuracy of 77.8 % for understanding customers’ order intentions and receives a satisfaction evaluation of “satisfied”. According to the preliminary application, the proposal is being extended to an ordering system in the bar for business communication.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Kirby R, Forlizzi J, Simmons R (2010) Affective social robots. Robot Automous Syst 58:322–332CrossRef Kirby R, Forlizzi J, Simmons R (2010) Affective social robots. Robot Automous Syst 58:322–332CrossRef
2.
Zurück zum Zitat Murphy RR, Nomura T, Billard A, Burke JL (2010) Human–robot interaction. IEEE Robot Autom Mag 17(2):85–89CrossRef Murphy RR, Nomura T, Billard A, Burke JL (2010) Human–robot interaction. IEEE Robot Autom Mag 17(2):85–89CrossRef
3.
Zurück zum Zitat Young JE, Sung J, Voida A, Sharlin E, Igarashi T, Christensen HI, Grinter RE (2011) Evaluating human–robot interaction. Int J Soc Robot 3(1):53–67CrossRef Young JE, Sung J, Voida A, Sharlin E, Igarashi T, Christensen HI, Grinter RE (2011) Evaluating human–robot interaction. Int J Soc Robot 3(1):53–67CrossRef
4.
Zurück zum Zitat Mitssunaga N, Miyashita T, Ishiguro H, Kogure K, Hagita N (2006) Robovie-IV: a communication robot interacting with people daily in an office. In: Proceedings of international conference on intelligent robots and system, Beijing, China, pp 5066–5072 Mitssunaga N, Miyashita T, Ishiguro H, Kogure K, Hagita N (2006) Robovie-IV: a communication robot interacting with people daily in an office. In: Proceedings of international conference on intelligent robots and system, Beijing, China, pp 5066–5072
5.
Zurück zum Zitat Fasola J, Mataric M (2012) Using socially assistive human–robot interaction to motivate physical exercise for older adults. Proc IEEE 100(8):2512–2526CrossRef Fasola J, Mataric M (2012) Using socially assistive human–robot interaction to motivate physical exercise for older adults. Proc IEEE 100(8):2512–2526CrossRef
6.
Zurück zum Zitat Mitsunaga N, Smith C, Kanda T, Ishiguro H, Hagita N (2008) Adapting robot behavior for human–robot interaction. IEEE Trans Robot 24(4):911–916CrossRef Mitsunaga N, Smith C, Kanda T, Ishiguro H, Hagita N (2008) Adapting robot behavior for human–robot interaction. IEEE Trans Robot 24(4):911–916CrossRef
7.
Zurück zum Zitat Calinon S, Sardellitti I, Caldwell DG (2010) Learning-based control strategy for safe human–robot interaction exploiting task and robot redundancies. In: IEEE/RSJ international conference on intelligent robots and systems, Taibei, Taiwan, pp 249–254 Calinon S, Sardellitti I, Caldwell DG (2010) Learning-based control strategy for safe human–robot interaction exploiting task and robot redundancies. In: IEEE/RSJ international conference on intelligent robots and systems, Taibei, Taiwan, pp 249–254
8.
Zurück zum Zitat Broz F, Nourbakhsh I, Simmons R (2013) Planning for human–robot interaction in socially situated tasks. Int J Soc Robot 5(2):193–241CrossRef Broz F, Nourbakhsh I, Simmons R (2013) Planning for human–robot interaction in socially situated tasks. Int J Soc Robot 5(2):193–241CrossRef
9.
Zurück zum Zitat Chen L-F, Liu Z-T, Dong F-Y, Yamazaki Y, Wu M, Hirota K (2013) Adapting multi-robot behavior to communication atmosphere in humans–robots interaction using fuzzy production rule based friend-Q learning. J Adv Comput Intell Intell Inf 17(2):291–301 Chen L-F, Liu Z-T, Dong F-Y, Yamazaki Y, Wu M, Hirota K (2013) Adapting multi-robot behavior to communication atmosphere in humans–robots interaction using fuzzy production rule based friend-Q learning. J Adv Comput Intell Intell Inf 17(2):291–301
10.
Zurück zum Zitat Chen L-F, Liu Z-T, Wu M, Dong F-Y, Yamazaki Y, Wu M, Hirota K (2014) Multi-robot behavior adaptation to local and global communication atmosphere in humans–robots interaction. J Multimodal User Interfaces 8(3):289–303CrossRef Chen L-F, Liu Z-T, Wu M, Dong F-Y, Yamazaki Y, Wu M, Hirota K (2014) Multi-robot behavior adaptation to local and global communication atmosphere in humans–robots interaction. J Multimodal User Interfaces 8(3):289–303CrossRef
11.
Zurück zum Zitat Drenner A, Janssen M, Kottas A et al (2013) Coordination and longevity in multi-robot teams involving miniature robots. J Intell Robot Syst 72(2):263–284CrossRef Drenner A, Janssen M, Kottas A et al (2013) Coordination and longevity in multi-robot teams involving miniature robots. J Intell Robot Syst 72(2):263–284CrossRef
12.
Zurück zum Zitat Geiger A, Lauer M, Urtasun R (2011) A generative model for 3D urban scene understanding from movable platforms. In: IEEE conference on computer vision and pattern recognition, Colorado, USA, pp 1945–1952 Geiger A, Lauer M, Urtasun R (2011) A generative model for 3D urban scene understanding from movable platforms. In: IEEE conference on computer vision and pattern recognition, Colorado, USA, pp 1945–1952
13.
Zurück zum Zitat Roberson MJ, Bohg J, Skantze GL, Gustafson J, Carlson R, Rasolzadeh B, Kragic D (2011) Enhanced visual scene understanding through human–robot dialog. In: IEEE/RSJ international conference on intelligent robots and systems, San Francisco, USA, pp 3342–3348 Roberson MJ, Bohg J, Skantze GL, Gustafson J, Carlson R, Rasolzadeh B, Kragic D (2011) Enhanced visual scene understanding through human–robot dialog. In: IEEE/RSJ international conference on intelligent robots and systems, San Francisco, USA, pp 3342–3348
14.
Zurück zum Zitat Bergh MV, Carton D, Nijs RD, Mitsou N, Landsiedel C, Kuehnlenz K, Wollherr D, Gool LV, Buss M (2011) Real-time 3D hand gesture interaction with a robot for understanding directions from humans. In: IEEE international symposium on robot and human interactive communication, Atlanta, USA, pp 357–362 Bergh MV, Carton D, Nijs RD, Mitsou N, Landsiedel C, Kuehnlenz K, Wollherr D, Gool LV, Buss M (2011) Real-time 3D hand gesture interaction with a robot for understanding directions from humans. In: IEEE international symposium on robot and human interactive communication, Atlanta, USA, pp 357–362
15.
Zurück zum Zitat Mohiyeddini C, Pauli R, Bauer S (2009) The role of emotion in bridging the intention behaviour gap: the case of sports participation. Psychol Sport Exerc 10(2):226–234CrossRef Mohiyeddini C, Pauli R, Bauer S (2009) The role of emotion in bridging the intention behaviour gap: the case of sports participation. Psychol Sport Exerc 10(2):226–234CrossRef
16.
Zurück zum Zitat Olsson A, Ochsner KN (2007) The role of social cognition in emotion. Cogn-Emot Interact 12(2):65–71 Olsson A, Ochsner KN (2007) The role of social cognition in emotion. Cogn-Emot Interact 12(2):65–71
17.
18.
Zurück zum Zitat Bottou L, Vapnik VN (1992) Local learning algorithms. Neutal Comput 4(6):888–900 Bottou L, Vapnik VN (1992) Local learning algorithms. Neutal Comput 4(6):888–900
19.
Zurück zum Zitat Shafi A, Vishanth W (2009) Understanding citizens’ behavioural intention in the adoption of e-government services in the state of Qatar. In: European conference on information systems, Verona, Italy Shafi A, Vishanth W (2009) Understanding citizens’ behavioural intention in the adoption of e-government services in the state of Qatar. In: European conference on information systems, Verona, Italy
20.
Zurück zum Zitat Orji RO (2010) Impact of gender and nationality on acceptance of a digital library: an empirical validation of nationality based UTAUT using SEM. J Emerg Trends Comput Inf Sci 1(2):68–79 Orji RO (2010) Impact of gender and nationality on acceptance of a digital library: an empirical validation of nationality based UTAUT using SEM. J Emerg Trends Comput Inf Sci 1(2):68–79
21.
Zurück zum Zitat Holland C, Hill R (2007) The effect of age, gender and driver status on pedestrians’ intentions to cross the road in risky situations intentions to cross the road in risky situations. Accid Anal Prev 39(2):224–237CrossRef Holland C, Hill R (2007) The effect of age, gender and driver status on pedestrians’ intentions to cross the road in risky situations intentions to cross the road in risky situations. Accid Anal Prev 39(2):224–237CrossRef
22.
Zurück zum Zitat Keysar B (1994) The illusory transparencyof intentoin: linguistic perspective taking in tex. Cogn Psychol 26(2):165–208CrossRef Keysar B (1994) The illusory transparencyof intentoin: linguistic perspective taking in tex. Cogn Psychol 26(2):165–208CrossRef
23.
Zurück zum Zitat Hanheide M, Lohse M, Zender H (2012) Expectations, intentions, and actions in human–robot interaction. Int J Soc Robot 4(2):107–108CrossRef Hanheide M, Lohse M, Zender H (2012) Expectations, intentions, and actions in human–robot interaction. Int J Soc Robot 4(2):107–108CrossRef
24.
Zurück zum Zitat Hirota K, Dong F (2008) Development of mascot robot system in NEDO project. In: International IEEE conference on intelligent systems, Varna, Bulgaria, pp 1–38-1-44 Hirota K, Dong F (2008) Development of mascot robot system in NEDO project. In: International IEEE conference on intelligent systems, Varna, Bulgaria, pp 1–38-1-44
25.
Zurück zum Zitat Cortes C, Vapnik VN (1995) Support-vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik VN (1995) Support-vector networks. Mach Learn 20(3):273–297MATH
26.
Zurück zum Zitat Yu H, Kim J, Kim Y, Hwang S, Lee YH (2012) An efficient method for learning nonlinear ranking SVM functions. Inf Sci 209:37–48MathSciNetCrossRef Yu H, Kim J, Kim Y, Hwang S, Lee YH (2012) An efficient method for learning nonlinear ranking SVM functions. Inf Sci 209:37–48MathSciNetCrossRef
27.
Zurück zum Zitat Tarabalka Y, Fauvel M, Chanussot J, Benediktsson JA (2010) SVM- and MRF-based method for accurate classification of hyperspectral images. IEEE Geosci Remote Sens Lett 7(4):736–740CrossRef Tarabalka Y, Fauvel M, Chanussot J, Benediktsson JA (2010) SVM- and MRF-based method for accurate classification of hyperspectral images. IEEE Geosci Remote Sens Lett 7(4):736–740CrossRef
28.
Zurück zum Zitat Moavenian M, Khorrami H (2010) A qualitative comparison of artificial neural networks and support vector machinesin ECG arrhythmias classification. Expert Syst Appl 37(4):3088–3093CrossRef Moavenian M, Khorrami H (2010) A qualitative comparison of artificial neural networks and support vector machinesin ECG arrhythmias classification. Expert Syst Appl 37(4):3088–3093CrossRef
29.
Zurück zum Zitat Suykens JAK, Vandewalle J, Moor BD (2001) Optimal control by least squares support vector machines. Neural Netw 14(1):23–25CrossRef Suykens JAK, Vandewalle J, Moor BD (2001) Optimal control by least squares support vector machines. Neural Netw 14(1):23–25CrossRef
30.
Zurück zum Zitat Ismail S, Shabri A, Samsudin R (2011) A hybrid model of self-organizing maps (SOM) and least square supportvector machine (LSSVM) for time-series forecasting. Expert Syst Appl 38(8):10574–10578CrossRef Ismail S, Shabri A, Samsudin R (2011) A hybrid model of self-organizing maps (SOM) and least square supportvector machine (LSSVM) for time-series forecasting. Expert Syst Appl 38(8):10574–10578CrossRef
31.
Zurück zum Zitat Huang C (2012) A reduced support vector machine approach for interval regression analysis. Inf Sci 217:56–64CrossRefMATH Huang C (2012) A reduced support vector machine approach for interval regression analysis. Inf Sci 217:56–64CrossRefMATH
32.
Zurück zum Zitat Ferreira JP, Crisostomo MM, Coimbra AP (2013) Adaptive PD controller modeled via support vector regression for a biped robot. IEEE Trans Control Syst Technol 21(3):941–949CrossRef Ferreira JP, Crisostomo MM, Coimbra AP (2013) Adaptive PD controller modeled via support vector regression for a biped robot. IEEE Trans Control Syst Technol 21(3):941–949CrossRef
33.
Zurück zum Zitat Dunn JC (1973) A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J Cybern 3(3):32–57MathSciNetCrossRefMATH Dunn JC (1973) A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J Cybern 3(3):32–57MathSciNetCrossRefMATH
34.
Zurück zum Zitat Bezdek JC (1980) A convergence theorem for the fuzzy ISODATA clustering algorithms. IEEE Trans Pattern Anal Mach Intell PAMI 2(1):1–8CrossRefMATH Bezdek JC (1980) A convergence theorem for the fuzzy ISODATA clustering algorithms. IEEE Trans Pattern Anal Mach Intell PAMI 2(1):1–8CrossRefMATH
35.
Zurück zum Zitat Dong WM, Wong FS (1987) Fuzzy weighted averages and implementation of the extension principle. Fuzzy Sets Syst 21(2):183–199MathSciNetCrossRefMATH Dong WM, Wong FS (1987) Fuzzy weighted averages and implementation of the extension principle. Fuzzy Sets Syst 21(2):183–199MathSciNetCrossRefMATH
36.
Zurück zum Zitat Keltner D, Haidt J (1999) Social functions of emotions at four levels of anysis. Cogn Emot 13(5):505–521CrossRef Keltner D, Haidt J (1999) Social functions of emotions at four levels of anysis. Cogn Emot 13(5):505–521CrossRef
37.
Zurück zum Zitat Spoor JR, Kelly JR (2004) The evolutionary significance of affect in groups: communication and group bonding. Group Process Intergroup Prelations 7(4):398–412CrossRef Spoor JR, Kelly JR (2004) The evolutionary significance of affect in groups: communication and group bonding. Group Process Intergroup Prelations 7(4):398–412CrossRef
38.
Zurück zum Zitat Klauer KC, Musch J (2003) Affective priming: findings and theories. Psychology of evaluation: affective processes in cognition and emotion. Lawrence Erlbaum, USA, pp 7–49 Klauer KC, Musch J (2003) Affective priming: findings and theories. Psychology of evaluation: affective processes in cognition and emotion. Lawrence Erlbaum, USA, pp 7–49
39.
Zurück zum Zitat Jain AK, Dubes RC (1988) Algorithms for clustering data. Prentice Hall, Englewood CliffsMATH Jain AK, Dubes RC (1988) Algorithms for clustering data. Prentice Hall, Englewood CliffsMATH
40.
Zurück zum Zitat Liu Z-T, Mu Z, Chen L-F et al (2012) Emotion recognition of violin music based on strings music theory for mascot robot system. In: 9th international conference on informatics in control, automation and robotics, Rome, Italy, pp 5–14 Liu Z-T, Mu Z, Chen L-F et al (2012) Emotion recognition of violin music based on strings music theory for mascot robot system. In: 9th international conference on informatics in control, automation and robotics, Rome, Italy, pp 5–14
41.
Zurück zum Zitat Yamazaki Y, Hatakeyama Y, Dong F-Y, Nomoto K, Hirota K (2008) Fuzzy inference based mentality expression for eye robot in affinity pleasure-arousal space. J Adv Comput Intell Intell Inf 12(3):304–313 Yamazaki Y, Hatakeyama Y, Dong F-Y, Nomoto K, Hirota K (2008) Fuzzy inference based mentality expression for eye robot in affinity pleasure-arousal space. J Adv Comput Intell Intell Inf 12(3):304–313
42.
Zurück zum Zitat Farchi G, Fidanza F, Giampaoli S, Mariotti S, Menotti A (2000) Alcohol and survival in the Italian rural cohorts of the seven countries study. Int J Epidemiol 29:667–671CrossRef Farchi G, Fidanza F, Giampaoli S, Mariotti S, Menotti A (2000) Alcohol and survival in the Italian rural cohorts of the seven countries study. Int J Epidemiol 29:667–671CrossRef
43.
Zurück zum Zitat Tang Y-K, Dong F-Y, Yuhki M, Yamazaki Y, Shibata T, Hirota K (2013) Deep level situation understanding and its application to casual communication between robots and humans. In: Internaitonal conference on informatics in control. Automation and robotics, Reykjavik, Iceland, pp 292–299 Tang Y-K, Dong F-Y, Yuhki M, Yamazaki Y, Shibata T, Hirota K (2013) Deep level situation understanding and its application to casual communication between robots and humans. In: Internaitonal conference on informatics in control. Automation and robotics, Reykjavik, Iceland, pp 292–299
44.
Zurück zum Zitat Liu Z-T, Wu M, Li D-Y, Chen L-F, Dong F-Y, Yamazaki Y, Hirota K (2013) Communication atmosphere in humans–robots interaction based on the concept of fuzzy atmosphere generated by emotional states of humans and robots. J Autom Mobile Robot Intell Syst 7(2):52–63 Liu Z-T, Wu M, Li D-Y, Chen L-F, Dong F-Y, Yamazaki Y, Hirota K (2013) Communication atmosphere in humans–robots interaction based on the concept of fuzzy atmosphere generated by emotional states of humans and robots. J Autom Mobile Robot Intell Syst 7(2):52–63
45.
Zurück zum Zitat Kelley R, Tavakkoli A, King C, Nicolescu M, Nicolescu M, Bebis G (2008) Understanding human intentions via hidden markov models in autonomous mobile robots. In: Proceedings of the 3rd ACM/IEEE international conference on human robot interaction, Amsterdam, Netherlands, pp 367–374 Kelley R, Tavakkoli A, King C, Nicolescu M, Nicolescu M, Bebis G (2008) Understanding human intentions via hidden markov models in autonomous mobile robots. In: Proceedings of the 3rd ACM/IEEE international conference on human robot interaction, Amsterdam, Netherlands, pp 367–374
46.
Zurück zum Zitat Bicho E, Erlhagen W, Sousa E et al (2012) The power of prediction: robots that read intentions. In: IEEE/RSJ international conference on intelligent robots and systems, Vilamoura, Portugal, pp 5458–5459 Bicho E, Erlhagen W, Sousa E et al (2012) The power of prediction: robots that read intentions. In: IEEE/RSJ international conference on intelligent robots and systems, Vilamoura, Portugal, pp 5458–5459
Metadaten
Titel
Emotion-Age-Gender-Nationality Based Intention Understanding in Human–Robot Interaction Using Two-Layer Fuzzy Support Vector Regression
verfasst von
Lue-Feng Chen
Zhen-Tao Liu
Min Wu
Min Ding
Fang-Yan Dong
Kaoru Hirota
Publikationsdatum
01.11.2015
Verlag
Springer Netherlands
Erschienen in
International Journal of Social Robotics / Ausgabe 5/2015
Print ISSN: 1875-4791
Elektronische ISSN: 1875-4805
DOI
https://doi.org/10.1007/s12369-015-0290-2

Weitere Artikel der Ausgabe 5/2015

International Journal of Social Robotics 5/2015 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.