Skip to main content
Erschienen in: International Journal of Social Robotics 4/2018

23.11.2017

The More the Merrier? Effects of Humanlike Learning Abilities on Humans’ Perception and Evaluation of a Robot

verfasst von: Astrid M. Rosenthal-von der Pütten, Jens Hoefinghoff

Erschienen in: International Journal of Social Robotics | Ausgabe 4/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we present three experimental studies in which subjects trained a robot to do a card game via reinforcement learning. In the first two studies participants interacted with the robot either without any learning ability (control group) or with one out of three versions of a learning algorithm implementing gradually aspects of more humanlike learning abilities. Results show that the implementation of a learning algorithm had positive effects regarding the evaluation of the robot, its learning abilities and the interaction. We found that more humanlike learning abilities do not always lead to better performance and evaluation and that results were to some extend influenced by longer or shorter interaction times. In a third study, we additionally explored the influence of other behavioral variations such as low or high verbal skills and interaction modalities in perceived intelligence of the robot irrespective of the implemented learning algorithm, but did not find significant effects. Results are discussed with regard to the socialness of future interaction scenarios.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Schaal S (1999) Is imitation learning the route to humanoid robots? Trends Cogn Sci 3:233–242CrossRef Schaal S (1999) Is imitation learning the route to humanoid robots? Trends Cogn Sci 3:233–242CrossRef
2.
Zurück zum Zitat Nicolescu MN, Mataric MJ (2003) Natural methods for robot task learning: instructive demonstrations, generalization and practice. In: Proceedings of the second international joint conference on autonomous agents and multiagent systems. ACM, pp 241–248 Nicolescu MN, Mataric MJ (2003) Natural methods for robot task learning: instructive demonstrations, generalization and practice. In: Proceedings of the second international joint conference on autonomous agents and multiagent systems. ACM, pp 241–248
3.
Zurück zum Zitat Argall BD, Chernova S, Veloso M, Browning B (2009) A survey of robot learning from demonstration. Robot Auton Syst 57(5):469–483CrossRef Argall BD, Chernova S, Veloso M, Browning B (2009) A survey of robot learning from demonstration. Robot Auton Syst 57(5):469–483CrossRef
4.
Zurück zum Zitat Billard A, Calinon S, Dillmann R, Schaal S (2008) Robot programming by demonstration. In: Siciliano B, Khatib O (eds) Springer handbook of robotics. Springer, Berlin, pp 1371–1394 Billard A, Calinon S, Dillmann R, Schaal S (2008) Robot programming by demonstration. In: Siciliano B, Khatib O (eds) Springer handbook of robotics. Springer, Berlin, pp 1371–1394
5.
Zurück zum Zitat Clouse JA, Utgoff PE (1992) A teaching method for reinforcement learning. In: Proceedings of the ninth international conference on machine learning (ICML92), pp 92–101 Clouse JA, Utgoff PE (1992) A teaching method for reinforcement learning. In: Proceedings of the ninth international conference on machine learning (ICML92), pp 92–101
6.
Zurück zum Zitat Thomaz AL, Breazeal C (2006) Reinforcement learning with human teachers: evidence of feedback and guidance with implications for learning performance. AAAI 6:1000–1005 Thomaz AL, Breazeal C (2006) Reinforcement learning with human teachers: evidence of feedback and guidance with implications for learning performance. AAAI 6:1000–1005
7.
Zurück zum Zitat Hoefinghoff J, Rosenthal-von der Pütten A, Pauli J, Krämer N (2015) You and your robot companion—a framework for creating robotic applications usable by non-experts. In: Proceedings of the 24th IEEE international symposium on robot and human interactive communication, pp 615–620 Hoefinghoff J, Rosenthal-von der Pütten A, Pauli J, Krämer N (2015) You and your robot companion—a framework for creating robotic applications usable by non-experts. In: Proceedings of the 24th IEEE international symposium on robot and human interactive communication, pp 615–620
8.
Zurück zum Zitat Meltzoff AN (1988) Infant imitation and memory: nine-month-olds in immediate and deferred tests. Child Dev 59:217–225CrossRef Meltzoff AN (1988) Infant imitation and memory: nine-month-olds in immediate and deferred tests. Child Dev 59:217–225CrossRef
9.
Zurück zum Zitat Minsky M (1975) A framework for representing knowledge. In: Winston PH (ed) Psychol Comput Vis. McGraw-Hill, New York, pp 211–277 Minsky M (1975) A framework for representing knowledge. In: Winston PH (ed) Psychol Comput Vis. McGraw-Hill, New York, pp 211–277
10.
Zurück zum Zitat Dube WV, McIlvane WJ, Maguire RW, Mackay HA, Stoddard LT (1989) Stimulus class formation and stimulusreinforcer relations. J Exp Anal Behav 51:65–76CrossRef Dube WV, McIlvane WJ, Maguire RW, Mackay HA, Stoddard LT (1989) Stimulus class formation and stimulusreinforcer relations. J Exp Anal Behav 51:65–76CrossRef
11.
Zurück zum Zitat Sloutsky VM (2003) The role of similarity in the development of categorization. Trends Cogn Sci 7:246–251CrossRef Sloutsky VM (2003) The role of similarity in the development of categorization. Trends Cogn Sci 7:246–251CrossRef
12.
Zurück zum Zitat Calinon S, Guenter F, Billard A (2007) On learning, representing, and generalizing a task in a humanoid robot. IEEE Trans Syst Man Cybern B Cybern 37:286–298CrossRef Calinon S, Guenter F, Billard A (2007) On learning, representing, and generalizing a task in a humanoid robot. IEEE Trans Syst Man Cybern B Cybern 37:286–298CrossRef
13.
Zurück zum Zitat Hester T, Quinlan M, Stone P (2010) Generalized model learning for reinforcement learning on a humanoid robot. In: IEEE International conference on robotics and automation (ICRA), pp 2369–2374 Hester T, Quinlan M, Stone P (2010) Generalized model learning for reinforcement learning on a humanoid robot. In: IEEE International conference on robotics and automation (ICRA), pp 2369–2374
14.
Zurück zum Zitat Hoefinghoff J, Rosenthal-von der Pütten AM, Pauli J, Krämer N (2015) “Yes dear, that belongs into the shelf!”—exploratory studies with elderly people who learn to train an adaptive robot companion. In: Proceedings of the international conference of social robotics, pp 235–244 Hoefinghoff J, Rosenthal-von der Pütten AM, Pauli J, Krämer N (2015) “Yes dear, that belongs into the shelf!”—exploratory studies with elderly people who learn to train an adaptive robot companion. In: Proceedings of the international conference of social robotics, pp 235–244
15.
Zurück zum Zitat Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge
16.
Zurück zum Zitat Tapus A, Mataric MJ (2008) Socially assistive robots: the link between personality, empathy, physiological signals, and task performance. In: AAAI spring symposium: emotion, personality, and social behavior, pp 133–140 Tapus A, Mataric MJ (2008) Socially assistive robots: the link between personality, empathy, physiological signals, and task performance. In: AAAI spring symposium: emotion, personality, and social behavior, pp 133–140
17.
Zurück zum Zitat Tapus A, Tapus C, Mataric MJ (2008) User robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy. Intell Serv Robot 1:169–183CrossRef Tapus A, Tapus C, Mataric MJ (2008) User robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy. Intell Serv Robot 1:169–183CrossRef
19.
Zurück zum Zitat Hoefinghoff J, Pauli J (2012) Decision making based on somatic markers. In: Proceedings of the 25th international Florida Artificial Intelligence Research Society conference. AAAI Press, pp 163–168 Hoefinghoff J, Pauli J (2012) Decision making based on somatic markers. In: Proceedings of the 25th international Florida Artificial Intelligence Research Society conference. AAAI Press, pp 163–168
20.
Zurück zum Zitat Hoefinghoff J (2015) A decision making framework for robot companion systems usable by non-experts, PhD dissertation, Lehrstuhl Intelligente Systeme, Universität Duisburg-Essen, Duisburg Hoefinghoff J (2015) A decision making framework for robot companion systems usable by non-experts, PhD dissertation, Lehrstuhl Intelligente Systeme, Universität Duisburg-Essen, Duisburg
21.
Zurück zum Zitat Damasio A (1994) Descartes error: emotion, reason, and the human brain. Putnam Press, Mahopac Damasio A (1994) Descartes error: emotion, reason, and the human brain. Putnam Press, Mahopac
22.
Zurück zum Zitat O’Doherty JP (2004) Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr Opin Neurobiol 14:769–776CrossRef O’Doherty JP (2004) Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr Opin Neurobiol 14:769–776CrossRef
23.
Zurück zum Zitat Wunderlich K, Rangel A, O’Doherty JP (2009) Neural computations underlying action-based decision making in the human brain. In: Proceedings of the National Academy of Sciences, vol 106, pp 17 199–17 204 Wunderlich K, Rangel A, O’Doherty JP (2009) Neural computations underlying action-based decision making in the human brain. In: Proceedings of the National Academy of Sciences, vol 106, pp 17 199–17 204
24.
Zurück zum Zitat Zeelenberg M, Beattie J, Van der Pligt J, de Vries NK (1996) Consequences of regret aversion: effects of expected feedback on risky decision making. Organ Behav Hum Decis Process 65:148–158CrossRef Zeelenberg M, Beattie J, Van der Pligt J, de Vries NK (1996) Consequences of regret aversion: effects of expected feedback on risky decision making. Organ Behav Hum Decis Process 65:148–158CrossRef
25.
Zurück zum Zitat Blais AR, Weber EU (2006) A domain-specific risk-taking (DOSPERT) scale for adult populations. Judgm Decis Mak 1:33–47 Blais AR, Weber EU (2006) A domain-specific risk-taking (DOSPERT) scale for adult populations. Judgm Decis Mak 1:33–47
Metadaten
Titel
The More the Merrier? Effects of Humanlike Learning Abilities on Humans’ Perception and Evaluation of a Robot
verfasst von
Astrid M. Rosenthal-von der Pütten
Jens Hoefinghoff
Publikationsdatum
23.11.2017
Verlag
Springer Netherlands
Erschienen in
International Journal of Social Robotics / Ausgabe 4/2018
Print ISSN: 1875-4791
Elektronische ISSN: 1875-4805
DOI
https://doi.org/10.1007/s12369-017-0445-4

Weitere Artikel der Ausgabe 4/2018

International Journal of Social Robotics 4/2018 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.