Skip to main content
Top

2015 | OriginalPaper | Chapter

Intelligent Agents for Virtual Simulation of Human-Robot Interaction

Authors : Ning Wang, David V. Pynadath, K. V. Unnikrishnan, Santosh Shankar, Chirag Merchant

Published in: Virtual, Augmented and Mixed Reality

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

To study how robots can work better with humans as a team, we have designed an agent-based online testbed that supports virtual simulation of domain-independent human-robot interaction. The simulation is implemented as an online game where humans and virtual robots work together in simulated scenarios. This testbed allows researchers to carry out human-robot interaction studies and gain better understanding of, for example, how a robot’s communication can improve human-robot team performance by fostering better trust relationships among humans and their robot teammates. In this paper, we discuss the requirements, challenges and the design of such human-robot simulation. We illustrate its operation with an example human-robot joint reconnaissance task.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Barber, D., Davis, L., Nicholson, D., Finkelstein, N., Chen, J.Y.: The mixed initiative experimental (MIX) testbed for human robot interactions with varied levels of automation. Technical report, DTIC Document (2008) Barber, D., Davis, L., Nicholson, D., Finkelstein, N., Chen, J.Y.: The mixed initiative experimental (MIX) testbed for human robot interactions with varied levels of automation. Technical report, DTIC Document (2008)
2.
go back to reference Boutilier, C., Dearden, R., Goldszmidt, M.: Stochastic dynamic programming with factored representations. Artif. Intell. 121(1), 49–107 (2000)MathSciNetCrossRefMATH Boutilier, C., Dearden, R., Goldszmidt, M.: Stochastic dynamic programming with factored representations. Artif. Intell. 121(1), 49–107 (2000)MathSciNetCrossRefMATH
3.
go back to reference Braun, T., Wettach, J., Berns, K.: A customizable, multi-host simulation and visualization framework for robot applications. In: Lee, S., Suh II, H., Kim, M.S. (eds.) Recent Progress in Robotics: Viable Robotic Service to Human, pp. 357–369. Springer, Heidelberg (2008)CrossRef Braun, T., Wettach, J., Berns, K.: A customizable, multi-host simulation and visualization framework for robot applications. In: Lee, S., Suh II, H., Kim, M.S. (eds.) Recent Progress in Robotics: Viable Robotic Service to Human, pp. 357–369. Springer, Heidelberg (2008)CrossRef
4.
go back to reference Cassandra, A.R., Kaelbling, L.P., Kurien, J.A.: Acting under uncertainty: Discrete Bayesian models for mobile-robot navigation. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 2, pp. 963–972 (1996) Cassandra, A.R., Kaelbling, L.P., Kurien, J.A.: Acting under uncertainty: Discrete Bayesian models for mobile-robot navigation. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 2, pp. 963–972 (1996)
5.
go back to reference Chalupsky, H., Gil, Y., Knoblock, C.A., Lerman, K., Oh, J., Pynadath, D.V., Russ, T.A., Tambe, M.: Electric elves: agent technology for supporting human organizations. AI Mag. 23(2), 11–24 (2002) Chalupsky, H., Gil, Y., Knoblock, C.A., Lerman, K., Oh, J., Pynadath, D.V., Russ, T.A., Tambe, M.: Electric elves: agent technology for supporting human organizations. AI Mag. 23(2), 11–24 (2002)
6.
go back to reference Cockburn, J., Solomon, Y., Kapadia, M., Badler, N.: Multi-modal human robot interaction in a simulation environment. Technical report, University of Pennsylvania (2013) Cockburn, J., Solomon, Y., Kapadia, M., Badler, N.: Multi-modal human robot interaction in a simulation environment. Technical report, University of Pennsylvania (2013)
7.
go back to reference Corritore, C.L., Kracher, B., Wiedenbeck, S.: On-line trust: concepts, evolving themes, a model. Int. J. Hum. Comput. Stud. 58(6), 737–758 (2003)CrossRef Corritore, C.L., Kracher, B., Wiedenbeck, S.: On-line trust: concepts, evolving themes, a model. Int. J. Hum. Comput. Stud. 58(6), 737–758 (2003)CrossRef
8.
go back to reference Cosenzo, K., Chen, J., Reinerman-Jones, L., Barnes, M., Nicholson, D.: Adaptive automation effects on operator performance during a reconnaissance mission with an unmanned ground vehicle. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 54, pp. 2135–2139. SAGE Publications (2010) Cosenzo, K., Chen, J., Reinerman-Jones, L., Barnes, M., Nicholson, D.: Adaptive automation effects on operator performance during a reconnaissance mission with an unmanned ground vehicle. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 54, pp. 2135–2139. SAGE Publications (2010)
9.
go back to reference Doshi, P., Perez, D.: Generalized point based value iteration for interactive POMDPs. In: Proceedings of the Conference on Artificial Intelligence, pp. 63–68 (2008) Doshi, P., Perez, D.: Generalized point based value iteration for interactive POMDPs. In: Proceedings of the Conference on Artificial Intelligence, pp. 63–68 (2008)
10.
go back to reference Dzindolet, M.T., Peterson, S.A., Pomranky, R.A., Pierce, L.G., Beck, H.P.: The role of trust in automation reliance. Int. J. Hum. Comput. Stud. 58, 697–718 (2003)CrossRef Dzindolet, M.T., Peterson, S.A., Pomranky, R.A., Pierce, L.G., Beck, H.P.: The role of trust in automation reliance. Int. J. Hum. Comput. Stud. 58, 697–718 (2003)CrossRef
11.
go back to reference Giachetti, R.E., Marcelli, V., Cifuentes, J., Rojas, J.A.: An agent-based simulation model of human-robot team performance in military environments. Syst. Eng. 16(1), 15–28 (2013)CrossRef Giachetti, R.E., Marcelli, V., Cifuentes, J., Rojas, J.A.: An agent-based simulation model of human-robot team performance in military environments. Syst. Eng. 16(1), 15–28 (2013)CrossRef
12.
go back to reference Gmytrasiewicz, P.J., Durfee, E.H.: A rigorous, operational formalization of recursive modeling. In: Proceedings of the International Conference on Multi-Agent Systems, pp. 125–132 (1995) Gmytrasiewicz, P.J., Durfee, E.H.: A rigorous, operational formalization of recursive modeling. In: Proceedings of the International Conference on Multi-Agent Systems, pp. 125–132 (1995)
13.
go back to reference Guestrin, C., Koller, D., Parr, R., Venkataraman, S.: Efficient solution algorithms for factored mdps. J. Artif. Intell. Res. 19, 399–468 (2003)MathSciNetMATH Guestrin, C., Koller, D., Parr, R., Venkataraman, S.: Efficient solution algorithms for factored mdps. J. Artif. Intell. Res. 19, 399–468 (2003)MathSciNetMATH
14.
go back to reference Hirth, J., Mehdi, S.A., Schmitz, N., Berns, K.: Development of a simulated environment for human-robot interaction. TELKOMNIKA (Telecommun. Comput. Electron. Control) 9(3), 465–472 (2011)CrossRef Hirth, J., Mehdi, S.A., Schmitz, N., Berns, K.: Development of a simulated environment for human-robot interaction. TELKOMNIKA (Telecommun. Comput. Electron. Control) 9(3), 465–472 (2011)CrossRef
15.
go back to reference Johnson, W.L., Valente, A.: Tactical language and culture training systems: using AI to teach foreign languages and cultures. Artif. Intell. Mag. 30(2), 72–84 (2009) Johnson, W.L., Valente, A.: Tactical language and culture training systems: using AI to teach foreign languages and cultures. Artif. Intell. Mag. 30(2), 72–84 (2009)
16.
go back to reference Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artif. Intell. 101, 99–134 (1998)MathSciNetCrossRefMATH Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artif. Intell. 101, 99–134 (1998)MathSciNetCrossRefMATH
17.
go back to reference Kim, J.M., Hill, J.R.W., Durlach, P.J., Lane, H.C., Forbell, E., Core, M., Marsella, S., Pynadath, D., Hart, J.: BiLAT: a game-based environment for practicing negotiation in a cultural context. Int. J. Artif. Intell. Educ. Special Issue on Ill-Defined Domains 19(3), 289–308 (2009) Kim, J.M., Hill, J.R.W., Durlach, P.J., Lane, H.C., Forbell, E., Core, M., Marsella, S., Pynadath, D., Hart, J.: BiLAT: a game-based environment for practicing negotiation in a cultural context. Int. J. Artif. Intell. Educ. Special Issue on Ill-Defined Domains 19(3), 289–308 (2009)
18.
go back to reference Klatt, J., Marsella, S., Krämer, N.C.: Negotiations in the context of AIDS prevention: an agent-based model using theory of mind. In: Vilhjálmsson, H.H., Kopp, S., Marsella, S., Thórisson, K.R. (eds.) IVA 2011. LNCS, vol. 6895, pp. 209–215. Springer, Heidelberg (2011) CrossRef Klatt, J., Marsella, S., Krämer, N.C.: Negotiations in the context of AIDS prevention: an agent-based model using theory of mind. In: Vilhjálmsson, H.H., Kopp, S., Marsella, S., Thórisson, K.R. (eds.) IVA 2011. LNCS, vol. 6895, pp. 209–215. Springer, Heidelberg (2011) CrossRef
19.
go back to reference Koenig, N., Howard, A.: Design and use paradigms for gazebo, an open-source multi-robot simulator. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3, pp. 2149–2154. IEEE (2004) Koenig, N., Howard, A.: Design and use paradigms for gazebo, an open-source multi-robot simulator. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3, pp. 2149–2154. IEEE (2004)
20.
go back to reference Koenig, S., Simmons, R.: Xavier: a robot navigation architecture based on partially observable Markov decision process models. In: Kortenkamp, D., Bonasso, R.P., Murphy, R.R. (eds.) Artificial Intelligence Based Mobile Robotics: Case Studies of Successful Robot Systems, pp. 91–122. MIT Press, Cambridge (1998) Koenig, S., Simmons, R.: Xavier: a robot navigation architecture based on partially observable Markov decision process models. In: Kortenkamp, D., Bonasso, R.P., Murphy, R.R. (eds.) Artificial Intelligence Based Mobile Robotics: Case Studies of Successful Robot Systems, pp. 91–122. MIT Press, Cambridge (1998)
21.
go back to reference Lee, J., Moray, N.: Trust, control strategies and allocation of function in human-machine systems. Ergonomics 35(10), 1243–1270 (1992)CrossRef Lee, J., Moray, N.: Trust, control strategies and allocation of function in human-machine systems. Ergonomics 35(10), 1243–1270 (1992)CrossRef
22.
go back to reference Lee, J.D., See, K.A.: Trust in automation: designing for appropriate reliance. Hum. Factors J. Hum. Factors Ergonomics Soc. 46(1), 50–80 (2004)CrossRef Lee, J.D., See, K.A.: Trust in automation: designing for appropriate reliance. Hum. Factors J. Hum. Factors Ergonomics Soc. 46(1), 50–80 (2004)CrossRef
23.
go back to reference Lewis, M., Wang, J., Hughes, S.: USARSim: simulation for the study of human-robot interaction. J. Cogn. Eng. Decis. Mak. 1(1), 98–120 (2007)CrossRef Lewis, M., Wang, J., Hughes, S.: USARSim: simulation for the study of human-robot interaction. J. Cogn. Eng. Decis. Mak. 1(1), 98–120 (2007)CrossRef
24.
go back to reference Marsella, S.C., Pynadath, D.V., Read, S.J.: PsychSim: agent-based modeling of social interactions and influence. In: Proceedings of the International Conference on Cognitive Modeling, pp. 243–248 (2004) Marsella, S.C., Pynadath, D.V., Read, S.J.: PsychSim: agent-based modeling of social interactions and influence. In: Proceedings of the International Conference on Cognitive Modeling, pp. 243–248 (2004)
25.
go back to reference Mayer, R.C., Davis, J.H., Schoorman, F.D.: An integrative model of organizational trust. Acad. Manag. Rev. 20(3), 709–734 (1995) Mayer, R.C., Davis, J.H., Schoorman, F.D.: An integrative model of organizational trust. Acad. Manag. Rev. 20(3), 709–734 (1995)
26.
go back to reference McAlinden, R., Gordon, A., Lane, H.C., Pynadath, D.: UrbanSim: a game-based simulation for counterinsurgency and stability-focused operations. In: Proceedings of the AIED Workshop on Intelligent Educational Games (2009) McAlinden, R., Gordon, A., Lane, H.C., Pynadath, D.: UrbanSim: a game-based simulation for counterinsurgency and stability-focused operations. In: Proceedings of the AIED Workshop on Intelligent Educational Games (2009)
27.
go back to reference Miller, L.C., Marsella, S., Dey, T., Appleby, P.R., Christensen, J.L., Klatt, J., Read, S.J.: Socially optimized learning in virtual environments (SOLVE). In: Si, M., Thue, D., André, E., Lester, J., Tanenbaum, J., Zammitto, V. (eds.) ICIDS 2011. LNCS, vol. 7069, pp. 182–192. Springer, Heidelberg (2011) CrossRef Miller, L.C., Marsella, S., Dey, T., Appleby, P.R., Christensen, J.L., Klatt, J., Read, S.J.: Socially optimized learning in virtual environments (SOLVE). In: Si, M., Thue, D., André, E., Lester, J., Tanenbaum, J., Zammitto, V. (eds.) ICIDS 2011. LNCS, vol. 7069, pp. 182–192. Springer, Heidelberg (2011) CrossRef
28.
go back to reference Parasuraman, R., Riley, V.: Humans and automation: use, misuse, disuse, abuse. Hum. Factors 39(2), 230–253 (1997)CrossRef Parasuraman, R., Riley, V.: Humans and automation: use, misuse, disuse, abuse. Hum. Factors 39(2), 230–253 (1997)CrossRef
29.
go back to reference Pineau, J., Montemerlo, M., Pollack, M., Roy, N., Thrun, S.: Towards robotic assistants in nursing homes: challenges and results. Robot. Autonomous Syst. 42(3), 271–281 (2003)CrossRefMATH Pineau, J., Montemerlo, M., Pollack, M., Roy, N., Thrun, S.: Towards robotic assistants in nursing homes: challenges and results. Robot. Autonomous Syst. 42(3), 271–281 (2003)CrossRefMATH
30.
go back to reference Pynadath, D.V., Marsella, S.C.: Fitting and compilation of multiagent models through piecewise linear functions. In: Proceedings of the International Conference on Autonomous Agents and Multi Agent Systems, pp. 1197–1204 (2004) Pynadath, D.V., Marsella, S.C.: Fitting and compilation of multiagent models through piecewise linear functions. In: Proceedings of the International Conference on Autonomous Agents and Multi Agent Systems, pp. 1197–1204 (2004)
31.
go back to reference Pynadath, D.V., Marsella, S.C.: PsychSim: Modeling theory of mind with decision-theoretic agents. In: Proceedings of the International Joint Conference on Artificial Intelligence, pp. 1181–1186 (2005) Pynadath, D.V., Marsella, S.C.: PsychSim: Modeling theory of mind with decision-theoretic agents. In: Proceedings of the International Joint Conference on Artificial Intelligence, pp. 1181–1186 (2005)
32.
go back to reference Pynadath, D.V., Si, M., Marsella, S.C.: Modeling theory of mind and cognitive appraisal with decision-theoretic agents. In: Gratch, J., Marsella, S. (eds.) Social Emotions in Nature and Artifact: Emotions in Human and Human-Computer Interaction, pp. 70–87. Oxford University Press, Oxford (2014) Pynadath, D.V., Si, M., Marsella, S.C.: Modeling theory of mind and cognitive appraisal with decision-theoretic agents. In: Gratch, J., Marsella, S. (eds.) Social Emotions in Nature and Artifact: Emotions in Human and Human-Computer Interaction, pp. 70–87. Oxford University Press, Oxford (2014)
33.
go back to reference Pynadath, D.V., Tambe, M.: Electric elves: adjustable autonomy in real-world multi-agent environments. In: Dautenhahn, K., Bond, A., Canamero, D., Edmonds, B. (eds.) Socially Intelligent Agents: Creating Relationships with Computers and Robots, Chap. 12, pp. 101–108. Kluwer, Dordrecht (2002)CrossRef Pynadath, D.V., Tambe, M.: Electric elves: adjustable autonomy in real-world multi-agent environments. In: Dautenhahn, K., Bond, A., Canamero, D., Edmonds, B. (eds.) Socially Intelligent Agents: Creating Relationships with Computers and Robots, Chap. 12, pp. 101–108. Kluwer, Dordrecht (2002)CrossRef
34.
go back to reference Robinette, P., Howard, A.M.: Trust in emergency evacuation robots.In: Proceedings of the IEEE International Symposium on Safety, Security, and Rescue Robotics, pp. 1–6. IEEE (2012) Robinette, P., Howard, A.M.: Trust in emergency evacuation robots.In: Proceedings of the IEEE International Symposium on Safety, Security, and Rescue Robotics, pp. 1–6. IEEE (2012)
35.
go back to reference Ross, S., Pineau, J., Paquet, S., Chaib-Draa, B.: Online planning algorithms for POMDPs. J. Artif. Intell. Res. 32, 663–704 (2008)MathSciNetMATH Ross, S., Pineau, J., Paquet, S., Chaib-Draa, B.: Online planning algorithms for POMDPs. J. Artif. Intell. Res. 32, 663–704 (2008)MathSciNetMATH
36.
go back to reference Salem, M., Lakatos, G., Amirabdollahian, F., Dautenhahn, K.: Would you trust a (faulty) robot?: Effects of error, task type and personality on human-robot cooperation and trust. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2015, pp. 141–148. ACM, New York (2015) Salem, M., Lakatos, G., Amirabdollahian, F., Dautenhahn, K.: Would you trust a (faulty) robot?: Effects of error, task type and personality on human-robot cooperation and trust. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2015, pp. 141–148. ACM, New York (2015)
37.
go back to reference Shoulson, A., Marshak, N., Kapadia, M., Badler, N.I.: Adapt: the agent developmentand prototyping testbed. IEEE Trans. Vis. Comput. Graph. 20(7), 1035–1047 (2014)CrossRef Shoulson, A., Marshak, N., Kapadia, M., Badler, N.I.: Adapt: the agent developmentand prototyping testbed. IEEE Trans. Vis. Comput. Graph. 20(7), 1035–1047 (2014)CrossRef
38.
go back to reference Swiecicki, C.C., Elliott, L.R., Wooldridge, R.: Squad-level soldier-robot dynamics: Exploring future concepts involving intelligent autonomous robots. Technical report ARL-TR-7215, Army Research Laboratory (2015) Swiecicki, C.C., Elliott, L.R., Wooldridge, R.: Squad-level soldier-robot dynamics: Exploring future concepts involving intelligent autonomous robots. Technical report ARL-TR-7215, Army Research Laboratory (2015)
39.
go back to reference Tan, J.T.C., Inamura, T.: Sigverse: a cloud computing architecture simulation platform for social human-robot interaction. In: Proceedings of the International Conference on Robotics and Automation, pp. 1310–1315. IEEE (2012) Tan, J.T.C., Inamura, T.: Sigverse: a cloud computing architecture simulation platform for social human-robot interaction. In: Proceedings of the International Conference on Robotics and Automation, pp. 1310–1315. IEEE (2012)
40.
go back to reference Whiten, A. (ed.): Natural Theories of Mind. Basil Blackwell, Oxford (1991) Whiten, A. (ed.): Natural Theories of Mind. Basil Blackwell, Oxford (1991)
41.
go back to reference Xu, A., Dudek, G.: Optimo: online probabilistic trust inference model for asymmetric human-robot collaborations. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2015, pp. 221–228. ACM, New York (2015) Xu, A., Dudek, G.: Optimo: online probabilistic trust inference model for asymmetric human-robot collaborations. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2015, pp. 221–228. ACM, New York (2015)
Metadata
Title
Intelligent Agents for Virtual Simulation of Human-Robot Interaction
Authors
Ning Wang
David V. Pynadath
K. V. Unnikrishnan
Santosh Shankar
Chirag Merchant
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-21067-4_24