Skip to main content
Top

2014 | OriginalPaper | Chapter

Experience in System Design for Human-Robot Teaming in Urban Search and Rescue

Authors : G. J. M. Kruijff, M. Janíček, S. Keshavdas, B. Larochelle, H. Zender, N. J. J. M. Smets, T. Mioch, M. A. Neerincx, J. V. Diggelen, F. Colas, M. Liu, F. Pomerleau, R. Siegwart, V. Hlaváč, T. Svoboda, T. Petříček, M. Reinstein, K. Zimmermann, F. Pirri, M. Gianni, P. Papadakis, A. Sinha, P. Balmer, N. Tomatis, R. Worst, T. Linder, H. Surmann, V. Tretyakov, S. Corrao, S. Pratzler-Wanczura, M. Sulk

Published in: Field and Service Robotics

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The paper describes experience with applying a user-centric design methodology in developing systems for human-robot teaming in Urban Search and Rescue. A human-robot team consists of several semi-autonomous robots (rovers/UGVs, microcopter/UAVs), several humans at an off-site command post (mission commander, UGV operators) and one on-site human (UAV operator). This system has been developed in close cooperation with several rescue organizations, and has been deployed in a real-life tunnel accident use case. The human-robot team jointly explores an accident site, communicating using a multi-modal team interface, and spoken dialogue. The paper describes the development of this complex socio-technical system per se, as well as recent experience in evaluating the performance of this system.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Relations between questions are indicated in brackets, e.g. (4) means a relation to question 4.
 
Literature
1.
go back to reference J.F. Allen, C.R. Perrault, Analyzing intention in utterances. Artif. Intell. 15(3) (1980) J.F. Allen, C.R. Perrault, Analyzing intention in utterances. Artif. Intell. 15(3) (1980)
2.
go back to reference J.F. Allen, D.J. Litman. Discourse processing and common sense plans. In P.R. Cohen, J. Morgan, M. Pollack (eds.), Intentions and Communication. The MIT Press, 1990 J.F. Allen, D.J. Litman. Discourse processing and common sense plans. In P.R. Cohen, J. Morgan, M. Pollack (eds.), Intentions and Communication. The MIT Press, 1990
3.
go back to reference A. Birk, S. Carpin, Rescue robotics—a crucial milestone on the road to autonomous systems. Adv. Robot. 20(5), 595–605 (2006)CrossRef A. Birk, S. Carpin, Rescue robotics—a crucial milestone on the road to autonomous systems. Adv. Robot. 20(5), 595–605 (2006)CrossRef
4.
go back to reference J.L. Burke, R.R. Murphy, M. Coovert, D. Riddle. Moonlight in Miami: An ethnographic study of human-robot interaction in USAR. Hum. Comput. Interact. 19(1–2), 85–116 (2004) J.L. Burke, R.R. Murphy, M. Coovert, D. Riddle. Moonlight in Miami: An ethnographic study of human-robot interaction in USAR. Hum. Comput. Interact. 19(1–2), 85–116 (2004)
5.
go back to reference J. Carlson, R.R. Murphy, How UGVs physically fail in the field. IEEE Trans. Rob. 21(3), 423–437 (2005) J. Carlson, R.R. Murphy, How UGVs physically fail in the field. IEEE Trans. Rob. 21(3), 423–437 (2005)
6.
go back to reference H. Clark, Using Language (Cambridge University Press, Cambridge, 1996) H. Clark, Using Language (Cambridge University Press, Cambridge, 1996)
7.
go back to reference A. Finzi, F. Pirri, Representing flexible temporal behaviors in the situation calculus, in Proceedings of the 19th International Joint Conference on Artificial Intelligence, IJCAI’05, (Morgan Kaufmann Publishers Inc, San Francisco, 2005), pp. 436–441 A. Finzi, F. Pirri, Representing flexible temporal behaviors in the situation calculus, in Proceedings of the 19th International Joint Conference on Artificial Intelligence, IJCAI’05, (Morgan Kaufmann Publishers Inc, San Francisco, 2005), pp. 436–441
8.
go back to reference T. Fong, C. Thorpe, C. Baur, Multi-robot remote driving with collaborative control. IEEE Trans. Indus. Electron. 54(4), 699–704 (2003)CrossRef T. Fong, C. Thorpe, C. Baur, Multi-robot remote driving with collaborative control. IEEE Trans. Indus. Electron. 54(4), 699–704 (2003)CrossRef
9.
go back to reference M. Gianni, P. Papadakis, F. Pirri, M. Liu, F. Pomerleau, F. Colas, K. Zimmerman, T. Svoboda, T. Petricek, G. J. M. Kruijff, H. Zender, Khambhaita, A unified framework for planning and execution-monitoring of mobile robots, in Proceedings of the AAAI-11 Workshop on Automated Action Planning for Autonomous Mobile Robots, 2011 M. Gianni, P. Papadakis, F. Pirri, M. Liu, F. Pomerleau, F. Colas, K. Zimmerman, T. Svoboda, T. Petricek, G. J. M. Kruijff, H. Zender, Khambhaita, A unified framework for planning and execution-monitoring of mobile robots, in Proceedings of the AAAI-11 Workshop on Automated Action Planning for Autonomous Mobile Robots, 2011
10.
go back to reference M. Gianni, P. Papadakis, F. Pirri, M. Pizzoli, Awareness in mixed initiative planning, in AAAI Fall Symposium Series, 2011 M. Gianni, P. Papadakis, F. Pirri, M. Pizzoli, Awareness in mixed initiative planning, in AAAI Fall Symposium Series, 2011
11.
go back to reference B.J. Grosz, C.L. Sidner, Attention, intention and the structure of discourse. Computat. Linguist. 12(3), 175–204 (1986) B.J. Grosz, C.L. Sidner, Attention, intention and the structure of discourse. Computat. Linguist. 12(3), 175–204 (1986)
12.
go back to reference C. Jansen, J.B.F. van Erp. Telepresence control of unmanned systems. in M. Barnes, F. Jentsch, eds. Human-Robot Interactions in Future Military Operations (Ashgate Publishing Limited, Hampshire, 2010), pp. 251–270 C. Jansen, J.B.F. van Erp. Telepresence control of unmanned systems. in M. Barnes, F. Jentsch, eds. Human-Robot Interactions in Future Military Operations (Ashgate Publishing Limited, Hampshire, 2010), pp. 251–270
13.
go back to reference M. Johnson, J.M. Bradshaw, P.J. Feltovich, R.R. Hoffman, C. Jonker, B. van Riemsdijk, M. Sierhuis, Beyond cooperative robotics: the central role of interdependence in coactive design. IEEE Intelligent Systems, pp. 81–88, May/June 2011 M. Johnson, J.M. Bradshaw, P.J. Feltovich, R.R. Hoffman, C. Jonker, B. van Riemsdijk, M. Sierhuis, Beyond cooperative robotics: the central role of interdependence in coactive design. IEEE Intelligent Systems, pp. 81–88, May/June 2011
14.
go back to reference S. Keshavdas, H. Zender, G.J.M Kruijff, M. Liu, F. Colas, Functional mapping: spatial inferencing to aid human-robot rescue efforts in unstructured disaster environments, in Proceedings of the 2012 AAAI Spring Symposium on Designing Intelligent Robots (2012) S. Keshavdas, H. Zender, G.J.M Kruijff, M. Liu, F. Colas, Functional mapping: spatial inferencing to aid human-robot rescue efforts in unstructured disaster environments, in Proceedings of the 2012 AAAI Spring Symposium on Designing Intelligent Robots (2012)
15.
go back to reference H. Khambhaita, G.J.M. Kruijff, M. Mancas, M. Gianni, P. Papadakis, F. Pirri, M. Pizzoli, Help me to help you: how to learn intentions, actions and plans, in Proceedings of AAAI Spring Symposium Help Me Help You: Bridging the Gaps in Human-Agent Collaboration, March 2011 H. Khambhaita, G.J.M. Kruijff, M. Mancas, M. Gianni, P. Papadakis, F. Pirri, M. Pizzoli, Help me to help you: how to learn intentions, actions and plans, in Proceedings of AAAI Spring Symposium Help Me Help You: Bridging the Gaps in Human-Agent Collaboration, March 2011
16.
go back to reference G. Klein, D.D. Woods, J.M. Bradshaw, R. Hoffman, P. Feltovich, Ten challenges for making automation a team player in joint human-agent activity. IEEE Intell. Syst. 19(6), 91–95, Nov–Dec 2004 G. Klein, D.D. Woods, J.M. Bradshaw, R. Hoffman, P. Feltovich, Ten challenges for making automation a team player in joint human-agent activity. IEEE Intell. Syst. 19(6), 91–95, Nov–Dec 2004
17.
go back to reference T. Komatsu, S. Yamada, Adaptation gap hypothesis: how differences between users’ expected and perceived agent functions affect their subjective impression. J. Syst. Cybern. Inform. 9(1), 67–74 (2011) T. Komatsu, S. Yamada, Adaptation gap hypothesis: how differences between users’ expected and perceived agent functions affect their subjective impression. J. Syst. Cybern. Inform. 9(1), 67–74 (2011)
18.
go back to reference G.J.M. Kruijff, M. Janíček, Using doctrines for human-robot collaboration to guide ethical behaviour. in Proceedings of the AAAI 2011 Fall Symposium Robot-Human Team-Work in Dynamic Adverse Environments. AAAI, 2011 G.J.M. Kruijff, M. Janíček, Using doctrines for human-robot collaboration to guide ethical behaviour. in Proceedings of the AAAI 2011 Fall Symposium Robot-Human Team-Work in Dynamic Adverse Environments. AAAI, 2011
19.
go back to reference G.J.M. Kruijff, M. Janíček, P. Lison, Continual processing of situated dialogue in human-robot collaborative activities. in Proceedings of the 19th International Symposium on Robot and Human Interactive Communication (RO-MAN 2010). IEEE, 2010 G.J.M. Kruijff, M. Janíček, P. Lison, Continual processing of situated dialogue in human-robot collaborative activities. in Proceedings of the 19th International Symposium on Robot and Human Interactive Communication (RO-MAN 2010). IEEE, 2010
20.
go back to reference G.J.M. Kruijff, M. Janíček, and H. Zender, Situated communication for joint activity in human-robot teams. IEEE Intell. Syst. 272, 27–35 (2012) forthcoming G.J.M. Kruijff, M. Janíček, and H. Zender, Situated communication for joint activity in human-robot teams. IEEE Intell. Syst. 272, 27–35 (2012) forthcoming
21.
go back to reference B. Larochelle, G.J.M. Kruijff, N. Smets, T. Mioch, P. Groenewegen, Establishing human situation awareness using a multi-modal operator control unit in an urban search and rescue human-robot team. in Proceedings of the 20th IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 2011 B. Larochelle, G.J.M. Kruijff, N. Smets, T. Mioch, P. Groenewegen, Establishing human situation awareness using a multi-modal operator control unit in an urban search and rescue human-robot team. in Proceedings of the 20th IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 2011
22.
go back to reference M. Liu, F. Colas, R. Siegwart. Regional topological segmentation based on mutual information graphs. in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2011 M. Liu, F. Colas, R. Siegwart. Regional topological segmentation based on mutual information graphs. in Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2011
23.
go back to reference M. Lohse. The role of expectations and situations in human-robot interaction. In K. Dautenhahn, J. Saunders, eds. New Frontiers in Human-Robot Interaction (John Benjamins, Amsterdam, 2011) pp. 35–56 M. Lohse. The role of expectations and situations in human-robot interaction. In K. Dautenhahn, J. Saunders, eds. New Frontiers in Human-Robot Interaction (John Benjamins, Amsterdam, 2011) pp. 35–56
24.
go back to reference C. Miller, R. Parasuraman, Designing for flexible interaction between humans and automation: delegation interfaces for supervisory control. Hum. Factors 49, 57–75 (2007)CrossRef C. Miller, R. Parasuraman, Designing for flexible interaction between humans and automation: delegation interfaces for supervisory control. Hum. Factors 49, 57–75 (2007)CrossRef
25.
go back to reference R.R. Murphy, Human-robot interaction in rescue robotics. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 34(2), 138–153 (2004)CrossRef R.R. Murphy, Human-robot interaction in rescue robotics. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 34(2), 138–153 (2004)CrossRef
26.
go back to reference R.R. Murphy, J.L. Burke, The safe human-robot ratio. in M.J. Barnes, F. Jentsch, eds. Human-Robot Interactions in Future Military Operations, Human Factors in Defence (Ashgate, Florida, 2010), pp. 31–49 R.R. Murphy, J.L. Burke, The safe human-robot ratio. in M.J. Barnes, F. Jentsch, eds. Human-Robot Interactions in Future Military Operations, Human Factors in Defence (Ashgate, Florida, 2010), pp. 31–49
27.
go back to reference R.R. Murphy, S. Tadokoro, D. Nardi, A. Jacoff, P. Fiorini, H. Choset, A.M. Erkmen. Search and rescue robotics. in B. Siciliano, O. Khatib, eds. Springer Handbook of Robotics (Springer, Berlin, 2008), Part F, pp. 1151–1173 R.R. Murphy, S. Tadokoro, D. Nardi, A. Jacoff, P. Fiorini, H. Choset, A.M. Erkmen. Search and rescue robotics. in B. Siciliano, O. Khatib, eds. Springer Handbook of Robotics (Springer, Berlin, 2008), Part F, pp. 1151–1173
28.
go back to reference T. Oron-Gilad, P.A. Hancock, Multi-modal information display under stress. in P.A. Hancock, J.L. Szalma, eds. Performance Under Stress, Human Factors in Defence (Ashgate, Florida, 2008), pp. 251–270 T. Oron-Gilad, P.A. Hancock, Multi-modal information display under stress. in P.A. Hancock, J.L. Szalma, eds. Performance Under Stress, Human Factors in Defence (Ashgate, Florida, 2008), pp. 251–270
29.
go back to reference P. Papadakis, I. Pratikakis, S. Perantonis, T. Theoharis, Efficient 3d shape matching and retrieval using a concrete radialized spherical projection representation. Pattern Recognit. 40(9), 2437–2452 (2007)CrossRefMATH P. Papadakis, I. Pratikakis, S. Perantonis, T. Theoharis, Efficient 3d shape matching and retrieval using a concrete radialized spherical projection representation. Pattern Recognit. 40(9), 2437–2452 (2007)CrossRefMATH
30.
go back to reference E.G. Papadopoulos, D.A. Rey. A new measure of tipover stability margin for mobile manipulators. in Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3111–3116, 1996 E.G. Papadopoulos, D.A. Rey. A new measure of tipover stability margin for mobile manipulators. in Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3111–3116, 1996
31.
go back to reference R. Parasuraman, M. Barnes, K. Cosenzo, Adaptive automation for human-robot teaming in future command and control systems. Int. J. Command Control 1(2), 43–68 (2007) R. Parasuraman, M. Barnes, K. Cosenzo, Adaptive automation for human-robot teaming in future command and control systems. Int. J. Command Control 1(2), 43–68 (2007)
32.
go back to reference F. Pirri, The well-designed logical robot: learning and experience from observations to the situation calculus. Artif. Intell. 175(1), 378–415 (2011) F. Pirri, The well-designed logical robot: learning and experience from observations to the situation calculus. Artif. Intell. 175(1), 378–415 (2011)
33.
go back to reference F. Pomerleau, S. Magnenat, F. Colas, M. Liu, R. Siegwart, Tracking a depth camera: parameter exploration for fast icp. in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2011) F. Pomerleau, S. Magnenat, F. Colas, M. Liu, R. Siegwart, Tracking a depth camera: parameter exploration for fast icp. in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2011)
34.
go back to reference P.M. Salmon, N.A. Stanton, G.H. Walker, D.P. Jenkins, Distributed Situation Awareness: Theory, Measurement, and Application to Teamwork (Ashgate, Human Factors in Defence, 2009) P.M. Salmon, N.A. Stanton, G.H. Walker, D.P. Jenkins, Distributed Situation Awareness: Theory, Measurement, and Application to Teamwork (Ashgate, Human Factors in Defence, 2009)
35.
go back to reference K. Stubbs, P.J. Hinds, D. Wettergreen, Autonomy and common ground in human-robot interaction: A field study. IEEE Intell. Syst. 22, 42–50 (2007) (Special Issue on Interacting with Autonomy) K. Stubbs, P.J. Hinds, D. Wettergreen, Autonomy and common ground in human-robot interaction: A field study. IEEE Intell. Syst. 22, 42–50 (2007) (Special Issue on Interacting with Autonomy)
36.
go back to reference J. van Diggelen, K. van Drimmelen, A. Heuvelink, P.J.M. Kerbusch, M.A. Neerincx, S.M.A van Trijp, E.M. Ubink, and B. van der Vecht. Mutual empowerment in mobile soldier support. Special Issue of the International Journal of Battlefield Technology on Human Factors and Battlefield Technologies. submitted. J. van Diggelen, K. van Drimmelen, A. Heuvelink, P.J.M. Kerbusch, M.A. Neerincx, S.M.A van Trijp, E.M. Ubink, and B. van der Vecht. Mutual empowerment in mobile soldier support. Special Issue of the International Journal of Battlefield Technology on Human Factors and Battlefield Technologies. submitted.
37.
go back to reference D.D. Woods, J. Tittle, M. Feil, A. Roesler, Envisioning human-robot coordination for future operations. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 34(2), 210–218 (2004) D.D. Woods, J. Tittle, M. Feil, A. Roesler, Envisioning human-robot coordination for future operations. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 34(2), 210–218 (2004)
38.
go back to reference K. Zimmermann, D. Hurych, T. Svoboda, Improving cascade of classifiers by sliding window alignment in between. in The 5th International Conference on Automation, Robotics and Applications. IEEE, 2011 K. Zimmermann, D. Hurych, T. Svoboda, Improving cascade of classifiers by sliding window alignment in between. in The 5th International Conference on Automation, Robotics and Applications. IEEE, 2011
Metadata
Title
Experience in System Design for Human-Robot Teaming in Urban Search and Rescue
Authors
G. J. M. Kruijff
M. Janíček
S. Keshavdas
B. Larochelle
H. Zender
N. J. J. M. Smets
T. Mioch
M. A. Neerincx
J. V. Diggelen
F. Colas
M. Liu
F. Pomerleau
R. Siegwart
V. Hlaváč
T. Svoboda
T. Petříček
M. Reinstein
K. Zimmermann
F. Pirri
M. Gianni
P. Papadakis
A. Sinha
P. Balmer
N. Tomatis
R. Worst
T. Linder
H. Surmann
V. Tretyakov
S. Corrao
S. Pratzler-Wanczura
M. Sulk
Copyright Year
2014
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-40686-7_8