Skip to main content
Top

2023 | OriginalPaper | Chapter

Ein interaktives strategisches Missionsmanagementsystem für intuitive Mensch-Roboter-Kooperation

Authors : Elsa Andrea Kirchner, Hagen Langer, Michael Beetz

Published in: KI-Technologie für Unterwasserroboter

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Zusammenfassung

Um die kooperative Aufgabenplanung und Koordination zwischen dem menschlichen Bediener und Roboterteams zu ermöglichen, werden neue Arten von Schnittstellen benötigt. Wir präsentieren ein interaktives strategisches Missionsmanagementsystem (ISMMS) für Unterwassererkundungen, die von gemischten Teams aus Robotern und menschlichen Ermittlern durchgeführt werden, das eine kooperative Aufgabenplanung und Koordination zwischen dem menschlichen Bediener und Roboterteams ermöglicht. Die Hauptziele des ISMMS sind es, Roboter in die Lage zu versetzen, dem Menschen ihre Absichten, Probleme und Situation schnell und auf intuitive Weise zu „erklären“, eine reibungslose Schnittstelle zwischen autonomem Verhalten und menschlicher Kontrolle zu ermöglichen, intelligente Schnittstellen zur obligatorischen externen Kontrolle bereitzustellen und eine adaptive Aufgabenteilung zu ermöglichen, wobei die intuitive Nutzung und Interaktion anhand von verhaltensbezogenen und physiologischen menschlichen Daten optimiert wird.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Song H, Rawat DB, Jeschke S, Brecher C (2016) Cyber-physical systems: foundations, principles and applications, reprint. Academic Press, Cambridge Song H, Rawat DB, Jeschke S, Brecher C (2016) Cyber-physical systems: foundations, principles and applications, reprint. Academic Press, Cambridge
2.
go back to reference Rammert W (2009) Hybride Handlungsträgerschaft: Ein Soziotechnisches Modell verteilten Handelns, in Intelligente Objekte. Springer, Berlin, S 23–33 Rammert W (2009) Hybride Handlungsträgerschaft: Ein Soziotechnisches Modell verteilten Handelns, in Intelligente Objekte. Springer, Berlin, S 23–33
3.
go back to reference Marconi L, Melchiorri C, Beetz M, Pangercic D, Siegwart R, Leutenegger S, Carloni R, Stramigioli S, Bruyninckx H, Doherty P, Kleiner A, Lippiello V, Finzi A, Siciliano B, Sala S, Tomatis N (2012) The SHERPA project: smart collaboration between humans and ground-aerial robots for improving rescuing activities in alpine environments. In: IEEE international symposium on safety, security, and rescue robotics (SSRR) Marconi L, Melchiorri C, Beetz M, Pangercic D, Siegwart R, Leutenegger S, Carloni R, Stramigioli S, Bruyninckx H, Doherty P, Kleiner A, Lippiello V, Finzi A, Siciliano B, Sala S, Tomatis N (2012) The SHERPA project: smart collaboration between humans and ground-aerial robots for improving rescuing activities in alpine environments. In: IEEE international symposium on safety, security, and rescue robotics (SSRR)
4.
go back to reference Kirchner EA, Kim S-K, Tabie M, Wöhrle H, Maurus M, Kirchner F (2016) An intelligent man-machine interface – multi-robot control adapted for task engagement based on single-trial detectability of p300. Front Human Neurosc 10:291. ISSN 1662-5161. https://doi.org/10.3389/fnhum.2016.00291. 229, 235, 244, 246 Kirchner EA, Kim S-K, Tabie M, Wöhrle H, Maurus M, Kirchner F (2016) An intelligent man-machine interface – multi-robot control adapted for task engagement based on single-trial detectability of p300. Front Human Neurosc 10:291. ISSN 1662-5161. https://​doi.​org/​10.​3389/​fnhum.​2016.​00291. 229, 235, 244, 246
5.
go back to reference Sonsalla R, Cordes F, Christensen L, Roehr TM, Stark T, Planthaber S, Maurus M, Mallwitz M, Kirchner EA (2017) Field testing of a cooperative multi-robot sample return mission in mars analogue environment. In: Proceedings of the 14th symposium on advanced space technologies in robotics and automation (ASTRA) Sonsalla R, Cordes F, Christensen L, Roehr TM, Stark T, Planthaber S, Maurus M, Mallwitz M, Kirchner EA (2017) Field testing of a cooperative multi-robot sample return mission in mars analogue environment. In: Proceedings of the 14th symposium on advanced space technologies in robotics and automation (ASTRA)
6.
go back to reference Planthaber S, Maurus M, Bongardt B, Mallwitz M, Vaca Benitnez LM, Christensen L, Cordes F, Sonsalla R, Stark T, Roehr T (2017) Controlling a semi-autonomous robot team from a virtual environment. In: proceedings of the companion of the 2017 ACM/IEEE international conference on human-robot interaction (HRI ’17). ACM, New York, NY, USA, 417–417. https://doi.org/10.1145/3029798.3036647 Planthaber S, Maurus M, Bongardt B, Mallwitz M, Vaca Benitnez LM, Christensen L, Cordes F, Sonsalla R, Stark T, Roehr T (2017) Controlling a semi-autonomous robot team from a virtual environment. In: proceedings of the companion of the 2017 ACM/IEEE international conference on human-robot interaction (HRI ’17). ACM, New York, NY, USA, 417–417. https://​doi.​org/​10.​1145/​3029798.​3036647
7.
go back to reference Straube S, Rohn M, Roemmermann M, Bergatt C, Jordan M, Kirchner EA (2011) On the closure of perceptual gaps in man-machine interaction: virtual immersion, psychophysics and electrophysiology. Perception, 40 ECVP Abstract Supplement:177. 241 Straube S, Rohn M, Roemmermann M, Bergatt C, Jordan M, Kirchner EA (2011) On the closure of perceptual gaps in man-machine interaction: virtual immersion, psychophysics and electrophysiology. Perception, 40 ECVP Abstract Supplement:177. 241
8.
go back to reference Wickens CD (1984) Processing resources in attention. In: Parasuraman R, Davies D (Hrsg) Varieties of attention, Academic Press, S 63–101 Wickens CD (1984) Processing resources in attention. In: Parasuraman R, Davies D (Hrsg) Varieties of attention, Academic Press, S 63–101
9.
go back to reference Wickens CD (1992) Engineering psychology and human performance (2nd. Aufl.), New York: HarperCollins Wickens CD (1992) Engineering psychology and human performance (2nd. Aufl.), New York: HarperCollins
10.
go back to reference Gerson AD, Parra LC, Sajda P (2006) Cortically coupled computer vision for rapid image search. IEEE Trans Neural Syst Rehabil Eng. 14(2):174–179CrossRef Gerson AD, Parra LC, Sajda P (2006) Cortically coupled computer vision for rapid image search. IEEE Trans Neural Syst Rehabil Eng. 14(2):174–179CrossRef
11.
go back to reference Kirchner EA, Kim S-K, Straube S, Seeland A, Wöhrle H, Krell MM, Tabie M, Fahle M (2013) On the applicability of brain reading for predictive human-machine interfaces in robotics. PLoS ONE, Pub Lib Sci, 8(12):e81732 Kirchner EA, Kim S-K, Straube S, Seeland A, Wöhrle H, Krell MM, Tabie M, Fahle M (2013) On the applicability of brain reading for predictive human-machine interfaces in robotics. PLoS ONE, Pub Lib Sci, 8(12):e81732
12.
go back to reference Coles M (1989) Modern mind-brain reading: psychophysiology, physiology, and cognition. Psychophysiology 26(3):251–269CrossRef Coles M (1989) Modern mind-brain reading: psychophysiology, physiology, and cognition. Psychophysiology 26(3):251–269CrossRef
13.
go back to reference Beetz M, Beßler D, Haidu A, Bozcuoglu AK, Bartels G (2018) KnowRob 2.0 – a 2nd generation knowledge processing framework for cognition-enabled robotic agents. In: International conference on robotics and automation (ICRA) Beetz M, Beßler D, Haidu A, Bozcuoglu AK, Bartels G (2018) KnowRob 2.0 – a 2nd generation knowledge processing framework for cognition-enabled robotic agents. In: International conference on robotics and automation (ICRA)
14.
go back to reference Tenorth M, Winkler J, Beßler D, Beetz M (2015) Open-EASE – a cloud-based knowledge service for autonomous learning, KI – Künstliche Intelligenz Tenorth M, Winkler J, Beßler D, Beetz M (2015) Open-EASE – a cloud-based knowledge service for autonomous learning, KI – Künstliche Intelligenz
15.
go back to reference Tenorth M, Beetz M (2013) KnowRob – a knowledge processing infrastructure for cognition-enabled robots. Int J Robot Res 32(5):566–590CrossRef Tenorth M, Beetz M (2013) KnowRob – a knowledge processing infrastructure for cognition-enabled robots. Int J Robot Res 32(5):566–590CrossRef
16.
go back to reference Bozcuoglu AK, Kazhoyan G, Furuta Y, Stelter S, Beetz M, Okada K, Inaba M (2018) The exchange of knowledge using cloud robotics. Robot Autom Lett 3(2):1072–1079CrossRef Bozcuoglu AK, Kazhoyan G, Furuta Y, Stelter S, Beetz M, Okada K, Inaba M (2018) The exchange of knowledge using cloud robotics. Robot Autom Lett 3(2):1072–1079CrossRef
17.
go back to reference Baddeley AD (1986) Working memory. Clarendon Press Baddeley AD (1986) Working memory. Clarendon Press
18.
go back to reference Endsley MR (2013) Situation awareness. Oxf Handb Cogn Eng Endsley MR (2013) Situation awareness. Oxf Handb Cogn Eng
19.
go back to reference Woods DD (1991) Representation aiding: a ten year retrospective, S 1173–1176 Woods DD (1991) Representation aiding: a ten year retrospective, S 1173–1176
20.
go back to reference Jamieson GA (2007) Ecological interface design for petrochemical process control: an empirical assessment. IEEE Trans Syst Man Cybern Part Syst Hum 37(6): 906–920CrossRef Jamieson GA (2007) Ecological interface design for petrochemical process control: an empirical assessment. IEEE Trans Syst Man Cybern Part Syst Hum 37(6): 906–920CrossRef
21.
go back to reference Burns CM et al (2008) Evaluation of ecological interface design for nuclear process control: situation awareness effects. Hum Factors 50(4):663–679CrossRef Burns CM et al (2008) Evaluation of ecological interface design for nuclear process control: situation awareness effects. Hum Factors 50(4):663–679CrossRef
22.
go back to reference St John M, Smallman HS, Manes DI, Feher BA, Morrison JG (2005) Heuristic automation for decluttering tactical displays. Hum Factors 47(3):509–525CrossRef St John M, Smallman HS, Manes DI, Feher BA, Morrison JG (2005) Heuristic automation for decluttering tactical displays. Hum Factors 47(3):509–525CrossRef
23.
go back to reference Murphy-Chutorian E, Trivedi MM (2009) Head pose estimation in computer vision: a survey. IEEE Trans Pattern Anal Mach Intell 31(4):607–626CrossRef Murphy-Chutorian E, Trivedi MM (2009) Head pose estimation in computer vision: a survey. IEEE Trans Pattern Anal Mach Intell 31(4):607–626CrossRef
24.
go back to reference Hansen DW, Qiang J (2010) In the eye of the beholder: a survey of models for eyes and gaze. IEEE Trans Pattern Anal Mach Intell 32(3):478–500CrossRef Hansen DW, Qiang J (2010) In the eye of the beholder: a survey of models for eyes and gaze. IEEE Trans Pattern Anal Mach Intell 32(3):478–500CrossRef
25.
go back to reference la Torre FD, Cohn JF (2011) Facial expression analysis. Visual analysis of humans. Springer, London, S 377–409 la Torre FD, Cohn JF (2011) Facial expression analysis. Visual analysis of humans. Springer, London, S 377–409
26.
go back to reference Dinges DF, Mallis MM, Maislin G, Iv P, JW (1998) Evaluation of Techniques for Ocular Measurement as an Index of Fatigue and the Basis for Alertness Management Dinges DF, Mallis MM, Maislin G, Iv P, JW (1998) Evaluation of Techniques for Ocular Measurement as an Index of Fatigue and the Basis for Alertness Management
27.
go back to reference Dong Y, Hu Z, Uchimura K, Murayama N (2011) Driver inattention monitoring system for intelligent vehicles: a review. IEEE Trans Intell Transp Syst 12(2):596–614CrossRef Dong Y, Hu Z, Uchimura K, Murayama N (2011) Driver inattention monitoring system for intelligent vehicles: a review. IEEE Trans Intell Transp Syst 12(2):596–614CrossRef
28.
go back to reference Banda N, Robinson P (2011) Multimodal affect recognition in intelligent tutoring systems. Affect Comput Intell Interact, 200–207 Banda N, Robinson P (2011) Multimodal affect recognition in intelligent tutoring systems. Affect Comput Intell Interact, 200–207
29.
go back to reference Whitehill J et al (2011) Towards an optimal affect-sensitive instructional system of cognitive skills 2011:20–25 Whitehill J et al (2011) Towards an optimal affect-sensitive instructional system of cognitive skills 2011:20–25
30.
go back to reference Kim Y, Lee H, Provost EM (2013) Deep learning for robust feature generation in audiovisual emotion recognition, S 3687–3691 Kim Y, Lee H, Provost EM (2013) Deep learning for robust feature generation in audiovisual emotion recognition, S 3687–3691
31.
go back to reference Borghini G, Astolfi L, Vecchiato G, Mattia D, Babiloni F (2014) Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci Biobehav Rev. 44:58–75CrossRef Borghini G, Astolfi L, Vecchiato G, Mattia D, Babiloni F (2014) Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci Biobehav Rev. 44:58–75CrossRef
32.
go back to reference Scharinger C, Soutschek A, Schubert T, Gerjets P (2017) Comparison of the working memory load in n-back and working memory span tasks by means of EEG frequency band power and P300 amplitude. Front Human Neurosc 11:6 Scharinger C, Soutschek A, Schubert T, Gerjets P (2017) Comparison of the working memory load in n-back and working memory span tasks by means of EEG frequency band power and P300 amplitude. Front Human Neurosc 11:6
33.
go back to reference Dasari D, Shou G, Ding L (2017) ICA-derived EEG correlates to mental fatigue, effort, and workload in a realistically simulated air traffic control task. 11, 297 Dasari D, Shou G, Ding L (2017) ICA-derived EEG correlates to mental fatigue, effort, and workload in a realistically simulated air traffic control task. 11, 297
34.
go back to reference Wascher E, Rasch B, Sänger J, Hoffmann S, Schneider D, Rinkenauer G, Heuer H, Gutberlet I (2014) Frontal theta activity reflects distinct aspects of mental fatigue. Biol Psychol 96:57–65CrossRef Wascher E, Rasch B, Sänger J, Hoffmann S, Schneider D, Rinkenauer G, Heuer H, Gutberlet I (2014) Frontal theta activity reflects distinct aspects of mental fatigue. Biol Psychol 96:57–65CrossRef
35.
go back to reference Pomer-Escher AG, Pinheiro de Souza MD, Bastos Filho TF (2014) Methodology for analysis of stress level based on asymmetry patterns of alpha rhythms in EEG signals. In: Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living (BRC), 5th ISSNIP-IEEE, S 1–5 Pomer-Escher AG, Pinheiro de Souza MD, Bastos Filho TF (2014) Methodology for analysis of stress level based on asymmetry patterns of alpha rhythms in EEG signals. In: Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living (BRC), 5th ISSNIP-IEEE, S 1–5
36.
go back to reference Fan M, Tootooni MS, Sivasubramony RS, Miskovic V, Rao PK, Chou C-A (2016) Acute stress detection using recurrence quantification analysis of electroencephalogram (EEG) Signals. Springer, Cham, S 252–261 Fan M, Tootooni MS, Sivasubramony RS, Miskovic V, Rao PK, Chou C-A (2016) Acute stress detection using recurrence quantification analysis of electroencephalogram (EEG) Signals. Springer, Cham, S 252–261
37.
go back to reference Garcia Molina G, Tsoneva T, Nijholt A (2009) Emotional brain-computer interfaces. In: International conference on affective computing and intelligent interaction, S 138–146 Garcia Molina G, Tsoneva T, Nijholt A (2009) Emotional brain-computer interfaces. In: International conference on affective computing and intelligent interaction, S 138–146
38.
go back to reference Hamid NH, Sulaiman N, Aris SAM, Murat ZH, Taib MN (2010) Evaluation of human stress using EEG power spectrum. In: 6th International colloquium on signal processing and its applications (CSPA), S 1–4 Hamid NH, Sulaiman N, Aris SAM, Murat ZH, Taib MN (2010) Evaluation of human stress using EEG power spectrum. In: 6th International colloquium on signal processing and its applications (CSPA), S 1–4
39.
go back to reference Aftanas LI, Varlamov AA, Pavlov SS, Makhnev VP, Reva NV (2001) Affective picture processing: event related synchronization within individually defined human theta band is modulated by valence dimension. Neurosci Lett 303:115–118CrossRef Aftanas LI, Varlamov AA, Pavlov SS, Makhnev VP, Reva NV (2001) Affective picture processing: event related synchronization within individually defined human theta band is modulated by valence dimension. Neurosci Lett 303:115–118CrossRef
42.
go back to reference Iturrate I, Montesano L, Minguez J (2010) Robot reinforcement learning using EEG-based reward signals. In: IEEE international conference of on robotics and automation (ICRA), S 4181–4184 Iturrate I, Montesano L, Minguez J (2010) Robot reinforcement learning using EEG-based reward signals. In: IEEE international conference of on robotics and automation (ICRA), S 4181–4184
43.
go back to reference Kim SK, Kirchner EA, Stefes A, Kirchner F (2017) Intrinsic interactive reinforcement learning – using error-related potentials for real world human-robot interaction. Sci Reports 7:17562 Kim SK, Kirchner EA, Stefes A, Kirchner F (2017) Intrinsic interactive reinforcement learning – using error-related potentials for real world human-robot interaction. Sci Reports 7:17562
Metadata
Title
Ein interaktives strategisches Missionsmanagementsystem für intuitive Mensch-Roboter-Kooperation
Authors
Elsa Andrea Kirchner
Hagen Langer
Michael Beetz
Copyright Year
2023
DOI
https://doi.org/10.1007/978-3-031-42369-7_16