Skip to main content

2019 | OriginalPaper | Buchkapitel

Estimating Human State from Simulated Assisted Driving with Stochastic Filtering Techniques

verfasst von : Gregory M. Gremillion, Daniel Donavanik, Catherine E. Neubauer, Justin D. Brody, Kristin E. Schaefer

Erschienen in: Advances in Human Factors in Simulation and Modeling

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This work proposes a process for formulating a model and estimation scheme to predict changes in decision authority with a simulated autonomous driving assistant. The unique component of this modeling approach is the use of direct estimation of governing mental decision states via recursive psychophysiological inference. Treating characteristic quantities of the environment as inputs, and behavioral and physiological signals as outputs, we propose the estimation of intermediate or underlying psychological states of the human can be used to predict the decision to engage or disengage a driving assistant, using methods of stochastic filtering. Such a framework should enable techniques to optimally fuse information and thereby improve performance in human-autonomy driving interactions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Phillips, E., Ososky, S., Grove, J., Jentsch, F.: From tools to teammates: toward the development of appropriate mental models for intelligent robots. In: Proceedings of the Human Factors and Ergonomics, pp. 1491–1495 (2011) Phillips, E., Ososky, S., Grove, J., Jentsch, F.: From tools to teammates: toward the development of appropriate mental models for intelligent robots. In: Proceedings of the Human Factors and Ergonomics, pp. 1491–1495 (2011)
2.
Zurück zum Zitat Hancock, P.A., Verwey, W.B.: Fatigue, workload and adaptive driver systems. Acc. Anal. Prev. 29(4), 495–506 (1997)CrossRef Hancock, P.A., Verwey, W.B.: Fatigue, workload and adaptive driver systems. Acc. Anal. Prev. 29(4), 495–506 (1997)CrossRef
3.
Zurück zum Zitat Stanton, N.A., Young, M.S.: Driver behaviour with adaptive cruise control. Ergonomics 48(10), 1294–1313 (2005)CrossRef Stanton, N.A., Young, M.S.: Driver behaviour with adaptive cruise control. Ergonomics 48(10), 1294–1313 (2005)CrossRef
4.
Zurück zum Zitat Koo, J., Kwac, J., Ju, W., Steinert, M., Leifer, L., Nass, C.: Why did my car just do that? Explain-ing semi-autonomous driving actions to improve driver understanding, trust, and performance. Int. J. Interact. Des. Manuf. 9(4), 269–275 (2015)CrossRef Koo, J., Kwac, J., Ju, W., Steinert, M., Leifer, L., Nass, C.: Why did my car just do that? Explain-ing semi-autonomous driving actions to improve driver understanding, trust, and performance. Int. J. Interact. Des. Manuf. 9(4), 269–275 (2015)CrossRef
5.
Zurück zum Zitat Parasuraman, R., Manzey, D.H.: Complacency and bias in human use of automation: an at-tentional integration. Hum. Fact.: J. Hum. Fact. Ergon. Soc. 52(3), 381–410 (2010)CrossRef Parasuraman, R., Manzey, D.H.: Complacency and bias in human use of automation: an at-tentional integration. Hum. Fact.: J. Hum. Fact. Ergon. Soc. 52(3), 381–410 (2010)CrossRef
6.
Zurück zum Zitat Adams, J.A., Deloach, S.A., Scheutz, M.: Shared mental models for human-robot teams. In: Proceedings of AAAI, Stanford, pp. 99–105 (2014) Adams, J.A., Deloach, S.A., Scheutz, M.: Shared mental models for human-robot teams. In: Proceedings of AAAI, Stanford, pp. 99–105 (2014)
7.
Zurück zum Zitat Awais, M., Henrich, D.: Human-robot collaboration by intention recognition using probabilistic state machines. In: Proceedings of International Workshop on Robotics in Alpe-Adria-Danube Region (RAAD), pp. 75–80. IEEE (2010) Awais, M., Henrich, D.: Human-robot collaboration by intention recognition using probabilistic state machines. In: Proceedings of International Workshop on Robotics in Alpe-Adria-Danube Region (RAAD), pp. 75–80. IEEE (2010)
8.
Zurück zum Zitat Ososky, S., Schuster, D., Jentsch, F., Fiore, S., Shumaker, R., Lebiere, C., Kurup, U., Oh, J., Stentz, A.: The importance of shared mental models and shared situation awareness for transforming robots from tools to teammates. In: Proceedings of SPIE - The International Society for Optical Engineering, p. 838710 (2012) Ososky, S., Schuster, D., Jentsch, F., Fiore, S., Shumaker, R., Lebiere, C., Kurup, U., Oh, J., Stentz, A.: The importance of shared mental models and shared situation awareness for transforming robots from tools to teammates. In: Proceedings of SPIE - The International Society for Optical Engineering, p. 838710 (2012)
9.
Zurück zum Zitat Chen, J.Y.C., Barnes, M.J.: Human–agent teaming for multirobot control: a review of human factors issues. IEEE Trans. Hum.-Mach. Syst. 44(1), 13–29 (2014)CrossRef Chen, J.Y.C., Barnes, M.J.: Human–agent teaming for multirobot control: a review of human factors issues. IEEE Trans. Hum.-Mach. Syst. 44(1), 13–29 (2014)CrossRef
10.
Zurück zum Zitat Schaefer, K.E., Brewer, R., Putney, J., Mottern, E., Barghout, J., Straub, E.R., Orlando, F.L.: Relinquishing manual control: collaboration requires the capability to understand robot intent. In: Proceedings of the IEEE 9th International Workshop on Collaborative Robots and Human Robot Interaction, pp. 359–366 (2016) Schaefer, K.E., Brewer, R., Putney, J., Mottern, E., Barghout, J., Straub, E.R., Orlando, F.L.: Relinquishing manual control: collaboration requires the capability to understand robot intent. In: Proceedings of the IEEE 9th International Workshop on Collaborative Robots and Human Robot Interaction, pp. 359–366 (2016)
11.
Zurück zum Zitat Lazarus, R.S.: The cognition-emotion debate: a bit of history. Handb. Cogn. Emot. 5(6), 3–19 (1999) Lazarus, R.S.: The cognition-emotion debate: a bit of history. Handb. Cogn. Emot. 5(6), 3–19 (1999)
12.
Zurück zum Zitat Matthews, G.: Towards a transactional ergonomics for driver stress and fatigue. Theoret. Issues Ergon. Sci. 3(2), 195–211 (2002)CrossRef Matthews, G.: Towards a transactional ergonomics for driver stress and fatigue. Theoret. Issues Ergon. Sci. 3(2), 195–211 (2002)CrossRef
13.
Zurück zum Zitat Xu, A., Dudek, G.: Trust-driven interactive visual navigation for autonomous robots. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 3922–3929 (2012) Xu, A., Dudek, G.: Trust-driven interactive visual navigation for autonomous robots. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 3922–3929 (2012)
14.
Zurück zum Zitat Takahashi, M., Kubo, O., Kitamura, M., Yoshikawa, H.: Neural network for human cognitive state estimation. In: Advanced Robotic Systems and the Real World Intelligent Robots and Systems 1994, pp. 2176–2183 (1994) Takahashi, M., Kubo, O., Kitamura, M., Yoshikawa, H.: Neural network for human cognitive state estimation. In: Advanced Robotic Systems and the Real World Intelligent Robots and Systems 1994, pp. 2176–2183 (1994)
15.
Zurück zum Zitat Ji, Q., Zhu, Z., Lan, P.: Real-time nonintrusive monitoring and prediction of driver fatigue. IEEE Trans. Veh. Technol. 53(4), 1052–1068 (2004)CrossRef Ji, Q., Zhu, Z., Lan, P.: Real-time nonintrusive monitoring and prediction of driver fatigue. IEEE Trans. Veh. Technol. 53(4), 1052–1068 (2004)CrossRef
16.
Zurück zum Zitat Metcalfe, J.S., Marathe, A.R., Haynes, B., Paul, V.J., Gremillion, G.M., Drnec, K., Atwater, C., Estepp, J.R., Lukos, J.R., Carter, E.A., Nothwang, W.D.: Building a framework to manage trust in automation. In: Proceedings of SPIE 10194, Micro- and Nanotechnology Sensors, Systems, and Applications IX, p. 101941U (2017) Metcalfe, J.S., Marathe, A.R., Haynes, B., Paul, V.J., Gremillion, G.M., Drnec, K., Atwater, C., Estepp, J.R., Lukos, J.R., Carter, E.A., Nothwang, W.D.: Building a framework to manage trust in automation. In: Proceedings of SPIE 10194, Micro- and Nanotechnology Sensors, Systems, and Applications IX, p. 101941U (2017)
17.
Zurück zum Zitat Donavanik, D., Hardt-Stremayr, A., Gremillion, G.M., Weiss, S., Nothwang, W.D.: Multi-sensor fusion techniques for state estimation of micro air vehicles. In: SPIE Defense and Security, p. 98361V. International Society for Optics and Photonics (2016) Donavanik, D., Hardt-Stremayr, A., Gremillion, G.M., Weiss, S., Nothwang, W.D.: Multi-sensor fusion techniques for state estimation of micro air vehicles. In: SPIE Defense and Security, p. 98361V. International Society for Optics and Photonics (2016)
18.
Zurück zum Zitat Rosencrantz, M., Gordon, G., Thrun, S.: Decentralized sensor fusion with distributed particle filters. In: Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence, pp. 493–500 (2002) Rosencrantz, M., Gordon, G., Thrun, S.: Decentralized sensor fusion with distributed particle filters. In: Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence, pp. 493–500 (2002)
19.
Zurück zum Zitat Van Der Merwe, R., Wan, E., Julier, S.: Sigma-point Kalman filters for nonlinear estimation and sensor-fusion: applications to integrated navigation. In: AIAA Guidance, Navigation, and Control Conference and Exhibit, p. 5120 (2004) Van Der Merwe, R., Wan, E., Julier, S.: Sigma-point Kalman filters for nonlinear estimation and sensor-fusion: applications to integrated navigation. In: AIAA Guidance, Navigation, and Control Conference and Exhibit, p. 5120 (2004)
20.
Zurück zum Zitat Gremillion, G.M., Metcalfe, J.S., Marathe, A.R., Paul, V.J., Christensen, J., Drnec, K., Haynes, B., Atwater, C.: Analysis of trust in autonomy for convoy operations. In: Proceedings of International Society for Optics and Photonics Defense+Security, p. 98361Z (2016) Gremillion, G.M., Metcalfe, J.S., Marathe, A.R., Paul, V.J., Christensen, J., Drnec, K., Haynes, B., Atwater, C.: Analysis of trust in autonomy for convoy operations. In: Proceedings of International Society for Optics and Photonics Defense+Security, p. 98361Z (2016)
21.
Zurück zum Zitat Cacioppo, J.T., Tassinary, L.G.: Inferring psychological significance from physiological signals. Am. Psychol. 45(1), 16 (1990) Cacioppo, J.T., Tassinary, L.G.: Inferring psychological significance from physiological signals. Am. Psychol. 45(1), 16 (1990)
22.
Zurück zum Zitat Just, M.A., Carpenter, P.A.: Eye fixations and cognitive processes. Cogn. Psychol. 8(4), 441–480 (1976)CrossRef Just, M.A., Carpenter, P.A.: Eye fixations and cognitive processes. Cogn. Psychol. 8(4), 441–480 (1976)CrossRef
23.
Zurück zum Zitat Poole, A., Ball, L.J.: Eye tracking in HCI and usability research. In: Encyclopedia of Human Computer Interaction, vol. 1. pp. 211–219 (2006) Poole, A., Ball, L.J.: Eye tracking in HCI and usability research. In: Encyclopedia of Human Computer Interaction, vol. 1. pp. 211–219 (2006)
24.
Zurück zum Zitat Glaholt, M.G., Reingold, E.M.: Eye movement monitoring as a process tracing methodology in decision making research. J. Neurosci. Psychol. Econ. 4(2), 125 (2011)CrossRef Glaholt, M.G., Reingold, E.M.: Eye movement monitoring as a process tracing methodology in decision making research. J. Neurosci. Psychol. Econ. 4(2), 125 (2011)CrossRef
25.
Zurück zum Zitat Marshall, S.: Measures of attention and cognitive effort in tactical decision making. Decis. Mak. Complex Environ. 321, 332 (2007) Marshall, S.: Measures of attention and cognitive effort in tactical decision making. Decis. Mak. Complex Environ. 321, 332 (2007)
26.
Zurück zum Zitat Beatty, J.: Pupillometric measurement of cognitive workload. TR-22, Department of Psychology, California University Los Angeles (1977) Beatty, J.: Pupillometric measurement of cognitive workload. TR-22, Department of Psychology, California University Los Angeles (1977)
27.
Zurück zum Zitat Schwalm, M., Keinath, A., Zimmer H.D.: Pupillometry as a method for measuring mental workload within a simulated driving task. Hum. Fact. Assist. Autom. 1–13 (2008) Schwalm, M., Keinath, A., Zimmer H.D.: Pupillometry as a method for measuring mental workload within a simulated driving task. Hum. Fact. Assist. Autom. 1–13 (2008)
28.
Zurück zum Zitat Parasuraman, R., Sheridan, T., Wickens, C.: Situation awareness, mental workload, and trust in automation: viable, empirically supported cognitive engineering constructs. J. Cogn. Eng. Decis. Mak. 2(2), 140–160 (2008)CrossRef Parasuraman, R., Sheridan, T., Wickens, C.: Situation awareness, mental workload, and trust in automation: viable, empirically supported cognitive engineering constructs. J. Cogn. Eng. Decis. Mak. 2(2), 140–160 (2008)CrossRef
29.
Zurück zum Zitat Shi, Y., Ruiz, N., Taib, R., Choi, E., Chen, F.: Galvanic skin response (GSR) as an index of cognitive load. In: CHI 2007, Extended Abstracts on Human Factors in Computing Systems, pp. 2651–2656 (2007) Shi, Y., Ruiz, N., Taib, R., Choi, E., Chen, F.: Galvanic skin response (GSR) as an index of cognitive load. In: CHI 2007, Extended Abstracts on Human Factors in Computing Systems, pp. 2651–2656 (2007)
30.
Zurück zum Zitat Bethel, C.L., Burke, J.L., Murphy, R.R., Salomon, K.: Psychophysiological experimental design for use in human-robot interaction studies. In: International Symposium on Collaborative Technologies and Systems (2007) Bethel, C.L., Burke, J.L., Murphy, R.R., Salomon, K.: Psychophysiological experimental design for use in human-robot interaction studies. In: International Symposium on Collaborative Technologies and Systems (2007)
31.
Zurück zum Zitat Figner, B., Murphy, R.O.: Using skin conductance in judgment and decision making re-search. In: Handbook of Process Tracing Methods for Decision Research, pp. 163–184 (2011) Figner, B., Murphy, R.O.: Using skin conductance in judgment and decision making re-search. In: Handbook of Process Tracing Methods for Decision Research, pp. 163–184 (2011)
32.
Zurück zum Zitat Matthews, R., McDonald, N.J., Trejo, L.J.: Psycho-physiological sensor techniques: an over-view. In: 11th International Conference on Human Computer Interaction (HCII), pp. 22–27 (2005) Matthews, R., McDonald, N.J., Trejo, L.J.: Psycho-physiological sensor techniques: an over-view. In: 11th International Conference on Human Computer Interaction (HCII), pp. 22–27 (2005)
33.
Zurück zum Zitat Montague, E., Xu, J., Chiou, E.: Shared experiences of technology and trust: an experimental study of physiological compliance between active and passive users in technology-mediated collaborative encounters. IEEE Trans. Hum.-Mach. Syst. 44(5), 614–624 (2014)CrossRef Montague, E., Xu, J., Chiou, E.: Shared experiences of technology and trust: an experimental study of physiological compliance between active and passive users in technology-mediated collaborative encounters. IEEE Trans. Hum.-Mach. Syst. 44(5), 614–624 (2014)CrossRef
34.
Zurück zum Zitat Schaefer, K.E., Scribner, D.R.: Individual differences, trust, and vehicle autonomy: a pilot study. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 59, no. 1. pp. 786–790 (2015) Schaefer, K.E., Scribner, D.R.: Individual differences, trust, and vehicle autonomy: a pilot study. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 59, no. 1. pp. 786–790 (2015)
35.
Zurück zum Zitat Haak, M., Bos, S., Panic, S., Rothkrantz, L.J.M.: Detecting stress using eye blinks and brain activity from EEG signals. In: Proceeding of the 1st Driver Car Interaction and Interface, pp. 35–60 (2008) Haak, M., Bos, S., Panic, S., Rothkrantz, L.J.M.: Detecting stress using eye blinks and brain activity from EEG signals. In: Proceeding of the 1st Driver Car Interaction and Interface, pp. 35–60 (2008)
36.
Zurück zum Zitat Rozado, D., Dunser, A.: Combining EEG with pupillometry to improve cognitive workload detection. Computer 48(10), 18–25 (2015)CrossRef Rozado, D., Dunser, A.: Combining EEG with pupillometry to improve cognitive workload detection. Computer 48(10), 18–25 (2015)CrossRef
37.
Zurück zum Zitat Haufe, S., Treder, M.S., Gugler, M.F., Sagebaum, M., Curio, G., Blankertz, B.: EEG potentials predict upcoming emergency brakings during simulated driving. J. Neural Eng. 8(5), 056001 (2011)CrossRef Haufe, S., Treder, M.S., Gugler, M.F., Sagebaum, M., Curio, G., Blankertz, B.: EEG potentials predict upcoming emergency brakings during simulated driving. J. Neural Eng. 8(5), 056001 (2011)CrossRef
38.
Zurück zum Zitat Lin, C.T., Chuang, C.H., Huang, C.S., Tsai, S.F., Lu, S.W., Chen, Y.H., Ko, L.W.: Wireless and wearable EEG system for evaluating driver vigilance. IEEE Trans. Biomed. Circuits Syst. 8(2), 165–176 (2014)CrossRef Lin, C.T., Chuang, C.H., Huang, C.S., Tsai, S.F., Lu, S.W., Chen, Y.H., Ko, L.W.: Wireless and wearable EEG system for evaluating driver vigilance. IEEE Trans. Biomed. Circuits Syst. 8(2), 165–176 (2014)CrossRef
39.
Zurück zum Zitat Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH
40.
Zurück zum Zitat Li, J., Cheng, K., Wang, S., Morstatter, F., Trevino, R.P., Tang, J., Liu, H.: ACM feature selection: a data perspective. Comput. Surv. 50(6), 94 (2017)CrossRef Li, J., Cheng, K., Wang, S., Morstatter, F., Trevino, R.P., Tang, J., Liu, H.: ACM feature selection: a data perspective. Comput. Surv. 50(6), 94 (2017)CrossRef
Metadaten
Titel
Estimating Human State from Simulated Assisted Driving with Stochastic Filtering Techniques
verfasst von
Gregory M. Gremillion
Daniel Donavanik
Catherine E. Neubauer
Justin D. Brody
Kristin E. Schaefer
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-319-94223-0_11