Skip to main content
Erschienen in: International Journal of Intelligent Transportation Systems Research 1/2022

27.01.2022

Comfortable awakening method for sleeping driver during autonomous driving

verfasst von: Shigeyuki Yamabe, Shuichi Kawaguchi, Masato Anakubo

Erschienen in: International Journal of Intelligent Transportation Systems Research | Ausgabe 1/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

There is a high possibility that the driver who is relieved from driving will suffer from sleepiness and there is a limit to keeping the driver awake in the system, which may cause a loss in comfort during autonomous driving. In this study, we propose a method for a comfortable awakening by installing a device that can wake up the driver as a safety function in case the driver falls asleep during autonomous driving. We have used existing devices to investigate the stimulation to the driver's five senses through the use of vibration, aroma and facial stimulation and we have evaluated a human machine interface (HMI) device that allows the driver to comfortably wake up from sleep using a driving simulator. The accuracy of driver operation was evaluated as well as physiological indices for heart rate changes before/after awakening and eyelid opening/closing times after waking up. Facial stimulation with air blowing devices (such as air conditioners) was the quickest way for the driver to return from autonomous driving to manual driving. We have shown that existing devices can be used as an HMI for comfortable awakening by applying airflow to the face.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

ATZelectronics worldwide

ATZlectronics worldwide is up-to-speed on new trends and developments in automotive electronics on a scientific level with a high depth of information. 

Order your 30-days-trial for free and without any commitment.

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Henze, R., Atabay, O., Raksincharoensak, P.: Monitoring Driver - Vehicle Control in Automated Driving Applications. IFAC-PapersOnLine 49(3), 285–290 (2016)CrossRef Henze, R., Atabay, O., Raksincharoensak, P.: Monitoring Driver - Vehicle Control in Automated Driving Applications. IFAC-PapersOnLine 49(3), 285–290 (2016)CrossRef
2.
Zurück zum Zitat Stapel, J.: Freddy Antony Mullakkal-Babu, Riender Happee, Automated driving reduces perceived workload, but monitoring causes higher cognitive load than manual driving. Transport. Res. F: Traffic Psychol. Behav. 60, 590–605 (January 2019)CrossRef Stapel, J.: Freddy Antony Mullakkal-Babu, Riender Happee, Automated driving reduces perceived workload, but monitoring causes higher cognitive load than manual driving. Transport. Res. F: Traffic Psychol. Behav. 60, 590–605 (January 2019)CrossRef
3.
Zurück zum Zitat Charles A Czeisler,Emerson M Wickwire, Laura K Barger, William C Dement, Karen Gamble, Natalie Hartenbaum, Maurice M Ohayon, Rafael Pelayo, Barbara Phillips, Kingman Strohl, Brian Tefft, Shantha M W Rajaratnam, Raman Malhotra, Kaitlyn Whiton, Max Hirshkowitz, Sleep-deprived motor vehicle operators are unfit to drive: a multidisciplinary expert consensus statement on drowsy driving, Sleep Health Vol. 2, Issue 2 Pages 94–99 (2016) Charles A Czeisler,Emerson M Wickwire, Laura K Barger, William C Dement, Karen Gamble, Natalie Hartenbaum, Maurice M Ohayon, Rafael Pelayo, Barbara Phillips, Kingman Strohl, Brian Tefft, Shantha M W Rajaratnam, Raman Malhotra, Kaitlyn Whiton, Max Hirshkowitz, Sleep-deprived motor vehicle operators are unfit to drive: a multidisciplinary expert consensus statement on drowsy driving, Sleep Health Vol. 2, Issue 2 Pages 94–99 (2016)
5.
Zurück zum Zitat Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studies, Transportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80 Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studies, Transportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80
6.
Zurück zum Zitat Xuxin Zhang, Xuesong Wang, Xiaohan Yang, Chuan Xu, Xiaohui Zhu, JiaohuaWei, Driver drowsiness detection using mixed-effect ordered logit model considering time cumulative effect, Analytic Methods in Accident Research, Volume 26, June 2020 Xuxin Zhang, Xuesong Wang, Xiaohan Yang, Chuan Xu, Xiaohui Zhu, JiaohuaWei, Driver drowsiness detection using mixed-effect ordered logit model considering time cumulative effect, Analytic Methods in Accident Research, Volume 26, June 2020
7.
Zurück zum Zitat Gromer, M., Salb, D., Walzer, T.: Natividad Martínez Madrid, Ralf Seepold, ECG sensor for detection of driver’s drowsiness. Procedia Computer Science 159, 1938–1946 (2019)CrossRef Gromer, M., Salb, D., Walzer, T.: Natividad Martínez Madrid, Ralf Seepold, ECG sensor for detection of driver’s drowsiness. Procedia Computer Science 159, 1938–1946 (2019)CrossRef
8.
Zurück zum Zitat Boverie, S., Giralt, A.: Driver vigilance diagnostic based on eyelid movement observation. IFAC Proceedings Volumes 41(2), 12831–12836 (2008)CrossRef Boverie, S., Giralt, A.: Driver vigilance diagnostic based on eyelid movement observation. IFAC Proceedings Volumes 41(2), 12831–12836 (2008)CrossRef
9.
Zurück zum Zitat Rami, N.: Khushaba, Sarath Kodagoda, Sara Lal, Gamini Dissanayake, Uncorrelated fuzzy neighborhood preserving analysis based feature projection for driver drowsiness recognition. Fuzzy Sets Syst. 221(16), 90–111 (June 2013) Rami, N.: Khushaba, Sarath Kodagoda, Sara Lal, Gamini Dissanayake, Uncorrelated fuzzy neighborhood preserving analysis based feature projection for driver drowsiness recognition. Fuzzy Sets Syst. 221(16), 90–111 (June 2013)
10.
Zurück zum Zitat Junhua Wang, Shuaiyi Sun, Shouen Fang, Ting Fu, Joshua Stipancic, Predicting drowsy driving in real-time situations: Using an advanced driving simulator, accelerated failure time model, and virtual location-based services, Accident Analysis & Prevention Volume 99, Part A, February 2017, Pages 321–329 Junhua Wang, Shuaiyi Sun, Shouen Fang, Ting Fu, Joshua Stipancic, Predicting drowsy driving in real-time situations: Using an advanced driving simulator, accelerated failure time model, and virtual location-based services, Accident Analysis & Prevention Volume 99, Part A, February 2017, Pages 321–329
11.
Zurück zum Zitat Murray WJohns, A sleep physiologist's view of the drowsy driver, Transportation Research Part F: Traffic Psychology and Behaviour Volume 3, Issue 4, December 2000, Pages 241–249 Murray WJohns, A sleep physiologist's view of the drowsy driver, Transportation Research Part F: Traffic Psychology and Behaviour Volume 3, Issue 4, December 2000, Pages 241–249
12.
Zurück zum Zitat Yanbin Wu, Ken Kihara, Yuji Takeda, Toshihisa Sato, Motoyuki Akamatsu, Satoshi Kitazaki, Effects of scheduled manual driving on drowsiness and response to take over request: A simulator study towards understanding drivers in automated driving, Accident Analysis & Prevention, March 2019 Volume 124 Pages 202–209 Yanbin Wu, Ken Kihara, Yuji Takeda, Toshihisa Sato, Motoyuki Akamatsu, Satoshi Kitazaki, Effects of scheduled manual driving on drowsiness and response to take over request: A simulator study towards understanding drivers in automated driving, Accident Analysis & Prevention, March 2019 Volume 124 Pages 202–209
13.
Zurück zum Zitat Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studiesTransportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80 Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studiesTransportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80
14.
Zurück zum Zitat Rosenbloom, T., Grossman, E.S.: Assessment of performance impairment after short naps with and without sleep inertia. Transport. Res. F: Traffic Psychol. Behav. 52, 1–13 (2018)CrossRef Rosenbloom, T., Grossman, E.S.: Assessment of performance impairment after short naps with and without sleep inertia. Transport. Res. F: Traffic Psychol. Behav. 52, 1–13 (2018)CrossRef
15.
Zurück zum Zitat Jiao, Y., Deng, Y., Luo, Y., Bao-Liang, Lu.: Driver sleepiness detection from EEG and EOG signals using GAN and LSTM networks. Neurocomputing 408(30), 100–111 (September 2020)CrossRef Jiao, Y., Deng, Y., Luo, Y., Bao-Liang, Lu.: Driver sleepiness detection from EEG and EOG signals using GAN and LSTM networks. Neurocomputing 408(30), 100–111 (September 2020)CrossRef
16.
Zurück zum Zitat Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., Babiloni, F.: Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 44, 58–75 (July 2014)CrossRef Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., Babiloni, F.: Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 44, 58–75 (July 2014)CrossRef
17.
Zurück zum Zitat Hong J. Eoh, Min K. Chung, Seong-Han Kim, Electroencephalographic study of drowsiness in simulated driving with sleep deprivation, International Journal of Industrial ErgonomicsApril 2005Volume 35, Issue 4Pages 307–320 Hong J. Eoh, Min K. Chung, Seong-Han Kim, Electroencephalographic study of drowsiness in simulated driving with sleep deprivation, International Journal of Industrial ErgonomicsApril 2005Volume 35, Issue 4Pages 307–320
18.
Zurück zum Zitat Sadegh Arefnezhad, Sajjad Samiee, Arno Eichberger, Matthias Frühwirth, Clemens Kaufmann, Emma Klotz, Applying deep neural networks for multi-level classification of driver drowsiness using Vehicle-based measures, Expert Systems with Applications Volume 162, 30 December 2020, 113778 Sadegh Arefnezhad, Sajjad Samiee, Arno Eichberger, Matthias Frühwirth, Clemens Kaufmann, Emma Klotz, Applying deep neural networks for multi-level classification of driver drowsiness using Vehicle-based measures, Expert Systems with Applications Volume 162, 30 December 2020, 113778
19.
Zurück zum Zitat Alexander P.Wolkow, Shantha M.W.Rajaratnam, Vanessa Wilkinson, Dexter Shee, Angela Baker, Teri LillingtonB.M.B.S, F.A.F.O.E.M (RACP), Peter Roest, Bernd MarxBBAE, Carmen Chew, Andrew Tucker, Shamsul Haque, Alexandre Schaefer, Mark E.Howard, The impact of heart rate-based drowsiness monitoring on adverse driving events in heavy vehicle drivers under naturalistic conditions, Sleep Health, Volume 6, Issue 3, June 2020, Pages 366–373 Alexander P.Wolkow, Shantha M.W.Rajaratnam, Vanessa Wilkinson, Dexter Shee, Angela Baker, Teri LillingtonB.M.B.S, F.A.F.O.E.M (RACP), Peter Roest, Bernd MarxBBAE, Carmen Chew, Andrew Tucker, Shamsul Haque, Alexandre Schaefer, Mark E.Howard, The impact of heart rate-based drowsiness monitoring on adverse driving events in heavy vehicle drivers under naturalistic conditions, Sleep Health, Volume 6, Issue 3, June 2020, Pages 366–373
20.
Zurück zum Zitat Hirsch, M., Diederichs, F., Widlroither, H., Graf, R., Bischoff, S.: Sleep and take-over in automated driving, International Journal of Transportation. Science and Technology 9(1), 42–51 (2020) Hirsch, M., Diederichs, F., Widlroither, H., Graf, R., Bischoff, S.: Sleep and take-over in automated driving, International Journal of Transportation. Science and Technology 9(1), 42–51 (2020)
21.
Zurück zum Zitat T.T. Postolache, U.K. Raheja, Body Rhythms / Biological Clocks, Encyclopedia of Mental Health (Second Edition) 193–203 (2016). T.T. Postolache, U.K. Raheja, Body Rhythms / Biological Clocks, Encyclopedia of Mental Health (Second Edition) 193–203 (2016).
22.
Zurück zum Zitat Sohoglu, E., Neuroscience, A.: Sounding Out the Brain Basis of Speech Perception. Curr. Biol. 29(12), R582–R584 (2019)CrossRef Sohoglu, E., Neuroscience, A.: Sounding Out the Brain Basis of Speech Perception. Curr. Biol. 29(12), R582–R584 (2019)CrossRef
23.
Zurück zum Zitat Eto, K., Yamazaki, A.K., Mukuda, M., Kabasawa, Y., Yoshida, H., Ito, K., Ogiwara, M.: Analysis of Effects of Aroma Foot Care Using Functional Near-infrared Spectroscopy. Procedia Computer Science 35, 1539–1546 (2014)CrossRef Eto, K., Yamazaki, A.K., Mukuda, M., Kabasawa, Y., Yoshida, H., Ito, K., Ogiwara, M.: Analysis of Effects of Aroma Foot Care Using Functional Near-infrared Spectroscopy. Procedia Computer Science 35, 1539–1546 (2014)CrossRef
24.
Zurück zum Zitat Nadia Mullen, Judith Charlton, Anna Devlin, Michel Bedard, Simulator validity: Behaviours observed on the simulator and on the road, Handbook of Driving Simulation for Engineering, Medicine and Psychology, 1–18 (2011). Nadia Mullen, Judith Charlton, Anna Devlin, Michel Bedard, Simulator validity: Behaviours observed on the simulator and on the road, Handbook of Driving Simulation for Engineering, Medicine and Psychology, 1–18 (2011).
25.
Zurück zum Zitat Ashis Kumar Das, Prashant Kumar, Suman Halder, Anwesha Banerjee, D.N. Tibarewala, A Laboratory Based Experimental Evaluation of Ocular Parameters as Fatigue and Drowsiness Measures, Procedia Computer Science 167 (2020) 2051–2059. Ashis Kumar Das, Prashant Kumar, Suman Halder, Anwesha Banerjee, D.N. Tibarewala, A Laboratory Based Experimental Evaluation of Ocular Parameters as Fatigue and Drowsiness Measures, Procedia Computer Science 167 (2020) 2051–2059.
26.
Zurück zum Zitat Wilbert G. Aguilar, Jorge I. Estrella, William López, Vanessa Abad, Driver Fatigue Detection Based on Real-Time Eye Gaze Pattern Analysis, ICIRA 2017: Intelligent Robotics and Applications pp 683–694 Wilbert G. Aguilar, Jorge I. Estrella, William López, Vanessa Abad, Driver Fatigue Detection Based on Real-Time Eye Gaze Pattern Analysis, ICIRA 2017: Intelligent Robotics and Applications pp 683–694
27.
Zurück zum Zitat Fukuda, K., Hayami, T., Shidoji, K., Matsuo, T.: The effect of stimulus location and Inter-Stimulus Intervals (ISI) upon blink activity. Int. J. Psychophysiol. 69(3), 229–230 (2008)CrossRef Fukuda, K., Hayami, T., Shidoji, K., Matsuo, T.: The effect of stimulus location and Inter-Stimulus Intervals (ISI) upon blink activity. Int. J. Psychophysiol. 69(3), 229–230 (2008)CrossRef
28.
Zurück zum Zitat Mortazavi, A., Eskandarian, A., Sayed, R.A.: Effect of drowsiness on driving performance variables of commercial vehicle drivers. Int. J. Automot. Technol. 10, 391–404 (2009)CrossRef Mortazavi, A., Eskandarian, A., Sayed, R.A.: Effect of drowsiness on driving performance variables of commercial vehicle drivers. Int. J. Automot. Technol. 10, 391–404 (2009)CrossRef
29.
Zurück zum Zitat Jasper S. Wijnands, Jason Thompson, Kerry A. Nice, Gideon D. P. A. Aschwanden & Mark Stevenson, Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks, Neural Computing and Applications volume 32, pages9731?9743(2020) Jasper S. Wijnands, Jason Thompson, Kerry A. Nice, Gideon D. P. A. Aschwanden & Mark Stevenson, Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks, Neural Computing and Applications volume 32, pages9731?9743(2020)
30.
Zurück zum Zitat D. Selvathi, FPGA Based Human Fatigue and Drowsiness Detection System Using Deep Neural Network for Vehicle Drivers in Road Accident Avoidance System, Human Behaviour Analysis Using Intelligent Systems pp 69–91 D. Selvathi, FPGA Based Human Fatigue and Drowsiness Detection System Using Deep Neural Network for Vehicle Drivers in Road Accident Avoidance System, Human Behaviour Analysis Using Intelligent Systems pp 69–91
Metadaten
Titel
Comfortable awakening method for sleeping driver during autonomous driving
verfasst von
Shigeyuki Yamabe
Shuichi Kawaguchi
Masato Anakubo
Publikationsdatum
27.01.2022
Verlag
Springer US
Erschienen in
International Journal of Intelligent Transportation Systems Research / Ausgabe 1/2022
Print ISSN: 1348-8503
Elektronische ISSN: 1868-8659
DOI
https://doi.org/10.1007/s13177-021-00291-0

Weitere Artikel der Ausgabe 1/2022

International Journal of Intelligent Transportation Systems Research 1/2022 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.