Skip to main content
Top
Published in:

27-01-2022

Comfortable awakening method for sleeping driver during autonomous driving

Authors: Shigeyuki Yamabe, Shuichi Kawaguchi, Masato Anakubo

Published in: International Journal of Intelligent Transportation Systems Research | Issue 1/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

There is a high possibility that the driver who is relieved from driving will suffer from sleepiness and there is a limit to keeping the driver awake in the system, which may cause a loss in comfort during autonomous driving. In this study, we propose a method for a comfortable awakening by installing a device that can wake up the driver as a safety function in case the driver falls asleep during autonomous driving. We have used existing devices to investigate the stimulation to the driver's five senses through the use of vibration, aroma and facial stimulation and we have evaluated a human machine interface (HMI) device that allows the driver to comfortably wake up from sleep using a driving simulator. The accuracy of driver operation was evaluated as well as physiological indices for heart rate changes before/after awakening and eyelid opening/closing times after waking up. Facial stimulation with air blowing devices (such as air conditioners) was the quickest way for the driver to return from autonomous driving to manual driving. We have shown that existing devices can be used as an HMI for comfortable awakening by applying airflow to the face.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

ATZelectronics worldwide

ATZlectronics worldwide is up-to-speed on new trends and developments in automotive electronics on a scientific level with a high depth of information. 

Order your 30-days-trial for free and without any commitment.

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Henze, R., Atabay, O., Raksincharoensak, P.: Monitoring Driver - Vehicle Control in Automated Driving Applications. IFAC-PapersOnLine 49(3), 285–290 (2016)CrossRef Henze, R., Atabay, O., Raksincharoensak, P.: Monitoring Driver - Vehicle Control in Automated Driving Applications. IFAC-PapersOnLine 49(3), 285–290 (2016)CrossRef
2.
go back to reference Stapel, J.: Freddy Antony Mullakkal-Babu, Riender Happee, Automated driving reduces perceived workload, but monitoring causes higher cognitive load than manual driving. Transport. Res. F: Traffic Psychol. Behav. 60, 590–605 (January 2019)CrossRef Stapel, J.: Freddy Antony Mullakkal-Babu, Riender Happee, Automated driving reduces perceived workload, but monitoring causes higher cognitive load than manual driving. Transport. Res. F: Traffic Psychol. Behav. 60, 590–605 (January 2019)CrossRef
3.
go back to reference Charles A Czeisler,Emerson M Wickwire, Laura K Barger, William C Dement, Karen Gamble, Natalie Hartenbaum, Maurice M Ohayon, Rafael Pelayo, Barbara Phillips, Kingman Strohl, Brian Tefft, Shantha M W Rajaratnam, Raman Malhotra, Kaitlyn Whiton, Max Hirshkowitz, Sleep-deprived motor vehicle operators are unfit to drive: a multidisciplinary expert consensus statement on drowsy driving, Sleep Health Vol. 2, Issue 2 Pages 94–99 (2016) Charles A Czeisler,Emerson M Wickwire, Laura K Barger, William C Dement, Karen Gamble, Natalie Hartenbaum, Maurice M Ohayon, Rafael Pelayo, Barbara Phillips, Kingman Strohl, Brian Tefft, Shantha M W Rajaratnam, Raman Malhotra, Kaitlyn Whiton, Max Hirshkowitz, Sleep-deprived motor vehicle operators are unfit to drive: a multidisciplinary expert consensus statement on drowsy driving, Sleep Health Vol. 2, Issue 2 Pages 94–99 (2016)
5.
go back to reference Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studies, Transportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80 Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studies, Transportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80
6.
go back to reference Xuxin Zhang, Xuesong Wang, Xiaohan Yang, Chuan Xu, Xiaohui Zhu, JiaohuaWei, Driver drowsiness detection using mixed-effect ordered logit model considering time cumulative effect, Analytic Methods in Accident Research, Volume 26, June 2020 Xuxin Zhang, Xuesong Wang, Xiaohan Yang, Chuan Xu, Xiaohui Zhu, JiaohuaWei, Driver drowsiness detection using mixed-effect ordered logit model considering time cumulative effect, Analytic Methods in Accident Research, Volume 26, June 2020
7.
go back to reference Gromer, M., Salb, D., Walzer, T.: Natividad Martínez Madrid, Ralf Seepold, ECG sensor for detection of driver’s drowsiness. Procedia Computer Science 159, 1938–1946 (2019)CrossRef Gromer, M., Salb, D., Walzer, T.: Natividad Martínez Madrid, Ralf Seepold, ECG sensor for detection of driver’s drowsiness. Procedia Computer Science 159, 1938–1946 (2019)CrossRef
8.
go back to reference Boverie, S., Giralt, A.: Driver vigilance diagnostic based on eyelid movement observation. IFAC Proceedings Volumes 41(2), 12831–12836 (2008)CrossRef Boverie, S., Giralt, A.: Driver vigilance diagnostic based on eyelid movement observation. IFAC Proceedings Volumes 41(2), 12831–12836 (2008)CrossRef
9.
go back to reference Rami, N.: Khushaba, Sarath Kodagoda, Sara Lal, Gamini Dissanayake, Uncorrelated fuzzy neighborhood preserving analysis based feature projection for driver drowsiness recognition. Fuzzy Sets Syst. 221(16), 90–111 (June 2013) Rami, N.: Khushaba, Sarath Kodagoda, Sara Lal, Gamini Dissanayake, Uncorrelated fuzzy neighborhood preserving analysis based feature projection for driver drowsiness recognition. Fuzzy Sets Syst. 221(16), 90–111 (June 2013)
10.
go back to reference Junhua Wang, Shuaiyi Sun, Shouen Fang, Ting Fu, Joshua Stipancic, Predicting drowsy driving in real-time situations: Using an advanced driving simulator, accelerated failure time model, and virtual location-based services, Accident Analysis & Prevention Volume 99, Part A, February 2017, Pages 321–329 Junhua Wang, Shuaiyi Sun, Shouen Fang, Ting Fu, Joshua Stipancic, Predicting drowsy driving in real-time situations: Using an advanced driving simulator, accelerated failure time model, and virtual location-based services, Accident Analysis & Prevention Volume 99, Part A, February 2017, Pages 321–329
11.
go back to reference Murray WJohns, A sleep physiologist's view of the drowsy driver, Transportation Research Part F: Traffic Psychology and Behaviour Volume 3, Issue 4, December 2000, Pages 241–249 Murray WJohns, A sleep physiologist's view of the drowsy driver, Transportation Research Part F: Traffic Psychology and Behaviour Volume 3, Issue 4, December 2000, Pages 241–249
12.
go back to reference Yanbin Wu, Ken Kihara, Yuji Takeda, Toshihisa Sato, Motoyuki Akamatsu, Satoshi Kitazaki, Effects of scheduled manual driving on drowsiness and response to take over request: A simulator study towards understanding drivers in automated driving, Accident Analysis & Prevention, March 2019 Volume 124 Pages 202–209 Yanbin Wu, Ken Kihara, Yuji Takeda, Toshihisa Sato, Motoyuki Akamatsu, Satoshi Kitazaki, Effects of scheduled manual driving on drowsiness and response to take over request: A simulator study towards understanding drivers in automated driving, Accident Analysis & Prevention, March 2019 Volume 124 Pages 202–209
13.
go back to reference Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studiesTransportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80 Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studiesTransportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80
14.
go back to reference Rosenbloom, T., Grossman, E.S.: Assessment of performance impairment after short naps with and without sleep inertia. Transport. Res. F: Traffic Psychol. Behav. 52, 1–13 (2018)CrossRef Rosenbloom, T., Grossman, E.S.: Assessment of performance impairment after short naps with and without sleep inertia. Transport. Res. F: Traffic Psychol. Behav. 52, 1–13 (2018)CrossRef
15.
go back to reference Jiao, Y., Deng, Y., Luo, Y., Bao-Liang, Lu.: Driver sleepiness detection from EEG and EOG signals using GAN and LSTM networks. Neurocomputing 408(30), 100–111 (September 2020)CrossRef Jiao, Y., Deng, Y., Luo, Y., Bao-Liang, Lu.: Driver sleepiness detection from EEG and EOG signals using GAN and LSTM networks. Neurocomputing 408(30), 100–111 (September 2020)CrossRef
16.
go back to reference Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., Babiloni, F.: Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 44, 58–75 (July 2014)CrossRef Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., Babiloni, F.: Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 44, 58–75 (July 2014)CrossRef
17.
go back to reference Hong J. Eoh, Min K. Chung, Seong-Han Kim, Electroencephalographic study of drowsiness in simulated driving with sleep deprivation, International Journal of Industrial ErgonomicsApril 2005Volume 35, Issue 4Pages 307–320 Hong J. Eoh, Min K. Chung, Seong-Han Kim, Electroencephalographic study of drowsiness in simulated driving with sleep deprivation, International Journal of Industrial ErgonomicsApril 2005Volume 35, Issue 4Pages 307–320
18.
go back to reference Sadegh Arefnezhad, Sajjad Samiee, Arno Eichberger, Matthias Frühwirth, Clemens Kaufmann, Emma Klotz, Applying deep neural networks for multi-level classification of driver drowsiness using Vehicle-based measures, Expert Systems with Applications Volume 162, 30 December 2020, 113778 Sadegh Arefnezhad, Sajjad Samiee, Arno Eichberger, Matthias Frühwirth, Clemens Kaufmann, Emma Klotz, Applying deep neural networks for multi-level classification of driver drowsiness using Vehicle-based measures, Expert Systems with Applications Volume 162, 30 December 2020, 113778
19.
go back to reference Alexander P.Wolkow, Shantha M.W.Rajaratnam, Vanessa Wilkinson, Dexter Shee, Angela Baker, Teri LillingtonB.M.B.S, F.A.F.O.E.M (RACP), Peter Roest, Bernd MarxBBAE, Carmen Chew, Andrew Tucker, Shamsul Haque, Alexandre Schaefer, Mark E.Howard, The impact of heart rate-based drowsiness monitoring on adverse driving events in heavy vehicle drivers under naturalistic conditions, Sleep Health, Volume 6, Issue 3, June 2020, Pages 366–373 Alexander P.Wolkow, Shantha M.W.Rajaratnam, Vanessa Wilkinson, Dexter Shee, Angela Baker, Teri LillingtonB.M.B.S, F.A.F.O.E.M (RACP), Peter Roest, Bernd MarxBBAE, Carmen Chew, Andrew Tucker, Shamsul Haque, Alexandre Schaefer, Mark E.Howard, The impact of heart rate-based drowsiness monitoring on adverse driving events in heavy vehicle drivers under naturalistic conditions, Sleep Health, Volume 6, Issue 3, June 2020, Pages 366–373
20.
go back to reference Hirsch, M., Diederichs, F., Widlroither, H., Graf, R., Bischoff, S.: Sleep and take-over in automated driving, International Journal of Transportation. Science and Technology 9(1), 42–51 (2020) Hirsch, M., Diederichs, F., Widlroither, H., Graf, R., Bischoff, S.: Sleep and take-over in automated driving, International Journal of Transportation. Science and Technology 9(1), 42–51 (2020)
21.
go back to reference T.T. Postolache, U.K. Raheja, Body Rhythms / Biological Clocks, Encyclopedia of Mental Health (Second Edition) 193–203 (2016). T.T. Postolache, U.K. Raheja, Body Rhythms / Biological Clocks, Encyclopedia of Mental Health (Second Edition) 193–203 (2016).
22.
go back to reference Sohoglu, E., Neuroscience, A.: Sounding Out the Brain Basis of Speech Perception. Curr. Biol. 29(12), R582–R584 (2019)CrossRef Sohoglu, E., Neuroscience, A.: Sounding Out the Brain Basis of Speech Perception. Curr. Biol. 29(12), R582–R584 (2019)CrossRef
23.
go back to reference Eto, K., Yamazaki, A.K., Mukuda, M., Kabasawa, Y., Yoshida, H., Ito, K., Ogiwara, M.: Analysis of Effects of Aroma Foot Care Using Functional Near-infrared Spectroscopy. Procedia Computer Science 35, 1539–1546 (2014)CrossRef Eto, K., Yamazaki, A.K., Mukuda, M., Kabasawa, Y., Yoshida, H., Ito, K., Ogiwara, M.: Analysis of Effects of Aroma Foot Care Using Functional Near-infrared Spectroscopy. Procedia Computer Science 35, 1539–1546 (2014)CrossRef
24.
go back to reference Nadia Mullen, Judith Charlton, Anna Devlin, Michel Bedard, Simulator validity: Behaviours observed on the simulator and on the road, Handbook of Driving Simulation for Engineering, Medicine and Psychology, 1–18 (2011). Nadia Mullen, Judith Charlton, Anna Devlin, Michel Bedard, Simulator validity: Behaviours observed on the simulator and on the road, Handbook of Driving Simulation for Engineering, Medicine and Psychology, 1–18 (2011).
25.
go back to reference Ashis Kumar Das, Prashant Kumar, Suman Halder, Anwesha Banerjee, D.N. Tibarewala, A Laboratory Based Experimental Evaluation of Ocular Parameters as Fatigue and Drowsiness Measures, Procedia Computer Science 167 (2020) 2051–2059. Ashis Kumar Das, Prashant Kumar, Suman Halder, Anwesha Banerjee, D.N. Tibarewala, A Laboratory Based Experimental Evaluation of Ocular Parameters as Fatigue and Drowsiness Measures, Procedia Computer Science 167 (2020) 2051–2059.
26.
go back to reference Wilbert G. Aguilar, Jorge I. Estrella, William López, Vanessa Abad, Driver Fatigue Detection Based on Real-Time Eye Gaze Pattern Analysis, ICIRA 2017: Intelligent Robotics and Applications pp 683–694 Wilbert G. Aguilar, Jorge I. Estrella, William López, Vanessa Abad, Driver Fatigue Detection Based on Real-Time Eye Gaze Pattern Analysis, ICIRA 2017: Intelligent Robotics and Applications pp 683–694
27.
go back to reference Fukuda, K., Hayami, T., Shidoji, K., Matsuo, T.: The effect of stimulus location and Inter-Stimulus Intervals (ISI) upon blink activity. Int. J. Psychophysiol. 69(3), 229–230 (2008)CrossRef Fukuda, K., Hayami, T., Shidoji, K., Matsuo, T.: The effect of stimulus location and Inter-Stimulus Intervals (ISI) upon blink activity. Int. J. Psychophysiol. 69(3), 229–230 (2008)CrossRef
28.
go back to reference Mortazavi, A., Eskandarian, A., Sayed, R.A.: Effect of drowsiness on driving performance variables of commercial vehicle drivers. Int. J. Automot. Technol. 10, 391–404 (2009)CrossRef Mortazavi, A., Eskandarian, A., Sayed, R.A.: Effect of drowsiness on driving performance variables of commercial vehicle drivers. Int. J. Automot. Technol. 10, 391–404 (2009)CrossRef
29.
go back to reference Jasper S. Wijnands, Jason Thompson, Kerry A. Nice, Gideon D. P. A. Aschwanden & Mark Stevenson, Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks, Neural Computing and Applications volume 32, pages9731?9743(2020) Jasper S. Wijnands, Jason Thompson, Kerry A. Nice, Gideon D. P. A. Aschwanden & Mark Stevenson, Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks, Neural Computing and Applications volume 32, pages9731?9743(2020)
30.
go back to reference D. Selvathi, FPGA Based Human Fatigue and Drowsiness Detection System Using Deep Neural Network for Vehicle Drivers in Road Accident Avoidance System, Human Behaviour Analysis Using Intelligent Systems pp 69–91 D. Selvathi, FPGA Based Human Fatigue and Drowsiness Detection System Using Deep Neural Network for Vehicle Drivers in Road Accident Avoidance System, Human Behaviour Analysis Using Intelligent Systems pp 69–91
Metadata
Title
Comfortable awakening method for sleeping driver during autonomous driving
Authors
Shigeyuki Yamabe
Shuichi Kawaguchi
Masato Anakubo
Publication date
27-01-2022
Publisher
Springer US
Published in
International Journal of Intelligent Transportation Systems Research / Issue 1/2022
Print ISSN: 1348-8503
Electronic ISSN: 1868-8659
DOI
https://doi.org/10.1007/s13177-021-00291-0

Premium Partners