Skip to main content
Top

2017 | OriginalPaper | Chapter

Driver Fatigue Detection Based on Real-Time Eye Gaze Pattern Analysis

Authors : Wilbert G. Aguilar, Jorge I. Estrella, William López, Vanessa Abad

Published in: Intelligent Robotics and Applications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper introduces a real time non-intrusive method to determine driver fatigue by analyzing eye gaze patterns. Using a standard webcam and a personal computer, the proposed method combines different techniques in order to keep a low computational cost without a loss of performance. Facial features are identified in a reference image to extract a region of interest, around the eyes of the user, and tracked by an optical flow algorithm in subsequent frames. Color segmentation on the resulting images allow the system to extract data needed to determine ocular following, blink detection, frequency, and percentage of eye lid closure over time (PERCLOS). This approach, while simple, proves to be very efficient and accurate for the hardware restricted setup, allowing faster information processing on modest specifications systems. For safety reasons, our experiments are limited to different subjects, simulating fatigue in laboratory conditions as well as a real time test on a moving vehicle to analyze the blinking patterns.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aguilar, W.G., Verónica, C., José, P.: Obstacle avoidance based-visual navigation for micro aerial vehicles. Electronics 6(1), 10 (2017)CrossRef Aguilar, W.G., Verónica, C., José, P.: Obstacle avoidance based-visual navigation for micro aerial vehicles. Electronics 6(1), 10 (2017)CrossRef
2.
go back to reference Aguilar, W.G., Verónica, C., José, P.: Obstacle avoidance for low-cost UAVs. In: IEEE 11th International Conference On Semantic Computing (ICSC), San Diego (2017) Aguilar, W.G., Verónica, C., José, P.: Obstacle avoidance for low-cost UAVs. In: IEEE 11th International Conference On Semantic Computing (ICSC), San Diego (2017)
3.
go back to reference Aguilar, W.G., Morales, S., Ruiz, H., Abad, V.: RRT* GL based optimal path planning for real-time navigation of UAVs. In: Rojas, I., Joya, G., Catala, A. (eds.) IWANN 2017. LNCS, vol. 10306, pp. 585–595. Springer, Cham (2017). doi:10.1007/978-3-319-59147-6_50 CrossRef Aguilar, W.G., Morales, S., Ruiz, H., Abad, V.: RRT* GL based optimal path planning for real-time navigation of UAVs. In: Rojas, I., Joya, G., Catala, A. (eds.) IWANN 2017. LNCS, vol. 10306, pp. 585–595. Springer, Cham (2017). doi:10.​1007/​978-3-319-59147-6_​50 CrossRef
4.
go back to reference Aguilar, W.G., Morales, S.: 3D environment mapping using the Kinect V2 and path planning based on RRT Algorithms. Electronics 5(4), 70 (2016)CrossRef Aguilar, W.G., Morales, S.: 3D environment mapping using the Kinect V2 and path planning based on RRT Algorithms. Electronics 5(4), 70 (2016)CrossRef
5.
go back to reference Cabras, P., Rosell, J., Pérez, A., Aguilar, W.G., Rosell, A.: Haptic-based navigation for the virtual bronchoscopy. In: 18th IFAC World Congress, Milano, Italy (2011) Cabras, P., Rosell, J., Pérez, A., Aguilar, W.G., Rosell, A.: Haptic-based navigation for the virtual bronchoscopy. In: 18th IFAC World Congress, Milano, Italy (2011)
8.
go back to reference Williamson, A., Friswell, R.: Exploratory study of fatigue in light and short haul transport drivers in NSW Australia. Accid. Anal. Prev. 40(1), 410–417 (2008)CrossRef Williamson, A., Friswell, R.: Exploratory study of fatigue in light and short haul transport drivers in NSW Australia. Accid. Anal. Prev. 40(1), 410–417 (2008)CrossRef
9.
go back to reference Dawson, D., Searle, A.K., Paterson, J.L.: Evaluating the use of fatigue detection technologies within a fatigue risk management system for the road transport industry. Sleep Med. Rev. 18, 1–12 (2013) Dawson, D., Searle, A.K., Paterson, J.L.: Evaluating the use of fatigue detection technologies within a fatigue risk management system for the road transport industry. Sleep Med. Rev. 18, 1–12 (2013)
10.
go back to reference Zhao, C., Zhao, M., Liu, J., Zheng, C.: Electroencephalogram and electrocardiograph assessment of mental fatigue in a driving simulator. Accid. Anal. Prev. 45, 83–90 (2012)CrossRef Zhao, C., Zhao, M., Liu, J., Zheng, C.: Electroencephalogram and electrocardiograph assessment of mental fatigue in a driving simulator. Accid. Anal. Prev. 45, 83–90 (2012)CrossRef
11.
go back to reference Saroj, A.C., Lal, K.L.: A critical review of the psychophysiology of driver fatigue. Biol. Psychol. 55, 173–194 (2001)CrossRef Saroj, A.C., Lal, K.L.: A critical review of the psychophysiology of driver fatigue. Biol. Psychol. 55, 173–194 (2001)CrossRef
13.
go back to reference Aguilar, W.G., Luna, M.A., Moya, J.F., Abad, V., Ruiz, H., Parra, H., Angulo, C.: Pedestrian detection for UAVs using cascade classifiers and saliency maps. In: Rojas, I., Joya, G., Catala, A. (eds.) IWANN 2017. LNCS, vol. 10306, pp. 563–574. Springer, Cham (2017). doi:10.1007/978-3-319-59147-6_48 CrossRef Aguilar, W.G., Luna, M.A., Moya, J.F., Abad, V., Ruiz, H., Parra, H., Angulo, C.: Pedestrian detection for UAVs using cascade classifiers and saliency maps. In: Rojas, I., Joya, G., Catala, A. (eds.) IWANN 2017. LNCS, vol. 10306, pp. 563–574. Springer, Cham (2017). doi:10.​1007/​978-3-319-59147-6_​48 CrossRef
14.
go back to reference Aguilar, W.G., Luna, M., Moya, J., Abad, V., Parra, H., Ruiz, H.: Pedestrian detection for UAVs using cascade classifiers with meanshift. In: IEEE 11th International Conference on Semantic Computing (ICSC), San Diego (2017) Aguilar, W.G., Luna, M., Moya, J., Abad, V., Parra, H., Ruiz, H.: Pedestrian detection for UAVs using cascade classifiers with meanshift. In: IEEE 11th International Conference on Semantic Computing (ICSC), San Diego (2017)
15.
go back to reference Liu, K., Luo, Y., Gyomei, T.E.I., Yang, S.: Attention recognition of drivers based on head pose estimation. In: Vehicle Power and Propulsion Conference (2008) Liu, K., Luo, Y., Gyomei, T.E.I., Yang, S.: Attention recognition of drivers based on head pose estimation. In: Vehicle Power and Propulsion Conference (2008)
16.
go back to reference Sanchez-Cuevas, M.C., Aguilar-Ponce, R.M., Tecpanecatl-Xihuitl, J.L.: A comparison of color models for color face segmentation. Procedia Technol. 7, 131–141 (2013)CrossRef Sanchez-Cuevas, M.C., Aguilar-Ponce, R.M., Tecpanecatl-Xihuitl, J.L.: A comparison of color models for color face segmentation. Procedia Technol. 7, 131–141 (2013)CrossRef
17.
go back to reference Li, L., Chen, Y., Li, Z.: Yawning detection for monitoring driver fatigue based on two cameras. In: 12th International IEEE Conference on Intelligent Transportation Systems (2009) Li, L., Chen, Y., Li, Z.: Yawning detection for monitoring driver fatigue based on two cameras. In: 12th International IEEE Conference on Intelligent Transportation Systems (2009)
18.
go back to reference Bergasa, L.M., et al.: Visual monitoring of driver inattention. IEEE Trans. Intell. Transp. Syst. 1(1), 63–77 (2006)CrossRef Bergasa, L.M., et al.: Visual monitoring of driver inattention. IEEE Trans. Intell. Transp. Syst. 1(1), 63–77 (2006)CrossRef
20.
go back to reference Al-Rahayfeh, A.M.E.R., Faezipour, M.I.A.D.: Eye tracking and head movement detection: a state-of-art survey. IEEE J. Transl. Eng. Health Med. 1, 2100212 (2013)CrossRef Al-Rahayfeh, A.M.E.R., Faezipour, M.I.A.D.: Eye tracking and head movement detection: a state-of-art survey. IEEE J. Transl. Eng. Health Med. 1, 2100212 (2013)CrossRef
21.
go back to reference Eskandarian, A., et al.: Advanced driver fatigue reasearch. US Department of Transportation (2007) Eskandarian, A., et al.: Advanced driver fatigue reasearch. US Department of Transportation (2007)
22.
go back to reference Horne, J., Reyner, L.: Vehicle accidents related to sleep: a review. Occup. Environ. Med. 56, 289–294 (1999)CrossRef Horne, J., Reyner, L.: Vehicle accidents related to sleep: a review. Occup. Environ. Med. 56, 289–294 (1999)CrossRef
23.
go back to reference Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Conference on Computer Vision and Pattern Recognition (2001) Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Conference on Computer Vision and Pattern Recognition (2001)
24.
go back to reference Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: An efficient alternative to SIFT or SURF. In: ICCV (2011) Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: An efficient alternative to SIFT or SURF. In: ICCV (2011)
25.
go back to reference Krig, S.: Interest point detector and feature descriptor survey. In: Computer Vision Metrics: Survey, Taxonomy, and Analysis. Apress (2014) Krig, S.: Interest point detector and feature descriptor survey. In: Computer Vision Metrics: Survey, Taxonomy, and Analysis. Apress (2014)
26.
go back to reference Aguilar, W.G., Angulo, C.: Real-time model-based video stabilization for microaerial vehicles. Neural Process. Lett. 43(2), 459–477 (2016)CrossRef Aguilar, W.G., Angulo, C.: Real-time model-based video stabilization for microaerial vehicles. Neural Process. Lett. 43(2), 459–477 (2016)CrossRef
27.
go back to reference Aguilar, W.G., Angulo, C.: Real-time video stabilization without phantom movements for micro aerial vehicles. EURASIP J. Image Video Process. 1, 1–13 (2014) Aguilar, W.G., Angulo, C.: Real-time video stabilization without phantom movements for micro aerial vehicles. EURASIP J. Image Video Process. 1, 1–13 (2014)
28.
go back to reference Aguilar, W.G., Angulo, C.: Robust video stabilization based on motion intention for low-cost micro aerial vehicles. In: 11th International Multi-conference on Systems, Signals & Devices (SSD), Barcelona, Spain (2014) Aguilar, W.G., Angulo, C.: Robust video stabilization based on motion intention for low-cost micro aerial vehicles. In: 11th International Multi-conference on Systems, Signals & Devices (SSD), Barcelona, Spain (2014)
29.
go back to reference Aguilar, W.G., Casaliglla, V.P., Pólit, J.L., Abad, V., Ruiz, H.: Obstacle avoidance for flight safety on unmanned aerial vehicles. In: Rojas, I., Joya, G., Catala, A. (eds.) IWANN 2017. LNCS, vol. 10306, pp. 575–584. Springer, Cham (2017). doi:10.1007/978-3-319-59147-6_49 CrossRef Aguilar, W.G., Casaliglla, V.P., Pólit, J.L., Abad, V., Ruiz, H.: Obstacle avoidance for flight safety on unmanned aerial vehicles. In: Rojas, I., Joya, G., Catala, A. (eds.) IWANN 2017. LNCS, vol. 10306, pp. 575–584. Springer, Cham (2017). doi:10.​1007/​978-3-319-59147-6_​49 CrossRef
30.
go back to reference Tomasi, C., Kanade, T.: Detection and Tracking of Point Features. Carnegie Mellon University, Pittsburgh (1991) Tomasi, C., Kanade, T.: Detection and Tracking of Point Features. Carnegie Mellon University, Pittsburgh (1991)
32.
go back to reference Dinges, D.F., Grace, R.: PERCLOS: a valid psychophysiological measure of alertness as assessed by psychomotor vigilance. US Department of Transportation (1998) Dinges, D.F., Grace, R.: PERCLOS: a valid psychophysiological measure of alertness as assessed by psychomotor vigilance. US Department of Transportation (1998)
Metadata
Title
Driver Fatigue Detection Based on Real-Time Eye Gaze Pattern Analysis
Authors
Wilbert G. Aguilar
Jorge I. Estrella
William López
Vanessa Abad
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-65292-4_59

Premium Partner