Skip to main content
Top

2019 | OriginalPaper | Chapter

A Lightweight Framework for Multi-device Integration and Multi-sensor Fusion to Explore Driver Distraction

Authors : Gernot Lechner, Michael Fellmann, Andreas Festl, Christian Kaiser, Tahir Emre Kalayci, Michael Spitzer, Alexander Stocker

Published in: Advanced Information Systems Engineering

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Driver distraction is a major challenge in road traffic and major cause of accidents. Vehicle industry dedicates increasing amounts of resources to better quantify the various activities of drivers resulting in distraction. Literature has shown that significant causes for driver distraction are tasks performed by drivers which are not related to driving, like using multimedia interfaces or glancing at co-drivers. One key aspect of the successful implementation of distraction prevention mechanisms is to know when the driver performs such auxiliary tasks. Therefore, capturing these tasks with appropriate measurement equipment is crucial. Especially novel quantification approaches combining data from different sensors and devices are necessary for comprehensively determining causes of driver distraction. However, as a literature review has revealed, there is currently a lack of lightweight frameworks for multi-device integration and multi-sensor fusion to enable cost-effective and minimally obtrusive driver monitoring with respect to scalability and extendibility. This paper presents such a lightweight framework which has been implemented in a demonstrator and applied in a small real-world study involving ten drivers performing simple distraction tasks. Preliminary results of our analysis have indicated a high accuracy of distraction detection for individual distraction tasks and thus the framework’s usefulness. The gained knowledge can be used to develop improved mechanisms for detecting driver distraction through better quantification of distracting tasks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
4.
go back to reference Thomas, P., Morris, A., Talbot, R., Fagerlind, H.: Identifying the causes of road crashes in Europe. Ann. Adv. Automot. Med. 57(13), 13–22 (2013) Thomas, P., Morris, A., Talbot, R., Fagerlind, H.: Identifying the causes of road crashes in Europe. Ann. Adv. Automot. Med. 57(13), 13–22 (2013)
5.
go back to reference Payre, W., Cestac, J., Dang, N.-T., Vienne, F., Delhomme, P.: Impact of training and in-vehicle task performance on manual control recovery in an automated car. Transp. Res. Part F: Traffic Psychol. Behav. 46(A), 216–227 (2017)CrossRef Payre, W., Cestac, J., Dang, N.-T., Vienne, F., Delhomme, P.: Impact of training and in-vehicle task performance on manual control recovery in an automated car. Transp. Res. Part F: Traffic Psychol. Behav. 46(A), 216–227 (2017)CrossRef
6.
go back to reference Zeeb, K., Buchner, A., Schrauf, M.: What determines the take-over time? An integrated model approach of driver take-over after automated driving. Accid. Anal. Prev. 78, 212–221 (2015)CrossRef Zeeb, K., Buchner, A., Schrauf, M.: What determines the take-over time? An integrated model approach of driver take-over after automated driving. Accid. Anal. Prev. 78, 212–221 (2015)CrossRef
11.
go back to reference Regan, M.A., Hallett, C., Gordon, C.P.: Driver distraction and driver inattention: definition, relationship and taxonomy. Accid. Anal. Prev. 43(5), 1771–1781 (2011)CrossRef Regan, M.A., Hallett, C., Gordon, C.P.: Driver distraction and driver inattention: definition, relationship and taxonomy. Accid. Anal. Prev. 43(5), 1771–1781 (2011)CrossRef
12.
go back to reference Sussman, E.D., Bishop, H., Madnick, B., Walters, R.: Driver inattention and highway safety. Transp. Res. Rec. 1047, 40–48 (1985) Sussman, E.D., Bishop, H., Madnick, B., Walters, R.: Driver inattention and highway safety. Transp. Res. Rec. 1047, 40–48 (1985)
13.
go back to reference Young, K., Regan, M.: Driver distraction: a review of the literature. In: Faulks, I.J., Regan, M., Stevenson, M., Brown, J., Porter, A., Irwin, J.D. (eds.) Distracted driving, pp. 379–405. Australasian College of Road Safety, Sydney (2007) Young, K., Regan, M.: Driver distraction: a review of the literature. In: Faulks, I.J., Regan, M., Stevenson, M., Brown, J., Porter, A., Irwin, J.D. (eds.) Distracted driving, pp. 379–405. Australasian College of Road Safety, Sydney (2007)
14.
go back to reference Dong, Y., Hu, Z., Uchimura, K., Murayama, N.: Driver inattention monitoring system for intelligent vehicles: a review. IEEE Trans. Intell. Transp. Syst. 12(2), 596–614 (2011)CrossRef Dong, Y., Hu, Z., Uchimura, K., Murayama, N.: Driver inattention monitoring system for intelligent vehicles: a review. IEEE Trans. Intell. Transp. Syst. 12(2), 596–614 (2011)CrossRef
15.
go back to reference Horberry, T., Anderson, J., Regan, M.A., Triggs, T.J., Brown, J.: Driver distraction: the effects of concurrent in-vehicle tasks, road environment complexity and age on driving performance. Accid. Anal. Prev. 38(1), 185–191 (2006)CrossRef Horberry, T., Anderson, J., Regan, M.A., Triggs, T.J., Brown, J.: Driver distraction: the effects of concurrent in-vehicle tasks, road environment complexity and age on driving performance. Accid. Anal. Prev. 38(1), 185–191 (2006)CrossRef
16.
go back to reference Klauer, S., Dingus, T., Neale, V., Sudweeks, J., Ramsey, D.: The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data. Virginia Tech Transportation Institute, Blacksburg (2006) Klauer, S., Dingus, T., Neale, V., Sudweeks, J., Ramsey, D.: The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data. Virginia Tech Transportation Institute, Blacksburg (2006)
17.
go back to reference D’Orazio, T., Leo, M., Guaragnella, C., Distante, A.: A visual approach for driver inattention detection. Pattern Recogn. 40(8), 2341–2355 (2007)CrossRef D’Orazio, T., Leo, M., Guaragnella, C., Distante, A.: A visual approach for driver inattention detection. Pattern Recogn. 40(8), 2341–2355 (2007)CrossRef
18.
go back to reference Fletcher, L., Zelinsky, A.: Driver inattention detection based on eye gaze—road event correlation. Int. J. Robot. Res. 28(6), 774–801 (2009)CrossRef Fletcher, L., Zelinsky, A.: Driver inattention detection based on eye gaze—road event correlation. Int. J. Robot. Res. 28(6), 774–801 (2009)CrossRef
19.
go back to reference Swan, M.: Emerging patient-driven health care models: an examination of health social networks, consumer personalized medicine and quantified self-tracking. Int. J. Environ. Res. Public Health 6(2), 492–525 (2009)CrossRef Swan, M.: Emerging patient-driven health care models: an examination of health social networks, consumer personalized medicine and quantified self-tracking. Int. J. Environ. Res. Public Health 6(2), 492–525 (2009)CrossRef
20.
go back to reference Swan, M.: The quantified self: fundamental disruption in big data science and biological discovery. Big data 1(2), 85–99 (2013)CrossRef Swan, M.: The quantified self: fundamental disruption in big data science and biological discovery. Big data 1(2), 85–99 (2013)CrossRef
21.
go back to reference Stocker, A., Kaiser, C., Fellmann, M.: Quantified vehicles. Bus. Inf. Syst. Eng. 59(2), 125–130 (2017)CrossRef Stocker, A., Kaiser, C., Fellmann, M.: Quantified vehicles. Bus. Inf. Syst. Eng. 59(2), 125–130 (2017)CrossRef
24.
go back to reference Pandian, P.S., Mohanavelu, K., Safeer, K.P., Kotresh, T.M., Shakunthala, D.T., Gopal, P., Padaki, V.C.: Smart Vest: wearable multi-parameter remote physiological monitoring system. Med. Eng. Phys. 30(4), 466–477 (2008)CrossRef Pandian, P.S., Mohanavelu, K., Safeer, K.P., Kotresh, T.M., Shakunthala, D.T., Gopal, P., Padaki, V.C.: Smart Vest: wearable multi-parameter remote physiological monitoring system. Med. Eng. Phys. 30(4), 466–477 (2008)CrossRef
25.
go back to reference Gellersen, H.W., Schmidt, A., Beigl, M.: Multi-sensor context-awareness in mobile devices and smart artifacts. Mob. Netw. Appl. 7(5), 341–351 (2002)CrossRef Gellersen, H.W., Schmidt, A., Beigl, M.: Multi-sensor context-awareness in mobile devices and smart artifacts. Mob. Netw. Appl. 7(5), 341–351 (2002)CrossRef
26.
go back to reference Ramos, F.B.A., Lorayne, A., Costa, A.A.M., de Sousa, R.R., et al.: Combining smartphone and smartwatch sensor data in activity recognition approaches: an experimental evaluation. In: Proceedings of the 28th International Conference on Software Engineering and Knowledge Engineering, SEKE 2016, Redwood City, pp. 267–272 (2016) Ramos, F.B.A., Lorayne, A., Costa, A.A.M., de Sousa, R.R., et al.: Combining smartphone and smartwatch sensor data in activity recognition approaches: an experimental evaluation. In: Proceedings of the 28th International Conference on Software Engineering and Knowledge Engineering, SEKE 2016, Redwood City, pp. 267–272 (2016)
27.
go back to reference Shoaib, M., Bosch, S., Scholten, H., Havinga, P.J., Incel, O.D.: Towards detection of bad habits by fusing smartphone and smartwatch sensors. In: Proceedings of the 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops), St. Louis, pp. 591–596 (2015) Shoaib, M., Bosch, S., Scholten, H., Havinga, P.J., Incel, O.D.: Towards detection of bad habits by fusing smartphone and smartwatch sensors. In: Proceedings of the 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops), St. Louis, pp. 591–596 (2015)
28.
go back to reference Vilarinho, T., Farshchian, B., Bajer, D.G., Dahl, O.H., et al.: A combined smartphone and smartwatch fall detection system. In: Proceedings of the 2015 IEEE International Conference on Computer and Information Technology, Liverpool, pp. 1443–1448 (2015) Vilarinho, T., Farshchian, B., Bajer, D.G., Dahl, O.H., et al.: A combined smartphone and smartwatch fall detection system. In: Proceedings of the 2015 IEEE International Conference on Computer and Information Technology, Liverpool, pp. 1443–1448 (2015)
29.
go back to reference Casilari, E., Santoyo-Ramón, J.A., Cano-García, J.M.: Analysis of a smartphone-based architecture with multiple mobility sensors for fall detection. PLoS ONE 11(12), e0168069 (2016)CrossRef Casilari, E., Santoyo-Ramón, J.A., Cano-García, J.M.: Analysis of a smartphone-based architecture with multiple mobility sensors for fall detection. PLoS ONE 11(12), e0168069 (2016)CrossRef
30.
go back to reference Giang, W.C., Shanti, I., Chen, H.Y.W., Zhou, A., Donmez, B.: Smartwatches vs. smartphones: a preliminary report of driver behavior and perceived risk while responding to notifications. In: Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Nottingham, pp. 154–161 (2015) Giang, W.C., Shanti, I., Chen, H.Y.W., Zhou, A., Donmez, B.: Smartwatches vs. smartphones: a preliminary report of driver behavior and perceived risk while responding to notifications. In: Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Nottingham, pp. 154–161 (2015)
31.
go back to reference Liu, L., Karatas, C., Li, H., Tan, S., et al.: Toward detection of unsafe driving with wearables. In: Proceedings of the 2015 workshop on Wearable Systems and Applications, Florence, pp. 27–32 (2015) Liu, L., Karatas, C., Li, H., Tan, S., et al.: Toward detection of unsafe driving with wearables. In: Proceedings of the 2015 workshop on Wearable Systems and Applications, Florence, pp. 27–32 (2015)
32.
go back to reference De Arriba-Pérez, F., Caeiro-Rodríguez, M., Santos-Gago, J.M.: Collection and processing of data from wrist wearable devices in heterogeneous and multiple-user scenarios. Sensors 16(9), 1538 (2016)CrossRef De Arriba-Pérez, F., Caeiro-Rodríguez, M., Santos-Gago, J.M.: Collection and processing of data from wrist wearable devices in heterogeneous and multiple-user scenarios. Sensors 16(9), 1538 (2016)CrossRef
33.
go back to reference Kluyver, T., Ragan-Kelley, B., Pérez, F., Granger, B., et al.: Jupyter notebooks – a publishing format for reproducible computational workflows. In: Proceedings of the 20th International Conference on Electronic Publishing, pp. 87–90. IOS Press, Goettingen (2016) Kluyver, T., Ragan-Kelley, B., Pérez, F., Granger, B., et al.: Jupyter notebooks – a publishing format for reproducible computational workflows. In: Proceedings of the 20th International Conference on Electronic Publishing, pp. 87–90. IOS Press, Goettingen (2016)
34.
go back to reference McKinney, W.: Data structures for statistical computing in Python. In: Proceedings of the 9th Python in Science Conference, Austin, pp. 51–56 (2010) McKinney, W.: Data structures for statistical computing in Python. In: Proceedings of the 9th Python in Science Conference, Austin, pp. 51–56 (2010)
35.
go back to reference Oliphant, T.E.: Guide to NumPy, 2nd edn. CreateSpace Independent Publishing Platform, USA (2015) Oliphant, T.E.: Guide to NumPy, 2nd edn. CreateSpace Independent Publishing Platform, USA (2015)
36.
go back to reference Christ, M., Braun, N., Neuffer, J., Kempa-Liehr, A.W.: Time series FeatuRe extraction on basis of scalable hypothesis tests. Neurocomputing 307, 72–77 (2018)CrossRef Christ, M., Braun, N., Neuffer, J., Kempa-Liehr, A.W.: Time series FeatuRe extraction on basis of scalable hypothesis tests. Neurocomputing 307, 72–77 (2018)CrossRef
37.
go back to reference Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)MathSciNetMATH
38.
go back to reference Kaiser, C., Stocker, A., Festl, A., Lechner, G., Fellmann, M.: A research agenda for vehicle information systems. ECIS (2018) Kaiser, C., Stocker, A., Festl, A., Lechner, G., Fellmann, M.: A research agenda for vehicle information systems. ECIS (2018)
Metadata
Title
A Lightweight Framework for Multi-device Integration and Multi-sensor Fusion to Explore Driver Distraction
Authors
Gernot Lechner
Michael Fellmann
Andreas Festl
Christian Kaiser
Tahir Emre Kalayci
Michael Spitzer
Alexander Stocker
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-21290-2_6

Premium Partner