Skip to main content
Top

2024 | OriginalPaper | Chapter

Ensemble of Randomized Neural Network and Boosted Trees for Eye-Tracking-Based Driver Situation Awareness Recognition and Interpretation

Authors : Ruilin Li, Minghui Hu, Jian Cui, Lipo Wang, Olga Sourina

Published in: Neural Information Processing

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Ensuring traffic safety is crucial in the pursuit of sustainable transportation. Across diverse traffic systems, maintaining good situation awareness (SA) is important in promoting and upholding traffic safety. This work focuses on a regression problem of using eye-tracking features to perform situation awareness (SA) recognition in the context of conditionally automated driving. As a type of tabular dataset, recent advances have shown that both neural networks (NNs) and gradient-boosted decision trees (GBDTs) are potential solutions to achieve better performance. To avoid the complex analysis to select the suitable model for the task, this work proposed to combine the NNs and tree-based models to achieve better performance on the task of SA assessment generally. Considering the necessity of the real-time measure for practical applications, the ensemble deep random vector functional link (edRVFL) and light gradient boosting machine (lightGBM) were used as the representative models of NNs and GBDTs in the investigation, respectively. Furthermore, this work exploited Shapley additive explanations (SHAP) to interpret the contributions of the input features, upon which we further developed two ensemble modes. Experimental results demonstrated that the proposed model outperformed the baseline models, highlighting its effectiveness. In addition, the interpretation results can also provide practitioners with references regarding the eye-tracking features that are more relevant to SA recognition.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Endsley, M.R.: Measurement of situation awareness in dynamic systems. Hum. Factors 37(1), 65–84 (1995)CrossRef Endsley, M.R.: Measurement of situation awareness in dynamic systems. Hum. Factors 37(1), 65–84 (1995)CrossRef
3.
go back to reference Li, R., Wang, L., Sourina, O.: Subject matching for cross-subject EEG-based recognition of driver states related to situation awareness. Methods 202, 136–143 (2022)CrossRef Li, R., Wang, L., Sourina, O.: Subject matching for cross-subject EEG-based recognition of driver states related to situation awareness. Methods 202, 136–143 (2022)CrossRef
4.
go back to reference Zhou, F., Yang, X.J., de Winter, J.C.F.: Using eye-tracking data to predict situation awareness in real time during takeover transitions in conditionally automated driving. IEEE Trans. Intell. Transp. Syst. 23(3), 2284–2295 (2022)CrossRef Zhou, F., Yang, X.J., de Winter, J.C.F.: Using eye-tracking data to predict situation awareness in real time during takeover transitions in conditionally automated driving. IEEE Trans. Intell. Transp. Syst. 23(3), 2284–2295 (2022)CrossRef
5.
go back to reference Li, F., Chen, C.-H., Lee, C.-H., Feng, S.: Artificial intelligence-enabled non-intrusive vigilance assessment approach to reducing traffic controller’s human errors. Knowl.-Based Syst. 239, 108047 (2022)CrossRef Li, F., Chen, C.-H., Lee, C.-H., Feng, S.: Artificial intelligence-enabled non-intrusive vigilance assessment approach to reducing traffic controller’s human errors. Knowl.-Based Syst. 239, 108047 (2022)CrossRef
6.
go back to reference Kadra, A., Lindauer, M., Hutter, F., Grabocka, J.: Well-tuned simple nets excel on tabular datasets. In: Ranzato, M., Beygelzimer, A., Dauphin, Y., Liang, P., Vaughan, J.W. (eds.) Advances in Neural Information Processing Systems, vol. 34, pp. 23928–23941. Curran Associates Inc. (2021) Kadra, A., Lindauer, M., Hutter, F., Grabocka, J.: Well-tuned simple nets excel on tabular datasets. In: Ranzato, M., Beygelzimer, A., Dauphin, Y., Liang, P., Vaughan, J.W. (eds.) Advances in Neural Information Processing Systems, vol. 34, pp. 23928–23941. Curran Associates Inc. (2021)
7.
go back to reference Gorishniy, Y., Rubachev, I., Khrulkov, V., Babenko, A.: Revisiting deep learning models for tabular data. In: Ranzato, M., Beygelzimer, A., Dauphin, Y., Liang, P., Vaughan, J.W. (eds.) Advances in Neural Information Processing Systems, vol. 34, pp. 18932–18943. Curran Associates Inc. (2021) Gorishniy, Y., Rubachev, I., Khrulkov, V., Babenko, A.: Revisiting deep learning models for tabular data. In: Ranzato, M., Beygelzimer, A., Dauphin, Y., Liang, P., Vaughan, J.W. (eds.) Advances in Neural Information Processing Systems, vol. 34, pp. 18932–18943. Curran Associates Inc. (2021)
8.
go back to reference McElfresh, D., Khandagale, S., Valverde, J., Ramakrishnan, G., Goldblum, M., White, C., et al.: When do neural nets outperform boosted trees on tabular data? arXiv preprint arXiv:2305.02997 (2023) McElfresh, D., Khandagale, S., Valverde, J., Ramakrishnan, G., Goldblum, M., White, C., et al.: When do neural nets outperform boosted trees on tabular data? arXiv preprint arXiv:​2305.​02997 (2023)
9.
go back to reference Arik, S.O., Pfister, T.: TabNet: attentive interpretable tabular learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 8, pp. 6679–6687 (2021) Arik, S.O., Pfister, T.: TabNet: attentive interpretable tabular learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 8, pp. 6679–6687 (2021)
10.
go back to reference Shi, Q., Katuwal, R., Suganthan, P.N., Tanveer, M.: Random vector functional link neural network based ensemble deep learning. Pattern Recogn. 117, 107978 (2021)CrossRef Shi, Q., Katuwal, R., Suganthan, P.N., Tanveer, M.: Random vector functional link neural network based ensemble deep learning. Pattern Recogn. 117, 107978 (2021)CrossRef
11.
go back to reference Malik, A.K., Ganaie, M.A., Tanveer, M., Suganthan, P.N., Alzheimer’s Disease Neuroimaging Initiative Initiative: Alzheimer’s disease diagnosis via intuitionistic fuzzy random vector functional link network. IEEE Trans. Comput. Soc. Syst. 1–12 (2022) Malik, A.K., Ganaie, M.A., Tanveer, M., Suganthan, P.N., Alzheimer’s Disease Neuroimaging Initiative Initiative: Alzheimer’s disease diagnosis via intuitionistic fuzzy random vector functional link network. IEEE Trans. Comput. Soc. Syst. 1–12 (2022)
12.
go back to reference Hu, M., Chion, J.H., Suganthan, P.N., Katuwal, R.K.: Ensemble deep random vector functional link neural network for regression. IEEE Trans. Syst. Man Cybern. Syst. 53(5), 2604–2615 (2023)CrossRef Hu, M., Chion, J.H., Suganthan, P.N., Katuwal, R.K.: Ensemble deep random vector functional link neural network for regression. IEEE Trans. Syst. Man Cybern. Syst. 53(5), 2604–2615 (2023)CrossRef
13.
go back to reference Malik, A., Gao, R., Ganaie, M., Tanveer, M., Suganthan, P.N.: Random vector functional link network: recent developments, applications, and future directions. Appl. Soft Comput. 143, 110377 (2023)CrossRef Malik, A., Gao, R., Ganaie, M., Tanveer, M., Suganthan, P.N.: Random vector functional link network: recent developments, applications, and future directions. Appl. Soft Comput. 143, 110377 (2023)CrossRef
14.
go back to reference Ke, G., et al.: LightGBM: a highly efficient gradient boosting decision tree. In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems, vol. 30. Curran Associates Inc. (2017) Ke, G., et al.: LightGBM: a highly efficient gradient boosting decision tree. In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems, vol. 30. Curran Associates Inc. (2017)
15.
go back to reference Lundberg, S.M., Lee, S.-I.: A unified approach to interpreting model predictions. In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems, vol. 30, pp. 4765–4774. Curran Associates Inc. (2017) Lundberg, S.M., Lee, S.-I.: A unified approach to interpreting model predictions. In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems, vol. 30, pp. 4765–4774. Curran Associates Inc. (2017)
16.
go back to reference Pelikan, M., Goldberg, D.E., Cantú-Paz, E.: BOA: the Bayesian optimization algorithm. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 525–532 (1999) Pelikan, M., Goldberg, D.E., Cantú-Paz, E.: BOA: the Bayesian optimization algorithm. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 525–532 (1999)
17.
go back to reference Lu, Z., Happee, R., de Winter, J.C.: Take over! A video-clip study measuring attention, situation awareness, and decision-making in the face of an impending hazard. Transport. Res. F: Traffic Psychol. Behav. 72, 211–225 (2020)CrossRef Lu, Z., Happee, R., de Winter, J.C.: Take over! A video-clip study measuring attention, situation awareness, and decision-making in the face of an impending hazard. Transport. Res. F: Traffic Psychol. Behav. 72, 211–225 (2020)CrossRef
18.
go back to reference Galton, F.: Regression towards mediocrity in hereditary stature. J. Anthropol. Inst. Great Br. Irel. 15, 246–263 (1886) Galton, F.: Regression towards mediocrity in hereditary stature. J. Anthropol. Inst. Great Br. Irel. 15, 246–263 (1886)
19.
go back to reference Platt, J., et al.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv. Large Margin Classifiers 10(3), 61–74 (1999) Platt, J., et al.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv. Large Margin Classifiers 10(3), 61–74 (1999)
20.
go back to reference Hoerl, A.E., Kennard, R.W.: Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12(1), 55–67 (1970)CrossRefMATH Hoerl, A.E., Kennard, R.W.: Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12(1), 55–67 (1970)CrossRefMATH
21.
go back to reference Chen, T., Guestrin, C.: XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 785–794 (2016) Chen, T., Guestrin, C.: XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 785–794 (2016)
22.
go back to reference Pao, Y.-H., Takefuji, Y.: Functional-link net computing: theory, system architecture, and functionalities. Computer 25(5), 76–79 (1992)CrossRef Pao, Y.-H., Takefuji, Y.: Functional-link net computing: theory, system architecture, and functionalities. Computer 25(5), 76–79 (1992)CrossRef
23.
go back to reference Suganthan, P.N., Katuwal, R.: On the origins of randomization-based feedforward neural networks. Appl. Soft Comput. 105, 107239 (2021)CrossRef Suganthan, P.N., Katuwal, R.: On the origins of randomization-based feedforward neural networks. Appl. Soft Comput. 105, 107239 (2021)CrossRef
Metadata
Title
Ensemble of Randomized Neural Network and Boosted Trees for Eye-Tracking-Based Driver Situation Awareness Recognition and Interpretation
Authors
Ruilin Li
Minghui Hu
Jian Cui
Lipo Wang
Olga Sourina
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-8067-3_37

Premium Partner