Top

Published in:

2025 | OriginalPaper | Chapter

6. Multimodal Interaction Design in Intelligent Vehicles

Authors : Yahui Wang, ZhiRong Xue, Jun Li, Siyu Jia, Baoling Yang

Published in: Human-Machine Interaction (HMI) Design for Intelligent Vehicles

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In Human-Machine Interface (HMI) design, visual, auditory, tactile, and olfactory senses can all play distinct roles. Visual information comprises 83% of all sensory inputs received.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

previous chapter HMI Design of Intelligent Vehicles Infotainment System

next chapter Human-Machine Interface (HMI) Design for Automated Driving

Aftab, A. R. (2019). Multimodal driver interaction with gesture, gaze and speech. 2019 International Conference on Multimodal Interaction (pp. 487–492).

Chang, C.-C., Boyle, L. N., Lee, J. D., & Jenness, J. (2017). Using tactile detection response tasks to assess in-vehicle voice control interactions. Transportation Research Part F: Traffic Psychology and Behaviour, 51, 38–46. https://doi.org/10.1016/j.trf.2017.06.008CrossRef

Gualtieri, L., Rauch, E., & Vidoni, R. (2021). Emerging research fields in safety and ergonomics in industrial collaborative robotics: A systematic literature review. Robotics and Computer-Integrated Manufacturing, 67, 101998. https://doi.org/10.1016/j.rcim.2020.101998CrossRef

He, Y., Sun, C., & Chang, F. (2023). The road safety and risky behavior analysis of delivery vehicle drivers in China. Accident Analysis & Prevention, 184, 107013. https://doi.org/10.1016/j.aap.2023.107013CrossRef

Kim, S., van Egmond, R., & Happee, R. (2024). How manoeuvre information via auditory (spatial and beep) and visual UI can enhance trust and acceptance in automated driving. Transportation Research Part F: Traffic Psychology and Behaviour, 100, 22–36. https://doi.org/10.1016/j.trf.2023.11.007CrossRef

Koay, H. V., Chuah, J. H., Chow, C.-O., & Chang, Y.-L. (2022). Detecting and recognizing driver distraction through various data modality using machine learning: A review, recent advances, simplified framework and open challenges (2014–2021). Engineering Applications of Artificial Intelligence, 115, 105309. https://doi.org/10.1016/j.engappai.2022.105309CrossRef

Kumar, N., & Lee, S. C. (2022). Human-machine interface in smart factory: A systematic literature review. Technological Forecasting and Social Change, 174, 121284. https://doi.org/10.1016/j.techfore.2021.121284CrossRef

Li, W., Huang, J., Xie, G., Karray, F., & Li, R. (2021). A survey on vision-based driver distraction analysis. Journal of Systems Architecture, 121, 102319. https://doi.org/10.1016/j.sysarc.2021.102319CrossRef

Li, X., Rong, J., Li, Z., Zhao, X., & Zhang, Y. (2022). Modeling drivers’ acceptance of augmented reality head-up display in connected environment. Displays, 75, 102307. https://doi.org/10.1016/j.displa.2022.102307CrossRef

Liang, N., Yang, J., Yu, D., Prakah-Asante, K. O., Curry, R., Blommer, M., Swaminathan, R., & Pitts, B. J. (2021). Using eye-tracking to investigate the effects of pre-takeover visual engagement on situation awareness during automated driving. Accident Analysis & Prevention, 157, 106143. https://doi.org/10.1016/j.aap.2021.106143CrossRef

Liu, L., & Duffy, V. G. (2024). Investigating cognitive workload in irrelevant speech-based information communication with visual distractions: Pleasant or distracted? International Journal of Industrial Ergonomics, 99, 103539. https://doi.org/10.1016/j.ergon.2023.103539CrossRef

Monk, C., Sall, R., Lester, B. D., & Higgins, J. S. (2023). Visual and cognitive demands of manual and voice-based driving mode implementations on smartphones. Accident Analysis & Prevention, 187, 107033. https://doi.org/10.1016/j.aap.2023.107033CrossRef

Niu, J., Wang, X., Liu, X., Wang, D., Qin, H., & Zhang, Y. (2019). Effects of mobile phone use on driving performance in a multiresource workload scenario. Traffic Injury Prevention. https://www.tandfonline.com/doi/abs/10.1080/15389588.2018.1527468

Portes, Q., Pinquier, J., Lerasle, F., & Carvalho, J. M. (2021). Multimodal human interaction analysis in vehicle cockpit. 2021 IEEE International Intelligent Transportation Systems Conference (ITSC) (pp. 2118–2124).

Tauqeer, M., Rubab, S., Khan, M. A., Naqvi, R. A., Javed, K., Alqahtani, A., Alsubai, S., & Binbusayyis, A. (2022). Driver’s emotion and behavior classification system based on Internet of Things and deep learning for Advanced Driver Assistance System (ADAS). Computer Communications, 194, 258–267. https://doi.org/10.1016/j.comcom.2022.07.031CrossRef

Trentin, V., Artuñedo, A., Godoy, J., & Villagra, J. (2023). Multi-modal interaction-aware motion prediction at unsignalized intersections. IEEE Transactions on Intelligent Vehicles, 8(5), 3349–3365.CrossRef

Title: Multimodal Interaction Design in Intelligent Vehicles
Authors: Yahui Wang
ZhiRong Xue
Jun Li
Siyu Jia
Baoling Yang
Publisher: Springer Nature Singapore
Book: Human-Machine Interaction (HMI) Design for Intelligent Vehicles
Print ISBN: 978-981-9778-22-5

Electronic ISBN: 978-981-9778-23-2

Copyright Year: 2025
DOI: https://doi.org/10.1007/978-981-97-7823-2_6