Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Bibliometric Literature Analysis and Systematic Review of Occupational Ergonomics Read chapter Read first chapter

2023 | OriginalPaper | Chapter

Standardization of User Experience Evaluation: Theory, Method and Promotion of High-Quality Development of Chinese Intelligent Vehicle Industry

Authors : Shiyan Tang, Ruilin Ouyang, Hao Tan

Published in: HCI International 2023 – Late Breaking Papers

Publisher: Springer Nature Switzerland

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

User experience (UX) evaluation can improve product quality, which has been confirmed in many studies. In recent years, the Chinese government has continued to promote the digitalization, intelligence and standardization of automobiles and the high-quality development of the intelligent automobile industry. However, there is still space for progress in production standardization and quality standardization, and mechanisms have not yet been designed to comprehensively measure the UX of intelligent vehicles. Therefore, the purpose of this paper is to develop a comprehensive framework for the evaluation of UX in intelligent vehicle human-machine interface (HMI) from the perspective of literature research and industry research. The framework was determined after a review of related literatures to analysis and summary existing evaluation approaches and was analyzed and organized according to the following components: UX evaluation object, the type of evaluation performer, HMI UX metrics, the most frequently applied evaluation methods, and UX influence factors. Through this method, it is possible for developers to obtain the theoretical knowledge and practical experience required for the evaluation of UX of HMI of intelligent vehicles, to carry out the evaluation to ensure the consistency of product quality, and then promote the high-quality development of the intelligent vehicle industry.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now
previous chapter Maneuver and Parameter Interventions in Automated Driving to Enhance User Satisfaction: A Kano Method Application
next chapter Crowdsourcing Data to Improve Transportation Safety and Efficiency: A Systematic Review
Literature
1.
2.
3.
4.
Maurer, S., Erbach, R., Kraiem, I., Kuhnert, S., Grimm, P., Rukzio, E.: Designing a guardian angel: giving an automated vehicle the possibility to override its driver. In: Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 341–350. Association for Computing Machinery, New York (2018)
5.
Rezvani, T., Driggs-Campbell, K., Sadigh, D., Sastry, S.S., Seshia, S.A., Bajcsy, R.: Towards trustworthy automation: user interfaces that convey internal and external awareness. In: 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), pp. 682–688. IEEE, New York (2016)
6.
Tran, C., Bark, K., Ng-Thow-Hing, V.: A left-turn driving aid using projected oncoming vehicle paths with augmented reality. In: Proceedings of the 5th international conference on automotive user interfaces and interactive vehicular applications, pp. 300–307. Association for Computing Machinery, New York (2013)
7.
Politis, I., Brewster, S., & Pollick, F.: Language-based multimodal displays for the handover of control in autonomous cars. In: Proceedings of the 7th international conference on automotive user interfaces and interactive vehicular applications, pp. 3–10. Association for Computing Machinery, New York (2015)
8.
Carmona, J., Guindel, C., Garcia, F., de la Escalera, A.: EHMI: review and guidelines for deployment on autonomous vehicles. Sensors 21(9), 1–21 (2021)CrossRef
9.
Wang, L., Zhong, L.: Human Engineering, 1st edn. Hunan University Publisher, Hunan (2011)
10.
Bengler, K., Rettenmaier, M., Fritz, N., Feierle, A.: From HMI to HMIs: towards an HMI framework for automated driving. Information 11(2), 1–17 (2020)CrossRef
11.
Tan, Z., et al.: Human–machine interaction in intelligent and connected vehicles: a review of status quo, issues, and opportunities. IEEE Trans. Intell. Transp. Syst. 23(9), 13954–13975 (2021)CrossRef
12.
Olaverri-Monreal, C., Hasan, A.E., Bulut, J., Körber, M., Bengler, K.: Impact of in-vehicle displays location preferences on drivers’ performance and gaze. IEEE Trans. Intell. Transp. Syst. 15(4), 1770–1780 (2014)CrossRef
13.
Lau, M., Jipp, M., Oehl, M.: One solution fits all? Evaluating different communication strategies of a light-based external human-machine interface for differently sized automated vehicles from a pedestrian’s perspective. Accid. Anal. Prev. 171, 106641 (2022)CrossRef
14.
Dey, D., et al.: Taming the eHMI jungle: A classification taxonomy to guide, compare, and assess the design principles of automated vehicles’ external human-machine interfaces. Transp. Res. Interdisc. Perspect. 7, 100174 (2020)
15.
Deb, S., Strawderman, L.J., Carruth, D.W.: Investigating pedestrian suggestions for external features on fully autonomous vehicles: a virtual reality experiment. Transport. Res. F: Traffic Psychol. Behav. 59, 135–149 (2018)CrossRef
16.
17.
18.
Norman, D., Miller, J., Henderson, A.: What you see, some of what’s in the future, and how we go about doing it: HI at Apple Computer. In: Conference companion on Human factors in computing systems, p. 155. ACM Press, New York (1995)
19.
Berni, A., Borgianni, Y.: Making order in user experience research to support its application in design and beyond. Appl. Sci. 11(15), 6981 (2021)CrossRef
20.
Hassenzahl, M., Tractinsky, N.: User experience-a research agenda. Behav. Inf. Technol. 25(2), 91–97 (2006)CrossRef
21.
Forlizzi, J., Ford, S.: The building blocks of experience: an early framework for interaction designers. In: Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques, pp. 419–423. Association for Computing Machinery, New York (2000)
22.
Roto, V., Law, E.L.C., Vermeeren, A., Hoonhout, J.: 10373 Abstracts Collection--Demarcating User eXperience. In: Dagstuhl Seminar Proceedings. Taylor & Francis, London (2011)
23.
Voinescu, A., Morgan, P.L., Alford, C., Caleb-Solly, P.: The utility of psychological measures in evaluating perceived usability of automated vehicle interfaces–a study with older adults. Transport. Res. F: Traffic Psychol. Behav. 72, 244–263 (2020)CrossRef
24.
García-Díaz, J.M., García-Ruiz, M.A., Aquino-Santos, R., Edwards-Block, A.: Evaluation of a driving simulator with a visual and auditory interface. In: Collazos, C., Liborio, A., Rusu, C. (eds.) Human Computer Interaction, LNCS, vol. 8278, pp. 131–139. Springer, Cham (2013)CrossRef
25.
Lewis, J.R.: The system usability scale: past, present, and future. Int. J. Hum. Comput. Inter. 34(7), 577–590 (2018)CrossRef
26.
Albers, D., et al.: Usability evaluation—advances in experimental design in the context of automated driving human–machine interfaces. Information 15(5), 240 (2020)CrossRef
27.
Detjen, H., Salini, M., Kronenberger, J., Geisler, S., Schneegass, S.: Towards transparent behavior of automated vehicles: design and evaluation of HUD concepts to support system predictability through motion intent communication. In: Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction, pp. 1–12. Association for Computing Machinery, New York (2021)
28.
Holländer, K., Colley, A., Mai, C., Häkkilä, J., Alt, F., Pfleging, B.: Investigating the influence of external car displays on pedestrians’ crossing behavior in virtual reality. In: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 1–11. Association for Computing Machinery, New York (2019)
29.
Riegler, A., Aksoy, B., Riener, A., Holzmann, C.: Gaze-based interaction with windshield displays for automated driving: impact of dwell time and feedback design on task performance and subjective workload. In: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 151–160. Association for Computing Machinery, New York (2020)
30.
Xu, J., Chen, J., Liu, Z.: Research on active interaction and user experience of community intelligent vehicle system. In: 2021 International Symposium on Artificial Intelligence and its Application on Media (ISAIAM), pp. 43–50. IEEE (2021)
31.
Su, Y., Tan, Z., Dai, N.: Changes in usability evaluation of human-machine interfaces from the perspective of automated vehicles. In: Ahram, T.Z., Falcão, C.S. (eds.) AHFE 2021, LNCS, vol. 275, pp. 886–893. Springer, Cham (2021)
32.
Xie, Y., Murphey, Y.L., Kochhar, D.S.: Personalized driver workload estimation using deep neural network learning from physiological and vehicle signals. IEEE Trans. Intell. Veh. 5(3), 439–448 (2019)CrossRef
33.
Weidner, F., Broll, W.: Smart S3D TOR: intelligent warnings on large stereoscopic 3D dashboards during take-overs. In: Proceedings of the 8th ACM International Symposium on Pervasive Displays, pp. 1–7. Associa-tion for Computing Machinery, New York (2019)
34.
Sauro, J., Lewis, J.R.: Quantifying the User Experience: Practical Statistics for User Research. Morgan Kaufmann, Massachusetts (2016)
35.
Hartson, H.R., Andre, T.S., Williges, R.C.: Criteria for evaluating usability evaluation methods. Int. J. Hum. Comput. Inter. 13(4), 373–410 (2001)CrossRef
36.
Chen, F., Terken, J.: Automotive Interaction Design: From Theory to Practice, 1st edn. China machine press, Beijing (2022)
37.
Vermeeren, A.P., Law, E.L.C., Roto, V., Obrist, M., Hoonhout, J., Väänänen-Vainio-Mattila, K.: User experience evaluation methods: current state and development needs. In: Proceedings of the 6th Nordic conference on human-computer interaction: Extending boundaries, NordiCHI 2010, pp. 521–530. Association for Computing Machinery, New York (2020)
38.
Rohrer, C.: When to use which user-experience research methods. Nielsen Norman Group (2014)
39.
Naujoks, F., Forster, Y., Wiedemann, K., & Neukum, A.: A human-machine interface for cooperative highly automated driving. In: Stanton, N., Landry, S., Di Bucchianico, G., Vallicelli, A. (eds) Advances in Human Aspects of Transportation, Advances in Intelligent Systems and Computing, vol. 484, pp. 585–595. Springer, Cham. (2017). https://​doi.​org/​10.​1007/​978-3-319-41682-3_​49
40.
Helander, M.G.: Handbook of Human-Computer Interaction. Hunan University Publisher, Elsevier (2014)
41.
Hartson, R., Pyla, P.S.: The UX Book: Process and guidelines for ensuring a quality user experience, Elsevier (2012)
42.
Cœugnet, S., Cahour, B., Kraïem, S.: A psycho-ergonomic approach of the street-crossing decision-making: toward pedestrians’ interactions with automated vehicles. In: Bagnara, S., Tartaglia, R., Albolino, S., Alexander, T., Fujita, Y. (eds.) IEA 2018. AISC, vol. 823, pp. 132–141. Springer, Cham (2019). https://​doi.​org/​10.​1007/​978-3-319-96074-6_​14CrossRef
43.
Hock, P., Kraus, J., Babel, F., Walch, M., Rukzio, E., Baumann, M.: How to design valid simulator studies for investigating user experience in automated driving: review and hands-on considerations. In: Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 105–117. Association for Computing Machinery, New York (2019)
Metadata
Title
Standardization of User Experience Evaluation: Theory, Method and Promotion of High-Quality Development of Chinese Intelligent Vehicle Industry
Authors
Shiyan Tang
Ruilin Ouyang
Hao Tan
Copyright Year
2023
Book
HCI International 2023 – Late Breaking Papers

Print ISBN: 978-3-031-48046-1

Electronic ISBN: 978-3-031-48047-8

Copyright Year: 2023

DOI
https://doi.org/10.1007/978-3-031-48047-8_27