Skip to main content

2018 | OriginalPaper | Buchkapitel

Towards a Conceptual Framework for the Objective Evaluation of User Experience

verfasst von : Carolina Rico-Olarte, Diego M. López, Sara Kepplinger

Erschienen in: Design, User Experience, and Usability: Theory and Practice

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Background: The concept of user experience (UX) involves many aspects and different perspectives, making it difficult to evaluate the whole set of what UX represents. Despite existing standards, a clear definition of the UX evaluation concerning the identification of the different aspects to be evaluated according to the perspectives forming the UX (user and system), taking into account a given context of use is missing. Objective: Propose a conceptual framework for identifying differences between the UX evaluation perspectives and their measurable aspects. Methods: We followed a qualitative method for building conceptual frameworks. Results: The proposed conceptual framework identifies and associates the main UX concepts, from the user and system perspectives. The obtained plane of concepts provides a better overview of the phenomenon studied. The built framework led to the definition of an objective UX evaluation method: physiological signals are the convergence point between the physical state of the user and the measurement of emotions. Conclusion: The evaluation of UX is particularly important in ICT solutions for health since users/patients must maintain the motivation to continue using technology, in order to guarantee adherence to their treatments or interventions. The obtained framework and method are the first step towards finding suitable and according-to-context UX evaluation processes allowing an improved interaction between user and system.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Roto, V., Law, E.L.-C., Vermeeren, A., Hoonhout, J.: User Experience White Paper. Presented at the Dagstuhl, Germany (2011) Roto, V., Law, E.L.-C., Vermeeren, A., Hoonhout, J.: User Experience White Paper. Presented at the Dagstuhl, Germany (2011)
3.
Zurück zum Zitat Carrillo, I., Meza-Kubo, V., Morán, A.L., Galindo, G., García-Canseco, E.: Processing EEG signals towards the construction of a user experience assessment method. In: Bravo, J., Hervás, R., Villarreal, V. (eds.) AmIHEALTH 2015. LNCS, vol. 9456, pp. 281–292. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-26508-7_28CrossRef Carrillo, I., Meza-Kubo, V., Morán, A.L., Galindo, G., García-Canseco, E.: Processing EEG signals towards the construction of a user experience assessment method. In: Bravo, J., Hervás, R., Villarreal, V. (eds.) AmIHEALTH 2015. LNCS, vol. 9456, pp. 281–292. Springer, Cham (2015). https://​doi.​org/​10.​1007/​978-3-319-26508-7_​28CrossRef
4.
Zurück zum Zitat Colpani, R., Homem, M.R.P.: An innovative augmented reality educational framework with gamification to assist the learning process of children with intellectual disabilities. In: 2015 6th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1–6 (2015) Colpani, R., Homem, M.R.P.: An innovative augmented reality educational framework with gamification to assist the learning process of children with intellectual disabilities. In: 2015 6th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1–6 (2015)
5.
Zurück zum Zitat Keskinen, T., Hakulinen, J., Heimonen, T., Turunen, M., Sharma, S., Miettinen, T., Luhtala, M.: Evaluating the experiential user experience of public display applications in the wild. In: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia, p. 7. ACM (2013) Keskinen, T., Hakulinen, J., Heimonen, T., Turunen, M., Sharma, S., Miettinen, T., Luhtala, M.: Evaluating the experiential user experience of public display applications in the wild. In: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia, p. 7. ACM (2013)
6.
Zurück zum Zitat Law, E., Roto, V., Vermeeren, A.P., Kort, J., Hassenzahl, M.: Towards a shared definition of user experience. In: CHI 2008 extended abstracts on Human factors in computing systems, pp. 2395–2398. ACM (2008) Law, E., Roto, V., Vermeeren, A.P., Kort, J., Hassenzahl, M.: Towards a shared definition of user experience. In: CHI 2008 extended abstracts on Human factors in computing systems, pp. 2395–2398. ACM (2008)
7.
Zurück zum Zitat Väänänen-Vainio-Mattila, K., Roto, V., Hassenzahl, M.: Now let’s do it in practice: user experience evaluation methods in product development. In: CHI 2008 Extended Abstracts on Human Factors in Computing Systems, pp. 3961–3964. ACM (2008) Väänänen-Vainio-Mattila, K., Roto, V., Hassenzahl, M.: Now let’s do it in practice: user experience evaluation methods in product development. In: CHI 2008 Extended Abstracts on Human Factors in Computing Systems, pp. 3961–3964. ACM (2008)
8.
Zurück zum Zitat Law, E.L.-C., Vermeeren, A.P., Hassenzahl, M., Blythe, M.: Towards a UX manifesto. In: Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI… but not as We Know it-Volume 2, pp. 205–206. British Computer Society (2007) Law, E.L.-C., Vermeeren, A.P., Hassenzahl, M., Blythe, M.: Towards a UX manifesto. In: Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI… but not as We Know it-Volume 2, pp. 205–206. British Computer Society (2007)
10.
Zurück zum Zitat Law, E.L.-C., Roto, V., Hassenzahl, M., Vermeeren, A.P., Kort, J.: Understanding, scoping and defining user experience: a survey approach. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 719–728. ACM (2009) Law, E.L.-C., Roto, V., Hassenzahl, M., Vermeeren, A.P., Kort, J.: Understanding, scoping and defining user experience: a survey approach. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 719–728. ACM (2009)
11.
Zurück zum Zitat Hassenzahl, M.: The hedonic/pragmatic model of user experience. In: UX Manifesto, vol. 10, pp. 10–14 (2007) Hassenzahl, M.: The hedonic/pragmatic model of user experience. In: UX Manifesto, vol. 10, pp. 10–14 (2007)
12.
Zurück zum Zitat Hassenzahl, M.: User experience (UX): towards an experiential perspective on product quality. In: Proceedings of the 20th Conference on l’Interaction Homme-Machine, pp. 11–15. ACM (2008) Hassenzahl, M.: User experience (UX): towards an experiential perspective on product quality. In: Proceedings of the 20th Conference on l’Interaction Homme-Machine, pp. 11–15. ACM (2008)
13.
Zurück zum Zitat Hassenzahl, M., Tractinsky, N.: User experience-a research agenda. Behav. Inf. Technol. 25, 91–97 (2006)CrossRef Hassenzahl, M., Tractinsky, N.: User experience-a research agenda. Behav. Inf. Technol. 25, 91–97 (2006)CrossRef
14.
Zurück zum Zitat Wiklund-Engblom, A., Hassenzahl, M., Bengs, A., Sperring, S.: What us needs tell about user experience. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5727, pp. 666–669. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-03658-3_71CrossRef Wiklund-Engblom, A., Hassenzahl, M., Bengs, A., Sperring, S.: What us needs tell about user experience. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5727, pp. 666–669. Springer, Heidelberg (2009). https://​doi.​org/​10.​1007/​978-3-642-03658-3_​71CrossRef
15.
Zurück zum Zitat Thüring, M., Mahlke, S.: Usability, aesthetics and emotions in human–technology interaction. Int. J. Psychol. 42, 253–264 (2007)CrossRef Thüring, M., Mahlke, S.: Usability, aesthetics and emotions in human–technology interaction. Int. J. Psychol. 42, 253–264 (2007)CrossRef
16.
Zurück zum Zitat Mandryk, R.L.: Physiological measures for game evaluation. In: Game Usability: Advice from the Experts for Advancing the Player Experience, pp. 207–235 (2008) Mandryk, R.L.: Physiological measures for game evaluation. In: Game Usability: Advice from the Experts for Advancing the Player Experience, pp. 207–235 (2008)
17.
Zurück zum Zitat Boehner, K., DePaula, R., Dourish, P., Sengers, P.: How emotion is made and measured. Int. J. Hum.-Comput. Stud. 65, 275–291 (2007)CrossRef Boehner, K., DePaula, R., Dourish, P., Sengers, P.: How emotion is made and measured. Int. J. Hum.-Comput. Stud. 65, 275–291 (2007)CrossRef
18.
Zurück zum Zitat Allam, A., Dahlan, H.M.: User experience: challenges and opportunities. J. Inf. Syst. Res. Innov. 3, 28–36 (2013) Allam, A., Dahlan, H.M.: User experience: challenges and opportunities. J. Inf. Syst. Res. Innov. 3, 28–36 (2013)
19.
Zurück zum Zitat Stone, D., Jarrett, C., Woodroffe, M., Minocha, S.: User Interface Design and Evaluation. Morgan Kaufmann, Burlington (2005) Stone, D., Jarrett, C., Woodroffe, M., Minocha, S.: User Interface Design and Evaluation. Morgan Kaufmann, Burlington (2005)
20.
Zurück zum Zitat Kort, J., Vermeeren, A., Fokker, J.E.: Conceptualizing and measuring user experience. In: UX Manifesto, p. 57 (2007) Kort, J., Vermeeren, A., Fokker, J.E.: Conceptualizing and measuring user experience. In: UX Manifesto, p. 57 (2007)
21.
Zurück zum Zitat Bevan, N.: What is the difference between the purpose of usability and user experience evaluation methods. In: Proceedings of the Workshop UXEM, pp. 1–4 (2009) Bevan, N.: What is the difference between the purpose of usability and user experience evaluation methods. In: Proceedings of the Workshop UXEM, pp. 1–4 (2009)
22.
Zurück zum Zitat Bevan, N.: International standards for usability should be more widely used. J. Usability Stud. 4, 106–113 (2009) Bevan, N.: International standards for usability should be more widely used. J. Usability Stud. 4, 106–113 (2009)
23.
Zurück zum Zitat Jabareen, Y.: Building a conceptual framework: philosophy, definitions, and procedure. Int. J. Qual. Methods 8, 49–62 (2009)CrossRef Jabareen, Y.: Building a conceptual framework: philosophy, definitions, and procedure. Int. J. Qual. Methods 8, 49–62 (2009)CrossRef
24.
Zurück zum Zitat Rico-Olarte, C., López, D., Kepplinger, S.: User experience evaluation methods in games for children with cognitive disabilities: a systematic review. In: Proceedings of 1st International Young Researcher Summit on Quality of Experience in Emerging Multimedia Services (QEEMS 2017), Erfurt, Germany (2017) Rico-Olarte, C., López, D., Kepplinger, S.: User experience evaluation methods in games for children with cognitive disabilities: a systematic review. In: Proceedings of 1st International Young Researcher Summit on Quality of Experience in Emerging Multimedia Services (QEEMS 2017), Erfurt, Germany (2017)
26.
Zurück zum Zitat Zarour, M., Alharbi, M.: User experience framework that combines aspects, dimensions, and measurement methods. Cogent Eng. Article no. 1421006 (2017) Zarour, M., Alharbi, M.: User experience framework that combines aspects, dimensions, and measurement methods. Cogent Eng. Article no. 1421006 (2017)
27.
Zurück zum Zitat Rico-Olarte, C., López, D., Blobel, B., Kepplinger, S.: User experience evaluations in rehabilitation video games for children: a systematic mapping of the literature. Stud. Health Technol. Inf. 243, 13 (2017) Rico-Olarte, C., López, D., Blobel, B., Kepplinger, S.: User experience evaluations in rehabilitation video games for children: a systematic mapping of the literature. Stud. Health Technol. Inf. 243, 13 (2017)
28.
Zurück zum Zitat Maia, C.L.B., Furtado, E.S.: A study about psychophysiological measures in user experience monitoring and evaluation. In: Proceedings of the 15th Brazilian Symposium on Human Factors in Computer Systems, pp. 7:1–7:9. ACM, New York (2016) Maia, C.L.B., Furtado, E.S.: A study about psychophysiological measures in user experience monitoring and evaluation. In: Proceedings of the 15th Brazilian Symposium on Human Factors in Computer Systems, pp. 7:1–7:9. ACM, New York (2016)
33.
Zurück zum Zitat Cacioppo, J.T., Tassinary, L.G., Berntson, G.: Handbook of Psychophysiology. Cambridge University Press, Cambridge (2007)CrossRef Cacioppo, J.T., Tassinary, L.G., Berntson, G.: Handbook of Psychophysiology. Cambridge University Press, Cambridge (2007)CrossRef
37.
Zurück zum Zitat Izard, C.E.: Basic emotions, relations among emotions, and emotion-cognition relations (1992)CrossRef Izard, C.E.: Basic emotions, relations among emotions, and emotion-cognition relations (1992)CrossRef
38.
Zurück zum Zitat Ekman, P.: An argument for basic emotions. Cogn. Emot. 6, 169–200 (1992)CrossRef Ekman, P.: An argument for basic emotions. Cogn. Emot. 6, 169–200 (1992)CrossRef
39.
Zurück zum Zitat Rico-Olarte, C., Narváez, S., Farinango, C., López, D.M., Pharow, P.S.: HapHop-Physio a computer game to support cognitive therapies in children. Psychol. Res. Behav. Manag. 10, 1–9 (2017)CrossRef Rico-Olarte, C., Narváez, S., Farinango, C., López, D.M., Pharow, P.S.: HapHop-Physio a computer game to support cognitive therapies in children. Psychol. Res. Behav. Manag. 10, 1–9 (2017)CrossRef
40.
Zurück zum Zitat Sim, G., Horton, M.: Investigating children’s opinions of games: fun toolkit vs. this or that. In: Proceedings of the 11th International Conference on Interaction Design and Children, pp. 70–77. ACM, New York (2012) Sim, G., Horton, M.: Investigating children’s opinions of games: fun toolkit vs. this or that. In: Proceedings of the 11th International Conference on Interaction Design and Children, pp. 70–77. ACM, New York (2012)
41.
Zurück zum Zitat Montañés, M.C.: Psicología de la emoción: el proceso emocional. Universidad de Valencia (2005) Montañés, M.C.: Psicología de la emoción: el proceso emocional. Universidad de Valencia (2005)
42.
Zurück zum Zitat Hernandez, J., Riobo, I., Rozga, A., Abowd, G.D., Picard, R.W.: Using electrodermal activity to recognize ease of engagement in children during social interactions. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 307–317. ACM (2014) Hernandez, J., Riobo, I., Rozga, A., Abowd, G.D., Picard, R.W.: Using electrodermal activity to recognize ease of engagement in children during social interactions. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 307–317. ACM (2014)
43.
Zurück zum Zitat Martínez, F., Barraza, C., González, N., González, J.: KAPEAN: understanding affective states of children with ADHD. Educ. Technol. Soc. 19, 18–28 (2016) Martínez, F., Barraza, C., González, N., González, J.: KAPEAN: understanding affective states of children with ADHD. Educ. Technol. Soc. 19, 18–28 (2016)
44.
Zurück zum Zitat Landowska, A., Miler, J.: Limitations of emotion recognition in software user experience evaluation context. In: 2016 Federated Conference on Computer Science and Information Systems (FedCSIS), pp. 1631–1640 (2016) Landowska, A., Miler, J.: Limitations of emotion recognition in software user experience evaluation context. In: 2016 Federated Conference on Computer Science and Information Systems (FedCSIS), pp. 1631–1640 (2016)
46.
Metadaten
Titel
Towards a Conceptual Framework for the Objective Evaluation of User Experience
verfasst von
Carolina Rico-Olarte
Diego M. López
Sara Kepplinger
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-91797-9_39

Neuer Inhalt