Skip to main content

2015 | OriginalPaper | Buchkapitel

Mind the Gap! Comparing Retrospective and Concurrent Ratings of Emotion in User Experience Evaluation

verfasst von : Anders Bruun, Simon Ahm

Erschienen in: Human-Computer Interaction – INTERACT 2015

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

User experience (UX) is typically measured retrospectively through subjective questionnaire ratings, yet we know little of how well these retrospective ratings reflect concurrent experiences of an entire event. UX entails a broad range of dimensions of which human emotion is considered to be crucial. This paper presents an empirical study of the discrepancy between concurrent and retrospective ratings of emotions. We induced two experimental conditions of varying pleasantness. Findings show the existence of a significant discrepancy between retrospective and concurrent ratings of emotions. In the most unpleasant condition we found retrospective ratings to be significantly overestimated compared to concurrent ratings. In the most pleasant condition we found retrospective ratings to correlate with the highest and final peaks of emotional arousal. This indicates that we cannot always rely on typical retrospective UX assessments to reflect concurrent experiences. Consequently, we discuss alternative methods of assessing UX, which have considerable implications for practice.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bargas-Avila, J.A., Hornbæk, K.: Old wine in new bottles or novel challenges. In: Procedings CHI, p. 2689. ACM, New York (2011) Bargas-Avila, J.A., Hornbæk, K.: Old wine in new bottles or novel challenges. In: Procedings CHI, p. 2689. ACM, New York (2011)
2.
Zurück zum Zitat Thüring, M., Mahlke, S.: Usability, aesthetics and emotions in human–technology interaction. Int. J. Psychol. 42, 253–264 (2007)CrossRef Thüring, M., Mahlke, S.: Usability, aesthetics and emotions in human–technology interaction. Int. J. Psychol. 42, 253–264 (2007)CrossRef
3.
Zurück zum Zitat Forlizzi, J., Battarbee, K.: Understanding experience in interactive systems. In: Proceedings DIS, pp. 261–268. ACM, New York (2004) Forlizzi, J., Battarbee, K.: Understanding experience in interactive systems. In: Proceedings DIS, pp. 261–268. ACM, New York (2004)
4.
Zurück zum Zitat Scherer, K.R.: What are emotions? and how can they be measured? Soc. Sci. Inf. 44, 695–729 (2005)CrossRef Scherer, K.R.: What are emotions? and how can they be measured? Soc. Sci. Inf. 44, 695–729 (2005)CrossRef
5.
Zurück zum Zitat Miron-Shatz, T., Stone, A., Kahneman, D.: Memories of yesterday’s emotions: does the valence of experience affect the memory-experience gap? Emotion 9, 885–891 (2009)CrossRef Miron-Shatz, T., Stone, A., Kahneman, D.: Memories of yesterday’s emotions: does the valence of experience affect the memory-experience gap? Emotion 9, 885–891 (2009)CrossRef
6.
Zurück zum Zitat Redelmeier, D.A., Kahneman, D.: Patients’ memories of painful medical treatments: real-time and retrospective evaluations of two minimally invasive procedures. Pain 66, 3–8 (1996)CrossRef Redelmeier, D.A., Kahneman, D.: Patients’ memories of painful medical treatments: real-time and retrospective evaluations of two minimally invasive procedures. Pain 66, 3–8 (1996)CrossRef
7.
Zurück zum Zitat Hassenzahl, M., Ullrich, D.: To do or not to do: differences in user experience and retrospective judgments depending on the presence or absence of instrumental goals. Interact. Comput. 19, 429–437 (2007)CrossRef Hassenzahl, M., Ullrich, D.: To do or not to do: differences in user experience and retrospective judgments depending on the presence or absence of instrumental goals. Interact. Comput. 19, 429–437 (2007)CrossRef
8.
Zurück zum Zitat Mahlke, S., Lindgaard, G.: Emotional experiences and quality perceptions of interactive products. In: Jacko, J. (ed.) Human-Computer Interaction. Interaction Design and Usability SE – 19, pp. 164–173. Springer, Heidelberg (2007)CrossRef Mahlke, S., Lindgaard, G.: Emotional experiences and quality perceptions of interactive products. In: Jacko, J. (ed.) Human-Computer Interaction. Interaction Design and Usability SE – 19, pp. 164–173. Springer, Heidelberg (2007)CrossRef
9.
Zurück zum Zitat Mahlke, S., Thüring, M.: Studying antecedents of emotional experiences in interactive contexts. In: Proceedings CHI, pp. 915–918. ACM, New York (2007) Mahlke, S., Thüring, M.: Studying antecedents of emotional experiences in interactive contexts. In: Proceedings CHI, pp. 915–918. ACM, New York (2007)
10.
Zurück zum Zitat Kujala, S., Miron-Shatz, T.: Emotions, experiences and usability in real-life mobile phone use. In: Proceedings CHI, pp. 1061–1070. ACM, New York (2013) Kujala, S., Miron-Shatz, T.: Emotions, experiences and usability in real-life mobile phone use. In: Proceedings CHI, pp. 1061–1070. ACM, New York (2013)
11.
Zurück zum Zitat Diener, E., Tay, L.: Review of the day reconstruction method (DRM). Soc. Indic. Res. 116, 255–267 (2014)CrossRef Diener, E., Tay, L.: Review of the day reconstruction method (DRM). Soc. Indic. Res. 116, 255–267 (2014)CrossRef
12.
Zurück zum Zitat Bylsma, L.M., Taylor-Clift, A., Rottenberg, J.: Emotional reactivity to daily events in major and minor depression. J. Abnorm. Psychol. 120, 155–167 (2011)CrossRef Bylsma, L.M., Taylor-Clift, A., Rottenberg, J.: Emotional reactivity to daily events in major and minor depression. J. Abnorm. Psychol. 120, 155–167 (2011)CrossRef
13.
Zurück zum Zitat James, W.: What is an emotion? Mind os-IX 9, 188–205 (1884) James, W.: What is an emotion? Mind os-IX 9, 188–205 (1884)
14.
Zurück zum Zitat Lang, P.J.: Behavioral treatment and bio-behavioral assessment: computer applications. In: Sidowski, J.B., Johnson, J.H., Williams, T.H. (eds.) Technology in Mental Health Care Delivery Systems, pp. 119–137. Ablex, Norwood (1980) Lang, P.J.: Behavioral treatment and bio-behavioral assessment: computer applications. In: Sidowski, J.B., Johnson, J.H., Williams, T.H. (eds.) Technology in Mental Health Care Delivery Systems, pp. 119–137. Ablex, Norwood (1980)
15.
Zurück zum Zitat Lang, P.J.: The emotion probe: Studies of motivation and attention. Am. Psychol. 50, 372–385 (1995)CrossRef Lang, P.J.: The emotion probe: Studies of motivation and attention. Am. Psychol. 50, 372–385 (1995)CrossRef
16.
Zurück zum Zitat Andreassi, J.L.: Psychophysiology: Human Behavior and Physiological Response. Lawrence Erlbaum, Mahwah (2000) Andreassi, J.L.: Psychophysiology: Human Behavior and Physiological Response. Lawrence Erlbaum, Mahwah (2000)
17.
Zurück zum Zitat Ward, R., Marsden, P.: Physiological responses to different WEB page designs. Int. J. Human-Computer Stud. 59, 199–212 (2003)CrossRef Ward, R., Marsden, P.: Physiological responses to different WEB page designs. Int. J. Human-Computer Stud. 59, 199–212 (2003)CrossRef
18.
Zurück zum Zitat Baumeister, R.F., Bratslavsky, E., Finkenauer, C., Vohs, K.D.: Bad is stronger than good. Rev. Gen. Psychol. 5, 323–370 (2001)CrossRef Baumeister, R.F., Bratslavsky, E., Finkenauer, C., Vohs, K.D.: Bad is stronger than good. Rev. Gen. Psychol. 5, 323–370 (2001)CrossRef
19.
Zurück zum Zitat Kahneman, D., Fredrickson, B.L., Schreiber, C.A., Redelmeier, D.A.: When more pain is preferred to less: adding a better end. Psychol. Sci. 4, 401–405 (1993)CrossRef Kahneman, D., Fredrickson, B.L., Schreiber, C.A., Redelmeier, D.A.: When more pain is preferred to less: adding a better end. Psychol. Sci. 4, 401–405 (1993)CrossRef
20.
Zurück zum Zitat Mahlke, S., Minge, M., Thüring, M.: Measuring multiple components of emotions in interactive contexts. In: CHI EA, pp. 1061–1066. ACM, New York (2006) Mahlke, S., Minge, M., Thüring, M.: Measuring multiple components of emotions in interactive contexts. In: CHI EA, pp. 1061–1066. ACM, New York (2006)
21.
Zurück zum Zitat Hassenzahl, M., Sandweg, N.: From mental effort to perceived usability: transforming experiences into summary assessments. In: CHI EA, pp. 1283–1286. ACM, New York (2004) Hassenzahl, M., Sandweg, N.: From mental effort to perceived usability: transforming experiences into summary assessments. In: CHI EA, pp. 1283–1286. ACM, New York (2004)
22.
Zurück zum Zitat Dockray, S., Grant, N., Stone, A.A., Kahneman, D., Wardle, J., Steptoe, A.: A comparison of affect ratings obtained with ecological momentary assessment and the day reconstruction method. Soc. Indic. Res. 99, 269–283 (2010)CrossRef Dockray, S., Grant, N., Stone, A.A., Kahneman, D., Wardle, J., Steptoe, A.: A comparison of affect ratings obtained with ecological momentary assessment and the day reconstruction method. Soc. Indic. Res. 99, 269–283 (2010)CrossRef
23.
Zurück zum Zitat Omodei, M.M., McLennan, J.: Studying complex decision making in natural settings: using a head-mounted video camera to study competitive orienteering. Percept. Mot. Skills 79, 1411–1425 (1994)CrossRefMATH Omodei, M.M., McLennan, J.: Studying complex decision making in natural settings: using a head-mounted video camera to study competitive orienteering. Percept. Mot. Skills 79, 1411–1425 (1994)CrossRefMATH
24.
Zurück zum Zitat Bentley, T., Johnston, L., von Baggo, K.: Evaluation using cued-recall debrief to elicit information about a user’s affective experiences. In: Proceedings OzCHI, pp. 1–10. CHISIG Australia, Narrabundah (2005) Bentley, T., Johnston, L., von Baggo, K.: Evaluation using cued-recall debrief to elicit information about a user’s affective experiences. In: Proceedings OzCHI, pp. 1–10. CHISIG Australia, Narrabundah (2005)
25.
Zurück zum Zitat Gao, Y., Bianchi-Berthouze, N., Meng, H.: What does touch tell us about emotions in touchscreen-based gameplay? ACM Trans. Comput. Interact. 19, 31:1–31:30 (2012)MATH Gao, Y., Bianchi-Berthouze, N., Meng, H.: What does touch tell us about emotions in touchscreen-based gameplay? ACM Trans. Comput. Interact. 19, 31:1–31:30 (2012)MATH
26.
Zurück zum Zitat Belford, Z., Neher, C., Pernsteiner, T., Stoffregen, J., Tariq, Z.: Music and physical performance: the effects of different music genres on physical performance as measured by the heart rate, electrodermal arousal, and maximum grip strength. In: JASS. 3 (2013) Belford, Z., Neher, C., Pernsteiner, T., Stoffregen, J., Tariq, Z.: Music and physical performance: the effects of different music genres on physical performance as measured by the heart rate, electrodermal arousal, and maximum grip strength. In: JASS. 3 (2013)
27.
Zurück zum Zitat Karapanos, E., Zimmerman, J., Forlizzi, J., Martens, J.-B.: Measuring the dynamics of remembered experience over time. Interact. Comput. 22, 328–335 (2010)CrossRef Karapanos, E., Zimmerman, J., Forlizzi, J., Martens, J.-B.: Measuring the dynamics of remembered experience over time. Interact. Comput. 22, 328–335 (2010)CrossRef
28.
Zurück zum Zitat Karapanos, E., Martens, J.-B., Hassenzahl, M.: On the retrospective assessment of users’ experiences over time: memory or actuality? In: CHI EA, pp. 4075–4080. ACM, New York (2010) Karapanos, E., Martens, J.-B., Hassenzahl, M.: On the retrospective assessment of users’ experiences over time: memory or actuality? In: CHI EA, pp. 4075–4080. ACM, New York (2010)
Metadaten
Titel
Mind the Gap! Comparing Retrospective and Concurrent Ratings of Emotion in User Experience Evaluation
verfasst von
Anders Bruun
Simon Ahm
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-22701-6_17

Neuer Inhalt