Skip to main content

2020 | OriginalPaper | Buchkapitel

A Generic Visualization Approach Supporting Task-Based Evaluation of Usability and User Experience

verfasst von : Regina Bernhaupt, Célia Martinie, Philippe Palanque, Günter Wallner

Erschienen in: Human-Centered Software Engineering

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Analyzing evaluation results of usability and user experience studies has its limitations when it comes to personalized user interfaces, highly complex and connected systems, or internationally used services involving millions of users. To support the analysis of the evaluation results of usability and user experience, a task-based evaluation approach is proposed. This approach uses multiple visualization views to support the analysis of evaluation results. The visualization offers different temporal views ranging from individual to more cumulative data views in order to combine results from evaluations and task models. The applicability of this approach is presented on a simple but demonstrative case study from television and entertainment.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bernhaupt, R., Palanque, P.: POISE - a framework for systemic change analysis (2020, in preparation) Bernhaupt, R., Palanque, P.: POISE - a framework for systemic change analysis (2020, in preparation)
2.
Zurück zum Zitat Bernhaupt, R., Navarre, D., Palanque, P., Winckler, M.: Model-based evaluation: a new way to support usability evaluation of multimodal interactive applications. In: Law, E.L.C., Hvannberg, E.T., Cockton, G. (eds.) Maturing Usability: Quality in Software, Interaction and Value. HCIS, pp. 96–119. Springer, London (2008). https://doi.org/10.1007/978-1-84628-941-5_5CrossRef Bernhaupt, R., Navarre, D., Palanque, P., Winckler, M.: Model-based evaluation: a new way to support usability evaluation of multimodal interactive applications. In: Law, E.L.C., Hvannberg, E.T., Cockton, G. (eds.) Maturing Usability: Quality in Software, Interaction and Value. HCIS, pp. 96–119. Springer, London (2008). https://​doi.​org/​10.​1007/​978-1-84628-941-5_​5CrossRef
3.
Zurück zum Zitat Bernhaupt, R., Palanque, P., Drouet, D., Martinie, C.: Enriching task models with usability and user experience evaluation data. In: Bogdan, C., Kuusinen, K., Lárusdóttir, M.K., Palanque, P., Winckler, M. (eds.) HCSE 2018. LNCS, vol. 11262, pp. 146–163. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-05909-5_9CrossRef Bernhaupt, R., Palanque, P., Drouet, D., Martinie, C.: Enriching task models with usability and user experience evaluation data. In: Bogdan, C., Kuusinen, K., Lárusdóttir, M.K., Palanque, P., Winckler, M. (eds.) HCSE 2018. LNCS, vol. 11262, pp. 146–163. Springer, Cham (2019). https://​doi.​org/​10.​1007/​978-3-030-05909-5_​9CrossRef
4.
Zurück zum Zitat Bernhaupt, R., Palanque, P., Manciet, F., Martinie, C.: User-test results injection into task-based design process for the assessment and improvement of both usability and user experience. In: Bogdan, C., et al. (eds.) HESSD/HCSE -2016. LNCS, vol. 9856, pp. 56–72. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-44902-9_5CrossRef Bernhaupt, R., Palanque, P., Manciet, F., Martinie, C.: User-test results injection into task-based design process for the assessment and improvement of both usability and user experience. In: Bogdan, C., et al. (eds.) HESSD/HCSE -2016. LNCS, vol. 9856, pp. 56–72. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-44902-9_​5CrossRef
5.
Zurück zum Zitat Brooke, J., et al.: SUS-a quick and dirty usability scale. In: Jordan, P.W., Thomas, B., McClelland, I.L., Weerdmeester, B. (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor & Francis, Abingdon (1996) Brooke, J., et al.: SUS-a quick and dirty usability scale. In: Jordan, P.W., Thomas, B., McClelland, I.L., Weerdmeester, B. (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor & Francis, Abingdon (1996)
6.
Zurück zum Zitat Diaper, D.: Task analysis for knowledge descriptions (TAKD): the method and an example. In: Task Analysis for Human-Computer Interaction, pp. 108–159. Lawrence Erlbaum Associates (1990) Diaper, D.: Task analysis for knowledge descriptions (TAKD): the method and an example. In: Task Analysis for Human-Computer Interaction, pp. 108–159. Lawrence Erlbaum Associates (1990)
7.
Zurück zum Zitat Eiselmayer, A., Wacharamanotham, C., Beaudouin-Lafon, M., Mackay, W.E.: Touchstone2: an interactive environment for exploring trade-offs in HCI experiment design. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York (2019) Eiselmayer, A., Wacharamanotham, C., Beaudouin-Lafon, M., Mackay, W.E.: Touchstone2: an interactive environment for exploring trade-offs in HCI experiment design. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York (2019)
8.
Zurück zum Zitat Fahssi, R., Martinie, C., Palanque, P.: Enhanced task modelling for systematic identification and explicit representation of human errors. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9299, pp. 192–212. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22723-8_16CrossRef Fahssi, R., Martinie, C., Palanque, P.: Enhanced task modelling for systematic identification and explicit representation of human errors. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9299, pp. 192–212. Springer, Cham (2015). https://​doi.​org/​10.​1007/​978-3-319-22723-8_​16CrossRef
9.
Zurück zum Zitat Goldberg, J.H., Wichansky, A.M.: Eye tracking in usability evaluation: a practitioner’s guide. In: The Mind’s Eye, pp. 493–516. Elsevier (2003) Goldberg, J.H., Wichansky, A.M.: Eye tracking in usability evaluation: a practitioner’s guide. In: The Mind’s Eye, pp. 493–516. Elsevier (2003)
10.
Zurück zum Zitat Greenberg, S.: Working through task-centered system design. In: Diaper, D., Stanton, N. (eds.) The Handbook of Task Analysis for Human-Computer Interaction, pp. 49–66. Lawrence Erlbaum Associates, Hillsdale (2004) Greenberg, S.: Working through task-centered system design. In: Diaper, D., Stanton, N. (eds.) The Handbook of Task Analysis for Human-Computer Interaction, pp. 49–66. Lawrence Erlbaum Associates, Hillsdale (2004)
11.
Zurück zum Zitat Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In: Szwillus, G., Ziegler, J. (eds) Mensch & Computer 2003. Berichte des German Chapter of the ACM, vol. 57, pp. 187–196. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-322-80058-9_19 Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In: Szwillus, G., Ziegler, J. (eds) Mensch & Computer 2003. Berichte des German Chapter of the ACM, vol. 57, pp. 187–196. Springer, Heidelberg (2003). https://​doi.​org/​10.​1007/​978-3-322-80058-9_​19
12.
Zurück zum Zitat Johnson, P.: Interactions, collaborations and breakdowns. In: Proceedings of the 3rd Annual Conference on Task Models and Diagrams, pp. 1–3. ACM, New York (2004) Johnson, P.: Interactions, collaborations and breakdowns. In: Proceedings of the 3rd Annual Conference on Task Models and Diagrams, pp. 1–3. ACM, New York (2004)
13.
Zurück zum Zitat Johnson, P., Johnson, H., Hamilton, F.: Getting the knowledge into HCI: theoretical and practical aspects of task knowledge structures. In: Cognitive Task Analysis. Lawrence Erlbaum Associates (2000) Johnson, P., Johnson, H., Hamilton, F.: Getting the knowledge into HCI: theoretical and practical aspects of task knowledge structures. In: Cognitive Task Analysis. Lawrence Erlbaum Associates (2000)
14.
Zurück zum Zitat Lallemand, C., Gronier, G.: Méthodes de design UX: 30 méthodes fondamentales pour concevoir et évaluer les systèmes interactifs. Editions Eyrolles (2015) Lallemand, C., Gronier, G.: Méthodes de design UX: 30 méthodes fondamentales pour concevoir et évaluer les systèmes interactifs. Editions Eyrolles (2015)
15.
Zurück zum Zitat Lazar, J., Feng, J.H., Hochheiser, H.: Research Methods in Human-Computer Interaction. Morgan Kaufmann, Burlington (2017) Lazar, J., Feng, J.H., Hochheiser, H.: Research Methods in Human-Computer Interaction. Morgan Kaufmann, Burlington (2017)
16.
Zurück zum Zitat Marti, P., Iacono, I.: Anticipated, momentary, episodic, remembered: the many facets of user experience. In: 2016 Federated Conference on Computer Science and Information Systems (FedCSIS), pp. 1647–1655 (2016) Marti, P., Iacono, I.: Anticipated, momentary, episodic, remembered: the many facets of user experience. In: 2016 Federated Conference on Computer Science and Information Systems (FedCSIS), pp. 1647–1655 (2016)
17.
Zurück zum Zitat Martinie, C., Palanque, P., Bouzekri, E., Cockburn, A., Canny, A., Barboni, E.: Analysing and demonstrating tool-supported customizable task notations, vol. 3. Association for Computing Machinery, New York, June 2019. https://doi.org/10.1145/3331154 Martinie, C., Palanque, P., Bouzekri, E., Cockburn, A., Canny, A., Barboni, E.: Analysing and demonstrating tool-supported customizable task notations, vol. 3. Association for Computing Machinery, New York, June 2019. https://​doi.​org/​10.​1145/​3331154
18.
Zurück zum Zitat Martinie, C., Palanque, P., Ragosta, M., Barboni, E.: Extending procedural task models by systematic explicit integration of objects, knowledge and information. In: Proceedings of the of the 31st European Conference on Cognitive Ergonomics, ECCE 2013. ACM, New York (2013) Martinie, C., Palanque, P., Ragosta, M., Barboni, E.: Extending procedural task models by systematic explicit integration of objects, knowledge and information. In: Proceedings of the of the 31st European Conference on Cognitive Ergonomics, ECCE 2013. ACM, New York (2013)
19.
Zurück zum Zitat Martinie, C., Palanque, P., Navarre, D., Winckler, M., Poupart, E.: Model-based training: an approach supporting operability of critical interactive systems. In: Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS 2011, pp. 53–62. ACM, New York (2011) Martinie, C., Palanque, P., Navarre, D., Winckler, M., Poupart, E.: Model-based training: an approach supporting operability of critical interactive systems. In: Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS 2011, pp. 53–62. ACM, New York (2011)
20.
Zurück zum Zitat Meng, X., Foong, P.S., Perrault, S., Zhao, S.: NexP: a beginner friendly toolkit for designing and conducting controlled experiments. In: Bernhaupt, R., Dalvi, G., Joshi, A., K. Balkrishan, D., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10515, pp. 132–141. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67687-6_10CrossRef Meng, X., Foong, P.S., Perrault, S., Zhao, S.: NexP: a beginner friendly toolkit for designing and conducting controlled experiments. In: Bernhaupt, R., Dalvi, G., Joshi, A., K. Balkrishan, D., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10515, pp. 132–141. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-67687-6_​10CrossRef
22.
Zurück zum Zitat Paterno, F.: Task models in interactive software systems. In: Handbook of Software Engineering and Knowledge Engineering. World Scientific (2000) Paterno, F.: Task models in interactive software systems. In: Handbook of Software Engineering and Knowledge Engineering. World Scientific (2000)
23.
Zurück zum Zitat Paternó, F., Mancini, C., Meniconi, S.: ConcurTaskTrees: a diagrammatic notation for specifying task models. In: Proceedings of IFIP INTERACT 1997, pp. 362–369. Lawrence Erlbaum Associates (1997) Paternó, F., Mancini, C., Meniconi, S.: ConcurTaskTrees: a diagrammatic notation for specifying task models. In: Proceedings of IFIP INTERACT 1997, pp. 362–369. Lawrence Erlbaum Associates (1997)
24.
Zurück zum Zitat Pinelle, D., Gutwin, C., Greenberg, S.: Task analysis for groupware usability evaluation: modelling shared-workspace tasks with the mechanics of collaboration. In: ACM Transactions on Computer-Human Interaction, vol. 10, no. 4. pp. 281–311. ACM, New York (2003) Pinelle, D., Gutwin, C., Greenberg, S.: Task analysis for groupware usability evaluation: modelling shared-workspace tasks with the mechanics of collaboration. In: ACM Transactions on Computer-Human Interaction, vol. 10, no. 4. pp. 281–311. ACM, New York (2003)
25.
Zurück zum Zitat Pirker, M.M., Bernhaupt, R.: Measuring user experience in the living room: results from an ethnographically oriented field study indicating major evaluation factors. In: Proceedings of the 9th European Conference on Interactive TV and Video, pp. 79–82. ACM, New York (2011) Pirker, M.M., Bernhaupt, R.: Measuring user experience in the living room: results from an ethnographically oriented field study indicating major evaluation factors. In: Proceedings of the 9th European Conference on Interactive TV and Video, pp. 79–82. ACM, New York (2011)
26.
Zurück zum Zitat Ragosta, M., Martinie, C., Palanque, P., Navarre, D., Sujan, M.A.: Concept maps for integrating modelling techniques for the analysis and re-design of partly-autonomous interactive systems. In: Proceedings of the 5th International Conference on Application and Theory of Automation in Command and Control Systems, ATACCS 2015, pp. 41–52. ACM, New York (2015) Ragosta, M., Martinie, C., Palanque, P., Navarre, D., Sujan, M.A.: Concept maps for integrating modelling techniques for the analysis and re-design of partly-autonomous interactive systems. In: Proceedings of the 5th International Conference on Application and Theory of Automation in Command and Control Systems, ATACCS 2015, pp. 41–52. ACM, New York (2015)
27.
Zurück zum Zitat Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., Riedl, J.: GroupLens: an open architecture for collaborative filtering of netnews. In: Smith, J.B., Smith, F.D., Malone, T.W. (eds.) Proceedings of the Conference on Computer Supported Cooperative Work, pp. 175–186. ACM (1994) Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., Riedl, J.: GroupLens: an open architecture for collaborative filtering of netnews. In: Smith, J.B., Smith, F.D., Malone, T.W. (eds.) Proceedings of the Conference on Computer Supported Cooperative Work, pp. 175–186. ACM (1994)
28.
Zurück zum Zitat Rosson, M.B., Carroll, J.M.: Usability Engineering: Scenario-Based Development of Human-computer Interaction. Elsevier, Amsterdam (2001) Rosson, M.B., Carroll, J.M.: Usability Engineering: Scenario-Based Development of Human-computer Interaction. Elsevier, Amsterdam (2001)
29.
Zurück zum Zitat Roto, V., Law, E., Vermeeren, A., Hoonhout, J.: User experience white paper: bringing clarity to the concept of user experience. In: Dagstuhl Seminar on Demarcating User Experience, pp. 1–12 (2011) Roto, V., Law, E., Vermeeren, A., Hoonhout, J.: User experience white paper: bringing clarity to the concept of user experience. In: Dagstuhl Seminar on Demarcating User Experience, pp. 1–12 (2011)
30.
Zurück zum Zitat Shneiderman, B.: The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings of the 1996 IEEE Symposium on Visual Languages, pp. 336–343 (1996) Shneiderman, B.: The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings of the 1996 IEEE Symposium on Visual Languages, pp. 336–343 (1996)
31.
Zurück zum Zitat Van der Veer, G., Lenting, B., Bergevoet, A.: GTA: groupware task analysis - modelling complexity. In: Acta Psychologica, New York, NY, vol. 91, no. 3, pp. 297–322 (1996) Van der Veer, G., Lenting, B., Bergevoet, A.: GTA: groupware task analysis - modelling complexity. In: Acta Psychologica, New York, NY, vol. 91, no. 3, pp. 297–322 (1996)
32.
Zurück zum Zitat Wallner, G., Kriglstein, S.: Visualization-based analysis of gameplay data - a review of literature. Entertain. Comput. 4(3), 143–155 (2013)CrossRef Wallner, G., Kriglstein, S.: Visualization-based analysis of gameplay data - a review of literature. Entertain. Comput. 4(3), 143–155 (2013)CrossRef
33.
Zurück zum Zitat Winckler, M., Palanque, P., Freitas, C.: Tasks and scenario-based evaluation of information visualization techniques. In: Proceedings of the 3rd Annual Conference on Task Models and Diagrams, TAMODIA 2004, pp. 165–172. ACM, New York (2004) Winckler, M., Palanque, P., Freitas, C.: Tasks and scenario-based evaluation of information visualization techniques. In: Proceedings of the 3rd Annual Conference on Task Models and Diagrams, TAMODIA 2004, pp. 165–172. ACM, New York (2004)
Metadaten
Titel
A Generic Visualization Approach Supporting Task-Based Evaluation of Usability and User Experience
verfasst von
Regina Bernhaupt
Célia Martinie
Philippe Palanque
Günter Wallner
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-64266-2_2

Premium Partner