Skip to main content
Top

2019 | OriginalPaper | Chapter

Enriching Task Models with Usability and User Experience Evaluation Data

Authors : Regina Bernhaupt, Philippe Palanque, Dimitri Drouet, Celia Martinie

Published in: Human-Centered Software Engineering

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Evaluation results focusing on usability and user experience are often difficult to be taken into account during an iterative design process. This is due to the fact that evaluation exploits concrete artefacts (prototype or system) while design and development are based on more abstract descriptions such as task models or software models. As concrete data cannot be represented, evaluation results are just discarded. This paper addresses the problem of discrepancy between abstract view of task models and concrete data produced in evaluations by first, describing the requirements for a task modelling notation: (a) representation of data for each individual participant, (b) representation of aggregated data for one evaluation as well as (c) several evaluations and (d) the need to visualize multi-dimensional data from the evaluation as well as the interactive system gathered during runtime. Second: by showing how the requirements were integrated in a task modelling tool. Using an example from an experimental evaluation possible usages of the tool are demonstrated.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference Baecker, R.M. (ed.): Readings in Human-computer Interaction: Toward the Year 2000. Morgan Kaufmann, San Francisco (1995) Baecker, R.M. (ed.): Readings in Human-computer Interaction: Toward the Year 2000. Morgan Kaufmann, San Francisco (1995)
4.
go back to reference Barboni, E., Ladry, J.-F., Navarre, D., Palanque, P., Winckler, M.: Beyond modelling: an integrated environment supporting co-execution of tasks and systems models. In: EICS 2010, pp. 165–174 (2010) Barboni, E., Ladry, J.-F., Navarre, D., Palanque, P., Winckler, M.: Beyond modelling: an integrated environment supporting co-execution of tasks and systems models. In: EICS 2010, pp. 165–174 (2010)
5.
go back to reference Bernhaupt, R., Manciet, F., Pirker, M.: User experience as a parameter to enhance automation acceptance: lessons from automating articulatory tasks. In: Proceedings of the 5th International Conference on Application and Theory of Automation in Command and Control Systems, pp. 140–150. ACM, New York (2015) Bernhaupt, R., Manciet, F., Pirker, M.: User experience as a parameter to enhance automation acceptance: lessons from automating articulatory tasks. In: Proceedings of the 5th International Conference on Application and Theory of Automation in Command and Control Systems, pp. 140–150. ACM, New York (2015)
6.
go back to reference Bernhaupt, R., Pirker, M.: Evaluating user experience for interactive television: towards the development of a domain-specific user experience questionnaire. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013, Part II. LNCS, vol. 8118, pp. 642–659. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40480-1_45CrossRef Bernhaupt, R., Pirker, M.: Evaluating user experience for interactive television: towards the development of a domain-specific user experience questionnaire. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013, Part II. LNCS, vol. 8118, pp. 642–659. Springer, Heidelberg (2013). https://​doi.​org/​10.​1007/​978-3-642-40480-1_​45CrossRef
7.
8.
go back to reference Bernhaupt, R., Palanque, P., Manciet, F., Martinie, C.: User-test results injection into task-based design process for the assessment and improvement of both usability and user experience. In: Bogdan, C., et al. (eds.) HCSE/HESSD 2016. LNCS, vol. 9856, pp. 56–72. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-44902-9_5CrossRef Bernhaupt, R., Palanque, P., Manciet, F., Martinie, C.: User-test results injection into task-based design process for the assessment and improvement of both usability and user experience. In: Bogdan, C., et al. (eds.) HCSE/HESSD 2016. LNCS, vol. 9856, pp. 56–72. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-44902-9_​5CrossRef
9.
go back to reference Brooke, J.: SUS-A quick and dirty usability scale. In: Usability Evaluation in Industry, pp. 189–194 (1996) Brooke, J.: SUS-A quick and dirty usability scale. In: Usability Evaluation in Industry, pp. 189–194 (1996)
11.
go back to reference Desmet, P., Overbeeke, K., Tax, S.: Designing products with added emotional value: development and application of an approach for research through design. Des. J. 4, 32–47 (2001) Desmet, P., Overbeeke, K., Tax, S.: Designing products with added emotional value: development and application of an approach for research through design. Des. J. 4, 32–47 (2001)
13.
go back to reference Fahssi, R., Martinie, C., Palanque, P.: Enhanced task modelling for systematic identification and explicit representation of human errors. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015, Part IV. LNCS, vol. 9299, pp. 192–212. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22723-8_16CrossRef Fahssi, R., Martinie, C., Palanque, P.: Enhanced task modelling for systematic identification and explicit representation of human errors. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015, Part IV. LNCS, vol. 9299, pp. 192–212. Springer, Cham (2015). https://​doi.​org/​10.​1007/​978-3-319-22723-8_​16CrossRef
14.
go back to reference Farenc, C., Palanque, P., Vanderdonckt, J.: User Interface evaluation: is it ever usable? In: Yuichiro, A., Katsuhiko, O., Hirohiko, M. (eds.) Advances in Human Factors/Ergonomics, vol. 20, pp. 329–334. Elsevier (1995) Farenc, C., Palanque, P., Vanderdonckt, J.: User Interface evaluation: is it ever usable? In: Yuichiro, A., Katsuhiko, O., Hirohiko, M. (eds.) Advances in Human Factors/Ergonomics, vol. 20, pp. 329–334. Elsevier (1995)
15.
go back to reference Fayollas, C., et al.: An approach for assessing the impact of dependability on usability: application to interactive cockpits. In: Proceedings of the 2014 Tenth European Dependable Computing Conference, Washington, DC, USA, pp. 198–209. IEEE Computer Society (2014) Fayollas, C., et al.: An approach for assessing the impact of dependability on usability: application to interactive cockpits. In: Proceedings of the 2014 Tenth European Dependable Computing Conference, Washington, DC, USA, pp. 198–209. IEEE Computer Society (2014)
16.
go back to reference Field, A.: Discovering Statistics Using IBM SPSS Statistics. Sage Publication Ltd., London (2013) Field, A.: Discovering Statistics Using IBM SPSS Statistics. Sage Publication Ltd., London (2013)
17.
go back to reference Forbrig, P., Martinie, C., Palanque, P., Winckler, M., Fahssi, R.: Rapid task-models development using sub-models, sub-routines and generic components. In: Sauer, S., Bogdan, C., Forbrig, P., Bernhaupt, R., Winckler, M. (eds.) HCSE 2014. LNCS, vol. 8742, pp. 144–163. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-44811-3_9CrossRef Forbrig, P., Martinie, C., Palanque, P., Winckler, M., Fahssi, R.: Rapid task-models development using sub-models, sub-routines and generic components. In: Sauer, S., Bogdan, C., Forbrig, P., Bernhaupt, R., Winckler, M. (eds.) HCSE 2014. LNCS, vol. 8742, pp. 144–163. Springer, Heidelberg (2014). https://​doi.​org/​10.​1007/​978-3-662-44811-3_​9CrossRef
18.
go back to reference Furnas, G.W.: Generalized fisheye views. In: Mantei, M., Orbeton, P. (eds.) Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 16–23. ACM, New York (1986) Furnas, G.W.: Generalized fisheye views. In: Mantei, M., Orbeton, P. (eds.) Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 16–23. ACM, New York (1986)
19.
go back to reference Hollnagel, E.: Cognitive Reliability and Error Analysis Method. Elsevier Science, Oxford (1998) Hollnagel, E.: Cognitive Reliability and Error Analysis Method. Elsevier Science, Oxford (1998)
20.
go back to reference ISO 9241-210 Ergonomics of Human-System Interaction Ergonomics of human-system interaction – Part 210: Human-centred design for interactive systems (2010) ISO 9241-210 Ergonomics of Human-System Interaction Ergonomics of human-system interaction – Part 210: Human-centred design for interactive systems (2010)
21.
go back to reference Jones, M., Marsden, G.: Mobile Interaction Design. John Wiley & Sons, Chichester (2006) Jones, M., Marsden, G.: Mobile Interaction Design. John Wiley & Sons, Chichester (2006)
22.
go back to reference Karapanos, E., Zimmerman, J., Forlizzi, J., Martens, J.-B.: Measuring the dynamics of remembered experience over time. Interact. Comput. 22, 328–335 (2010)CrossRef Karapanos, E., Zimmerman, J., Forlizzi, J., Martens, J.-B.: Measuring the dynamics of remembered experience over time. Interact. Comput. 22, 328–335 (2010)CrossRef
23.
go back to reference Lazar, D.J., Feng, D.J.H., Hochheiser, D.H.: Research Methods in Human-Computer Interaction. John Wiley & Sons, New York (2010) Lazar, D.J., Feng, D.J.H., Hochheiser, D.H.: Research Methods in Human-Computer Interaction. John Wiley & Sons, New York (2010)
24.
go back to reference Martinie, C., et al.: Formal tasks and systems models as a tool for specifying and assessing automation designs. In: Proceedings of the 1st International Conference on Application and Theory of Automation in Command and Control Systems, pp. 50–59. IRIT Press, Toulouse (2011) Martinie, C., et al.: Formal tasks and systems models as a tool for specifying and assessing automation designs. In: Proceedings of the 1st International Conference on Application and Theory of Automation in Command and Control Systems, pp. 50–59. IRIT Press, Toulouse (2011)
25.
go back to reference Martinie, C., Palanque, P., Fahssi, R., Blanquart, J.P., Fayollas, C.: Seguin: task model-based systematic analysis of both system failures and human errors. IEEE Trans. Hum. Mach. Syst. 46, 243–254 (2016)CrossRef Martinie, C., Palanque, P., Fahssi, R., Blanquart, J.P., Fayollas, C.: Seguin: task model-based systematic analysis of both system failures and human errors. IEEE Trans. Hum. Mach. Syst. 46, 243–254 (2016)CrossRef
26.
go back to reference Martinie, C., Navarre, D., Palanque, P., Fayollas, C.: A generic tool-supported framework for coupling task models and interactive applications. In: Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 244–253. ACM, New York (2015) Martinie, C., Navarre, D., Palanque, P., Fayollas, C.: A generic tool-supported framework for coupling task models and interactive applications. In: Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 244–253. ACM, New York (2015)
27.
go back to reference Martinie, C., Palanque, P., Navarre, D., Winckler, M., Poupart, E.: Model-based training: an approach supporting operability of critical interactive systems. In: Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 53–62. ACM, New York (2011) Martinie, C., Palanque, P., Navarre, D., Winckler, M., Poupart, E.: Model-based training: an approach supporting operability of critical interactive systems. In: Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 53–62. ACM, New York (2011)
28.
go back to reference Martinie, C., Palanque, P., Ragosta, M., Fahssi, R.: Extending procedural task models by systematic explicit integration of objects, knowledge and information. In: Proceedings of the 31st European Conference on Cognitive Ergonomics, pp. 23:1–23:10. ACM, New York (2013) Martinie, C., Palanque, P., Ragosta, M., Fahssi, R.: Extending procedural task models by systematic explicit integration of objects, knowledge and information. In: Proceedings of the 31st European Conference on Cognitive Ergonomics, pp. 23:1–23:10. ACM, New York (2013)
29.
go back to reference Martinie, C., Palanque, P., Winckler, M.: Structuring and composition mechanisms to address scalability issues in task models. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part III. LNCS, vol. 6948, pp. 589–609. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-23765-2_40CrossRef Martinie, C., Palanque, P., Winckler, M.: Structuring and composition mechanisms to address scalability issues in task models. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part III. LNCS, vol. 6948, pp. 589–609. Springer, Heidelberg (2011). https://​doi.​org/​10.​1007/​978-3-642-23765-2_​40CrossRef
31.
go back to reference Mori, G., Paterno, F., Santoro, C.: CTTE: support for developing and analyzing task models for interactive system design. IEEE Trans. Softw. Eng. 28, 797–813 (2002)CrossRef Mori, G., Paterno, F., Santoro, C.: CTTE: support for developing and analyzing task models for interactive system design. IEEE Trans. Softw. Eng. 28, 797–813 (2002)CrossRef
33.
go back to reference Nielsen, J., Mack, R.L. (eds.): Usability Inspection Methods. John Wiley & Sons, Inc., New York (1994) Nielsen, J., Mack, R.L. (eds.): Usability Inspection Methods. John Wiley & Sons, Inc., New York (1994)
34.
go back to reference Norman, D.A., Draper, S.W.: User Centered System Design; New Perspectives on Human-Computer Interaction. L. Erlbaum Associates Inc., Hillsdale (1986)CrossRef Norman, D.A., Draper, S.W.: User Centered System Design; New Perspectives on Human-Computer Interaction. L. Erlbaum Associates Inc., Hillsdale (1986)CrossRef
37.
go back to reference Pinelle, D., Gutwin, C., Greenberg, S.: Task analysis for groupware usability evaluation: modeling shared-workspace tasks with the mechanics of collaboration. ACM Trans. Comput. Hum. Interact. 10, 281–311 (2003)CrossRef Pinelle, D., Gutwin, C., Greenberg, S.: Task analysis for groupware usability evaluation: modeling shared-workspace tasks with the mechanics of collaboration. ACM Trans. Comput. Hum. Interact. 10, 281–311 (2003)CrossRef
38.
go back to reference Pirker, M., Bernhaupt, R., Mirlacher, T.: Investigating usability and user experience as possible entry barriers for touch interaction in the living room. In: Proceedings of the 8th International Interactive Conference on Interactive TV&Video, pp. 145–154. ACM, New York (2010) Pirker, M., Bernhaupt, R., Mirlacher, T.: Investigating usability and user experience as possible entry barriers for touch interaction in the living room. In: Proceedings of the 8th International Interactive Conference on Interactive TV&Video, pp. 145–154. ACM, New York (2010)
39.
40.
go back to reference Shneiderman, B.: The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings of the 1996 IEEE Symposium on Visual Languages, Washington, DC, USA, pp. 336–343. IEEE Computer Society (1996) Shneiderman, B.: The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings of the 1996 IEEE Symposium on Visual Languages, Washington, DC, USA, pp. 336–343. IEEE Computer Society (1996)
41.
go back to reference Swearngin, A., Cohen, M.B., John, B.E., Bellamy, R.K.E.: Human performance regression testing. In: Proceedings of the 2013 International Conference on Software Engineering, Piscataway, NJ, USA, pp. 152–161. IEEE Press (2013) Swearngin, A., Cohen, M.B., John, B.E., Bellamy, R.K.E.: Human performance regression testing. In: Proceedings of the 2013 International Conference on Software Engineering, Piscataway, NJ, USA, pp. 152–161. IEEE Press (2013)
Metadata
Title
Enriching Task Models with Usability and User Experience Evaluation Data
Authors
Regina Bernhaupt
Philippe Palanque
Dimitri Drouet
Celia Martinie
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-05909-5_9

Premium Partner