skip to main content
research-article

Towards a theory of user judgment of aesthetics and user interface quality

Authors Info & Claims
Published:11 December 2008Publication History
Skip Abstract Section

Abstract

The article introduces a framework for users' design quality judgments based on Adaptive Decision Making theory. The framework describes judgment on quality attributes (usability, content/functionality, aesthetics, customisation and engagement) with dependencies on decision making arising from the user's background, task and context. The framework is tested and refined by three experimental studies. The first two assessed judgment of quality attributes of websites with similar content but radically different designs for aesthetics and engagement. Halo effects were demonstrated whereby attribution of good quality on one attribute positively influenced judgment on another, even in the face of objective evidence to the contrary (e.g., usability errors). Users' judgment was also shown to be susceptible to framing effects of the task and their background. These appear to change the importance order of the quality attributes; hence, quality assessment of a design appears to be very context dependent. The third study assessed the influence of customisation by experiments on mobile services applications, and demonstrated that evaluation of customisation depends on the users' needs and motivation. The results are discussed in the context of the literature on aesthetic judgment, user experience and trade-offs between usability and hedonic/ludic design qualities.

References

  1. Bernier, M. J. 1996. Establishing the psychometric properties of a scale for evaluating quality in printed educational materials. Pat. Educat. Counsel. 283--299.Google ScholarGoogle Scholar
  2. Bloch, P. 1995. Seeking the ideal form: Product design and consumer response. J. Market. 59, 16--29.Google ScholarGoogle ScholarCross RefCross Ref
  3. Blom, J. and Monk, A. 2003. Theory of personalization of appearance: Why users personalize their PCs and mobile phones. Human-Comput. Interact. 18, 3, 193--228. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Csikszentmihalyi, M. 2002. Flow: The Classic Work on How to Achieve Happiness (Revised ed.). Rider, London, UK.Google ScholarGoogle Scholar
  5. De Angeli, A., Lynch, P., and Johnson, G. I. 2002. Pleasure versus efficiency in user interfaces: Towards an involvement framework. In Pleasure with products: Beyond usability. W. S. Green, and P. W. Jordan, Eds. Taylor and Francis, London, UK, 97--111.Google ScholarGoogle Scholar
  6. De Angeli, A., Sutcliffe, A. G., and Hartmann, J. 2006. Interaction, usability and aesthetics: What influences users' preferences? In Proceedings of DIS 06, Designing Interactive Systems. ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. De Bruijn, O., De Angeli, A., and Sutcliffe, A. G. 2007. Customer experience requirements for e-commerce web-sites. Int. J. Web Engin. Tech. 3, 4, 441--464. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Dion, K., Berscheid, E., and Walster, E. 1972. What is beautiful is good. J. Personal. Soc. Psych. 24, 285--290.Google ScholarGoogle ScholarCross RefCross Ref
  9. Djajadiningrat, J. P., Overbeeke, C. J., and Wensveen, S. A. G. 2000. Augmenting fun and beauty: A pamphlet. In Proceedings of Designing Augmented Reality Environments (DARE 2000) (Elsinore, Denmark). 131--134. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Hallnäs, L. and Redström, J. 2002. From use to presence: On the expression of aesthetics of everyday computational things. ACM Trans. Comput.-Human Interact. 9, 2, 106--124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Hartmann, J., Sutcliffe, A.G., and De Angeli, A. 2007. Investigating attractiveness in web user interfaces. In Proceedings of Conference on Human Factors in Computing Systems (CHI'07) (San Jose, CA). ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Hassenzahl, M. 2002. The effect of perceived hedonic quality on product appealingness. Int. J. Human-Comput. Interact. 13, 479--497.Google ScholarGoogle Scholar
  13. Hassenzahl, M. 2003. The thing and I: Understanding the relationship between user and product. In Funology: From Usability to Enjoyment. M. Blythe, C. Overbeeke, A. F. Monk, and P. C. Wright, Eds. Kluwer, Dortrecht, 31--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Hassenzahl, M. 2004. The interplay of beauty, goodness and usability in interactive products. Human-Comput. Interact. 19, 4, 319--349. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Hassenzahl, M., Platz, A., Burmester, M., and Lehner, K. 2000. Hedonic and ergonomic quality aspects determine a software's appeal. In Proceedings of Conference on Human Factors in Computing Systems (CHI'2000) (The Hague Apr. 1--6). T. Turner, G. Szwillus, M. Czerwinski, and F. Paterno, Eds. ACM, New York, 201--208. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. IBM. 2000. Ease of use: Design principles. http://www.ibm.com/ibm/easy/eou_ext.nsf/Publish/6. (20 November 2000).Google ScholarGoogle Scholar
  17. ISO. 1997. ISO 9241: Ergonomic requirements for office systems with visual display terminals (VDTs). International Standards Organisation, Geneva, Switzerland.Google ScholarGoogle Scholar
  18. Ivory, M. and Hearst, M. 2001. The state of the art in automated usability evaluation of user interfaces. ACM Comput. Surv. 33, 4, 173--197. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Kim, J., Lee, J., and Choi, D. 2003. Designing emotionally evocative homepages: An empirical study of the quantitative relations between design factors and emotional dimensions. Int. J. Human-Comput. Stud. 59, 6, 899--940. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Lavie, T. and Tractinsky, N. 2004. Assessing dimensions of perceived visual aesthetics of web sites. Int. J. Human-Comput. Stud. 60, 3, 269--298. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Lindgaard, G. and Dudek, C. 2003. What is this evasive beast we call user satisfaction? Interact. Comput. 15, 3, 429--452.Google ScholarGoogle ScholarCross RefCross Ref
  22. Lynch, P. J. and Horton, S. 2001. Web Style Guidelines (2nd ed.). Yale University Press, New Haven, CT.Google ScholarGoogle Scholar
  23. McCarthy, J. and Wright, P. 2005. Technology as Experience. MIT Press, Cambridge, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Meiners, M. L. and Sheposh, J. P. 1977. Beauty or brains: Which image for your mate? Personal. Social Psych. 3, 262--265.Google ScholarGoogle Scholar
  25. Merrilees, B. and Fry, M. L. 2002. Corporate branding: A framework for e-retailers. Corp. Reput. Rev. 5, 213--225.Google ScholarGoogle ScholarCross RefCross Ref
  26. Mullet, K. and Sano, D. 1995. Designing Visual Interfaces: Communication Oriented Techniques. SunSoft Press, Englewood Cliffs, NJ, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Nielsen, J. 1993. Usability Engineering. Academic Press, Orlands, FL. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Nielsen, J. 2000. Designing Web Usability: The Practice of Simplicity. New Riders, Indianapolis, IN, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Nielsen, J. and Molich, R. 1990. Heuristic evaluation of user interfaces. SIGCHI Bulletin (April: special issue), 249--256.Google ScholarGoogle Scholar
  30. Norman, D. A. 2004. Emotional Design: Why We Love (or Hate) Everyday Things. Basic Books, New York.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Overbeeke, K. C., Djajadiningrat, J. P., Hummels, C. C. M., and Wensveen, S. A. G. 2002. Chapter 7. In Pleasure with Products: Beyond Usability, W. S. Green, and P. W. Jordan, Eds. Taylor and Francis, London, UK, 97--111.Google ScholarGoogle Scholar
  32. Park, S., Choi, D., and Kim, J. 2004. Critical factors for the aesthetic fidelity of web pages: Empirical studies with professional web designers and users. Interact. Comput. 16, 2, 351--376.Google ScholarGoogle ScholarCross RefCross Ref
  33. Payne, J. W., Bettman, J. R., and Johnson, E. J. 1993. The Adaptive Decision Maker. Cambridge University Press, Cambridge, UK.Google ScholarGoogle Scholar
  34. Petersen, M. G., Iversen, O. S., Krogh, P. G., and Ludvigsen, M. 2004. Aesthetic interaction: A pragmatist's aesthetics of interactive systems. In Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS 2004). ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Reeves, B. and Nass, C. 1996. The Media Equation: How People Treat Computers, Television and New Media Like Real People and Places. CLSI/Cambridge University Press, Stanford CA/Cambridge, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Schaller, D. T., Allison-Bunnell, S., Chow, A., Marty, P., and Heo, M. 2004. To FlashFlash or not to FlashFlash? Usability and user engagement of HTML vs. FlashFlash. In Proceedings of the Museums and the Web 2004 International Conference. Available on-line at http://www.eduweb.com/ToFlashFlashornot.pdf.Google ScholarGoogle Scholar
  37. Shusterman, R. 1992. Pragmatist Aesthetics, Living Beauty, Rethinking art. Blackwell, Oxford, UK.Google ScholarGoogle Scholar
  38. Spool, J. M., Scanlon, T., Snyder, C., Schroeder, W., and De Angelo, T. 1999. Web Site Usability: A Designer's Guide. Morgan-Kaufmann, San Francisco, CA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Sutcliffe, A. G. 2002a. Assessing the reliability of heuristic evaluation for website attractiveness and usability. Proceedings of the Hawaii International Conference on System Sciences (HICSS 35), (Hawaii, Jan. 7--10). IEEE Computer Society Press, Los Alamitos, CA, 1838--1847. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Sutcliffe, A. G. 2002b. Heuristic evaluation of website attractiveness and usability. In Proceedings: 8th Workshop on Design, Specification and Verification of Interactive Systems (Glasgow, Ireland, June 13--15). Springer-Verlag, Berlin, Germany, 188--199. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Sutcliffe, A. G. and De Angeli, A. 2005. Assessing interaction styles in web user interfaces. In Proceedings of Human Computer Interaction (INTERACT 2005) (Rome, Italy). Springer Verlag, Berlin, Germany, 405--417. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Tractinsky, N. 1997. Aesthetics and apparent usability: Empirically assessing cultural and methodological issues. In Human Factors in Computing Systems: CHI 97 Conference Proceedings, S. Pemberton, Ed. (Atlanta, GA, May 22--27) ACM, New York, 115--122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Tractinsky, N., Shoval-Katz, A., and Ikar, D. 2000. What is beautiful is usable. Interact. Comput. 13, 2, 127--145.Google ScholarGoogle ScholarCross RefCross Ref
  44. Tractinsky, N., and Zmiri, D. 2006, Exploring attributes of skins as potential antecedents of emotion in HCI. In Aesthetic Computing, P. Fishwick, Ed. MIT Press, Cambridge, MA, 405--521.Google ScholarGoogle Scholar
  45. Turner, J. C. 1987. Rediscovering the social group: A self-categorization theory. Basil, Blackwell, Oxford, UK.Google ScholarGoogle Scholar

Index Terms

  1. Towards a theory of user judgment of aesthetics and user interface quality

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM Transactions on Computer-Human Interaction
            ACM Transactions on Computer-Human Interaction  Volume 15, Issue 4
            November 2008
            98 pages
            ISSN:1073-0516
            EISSN:1557-7325
            DOI:10.1145/1460355
            Issue’s Table of Contents

            Copyright © 2008 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 11 December 2008
            • Revised: 1 May 2008
            • Accepted: 1 May 2008
            • Received: 1 March 2007
            Published in tochi Volume 15, Issue 4

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader