skip to main content
article

A field evaluation of an adaptable two-interface design for feature-rich software

Published:01 May 2007Publication History
Skip Abstract Section

Abstract

Two approaches for supporting personalization in complex software are system-controlled adaptive menus and user-controlled adaptable menus. We evaluate a novel interface design for feature-rich productivity software based on adaptable menus. The design allows the user to easily customize a personalized interface, and also supports quick access to the default interface with all of the standard features. This design was prototyped as a front-end to a commercial word processor. A field experiment investigated users' personalizing behavior and tested the effects of different interface designs on users' satisfaction and their perceived ability to navigate, control, and learn the software. There were two conditions: a commercial word processor with adaptive menus and our prototype with adaptable menus for the same word processor. Our evaluation shows: (1) when provided with a flexible, easy-to-use and easy-to-understand customization mechanism, the majority of users do effectively personalize their interface; and (2) user-controlled interface adaptation with our adaptable menus results in better navigation and learnability, and allows for the adoption of different personalization strategies, as compared to a particular system-controlled adaptive menu system that implements a single strategy. We report qualitative data obtained from interviews and questionnaires with participants in the evaluation in addition to quantitative data.

References

  1. Alpert, S. R., Karat, J., Karat, C.-M., Brodie, C., and Vergo, J. 2003. User attitudes regarding a user-adaptive eCommerce website. User Model. User-Adapt. Interact. 13, 373--396. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Browne, D., Totterdell, P., and Norman, M. Eds. 1990. Adaptive User Interfaces. London: Academic Press Ltd., London, UK. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Campbell, D. T. and Stanley, J. C. 1972. Experimental and Quasi-Experimental Designs for Research. Rand McNally & Company, Chicago, IL.Google ScholarGoogle Scholar
  4. Carroll, J. and Carrithers, C. 1984. Blocking learner error states in a training-wheels system. Human Fact. 26, 4, 377--389.Google ScholarGoogle ScholarCross RefCross Ref
  5. Cote-Munoz, J. A. 1993. AIDA---An adaptive system for interactive drafting of CAD applications. In Adaptive User Interfaces: Principles and Practice. M. Schneider-Hufschmidt, T. Kuhne, and U. Malinowski, Eds., North-Holland: Elsevier Science Publishers B.V., Amsterdam, The Netherlands.Google ScholarGoogle Scholar
  6. Csinger, A., Booth, K. S., and Poole, D. L. 1994. AI meets authoring: User models for intelligent multimedia. Artifi. Intel. Rev. J. 8, 3, 447--468.Google ScholarGoogle ScholarCross RefCross Ref
  7. Cypher, A. 1991. Eager: Programming repetitive tasks by example. In Proceedings of ACM CHI'91. ACM, New York, 33--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Davis, J., Dye, J., Johnson, N., and Bell, S. 1999. Microsoft Usability Report.Google ScholarGoogle Scholar
  9. Debevc, M., Meyer, B., Donlagic, D., and Svecko, R. 1996. Design and evaluation of an adaptive icon toolbar. User Model. User-Adapt. Interact. 6, 1, 1--21.Google ScholarGoogle ScholarCross RefCross Ref
  10. Dieterich, H., Malinowski, U., Kühme, T., and Schneider-Hufschmidt, M. 1993. State of the art in adaptive user interfaces. In Adaptive User Interfaces: Principles and Practice, M. Schneider-Hufschmidt, T. Kuhme, and U. Malinowski, Eds., North Holland: Elsevier Science Publishers B.V., Amsterdam, The Netherlands, 13--48.Google ScholarGoogle Scholar
  11. Finlater, L. and McGrenere, J. 2004. A comparison of static, adaptive, and adaptable menus. In Proceedings of ACM CHI 2004. ACM, New York, 89--96. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Fischer, G. 1993. Shared knowledge in cooperative problem-solving systems---integrating adaptive and adaptable components. In Adaptive User Interfaces: Principles and Practice, M. Schneider-Hufschmidt, T. Kuhme, and U. Malinowski, Eds., North Holland: Elsevier Science Publishers B.V., Amsterdam, The Netherlands, 49--68.Google ScholarGoogle Scholar
  13. Gajos, K., Czerwinski, M., Tan, D., and Weld, D. 2006. Exploring the desing space for adadptive graphical user interfaces. In Proceedings of AVI '06, 201--208. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Gantt, M. and Nardi, B. 1992. Gardeners and gurus: Patterns of cooperation among CAD users. In Proceedings of ACM CHI'92. ACM, New York, 107--117. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Gong, G. and Salvendy, G. 1995. An approach to the design of a skill adaptive interface. Int. J. Human-Comput. Interact. 7, 4, 365--383.Google ScholarGoogle ScholarCross RefCross Ref
  16. Greenberg, S. 1993. The Computer User as Toolsmith: The Use, Reuse, and Organization of Computer-Based Tools. Cambridge University Press, Cambridge, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Greenberg, S. and Witten, I. 1985. Adaptive personalized interfaces---A question of viability. Behav. Inf. Tech. 4, 1, 31--45.Google ScholarGoogle ScholarCross RefCross Ref
  18. Horvitz, E. 1999. Principles of mixed-initiative user interfaces. In Proceedings of ACM CHI'99. ACM, New York, 159--166. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Hsi, I. and Potts, C. 2000. Studying the evolution and enhancement of software features. In Proceedings of International Conference on Software Maintenance. 143--151. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Jameson, A. and Schwarzkopf, E. 2002. Pros and cons of controllability: An empirical study. In Proceedings of Adaptive Hypermedia 2002. 193--202. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Karat, C.-M., Blom, J., and Karat, J., Eds. 2004. Designing Personalized User Experiences for eCommerce. Kluwer Academic Publishers, Dordrecht, Netherlands. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Kaufman, L. and Weed, B. 1998. Too much of a good thing? Identifying and resolving bloat in the user interface: A CHI 98 workshop. SIGCHI Bulletin 30, 4, 46--47. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Krogsoeter, M., Oppermann, R., and Thomas, C. 1994. A user interface integrating adaptability and adaptivity. In Adaptive user support: ergonomic design of manually and automatically adaptable software, R. Oppermann, Ed., Lawrence Erlbaum and Associates, Inc., Hillsdayle, NJ, pp. 97--124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Landauer, T. 1997. Chapter 9: Behavioral research methods in human-computer interaction. In Handbook of Human-Computer Interaction (2nd ed.) M. G. Helander, T. K. Landauer, and P. V. Prabhu Eds., Elsevier Science B.V., Amsterdam, The Netherlands, pp. 203--227.Google ScholarGoogle Scholar
  25. Lim, W. S., Kim, J. W., Yoon, J. S., Jang, J. H., and Han, S. H. 2005. Usability of an adaptive toolbar in selecting functions. J. Ergonom. Soc. Korea 24, 4, 73--78.Google ScholarGoogle ScholarCross RefCross Ref
  26. Linton, F., Joy, D., Schaefer, P., and Charron, A. 2000. OWL: A recommender system for organization-wide learning. Educat. Tech. Soc. 3, 1.Google ScholarGoogle Scholar
  27. Mackay, W. E. 1990. Patterns of sharing customizable software. In Proceedings of ACM CSCW'90, ACM, New York, 209--221. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Mackay, W. E. 1991. Triggers and barriers to customizing software. In Proceedings of ACM CHI'91, ACM New York, 153--160. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. MacLean, A., Carter, K., Lovstrand, L., and Moran, T. 1990. User-tailorable systems: Pressing the issues with buttons. In Proceedings of ACM CHI'90, ACM, New York, 175--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Malinowski, U., Kühme, T., Dieterich, H., and Schneider-Hufschmidt, M. 1993. Computer-aided adaption of user interfaces with menus and dialog boxes. In Proceedings of 5th Conference on Human-Computer Interaction. 122--127.Google ScholarGoogle Scholar
  31. Maybury, M. T. and Wahlster, W. 1999. Readings in Intelligent User Interfaces. Morgan-Kaufmann Publishers, Inc., San Francisco, CA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. McGrenere, J. 2002. The Design and evaluation of multiple interfaces: A solution for complex software. Doctoral Dissertation, University of Toronto, Toronto, Canada. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. McGrenere, J. and Moore, G. 2000. Are we all in the same “bloat”? In Proceedings of Graphics Interface 2000, 187--196.Google ScholarGoogle Scholar
  34. Miah, T., Karageorgou, M., and Knott, R. P. 1997. Adaptive toolbars: An architectural overview, from http://ui4all.ics.forth.gr/UI4ALL-97/miah.pdfGoogle ScholarGoogle Scholar
  35. Microsoft Office 2000 Products Enhancements Guide. 2000. from http://www.microsoft.com/Office/evaluation/ofcpeg.htmGoogle ScholarGoogle Scholar
  36. Miller, J. R., Sullivan, J. W., and Tyler, S. W. 1991. Introduction. In Intelligent User Interfaces J. S. Sullivan and S. W. Tyler Eds., ACM Press, New York, pp. 1--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Norman, D. 1998. The Invisible Computer. MIT Press, Cambridge, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Page, S. R., Johnsgard, T. J., Albert, U., and Allen, C. D. 1996. User customization of a word processor. In Proceedings of ACM CHI 96, ACM, New York, 340--346. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Schneider-Hufschmidt, M., Kuhme, T., and Malinowski, U. Eds. 1993. Adaptive User Interfaces: Principles and Practice. North-Holland: Elsevier Science Publishers B.V., Amsterdam, The Netherlands. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Sears, A. and Shneiderman, B. 1994. Split menus: Effectively using selection frequency to organize menus. ACM Trans. Computer-Human Interact. 1, 1, 27--51. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Shneiderman, B. 1997. Designing the User Interface: Strategies for Effective Human-Computer Interaction (3rd ed.). Addison-Wesley Publishing, Reading, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Shneiderman, B. and Maes, P. 1997. Direct manipulation vs. interface agents: Excerpts from debates at IUI 97 and CHI 97. Interactions 4, 6, 42--61. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Thomas, C. G. and Krogsoeter, M. 1993. An adaptive environment for the user interface in Excel. In Proceedings of ACM IUI '93, 123--130. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Vicente, K. J. and Torenvliet, G. L. 2000. The earth is spherical (p < 0.05): alternative methods of statistical inference. Theoret. Issues Ergonom. Sci. 1, 3, 248--271.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. A field evaluation of an adaptable two-interface design for feature-rich software

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader