skip to main content
article

WebQuilt: A proxy-based approach to remote web usability testing

Published:01 July 2001Publication History
Skip Abstract Section

Abstract

WebQuilt is a web logging and visualization system that helps web design teams run usability tests (both local and remote) and analyze the collected data. Logging is done through a proxy, overcoming many of the problems with server-side and client-side logging. Captured usage traces can be aggregated and visualized in a zooming interface that shows the web pages people viewed. The visualization also shows the most common paths taken through the web site for a given task, as well as the optimal path for that task, as designated by the designer. This paper discusses the architecture of WebQuilt and describes how it can be extended for new kinds of analyses and visualizations.

References

  1. BEDERSON,B.AND HOLLAN, J. 1994. Pad CC : A Zooming Graphical Interface for Exploring Alternative Interface Physics. In ACM Symposium on User Interface Software and Technology: UIST '94. Marina del Rey, CA, November. 17-26. Google ScholarGoogle Scholar
  2. BEYER,H.AND HOLTZBLATT, K. 1998. Contextual Design: Defining Customer-Centered Systems. Morgan Kaufmann, San Francisco. Google ScholarGoogle Scholar
  3. CHI, E., ET AL. 1998. Visualizing the Evolution of Web Ecologies. In ACM CHI Conference on Human Factors in Computing Systems. 400-407. Google ScholarGoogle Scholar
  4. CHOO,C.W.,DETLOR,B.,AND TURNBULL, D. 1998. A Behavioral Model of Information Seeking on the Web-Preliminary Results of a Study of How Managers and IT Specialists Use the Web. In Proceedings of the 61st Annual Meeting, 35, 290-302.Google ScholarGoogle Scholar
  5. CUGINI,J.AND SCHOLTZ, J. 1999. VISVIP: 3D Visualization of Paths through Web Sites. In International Workshop on Web-Based Information Visualization (WebVis'99). Florence, Italy. 259-263. Google ScholarGoogle Scholar
  6. DAVISON, B. 1999. Web Traffic Logs: An Imperfect Resource for Evaluation. In Ninth Annual Conference of the Internet Society (INET'99). San Jose, CA, June.Google ScholarGoogle Scholar
  7. EDMONDS, A. 2001. http://sourceforge.net/projects/lucidity/.Google ScholarGoogle Scholar
  8. Ergosoft Laboratories. 2001. ErgoBrowser. http://www.ergolabs.com/ergoBrowser/ergoBrowser. htm.Google ScholarGoogle Scholar
  9. ETGEN,M.AND CANTOR, J. 1999. What Does Getting WET (Web Event-Logging Tool) Mean for Web Usability? In Proceedings of the Fifth Conference on Human Factors and the Web. Gaithersburg, MD, June.Google ScholarGoogle Scholar
  10. GOULD,J.AND LEWIS, C. 1985. Designing for Usability: Key Principles and What Designers Think. In Communications of the ACM, 28, 3, 300-311. Google ScholarGoogle Scholar
  11. GUZDIAL, M., ET AL. 1994. Analyzing and visualizing event log files: A computational science of usability. Presented at Human Computer Interaction Consortium Workshop. Winter Park, CO, February.Google ScholarGoogle Scholar
  12. HELFRICH,B.AND LANDAY, J. A. 1999. QUIP: Quantitative User Interface Profiling, http:// home.earthlink.net/>>bhelfrich/quip/.Google ScholarGoogle Scholar
  13. HOCHHEISER,H.AND SHNEIDERMAN, B. 1999. Understanding Patterns of User Visits to Web Sites: Interactive Starfield Visualizations of WWW Log Data. Technical Report ncstrl.umcp/CS-TR-3989, University of Maryland. College Park, MD, February.Google ScholarGoogle Scholar
  14. MYERS,B.A.AND ROSSON, M. B. 1992. Survey on User Interface Programming. In Proceedings of the Conference on Human Factors in Computing Systems. Monterey, CA, May. 195-202. Google ScholarGoogle Scholar
  15. NetrakerCorporation. 2001. NetRaker Suite. http://netraker.com.Google ScholarGoogle Scholar
  16. NIELSEN,J.AND LANDAUER, T. 1993. A mathematical model of the finding of usability problems. In ACM INTERCHI'93. Amsterdam, The Netherlands, April. 206-213. Google ScholarGoogle Scholar
  17. NIST. 1999. WebVIP. http://zing.ncsl.nist.gov/webmet/vip/webvip-process.html.Google ScholarGoogle Scholar
  18. NORMAN, D. A. 1990. The Design of Everyday Things. Doubleday, NY.Google ScholarGoogle Scholar
  19. PITKOW,J.E.AND BHARAT, K. 1994. WebViz: A Tool for World-Wide Web Access Log Analysis. In First International Conference on the World-Wide Web. Geneva, Switzerland, May. 271-277.Google ScholarGoogle Scholar
  20. PITKOW,J.E.AND PIROLLI, P. 1999. Mining Longest Repeated Subsequences to Predict World Wide Web Surfing. In Second USENIX Symposium on Internet Technologies and Systems. Boulder, CO, October. Google ScholarGoogle Scholar
  21. RUBIN, J. 1994. Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. John Wiley & Sons, NY. Google ScholarGoogle Scholar
  22. SPOOL,J.M.,ET AL. 1998. Web Site Usability: A Designer's Guide. Academic Press, San Diego, CA. Google ScholarGoogle Scholar
  23. SPOOL,J.AND SCHROEDER, W. 2001. Testing Web Sites: Five Users is Nowhere Near Enough. In ACM CHI Conference on Human Factors in Computing Systems, Extended Abstracts. Seattle, WA, April. Google ScholarGoogle Scholar
  24. Sun Microsystems. 2001. Java Secure Socket Extension. http://java.sun.com/products/jsse/index. html.Google ScholarGoogle Scholar
  25. TAUSCHER, L. M. 1999. Evaluating History Mechanisms: An Empirical Study of Reuse Patterns in WWW Navigation. MS Thesis, Department of Computer Science, University of Calgary, Alberta, Canada.Google ScholarGoogle Scholar
  26. TEDESCHI, B. 1999. Good Web Site Design Can Lead to Healthy Sales, http://www.nytimes.com/ library/tech/99/08/cyber/commerce/30commerce.html.Google ScholarGoogle Scholar
  27. TSCHALAR, R. 2000. HTTPClient V0.3-2. http://www.innovation.ch/java/HTTPClient/index.htm.Google ScholarGoogle Scholar
  28. VIRZI, R. A. 1992. Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough? Human Factors, 34, 4, 457-468. Google ScholarGoogle Scholar
  29. VisualInsights. 2001. eBizinsights. http://www.visualinsights.com.Google ScholarGoogle Scholar
  30. Vividence. 2000a. Vividence Browser. http://www.vividence.com/resources/public/solutions/demo/ demo-print.htm.Google ScholarGoogle Scholar
  31. Vividence. 2000b. Vividence Clickstreams. http://www.vividence.com/resources/public/solutions/ demo/demo-print.htm.Google ScholarGoogle Scholar
  32. WEXELBLAT,A.AND MAES, P. 1999. Footprints: History-Rich Tools for Information Foraging. In ACM CHI Conference on Human Factors in Computing Systems. Pittsburgh, PA, May, 270-277. Google ScholarGoogle Scholar
  33. ZonaResearch. 1999. Shop Until You Drop? A Glimpse into Internet Shopping Success. http:// www.zonaresearch.com/promotios/samples/zaps/Zap06.htm.Google ScholarGoogle Scholar
  34. Zoomerang. 2001. http://www.zoomerang.com.Google ScholarGoogle Scholar

Index Terms

  1. WebQuilt: A proxy-based approach to remote web usability testing

            Recommendations

            Reviews

            James H. Bradford

            Web browsing has become a significant activity throughout the developed world. It is an activity that underpins modern e-commerce, as well as facilitating access to the vast store of communal knowledge held in the World Wide Web. Research into the human factors of browsing behavior is important because Web browsing itself is important. This paper introduces an interesting new tool for the usability testing of Web pages. The authors point out that traditional transaction logging for user Web browsing behavior is either server-based or client-based. Both approaches have their drawbacks. The authors introduce a variation of the server-side technique that uses a proxy server to get around some of the traditional problems with server-side logging. This tool, called WebQuilt, represents a novel—and potentially very useful—approach to data collection. Much of the rest of the paper describes the implementation of the WebQuilt tool, in sufficient detail to guide other researchers in the development of their own proxy server monitoring tools. The paper concludes with a detailed discussion of action inferencing and visualization techniques that will be valuable to researchers in this area, no matter what data collection procedure is used. In summary, this is a good piece of applied research, which sets the groundwork for further experiments in an important area of human factors study. Online Computing Reviews Service

            Access critical reviews of Computing literature here

            Become a reviewer for Computing Reviews.

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader