skip to main content
10.1145/1111449.1111492acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
Article

SWISH: semantic analysis of window titles and switching history

Published:29 January 2006Publication History

ABSTRACT

Information workers are often involved in multiple tasks and activities that they must perform in parallel or in rapid succession. In consequence, task management itself becomes yet another task that information workers need to perform in order to get the rest of their work done. Recognition of this problem has led to research on task management systems, which can help by allowing fast task switching, fast task resumption, and automatic task identification. In this paper we focus on the latter: we tackle the problem of automatically detecting the tasks that the user is involved in, by identifying which of the windows on the user's desktop are related to each other. The underlying assumption is that windows that belong to the same task share some common properties with one another that we can detect from data. We will refer to this problem as the task assignment problem.To address this problem, we have built a prototype named Swish that: (1) constantly monitors users' desktop activities using a stream of windows events; (2) logs and processes this raw event stream, and (3) implements two criteria of window "relatedness", namely the semantic similarity of their titles, and the temporal closeness in their access patterns.In addition to describing the Swish prototype in detail, we validate it with 4 hours of user data, obtaining task classification accuracies of about 70%. We also discuss our plans on including Swish in a number of intelligent user interfaces and future lines of research.

References

  1. Aizawa. The feature quantity: An information theoretic perspective of tfidf-like measures. Information Processing and Management, 39:1:pp. 45--65, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. L. Bannon, A. Cypher, S. Greenspan, and M.L. Monty. Evaluation and analysis of users' activity organization. In Proc. SIGCHI conf. on Human Factors in Computing Systems (CHI'83), pages pp. 54--57, 1983. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. P. Baudisch, N. Good, and P. Stewart. Focus plus context screens: combining display technology with visualization techniques. In Proc. of UIST'01, pages pp. 31--40, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. B. Bederson and J. Hollan. Pad++: A zooming graphical interface for exploring alternative interface physics. In Proc. ACM symposium on User interface software and technology (UIST'94), pages pp. 17--26, 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. B. Bell and S. Feiner. Dynamic space management for user interfaces. In Proc. ACM symposium on User interface software and technology (UIST'00), pages pp. 238--248, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. V. Bellotti, N. Ducheneaut, M. Howard, and I. Smith. Taking email to task: the design and evaluation of a task management centered email tool. In Proc. SIGCHI conf. on Human Factors in Computing Systems (CHI'03), pages pp. 345--352, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. S. Bly and J. Rosenberg. A comparison of tiled and overlapping windows. In Proc. SIGCHI conf. on Human Factors in Computing Systems (CHI'86), pages pp. 101--106, 1986. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. C. Bron and J. Kerbosch. Algorithm 457 --finding all the cliques of an undirected graph. Communications of the ACM, 16(9):pp. 575--577, 1973. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. S.C. Deerwester, S. Dumais, T.K. Landauer, G.W. Fumas, and R.A. Harshman. Indexing by latent semantic analysis. Journal of the American Society of Information Science, 41(6):pp. 391--407, 1990.Google ScholarGoogle ScholarCross RefCross Ref
  10. A.P. Dempster, N.M. Laird, and D.B Rubin. Maximum likelihood from incomplete data via de $em$ algorithm. Journal of the Royal Statistical Society, 39-B:pp. 1--38, 1977.Google ScholarGoogle Scholar
  11. K.D. Fenstermacher and M. Ginsburg. A lightweight framework for cross-application user monitoring. Computer, 35(3):pp. 51--59, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. A. Goldberg. Smalltalk-80. Addison-Wesley, 1983.Google ScholarGoogle Scholar
  13. A. Henderson and S. Card. Rooms: the use of multiple virtual workspaces to reduce space contention in a window-based graphical user interface. ACM Transactions on Graphics (TOG), 5(3):pp. 211--243, 1986. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. T. Hofmann. Probabilistic latent semantic indexing. In Research and Development in Information Retrieval, pages pp. 50--57, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. D.R. Hutchings, G. Smith, B. Meyers, M. Czerwinski, and G. Robertson. Display space usage and window management operation comparisons between single monitor and multiple monitor users. In Proc. Conf. on Advanced Visual Interfaces (AVI'04), pages pp. 32--39, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. F.V. Jensen. Bayesian Networks and Decision Graphs. Springer Verlag, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. E. Kandogan and B. Schneiderman. Elastic windows: evaluation of multi-window operations. In Proc. SIGCHI conf. on Human Factors in Computing Systems (CHI'97), pages pp. 250--257, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. B. MacIntyre, E.D. Mynatt, S. Voida, K.M. Hansen, J. Tullio, and G.M. Corso. Support for multitasking and background awareness using interactive peripheral displays. In Proc. ACM symposium on User interface software and technology (UIST'01), pages pp. 34--43, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. M. Meila and D. Heckerman. An experimental comparison of several clustering and initialization methods. Machine Learning, 42:9--29, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. M. Porter. An algorithm for suffix stripping. Program, 14(3):pp. 130--137, 1980.Google ScholarGoogle ScholarCross RefCross Ref
  21. J. Rekimoto. Time-machine computing: A time-centric approach for the information environment. In Proc. ACM symposium on User interface software and technology (UIST'99), pages pp. 45--54, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. G. Robertson, E. Horvitz, M. Czerwinski, P. Baudisch, D.R. Hutchings, B. Meyers, D. Robbins, and G. Smith. Scalable fabric: flexible task management. In Proc. Conf. on Advanced Visual Interfaces (AVI'04), pages pp. 85--89, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. G. Robertson, M. van Dantzich, D. Robbins, M. Czerwinski, K. Hinckley, K. Risden, D. Thiel, and V. Gorokhovsky. The task gallery: a 3d window manager. In Proc. SIGCHI conf. on Human Factors in Computing Systems (CHI'00), pages pp. 494--501, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. G. Smith, P. Baudisch, G. Robertson, M. Czewinski, B. Meyers, D. Robbins, and D. Andrews. Groupbar: The taskbar evolved. In Proc. OZCHI'03, pages pp. 41--50, 2003.Google ScholarGoogle Scholar
  25. S. Stumpf, X. Bao, A. Dragunov, T.G. Dietterich, J.L. Herlocker, K. Johnsrude, L. Li, and J. Shen. Predicting user tasks: I know what you're doing! In National Conference on Artificial Intelligence (AAAI'05), pages pp. --, 2005.Google ScholarGoogle Scholar
  26. W. Teitelman. Methodology of Window Management, chapter Ten years of window system - A retrospective view. Berlin: Springer-Verlag, 1986. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. H. Wurnig. Design of a collaborative multi-user desktop system for augmented reality. In Proc. Central European Seminar in Computer Graphics, 1998.Google ScholarGoogle Scholar

Index Terms

  1. SWISH: semantic analysis of window titles and switching history

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              IUI '06: Proceedings of the 11th international conference on Intelligent user interfaces
              January 2006
              392 pages
              ISBN:1595932879
              DOI:10.1145/1111449

              Copyright © 2006 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 29 January 2006

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • Article

              Acceptance Rates

              Overall Acceptance Rate746of2,811submissions,27%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader