skip to main content
10.1145/2047196.2047212acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

ShowMeHow: translating user interface instructions between applications

Authors Info & Claims
Published:16 October 2011Publication History

ABSTRACT

Many people learn how to use complex authoring applications through tutorials. However, user interfaces for authoring tools differ between versions, platforms, and competing products, limiting the utility of tutorials. Our goal is to make tutorials more useful by enabling users to repurpose tutorials between similar applications. We introduce UI translation interfaces which enable users to locate commands in one application using the interface language of another application. Our end-user tool, ShowMeHow, demonstrates two interaction techniques to accomplish translations: 1) direct manipulation of interface facades and 2) text search for commands using the vocabulary of another application. We discuss tools needed to construct the translation maps that enable these techniques. An initial study (n=12) shows that users can locate unfamiliar commands twice as fast with interface facades. A second study showed that users can work through tutorials written for one application in another application.

Skip Supplemental Material Section

Supplemental Material

fp101.mov

mov

26.2 MB

References

  1. GIMPshop. http://www.gimpshop.com/. Retrieved 4/2011.Google ScholarGoogle Scholar
  2. Ron Baecker. Showing instead of telling. In Proceedings of the 20th annual international conference on Computer documentation, SIGDOC '02, pages 10--16, New York, NY, USA, 2002. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Lawrence Bergman, Vittorio Castelli, Tessa Lau, and Daniel Oblinger. Docwizards: a system for authoring follow-me documentation wizards. In Proceedings of the 18th annual ACM symposium on User interface software and technology, UIST '05, pages 191--200, New York, NY, USA, 2005. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. John M. Carroll. The Nurnberg funnel: designing minimalist instruction for practical computer skill. MIT Press, Cambridge, MA, USA, 1990. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Sudarshan S. Chawathe, Anand Rajaraman, Hector Garcia-Molina, and Jennifer Widom. Change detection in hierarchically structured information. SIGMOD Record, 25:493--504, June 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Sid Davis and Susan Wiedenbeck. The mediating effects of intrinsic motivation, ease of use and usefulness perceptions on performance in first-time and subsequent computer users. Interacting with Computers, 13(5):549 -- 580, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  7. Morgan Dixon and James Fogarty. Prefab: implementing advanced behaviors using pixel-based reverse engineering of interface structure. In Proceedings of the 28th international conference on Human factors in computing systems, CHI '10, pages 1525--1534, New York, NY, USA, 2010. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Adam Fourney, Richard Mann, and Michael Terry. Queryfeature graphs:bridging user vocabulary and system functionality. In Proceedings of the 24th annual ACM symposium on User interface software and technology, UIST '11, New York, NY, USA, 2011. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Krzysztof Z. Gajos, Daniel S. Weld, and Jacob O. Wobbrock. Automatically generating personalized user interfaces with supple. Artificial Intelligence, 174(12--13):910--950, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Floraine Grabler, Maneesh Agrawala, Wilmot Li, Mira Dontcheva, and Takeo Igarashi. Generating photo manipulation tutorials by demonstration. ACM Transactions on Graphics, 28:66:1--66:9, July 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Tovi Grossman, George Fitzmaurice, and Ramtin Attar. A survey of software learnability: metrics, methodologies and guidelines. In Proceedings of the 27th international conference on Human factors in computing systems, CHI '09, pages 649--658, New York, NY, USA, 2009. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Tovi Grossman, Justin Matejka, and George Fitzmaurice. Chronicle: capture, exploration, and playback of document workflow histories. In Proceedings of the 23nd annual ACM symposium on User interface software and technology, UIST '10, pages 143--152, New York, NY, USA, 2010. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Susan M. Harrison. A comparison of still, animated, or nonillustrated on-line help with written or spoken instructions in a graphical user interface. In Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '95, pages 82--89, New York, NY, USA, 1995. ACM Press/Addison-Wesley Publishing Co. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Björn Hartmann, Leslie Wu, Kevin Collins, and Scott R. Klemmer. Programming by a sample: rapidly creating web applications with d.mix. In Proceedings of the 20th annual ACM symposium on User interface software and technology, UIST '07, pages 241--250, New York, NY, USA, 2007. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Edwin L. Hutchins, James D. Hollan, and Donald A. Norman. Direct manipulation interfaces. Human-Computer Interaction, 1:311--338, 1985. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. David F. Huynh, Robert C. Miller, and David R. Karger. Potluck: semi-ontology alignment for casual users. In Proceedings of the 6th international The semantic web and 2nd Asian conference on Asian semantic web conference, ISWC'07/ASWC'07, pages 903--910, Berlin, Heidelberg, 2007. Springer-Verlag. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Caitlin Kelleher and Randy Pausch. Stencils-based tutorials: design and evaluation. In Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '05, pages 541--550, New York, NY, USA, 2005. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Miryung Kim and David Notkin. Program element matching for multi-version program analyses. In Proceedings of the 2006 international workshop on Mining software repositories, MSR '06, pages 58--64, New York, NY, USA, 2006. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Kevin Knabe. Apple guide: a case study in user-aided design of online help. In Conference companion on Human factors in computing systems, CHI '95, pages 286--287, New York, NY, USA, 1995. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Ranjitha Kumar, Jerry O. Talton, Salman Ahmad, and Scott R. Klemmer. Bricolage: Example-based retargeting for web design. In Proceedings of the 29th international conference on Human factors in computing systems, CHI '11, New York, NY, USA, 2011. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. David Kurlander and Steven Feiner. A history-based macro by example system. In Proceedings of the 5th annual ACM symposium on User interface software and technology, UIST '92, pages 99--106, New York, NY, USA, 1992. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Tessa Lau, Clemens Drews, and Jeffrey Nichols. Interpreting written how-to instructions. In Proceedings of the 21st international jont conference on Artifical intelligence, pages 1433--1438, San Francisco, CA, USA, 2009. Morgan Kaufmann Publishers Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Toshio Nakamura and Takeo Igarashi. An application-independent system for visualizing user operation history. In Proceedings of the 21st annual ACM symposium on User interface software and technology, UIST '08, pages 23--32, New York, NY, USA, 2008. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Jeffrey Nichols, Brad A. Myers, and Brandon Rothrock. Uniform: automatically generating consistent remote control user interfaces. In Proceedings of the SIGCHI conference on Human Factors in computing systems, CHI '06, pages 611--620, New York, NY, USA, 2006. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Fabio Paterno. Model-Based Design and Evaluation of Interactive Applications. Springer-Verlag, London, UK, 1st edition, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Angel R. Puerta. A model-based interface development environment. IEEE Software, 14:40--47, July 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Erhard Rahm and Philip A. Bernstein. A survey of approaches to automatic schema matching. The VLDB Journal, 10:334--350, December 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Christian Spannagel, Raimund Girwidz, Herbert Löthe, Andreas Zendler, and Ulrik Schroeder. Animated demonstrations and training wheels interfaces in a complex learning environment. Interacting with Computers, 20:97--111, January 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Christof C. van Nimwegen, Daniel D. Burgos, Herre H. van Oostendorp, and Hermina H. J. M. Schijf. The paradox of the assisted user: guidance can be counterproductive. In Proceedings of the SIGCHI conference on Human Factors in computing systems, CHI '06, pages 917--926, New York, NY, USA, 2006. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Robert Wilensky, Yigal Arens, and David Chin. Talking to unix in english: an overview of uc. Communications of the ACM, 27:574--593, June 1984. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. ShowMeHow: translating user interface instructions between applications

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology
      October 2011
      654 pages
      ISBN:9781450307161
      DOI:10.1145/2047196

      Copyright © 2011 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 16 October 2011

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      UIST '11 Paper Acceptance Rate67of262submissions,26%Overall Acceptance Rate842of3,967submissions,21%

      Upcoming Conference

      UIST '24

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader