Dean Rubine
ABSTRACT
Gesture-Based interfaces offer an alternative to traditional keyboard, menu, and direct manipulation interfaces. The ability to specify objects, an operation, and additional parameters with a single intuitive gesture appeals to both novice and experienced users. Unfortunately, gesture-based interfaces have not been extensively researched, partly because they are difficult to create. This paper describes GRANDMA, a toolkit for rapidly adding gestures to direct manipulation interfaces. The trainable single-stroke gesture recognizer used by GRANDMA is also described.
- 1.BUXTON, W. Chunking and phrasing and the design of human-computer dialogues. In Information Processing 86 (North Holland, 1986), Elsevier Science Publishers B.V.Google Scholar
- 2.BUXTON, W., SNIDERMAN, R., REEVES, W., PATEL, S., AND BAECKER, R. The evolution of the SSSP scoreediting tools. In Foundations of Computer Music, C. Roads and J. Strawn, Eds. MIT Press, Cambridge, Mass., 1985, ch. 22, pp. 387-392.Google Scholar
- 3.COLEMAN, M. L. Text editing on a graphic display device using hand-drawn proofreader's symbols. In Pertinent Concepts in Computer Graphics, Proceedings of the Second University of Illinois Conference on Computer Graphics, M. Faiman and j. Nievergelt, Eds. University of Illinois Press, Urbana, Chicago, London, 1969, pp. 283-290.Google Scholar
- 4.Cox, B. J. Object Oriented Programming: An Evolutionary Approach. Addison-Wesley, 1986. Google ScholarDigital Library
- 5.DUDA, R., AND HART, 1a. Pattern Classification and Scene Analysis. Wiley Interscience, 1973.Google ScholarDigital Library
- 6.GUY ON, I., ALBRECHT, P., CUN, Y. L., DENKER, J., AND HUBBARD, W. Design of a neural network character recognizer for a touch terminal. Pattern Recognition (forthcoming).Google Scholar
- 7.HENRY, T., HUDSON, S., AND NEWELL, G. Integrating gesture and snapping into a user interface toolkit. In UIST '90 (1990), ACM, pp. 112-122. Google ScholarDigital Library
- 8.KRASNER, G. E., AND POPE, S. T. A description of the Model-View-Controller user interface paradigm in the Smalltalk-80 system. Journal of Object Oriented Programming i, 3 (Aug. 1988), 26--49. Google ScholarDigital Library
- 9.KURTENBACH, G., AND BUXTON, W. GEdit: A test bed for editing by contiguous gestures. To be published in SIGCHI Bulletin, 1991. Google ScholarDigital Library
- 10.LEE, S., BUXTON, W., AND SMITH, K. A multi-touch three dimensional touch tablet. In Proceedings of CHI'85 Conference on Human Factors in Computing Systems (1985), ACM, pp. 21-25. Google ScholarDigital Library
- 11.LIPSCOMB, J. S. A trainable gesture recognizer. Pattern Recognition (i 991 ). Also available as IBM Tech Report RC ! 6448 (#73078). Google ScholarDigital Library
- 12.McAVlNNEY, P. Telltale gestures. Byte 15, 7 (July 1990), 237-240.Google Scholar
- 13.MINSKY, M. R. Manipulating simulated objects with real-world gestures using a force and position sensitive screen. Computer Graphics 18, 3 (July 1984), 195- 203. Google ScholarDigital Library
- 14.MYERS, B. A., GIUSE, D., DANNENBERG, R. B., ZAN- DEN, B. V., KOSBIE, D., PERVIN, E., MICKISH, A., AND MARCHAL, P. Comprehensive support for graphical, highly-interactive user interfaces: The Garnet user interface development environment. IEEE Computer 23, 11 (Nov 1990). Google ScholarDigital Library
- 15.NEWMAN, W., AND SPROULL, R. Principles oflnteractive Computer Graphics. McGraw-Hill, 1979. Google ScholarDigital Library
- 16.NEXT. The NeXT System Reference Manual. NEXT, Inc., ! 989.Google Scholar
- 17.PALAY, A., HANSEN, W., KAZAR, M., SHERMAN, M., WADLOW, M., NEUENDORFFER, T., STERN, Z., BADER, M., AND PETERS, T. The Andrew toolkit: An overview. In Proceedings of the USENIX Technical Conference (Dallas, February 1988), pp. 11-23.Google Scholar
- 18.RHYNE, J. R., AND WOLF, C. G. Gestural interfaces for information processing applications. Tech. Rep. RC12179, IBM T.J. Watson Research Center, IBM Corporation, EO. Box 218, Yorktown Heights, NY 10598, Sept. 1986.Google Scholar
- 19.RUBINE, D. Integrating gesture recognition and direct manipulation. In Proceedings of the Summer '91 USENIX Technical Conference ( 1991 ).Google Scholar
- 20.RUBINE, D. The Automatic Recognition of Gestures. PhD thesis, School of Computer Science, Carnegie Mellon University, forthcoming, 1991. Google ScholarDigital Library
- 21.SUEN, C., BERTHOD, M., AND MORI, S. Automatic recognition of handprinted characters: The state of the art. Proceedings of the IEEE 68, 4 (April 1980), 469-487.Google ScholarCross Ref
- 22.ZIMMERMAN, T., LANIER, J., BLANcHARD, C., BRYSON, S., AND HARVILL, Y. A hand gesture interface device. CHI+G! (1987), 189-192. Google ScholarDigital Library
Index Terms
- Specifying gestures by example
Recommendations
Specifying gestures by example
Gesture-Based interfaces offer an alternative to traditional keyboard, menu, and direct manipulation interfaces. The ability to specify objects, an operation, and additional parameters with a single intuitive gesture appeals to both novice and ...
Progress in building user interface toolkits: the world according to XIT
UIST '92: Proceedings of the 5th annual ACM symposium on User interface software and technologyUser interface toolkits and higher-level tools built on top of them play an ever increasing part in developing graphical user interfaces. This paper describes the XIT system, a user interface development tool for the X Window System, based on Common ...
Metamouse: specifying graphical procedures by example
Special issue: Proceedings of the 1989 ACM SIGGRAPH conferenceMetamouse is a device enabling the user of a drawing program to specify graphical procedures by supplying example execution traces. The user manipulates objects directly on the screen, creating graphical tools where necessary to help make constraints ...
Comments