Vittorio Fuccella
Poika Isokoski
ABSTRACT
We describe the design and evaluation of a gestural text editing technique for touchscreen devices. The gestures are drawn on top of the soft keyboard and interpreted as commands for moving the caret, performing selections, and controlling the clipboard. Our implementation is an Android service that can be used in any text editing task on Android-based devices. We conducted an experiment to compare the gestural editing technique against the widget-based technique available on a smartphone (Samsung Galaxy II with Android 2.3.5). The results show a performance benefit of 13-24% for the gestural technique depending on the font size. Subjective feedback from the participants was also positive. Because the two editing techniques use different input areas, they can co-exist on a device. This means that the gestural editing can be added on any soft keyboard without interfering with user experience for those users that choose not to use it.
- Almaksour, A., Anquetil, E., Quiniou, S., and Cheriet, M. Personalizable pen-based interface using lifelong learning. In Proc. of ICFHR'10 (2010), 188--193. Google Scholar
Digital Library
- Appert, C., and Zhai, S. Using strokes as command shortcuts: cognitive benefits and toolkit support. In Proc. of CHI'09, ACM (2009), 2289--2298. Google ScholarDigital Library
- Bangor, A., Kortum, P. T., and Miller, J. T. An Empirical Evaluation of the System Usability Scale. IJHCI 24, 6 (2008), 574--594.Google Scholar
- Borenstein, N. S. The evaluation of text editors: a critical review of the roberts and morgan methodology based on new experiments. In Proc. of CHI'85, ACM (1985), 99--105. Google ScholarDigital Library
- Bragdon, A., Nelson, E., Li, Y., and Hinckley, K. Experimental analysis of touch-screen gesture designs in mobile environments. In Proc. of CHI '11, ACM (2011), 403--412. Google ScholarDigital Library
- Brooke, J. Sus: A quick and dirty usability scale. In Usability evaluation in industry, P. W. Jordan, B. Weerdmeester, A. Thomas, and I. L. Mclelland, Eds. Taylor and Francis, London, 1996.Google Scholar
- Cockburn, A., Ahlström, D., and Gutwin, C. Understanding performance in touch selections: Tap, drag and radial pointing drag with finger, stylus and mouse. Int. J. Hum.-Comput. Stud. 70, 3 (Mar. 2012), 218--233. Google ScholarDigital Library
- Costagliola, G., Fuccella, V., and Capua, M. D. Interpreting gestures for text entry on touch screen devices. In Proceedings of The 16th International Conference on Distributed Multimedia Systems (2010), 315--320.Google Scholar
- Costagliola, G., Fuccella, V., and Di Capua, M. Text entry with keyscretch. In Proceedings of the 16th international conference on Intelligent User Interfaces, ACM (2011), 277--286. Google ScholarDigital Library
- Embley, D. W., and Nagy, G. Can we expect to improve text editing performance? In Proc. of CHI '82, ACM (1982), 152--156. Google ScholarDigital Library
- Gould, J. D., and Alfaro, L. Revising documents with text editors, handwriting recognition, and speech recognition systems. Human Factors: The Journal of the Human Factors and Ergonomics Society 26, 4 (Aug. 1984), 431--441.Google ScholarCross Ref
- Gould, J. D., Lewis, C., and Barnes, V. Cursor movement during text editing. ACM Trans. Inf. Syst. 3, 1 (Jan. 1985), 22--34. Google ScholarDigital Library
- Isokoski, P. Performance of menu-augmented soft keyboards. In Proc. of CHI '04, ACM (2004), 423--430. Google ScholarDigital Library
- Kristensson, P.-O., and Zhai, S. Shark2: a large vocabulary shorthand writing system for pen-based computers. In Proc. of UIST '04, ACM (2004), 43--52. Google ScholarDigital Library
- Kristensson, P. O., and Zhai, S. Command strokes with and without preview: using pen gestures on keyboard for command selection. In Proc. of CHI '07, ACM (2007), 1137--1146. Google ScholarDigital Library
- Mankoff, J., and Abowd, G. D. Cirrin: a word-level unistroke keyboard for pen input. In Proc. of the ACM UIST 98, ACM (1998), 213--214. Google ScholarDigital Library
- Pedersen, E. R., McCall, K., Moran, T. P., and Halasz, F. G. Tivoli: an electronic whiteboard for informal workgroup meetings. In Proc. of CHI '93, ACM (1993), 391--398. Google ScholarDigital Library
- Roberts, T. L. Evaluation of computer text editors. PhD thesis, Stanford, CA, USA, 1980. AAI8011699. Google ScholarDigital Library
- Roberts, T. L., and Moran, T. P. Evaluation of text editors. In Proc. of CHI '82, ACM (1982), 136--141. Google ScholarDigital Library
- Roberts, T. L., and Moran, T. P. The evaluation of text editors: methodology and empirical results. Commun. ACM 26, 4 (Apr. 1983), 265--283. Google ScholarDigital Library
- Rubine, D. Specifying gestures by example. In Proc. of SIGGRAPH '91, ACM (1991), 329--337. Google ScholarDigital Library
- Tesler, L. A personal history of modeless text editing and cut/copy-paste. Interactions 19, 4 (Aug. 2012), 70--75. Google ScholarDigital Library
- Westerman, W., Lamiraux, H., and Dreisbach, M. Swipe gestures for touch screen keyboards. US Patent 20080316183, 2008.Google Scholar
- Wobbrock, J. O., Wilson, A. D., and Li, Y. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In Proc. of UIST '07, ACM (2007), 159--168. Google ScholarDigital Library
- Wolf, C. G., and Morrel-Samuels, P. The use of hand-drawn gestures for text editing. International Journal of Man-Machine Studies 27, 1 (1987), 91--102. Google ScholarDigital Library
Index Terms
- Gestures and widgets: performance in text editing on multi-touch capable mobile devices
Recommendations
Shortcut Gestures for Mobile Text Editing on Fully Touch Sensitive Smartphones
While advances in mobile text entry enable smartphone users to type almost as fast as on hardware keyboards, text-heavy activities are still not widely adopted. One reason is the lack of shortcut mechanisms. In this article, we determine shortcuts for ...
Virtual Stick in Caret Positioning on Touch Screens
IHM '13: Proceedings of the 25th Conference on l'Interaction Homme-MachineWe present our design exploration in the area of virtual stick controllers and a preliminary evaluation in an editing task. Virtual stick controllers are one solution to the problem of precise pointing on touch screens. They operate by using an area of ...
Hover widgets: using the tracking state to extend the capabilities of pen-operated devices
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe present Hover Widgets, a new technique for increasing the capabilities of pen-based interfaces. Hover Widgets are implemented by using the pen movements above the display surface, in the tracking state. Short gestures while hovering, followed by a ...
Comments