Ilhan Aslan
ABSTRACT
In this paper, we report on a series of studies, exploring the potential of pen and mid-air input on tablets. We describe a field study with an early prototype of a drawing application and follow-up inquiries, such as the development and comparison of gesture sets for pen and mid-air input and pen and multi-touch input with users in a lab environment. Overall, our results suggest that pen and mid-air input should be offered to complement traditional pen and multi-touch input on tablets. We illustrate the final user-defined gestures set for pen and mid-air input and discuss how user preferences of mid-air gestures over touch gestures seem to depend on the complexity of operations and the need of additional menus on the screen.
- Annett, M., Grossman, T., Wigdor, D., and Fitzmaurice, G. Medusa: A proximity-aware multi-touch tabletop. In Proc. of, UIST '11, ACM (2011), 337--346. Google Scholar
Digital Library
- Aslan, I., Krischkowsky, A., Meschtscherjakov, A., Wuchse, M., and Tscheligi, M. A leap for touch: Proximity sensitive touch targets in cars. In Proc. of, AutomotiveUI '15, ACM (New York, NY, USA, 2015), 39--46. Google ScholarDigital Library
- Aslan, I., Meneweger, T., Fuchsberger, V., and Tscheligi, M. Sharing touch interfaces: Proximity-sensitive touch targets for tablet-mediated collaboration. In Proc. of, ICMI '15, ACM (2015), 279--286. Google ScholarDigital Library
- Balakrishnan, R., and Hinckley, K. The role of kinesthetic reference frames in two-handed input performance. In Proc. of, UIST '99, ACM (1999), 171--178. Google ScholarDigital Library
- Brandl, P., Leitner, J., Seifried, T., Haller, M., Doray, B., and To, P. Occlusion-aware menu design for digital tabletops. CHI EA '09, ACM (2009), 3223--3228. Google ScholarDigital Library
- Brooke, J. Sus-a quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.Google Scholar
- Chen, X. A., Schwarz, J., Harrison, C., Mankoff, J., and Hudson, S. E. Air+touch: Interweaving touch & in-air gestures. In Proc. of, UIST '14, ACM (2014), 519--525. Google ScholarDigital Library
- Ericsson, K. A., and Simon, H. A. Protocol analysis, 1993.Google Scholar
- Guiard, Y. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of motor behavior 19, 4 (1987), 486--517.Google Scholar
- Han, J., Ahn, S., and Lee, G. Transture: Continuing a touch gesture on a small screen into the air. CHI EA '15, ACM (2015), 1295--1300. Google ScholarDigital Library
- Hassenzahl, M., Burmester, M., and Koller, F. Attrakdiff: Ein fragebogen zur messung wahrgenommener hedonischer und pragmatischer qualität. In Mensch & Computer 2003. Springer, 2003.Google Scholar
- Hilliges, O., Izadi, S., Wilson, A. D., Hodges, S., Garcia-Mendoza, A., and Butz, A. Interactions in the air: adding further depth to interactive tabletops. In Proc. of, UIST '09, ACM (2009), 139--148. Google ScholarDigital Library
- Hinckley, K., Chen, X. A., and Benko, H. Motion and context sensing techniques for pen computing. In Proc. of, GI '13, Canadian Information Processing Society (Toronto, Ont., Canada, Canada, 2013), 71--78. Google ScholarDigital Library
- Hinckley, K., Pahud, M., Benko, H., Irani, P., Guimbretière, F., Gavriliu, M., Chen, X. A., Matulic, F., Buxton, W., and Wilson, A. Sensing techniques for tablet+stylus interaction. In Proc. of, UIST '14, ACM (2014), 605--614. Google ScholarDigital Library
- Hinckley, K., Pahud, M., Benko, H., Irani, P., Guimbretière, F., Gavriliu, M., Chen, X. A., Matulic, F., Buxton, W., and Wilson, A. Sensing techniques for tablet+stylus interaction. In Proc. of, UIST '14, ACM (2014), 605--614. Google ScholarDigital Library
- Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. Manual deskterity: an exploration of simultaneous pen+ touch direct input. CHI EA '10, ACM (2010), 2793--2802. Google ScholarDigital Library
- Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. Pen+ touch= new tools. In Proc. of, UIST'10, ACM (2010), 27--36. Google ScholarDigital Library
- Jackson, B., Schroeder, D., and Keefe, D. F. Nailing down multi-touch: anchored above the surface interaction for 3d modeling and navigation. In Proc. of, Canadian Information Processing Society (2012), 181--184. Google ScholarDigital Library
- Kabbash, P., Buxton, W., and Sellen, A. Two-handed input in a compound task. In Proc. of, CHI '94, ACM (1994), 417--423. Google ScholarDigital Library
- Klemmer, S. R., Hartmann, B., and Takayama, L. How bodies matter: Five themes for interaction design. In Proc. of, DIS'06 (2006). Google ScholarDigital Library
- Lahey, B., Girouard, A., Burleson, W., and Vertegaal, R. Paperphone: Understanding the use of bend gestures in mobile devices with flexible electronic paper displays. In Proc. of, CHI '11, ACM (2011), 1303--1312. Google ScholarDigital Library
- Marquardt, N., Jota, R., Greenberg, S., and Jorge, J. A. The continuous interaction space: interaction techniques unifying touch and gesture on and above a digital surface. In INTERACT 2011. Springer, 2011. Google ScholarDigital Library
- Matulic, F., and Norrie, M. Empirical evaluation of uni-and bimodal pen and touch interaction properties on digital tabletops. In Proc. of, ITS'12, ACM (2012), 143--152. Google ScholarDigital Library
- Matulic, F., and Norrie, M. C. Supporting active reading on pen and touch-operated tabletops. In Proc. of, AVI '12, ACM (2012), 612--619. Google ScholarDigital Library
- Ruiz, J., Li, Y., and Lank, E. User-defined motion gestures for mobile interaction. In Proc. of, CHI '11, ACM (2011), 197--206. Google ScholarDigital Library
- Schuler, D., and Namioka, A. Participatory design: Principles and practices. CRC Press, 1993. Google ScholarDigital Library
- Underkoffler, J., and Ishii, H. Urp: A luminous-tangible workbench for urban planning and design. In Proc. of, CHI '99, ACM (1999), 386--393. Google ScholarDigital Library
- Wilson, A. D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D. Bringing physics to the surface. In Proc. of, UIST '08, ACM (2008), 67--76. Google ScholarDigital Library
- Wobbrock, J. O., Morris, M. R., and Wilson, A. D. User-defined gestures for surface computing. In Proc. of, CHI '09, ACM (2009), 1083--1092. Google ScholarDigital Library
- Wu, M., and Balakrishnan, R. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In Proc. of, UIST '03, ACM (2003), 193--202. Google ScholarDigital Library
- Wu, M., Shen, C., Ryall, K., Forlines, C., and Balakrishnan, R. Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces. In Horizontal Interactive Human-Computer Systems, 2006. TableTop 2006., IEEE (2006), 8--pp. Google ScholarDigital Library
- Yang, X.-D., Grossman, T., Irani, P., and Fitzmaurice, G. Touchcuts and touchzoom: Enhanced target selection for touch displays using finger proximity sensing. In Proc. of, CHI '11, ACM (2011), 2585--2594. Google ScholarDigital Library
- Yee, K.-P. Two-handed interaction on a tablet display. CHI EA '04, ACM (2004), 1493--1496. Google ScholarDigital Library
- Yoon, D., Chen, N., and Guimbretière, F. Texttearing: Opening white space for digital ink annotation. In Proc. of, UIST'13, ACM (2013), 107--112. Google ScholarDigital Library
Index Terms
- Pen + Mid-Air: An Exploration of Mid-Air Gestures to Complement Pen Input on Tablets
Recommendations
Eliciting Mid-Air Gestures for Wall-Display Interaction
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer InteractionFreehand mid-air gestures are a promising input method for interacting with wall displays. However, work on mid-air gestures for wall-display interaction has mainly explored what is technically possible, which might not result in gestures that users ...
LeapArm-Facilitating Sensory Spaces for Mid-air Gestural Interaction
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer InteractionWe present the LeapArm system, which combines a Leap Motion controller for mid-air gestural human-computer interaction with a robotic arm. LeapArm actuates in real-time the orientation of the controller towards a user's hand, dynamically expanding the ...
Demonstrating Proxemic Cursor Input for Touchless Displays
SUI '23: Proceedings of the 2023 ACM Symposium on Spatial User InteractionTouchless gesture interfaces often use cursor-based interactions, where widgets are targeted by a movable cursor and activated with a mid-air gesture. Proxemic cursor interactions are a novel alternative that facilitate faster selection without the need ...
Comments