William Hamilton
Andruid Kerne
Tom Robbins
ABSTRACT
We used the situated context of real-time strategy (RTS) games to address the design and evaluation of new pen + touch interaction techniques. RTS play is a popular genre of Electronic Sports (eSports), games played and spectated at an extremely high level. Interaction techniques are critical for eSports players, because they so directly impact performance.
Through this process, new techniques and implications for pen + touch and bi-manual interaction emerged. We enhance non-dominant hand (NDH) interaction with edge-constrained affordances, anchored to physical features of interactive sur- faces, effectively increasing target width. We develop bi-manual overloading, an approach to reduce the total number of occurrences of NDH retargeting. The novel isosceles lasso select technique facilitates selection of complex object subsets. Pen-in-hand interaction, dominant hand touch interaction performed with the pen stowed in the palm, also emerged as an efficient and expressive interaction paradigm.
Supplemental Material
- Appert, C., Chapuis, O., Beaudouin-Lafon, M. Evaluation of pointing performance on screen edges. Proc. AVI (2008), 119--126. Google Scholar
Digital Library
- Balakrishnan, R., MacKenzie, I. S. Performance differences in the fingers, wrist, and forearm in computer input control. Proc. CHI (1997). Google ScholarDigital Library
- Brandl, P., Forlines, C., Wigdor, D., Haller, M., Shen, C. Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces. Proc. AVI (2008). Google ScholarDigital Library
- Cheung, G., Huang, J. Starcraft from the stands: Understanding the game spectator. Proc. CHI (2011). Google ScholarDigital Library
- Cutler, L. D., Fröhlich, B., Hanrahan, P. Two-handed direct manipulation on the responsive workbench. Proc. I3D (1997). Google ScholarDigital Library
- Damaraju, S., Kerne, A. Comparing multi-touch interaction techniques for manipulation of an abstract parameter space. Proc. ICMI (2011). Google ScholarDigital Library
- Froehlich, J., Wobbrock, J. O., Kane, S. K. Barrier pointing: using physical edges to assist target acquisition on mobile device touch screens. Proc. SIGACCESS (2007), 19--26. Google ScholarDigital Library
- Gibson, J. J. The ecological approach to visual perception. Psychology Press, 1986.Google Scholar
- Guiard, Y. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. J. Motor Behavior 19 (1987).Google Scholar
- Hinckley, K., Guimbretiere, F., Baudisch, P., Sarin, R., Agrawala, M., Cutrell, E. The springboard: Multiple modes in one spring-loaded control. Proc. CHI (2006). Google ScholarDigital Library
- Hinckley, K., Pausch, R., Proffitt, D., Patten, J., Kassell, N. Cooperative bimanual action. Proc. CHI (1997), 27--34. Google ScholarDigital Library
- Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., Buxton, B. Manual deskterity: An exploration of simultaneous pen + touch direct input. CHI EA (2010). Google ScholarDigital Library
- Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., Buxton, B. Pen + touch = new tools. Proc. UIST (2010). Google ScholarDigital Library
- Kabbash, P., MacKenzie, I. S., Buxton, W. Human performance using computer input devices in the preferred and non-preferred hands. Proc. CHI (1993), 474--481. Google ScholarDigital Library
- Kaltenbrunner, M., Bovermann, T., Bencina, R., Costanza, E. TUIO: A protocol for table-top tangible user interfaces. Proc. 6th Int'l Gesture Workshop (2005).Google Scholar
- Kurtenbach, G., Buxton, W. The limits of expert performance using hierarchic marking menus. Proc. CHI (1993), 482--487. Google ScholarDigital Library
- League of Legends. {PC}. Riot Games, 2009.Google Scholar
- Moeller, J., Kerne, A. ZeroTouch: An optical multi-touch and free-air interaction architecture. Proc. CHI (2012), Full paper in press. Google ScholarDigital Library
- Norman, D. A. The Design of Everyday Things. Basic Books, September 2002. Google ScholarDigital Library
- Odell, D. L., Davis, R. C., Smith, A., Wright, P. K. Toolglasses, marking menus, and hotkeys: a comparison of one and two-handed command selection techniques. Proc. GI (2004). Google ScholarDigital Library
- Plott, S. Day{9} Daily #242 Secrets of Hotkeys, APM, and Mouse Movement, February 2011.Google Scholar
- Salen, K., Zimmerman, E. Rules of Play: Game Design Fundamentals. MIT Press, Cambridge, MA, USA, 2004. Google ScholarDigital Library
- Spring Engine. {open source}, 2004. http://springrts.com/.Google Scholar
- StarCraft II. {OSX}. Blizzard Entertainment, 2010.Google Scholar
- Todor, J. I., Doane, T. Handedness and hemispheric asymmetry in the control of movements. J Mot Behav 10, 4 (Dec. 1978), 295--300.Google ScholarCross Ref
- Wills, G. J. Selection: 524,288 ways to say "this is interesting". Proc. INFOVIS (1996). Google ScholarDigital Library
- Wobbrock, J. O., Morris, M. R., Wilson, A. D. User-defined gestures for surface computing. Proc. CHI (2009). Google ScholarDigital Library
- Zabramski, S. Careless touch: a comparative evaluation of mouse, pen, and touch input in shape tracing task. Proc. OzCHI (2011), 329--332. Google ScholarDigital Library
- Zero-K. {open source}, 2010. http://zero-k.info/.Google Scholar
Index Terms
- High-performance pen + touch modality interactions: a real-time strategy game eSports context
Recommendations
Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technologyWe describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Pen-in-hand command: NUI for real-time strategy esports
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing SystemsElectronic Sports (eSports) is the professional play and spectating of digital games. Real-time strategy games are a form of eSport that require particularly high- performance and precise interaction. Prior eSports HCI has been keyboard and mouse based. ...
Comments