Mingyu Liu
Mathieu Nancel
Daniel Vogel
ABSTRACT
We describe Gunslinger, a mid-air interaction technique using barehand postures and gestures. Unlike past work, we explore a relaxed arms-down position with both hands interacting at the sides of the body. It features "hand-cursor" feedback to communicate recognized hand posture, command mode and tracking quality; and a simple, but flexible hand posture recognizer. Although Gunslinger is suitable for many usage contexts, we focus on integrating mid-air gestures with large display touch input. We show how the Gunslinger form factor enables an interaction language that is equivalent, coherent, and compatible with large display touch input. A four-part study evaluates Midas Touch, posture recognition feedback, pointing and clicking, and general usability.
Supplemental Material
- Bailly, G., et al. Shoesense: A new perspective on gestural interaction and wearable applications. In Proc. CHI '12, ACM (2012), 1239--1248. Google Scholar
Digital Library
- Ballendat, T., Marquardt, N., and Greenberg, S. Proxemic interaction: Designing for a proximity and orientation-aware environment. In Proc. ITS '10, ACM Press (2010). Google ScholarDigital Library
- Bragdon, A., DeLine, R., Hinckley, K., and Morris, M. R. Code space: Touch + air gesture hybrid interactions for supporting developer meetings. In Proc. ITS '11, ACM (2011), 212--221. Google ScholarDigital Library
- Chan, L., et al. Fingerpad: Private and subtle interaction using fingertips. In Proc. UIST '13, ACM (2013), 255--260. Google ScholarDigital Library
- Chen, K.-Y., Lyons, K., White, S., and Patel, S. utrack: 3d input using two magnetic sensors. In Proc. UIST '13, ACM (2013), 237--244. Google ScholarDigital Library
- Forlines, C., Vogel, D., and Balakrishnan, R. HybridPointing: fluid switching between absolute and relative pointing with a direct input device. In Proc. UIST'06, ACM (2006), 211--220. Google ScholarDigital Library
- Harrison, C., Benko, H., and Wilson, A. D. Omnitouch: Wearable multitouch interaction everywhere. In Proc. UIST '11, ACM (2011), 441--450. Google ScholarDigital Library
- Hincapie-Ramos, J. D., Guo, X., Moghadasian, P., and Irani, P. Consumed endurance: A metric to quantify arm fatigue of mid-air interactions. In Proc. CHI '14, ACM (2014), 1063--1072. Google ScholarDigital Library
- Kim, D., et al. Digits: Freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In Proc. UIST '12, ACM (2012), 167--176. Google ScholarDigital Library
- Levesque, J.-C., Laurendeau, D., and Mokhtari, M. Bimanual gestural interface for virtual environments. In Proc. VR '11 (March 2011), 223--224. Google ScholarDigital Library
- Lu, G., Shark, L.-K., Hall, G., and Zeshan, U. Immersive manipulation of virtual objects through glove-based hand gesture interaction. Virtual Real. 16, 3 (Sept. 2012), 243--252. Google ScholarDigital Library
- Markussen, A., Jakobsen, M. R., and Hornbæk, K. Vulture: A Mid-air Word-gesture Keyboard. In Proc. CHI '14, ACM (2014), 1073--1082. Google ScholarDigital Library
- Mistry, P., and Maes, P. Sixthsense: A wearable gestural interface. In Proc. SIGGRAPH ASIA '09, ACM (2009), 85--85. Google ScholarDigital Library
- Nancel, M., et al. High-precision pointing on large wall displays using small handheld devices. In Proc. CHI '13, ACM (2013), 831--840. Google ScholarDigital Library
- Oviatt, S. Ten myths of multimodal interaction. Commun. ACM 42, 11 (Nov. 1999), 74--81. Google ScholarDigital Library
- Piekarski, W., and Smith, R. Robust gloves for 3d interaction in mobile outdoor ar environments. In Proc. ISMAR '06, IEEE Computer Society (2006), 251--252. Google ScholarDigital Library
- Saponas, T. S., Harrison, C., and Benko, H. PocketTouch: Through-fabric Capacitive Touch Input. In Proc. UIST '11, ACM (2011), 303--308. Google ScholarDigital Library
- Vogel, D., and Balakrishnan, R. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In Proc. UIST '04, ACM (2004), 137--146. Google ScholarDigital Library
- Vogel, D., and Balakrishnan, R. Distant freehand pointing and clicking on very large, high resolution displays. In Proc. UIST '05, ACM (2005), 33--42. Google ScholarDigital Library
Index Terms
- Gunslinger: Subtle Arms-down Mid-air Interaction
Recommendations
Investigating Cross-Device Interaction between a Handheld Device and a Large Display
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsThere is a growing interest in HCI research to explore cross-device interaction, giving rise to an interest in different approaches facilitating interaction between handheld devices and large displays. Contributing to this, we have investigated the use ...
Comparison of gestural, touch, and mouse interaction with Fitts' law
OzCHI '13: Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, CollaborationWe present preliminary results of an experiment to compare gestural, touch, and mouse interaction using Fitts' law. A total of 15 participants were asked to select 100 targets as quickly and accurately as possible using each technique. Selection of ...
Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technologyWe describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Comments