Anhong Guo
Tim Paek
ABSTRACT
Because smartwatches are worn on the wrist, they do not require users to hold the device, leaving at least one hand free to engage in other activities. Unfortunately, this benefit is thwarted by the typical interaction model of smartwatches; for interactions beyond glancing at information or using speech, users must utilize their other hand to manipulate a touchscreen and/or hardware buttons. In order to enable no-touch, wrist-only smartwatch interactions so that users can, for example, hold a cup of coffee while controlling their device, we explore two tilt-based interaction techniques for menu selection and navigation: AnglePoint, which directly maps the position of a virtual pointer to the tilt angle of the smartwatch, and ObjectPoint, which objectifies the underlying virtual pointer as an object imbued with a physics model. In a user study, we found that participants were able to perform menu selection and continuous selection of menu items as well as navigation through a menu hierarchy more quickly and accurately with ObjectPoint, even though previous research on tilt for other mobile devices suggested that AnglePoint would be more effective. We provide an explanation of our results and discuss the implications for more "hands-free" smartwatch interactions.
- Daniel Ashbrook, Kent Lyons, and Thad Starner. 2008. An investigation into round touchscreen wristwatch interaction. In Proceedings of the 10th international conference on Human computer interaction with mobile devices and services (MobileHCI '08). ACM, New York, NY, USA, 311--314. http://doi.acm.org/10.1145/1409240.1409276 Google Scholar
Digital Library
- Patrick Baudisch and Gerry Chu. 2009. Back-of-device interaction allows creating very small touch devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1923--1932. http://doi.acm.org/10.1145/1518701.1518995 Google ScholarDigital Library
- Xiang 'Anthony' Chen, Tovi Grossman, and George Fitzmaurice. 2014. Swipeboard: a text entry technique for ultra-small interfaces that supports novice to expert transitions. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14). ACM, New York, NY, USA, 615--620. http://doi.acm.org/10.1145/2642918.2647354 Google ScholarDigital Library
- Andrew Crossan, and Roderick Murray-Smith. "Variability in wrist-tilt accelerometer based gesture interfaces." Mobile Human-Computer Interaction-MobileHCI 2004. Springer Berlin Heidelberg, 2004. 144--155.Google Scholar
- Andrew Crossan, John Williamson, Stephen Brewster, and Rod Murray-Smith. 2008. Wrist rotation for interaction in mobile contexts. In Proceedings of the 10th international conference on Human computer interaction with mobile devices and services (MobileHCI '08). ACM, New York, NY, USA, 435--438. DOI=http://dx.doi.org/10.1145/1409240.1409307 Google ScholarDigital Library
- Google. 2015. Wrist gestures with Android Wear. Video. (27 April 2015.). Retrieved September 18, 2015 from https://www.youtube.com/watch?v=_R0qbB4hVbUGoogle Scholar
- Chris Harrison and Scott E. Hudson. 2009. Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST '09). ACM, New York, NY, USA, 121--124. http://doi.acm.org/10.1145/1622176.1622199 Google ScholarDigital Library
- Chris Harrison, Desney Tan, and Dan Morris. 2010. Skinput: appropriating the body as an input surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 453--462. http://doi.acm.org/10.1145/1753326.1753394 Google ScholarDigital Library
- Alexandra Ion, Edward Jay Wang, and Patrick Baudisch. 2015. Skin Drag Displays: Dragging a Physical Tactor across the User's Skin Produces a Stronger Tactile Stimulus than Vibrotactile. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2501--2504. http://doi.acm.org/10.1145/2702123.2702459 Google ScholarDigital Library
- Jungsoo Kim, Jiasheng He, Kent Lyons, and Thad Starner. 2007. The Gesture Watch: A Wireless Contact-free Gesture based Wrist Interface. In Wearable Computers, 2007 11th IEEE International Symposium on. 15--22. http://dx.doi.org/10.1109/ISWC.2007.4373770 Google ScholarDigital Library
- Gierad Laput, Robert Xiao, Xiang 'Anthony' Chen, Scott E. Hudson, and Chris Harrison. 2014. Skin buttons: cheap, small, low-powered and clickable fixed-icon laser projectors. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14). ACM, New York, NY, USA, 389--394. http://doi.acm.org/10.1145/2642918.2647356 Google ScholarDigital Library
- Christian Loclair, Sean Gustafson, and Patrick Baudisch. 2010. PinchWatch: a wearable device for one-handed microinteractions. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services workshop on Ensembles of on-body devices (MobileHCI '10) ACM, New York, NY, USA.Google Scholar
- Kent Lyons, David Nguyen, Daniel Ashbrook, and Sean White. 2012. Facet: a multi-segment wrist worn system. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12). ACM, New York, NY, USA, 123--130. http://doi.acm.org/10.1145/2380116.2380134 Google ScholarDigital Library
- Ian Oakley and Doyoung Lee. 2014. Interaction on the edge: offset sensing for small devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 169--178. http://doi.acm.org/10.1145/2556288.2557138 Google ScholarDigital Library
- Ian Oakley and Sile O'Modhrain. 2005. Tilt to scroll: evaluating a motion based vibrotactile mobile interface. In Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Tele-operator Systems, 2005. World Haptics 2005. First Joint. 40--49. http://dx.doi.org/10.1109/WHC.2005.138 Google ScholarDigital Library
- Stephen Oney, Chris Harrison, Amy Ogan, and Jason Wiese. 2013. ZoomBoard: a diminutive qwerty soft keyboard using iterative zooming for ultra-small devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2799--2802. http://doi.acm.org/10.1145/2470654.2481387 Google ScholarDigital Library
- Kurt Partridge, Saurav Chatterjee, Vibha Sazawal, Gaetano Borriello, and Roy Want. 2002. TiltType: accelerometer-supported text entry for very small devices. In Proceedings of the 15th annual ACM symposium on User interface software and technology (UIST '02). ACM, New York, NY, USA, 201--204. http://doi.acm.org/10.1145/571985.572013 Google ScholarDigital Library
- Lorenzo Porzi, Stefano Messelodi, Carla Mara Modena, and Elisa Ricci. 2013. A smart watch-based gesture recognition system for assisting people with visual impairments. In Proceedings of the 3rd ACM international workshop on Interactive multimedia on mobile & portable devices (IMMPD '13). ACM, New York, NY, USA, 19--24. http://doi.acm.org/10.1145/2505483.2505487 Google ScholarDigital Library
- Mahfuz Rahman, Sean Gustafson, Pourang Irani, and Sriram Subramanian. 2009. Tilt techniques: investigating the dexterity of wrist-based input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1943--1952. http://doi.acm.org/10.1145/1518701.1518997 Google ScholarDigital Library
- Jun Rekimoto. 1996. Tilting operations for small screen interfaces. In Proceedings of the 9th annual ACM symposium on User interface software and technology (UIST '96). ACM, New York, NY, USA, 167--168. http://doi.acm.org/10.1145/237091.237115 Google ScholarDigital Library
- Jun Rekimoto. 2001. Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In Wearable Computers, 2001 fifth IEEE International Symposium on. 21--27. http://dx.doi.org/10.1109/ISWC.2007.4373770 Google ScholarDigital Library
- T. Scott Saponas, Desney S. Tan, Dan Morris, Ravin Balakrishnan, Jim Turner, and James A. Landay. 2009. Enabling always-available input with muscle-computer interfaces. In Proceedings of the 22nd annual ACM symposium on User interface software and technology (UIST '09). ACM, New York, NY, USA, 167--176. http://doi.acm.org/10.1145/1622176.1622208 Google ScholarDigital Library
- Robert J. Teather and I. Scott MacKenzie. 2014. Position vs. velocity control for tilt-based interaction. In Proceedings of Graphics Interface 2014 (GI '14). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 51--58. http://doi.acm.org/10.1145/2619648.2619658 Google ScholarDigital Library
- Apple Watch. 2015. Retrieved September 23, 2015 from http://www.apple.com/watch/watch-reimagined/Google Scholar
- Android Wear. 2015. Retrieved September 23, 2015 from https://www.android.com/wear/Google Scholar
- Lars Weberg, Torbjörn Brange, and Åsa Wendelbo Hansson. 2001. A piece of butter on the PDA display. In CHI '01 Extended Abstracts on Human Factors in Computing Systems (CHI EA '01). ACM, New York, NY, USA, 435--436. http://doi.acm.org/10.1145/634067.634320 Google ScholarDigital Library
- Daniel Wigdor and Ravin Balakrishnan. 2003. TiltText: using tilt for text input to mobile phones. In Proceedings of the 16th annual ACM symposium on User interface software and technology (UIST '03). ACM, New York, NY, USA, 81--90. http://doi.acm.org/10.1145/964696.964705 Google ScholarDigital Library
- John Williamson, and Roderick Murray-Smith. "Hex: Dynamics and probabilistic text entry." Switching and Learning in Feedback Systems. Springer Berlin Heidelberg, 2005. 333--342. Google ScholarDigital Library
- Robert Xiao, Gierad Laput, and Chris Harrison. 2014. Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 193--196. http://doi.acm.org/10.1145/2556288.2557017 Google ScholarDigital Library
- Chao Xu, Parth H. Pathak, and Prasant Mohapatra. 2015. Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch. In Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications (HotMobile '15). ACM, New York, NY, USA, 9--14. http://doi.acm.org/10.1145/2699343.269935 Google ScholarDigital Library
Index Terms
- Exploring tilt for no-touch, wrist-only interactions on smartwatches
Recommendations
MyoTilt: a target selection method for smartwatches using the tilting operation and electromyography
MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and ServicesWe present the MyoTilt target selection method for smartwatches, which employs a combination of a tilt operation and electromyography (EMG). First, a user tilts his/her arm to indicate the direction of cursor movement on the smartwatch; then s/he ...
Detachable Smartwatch: More Than A Wearable
Glanceability and low access time are arguably the key assets of a smartwatch. However, smartwatches are currently limited to micro-interactions. They do not enable complex interactions and, in general, they do not afford continuous use for long. We ...
Skin buttons: cheap, small, low-powered and clickable fixed-icon laser projectors
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technologySmartwatches are a promising new interactive platform, but their small size makes even basic actions cumbersome. Hence, there is a great need for approaches that expand the interactive envelope around smartwatches, allowing human input to escape the ...
Comments