skip to main content
10.1145/3229434.3229457acmconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
research-article

MyoTilt: a target selection method for smartwatches using the tilting operation and electromyography

Published:03 September 2018Publication History

ABSTRACT

We present the MyoTilt target selection method for smartwatches, which employs a combination of a tilt operation and electromyography (EMG). First, a user tilts his/her arm to indicate the direction of cursor movement on the smartwatch; then s/he applies forces on the arm. EMG senses the force and moves the cursor to the direction where the user is tilting his/her arm to manipulate the cursor. In this way, the user can simply manipulate the cursor on the smartwatch with minimal effort, by tiling the arm and applying force to it. We conducted an experiment to investigate its performance and to understand its usability. Result showed that participants selected small targets with an accuracy greater than 93.89%. In addition, performance significantly improved compared to previous tilting operation methods. Likewise, its accuracy was stable as targets became smaller, indicating that the method is unaffected by the "fat finger problem".

References

  1. Shuhei Aoyama, Buntarou Shizuki and Jiro Tanaka. 2016. ThumbSlide: An Interaction Technique for Smartwatches using a Thumb Slide Movement. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 2403--2409. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. John Brooke. 1996. SUS - A quick and dirty usability scale. Usability evaluation industry, 189--194.Google ScholarGoogle Scholar
  3. Wei-Hung Chen. 2015. Blowatch: Blowable and Hands-free Interaction for Smartwatches. In Proceedings of the 2015 CHI Conference on Human Factors in Computing Systems (CHI'15), 103--108. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Rajkumar Darbar, Prasanta Kr Sen and Debasis Smanta. 2016. PressTact: Side Pressure-Based Input for Smartwatch Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 2431--2438. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Artem Dementyev and Joseph A. Paradiso. 2014. WristFlex: Low-Power Gesture Input with Wrist-Worn Pressure Sensors. In Proceedings of the 27th Annual Symposium on User Interface Software and Technology (UIST'14), 161--166. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Markus Funk, Alireza Sahami, Niels Henze and Albrecht Schmidt. 2014. Using a touch-sensitive wristband for text entry on smart watches. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14), 2305--2310. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Linda Di Geronimo, Marica Bertarini, Julia Badertscher, Maria Husmann and Moira C. Norrie. 2017. MyoShare: Sharing Data Among Devices via Mid-Air Gestures. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI'17), Article No.48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Hyunjae Gil, Do Young Lee, Seunggyu Im and Iaan Oakley. 2017. TriTap: Identifying Finger Touches on Smartwatches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17), 3879--3890. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Jun Gong, Lan Li, Daniel Vogel and Xing-Dong Yang. 2017. Cito: An Actuated Smartwatch for Extended Interactions. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17), 5331--5345. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Timo Götzelmann and Pere-Pau Vázquez. 2015. InclineType-An Accelerometer-based Typing Approach for Smartwatches. In Proceedings of the XVI International Conference on Human Computer Interaction (Interaccion'15), Article No.59. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Anhong Guo and Tim Peak. 2016. Exploring Tilt for No-Touch, Wrist-Only Interactions on Smartwatches. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI'16), 17--28. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Aakar Gupta and Ravin Balakrishnan. 2016. DualKey: Miniature Screen Text Entry via Finger Identification. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 59--70. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Chris Harrison and Scott E. Hudson. 2009. Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (UIST'09), 121--124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. S. G. Hart and L. E. Staveland. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Human Mental Workload, North Holland Press, Amserdam, page 46, 1988. P. A. Hancock and N. Meshikati (eds.).Google ScholarGoogle Scholar
  15. Da-Yuan Huang, Liwei Chan, Shuo Yang, Fan Wang, Rong-Hao Liang, De-Nian Yang, Yi-Ping Hung and Bing-Yu Chen. 2016. DigitSpace: Designing Thumb-to Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 1526--1537. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Akira Ishii and Buntarou Shizuki. 2016. Exploring Callout Design in Selection Task for Ultra-small Touch Screen Devices. In Proceedings of the 28th Australian Conference on Computer-Human Interaction (OzCHI'16), 426--434. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Frederic Kerber, Tobias Kiefer, Markus Löchtefeld and Antonio Krüger. 2017. Investigating Current Techniques for Opposite-Hand Smartwatch Interaction. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI'17), Article No.24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Frederic Kerber, Pascal Lessel and Antonio Krüger. 2015. Same-side Hand Interactions with Arm-placed Devices Using EMG. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15), 1367--1372. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Yuki Kubo, Buntarou Shizuki, and Shin Takahashi. 2016. Watch Commander: A Gesture-based Invocation System for Rectangular Smartwatches using B2B-Swipe. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST'16), 37--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Yuki Kubo, Buntarou Shizuki and Jiro Tanaka. 2016. B2B-Swipe: Swipe Gesture for Rectangular Smartwatches from a Bezel to a Bezel. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 3852--3856. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Gierad Laput, Robert Xiao, Xiang Chen, Scott E. Hudson and Chris Harrison. 2014. Skin Buttons: Cheap, Small, Low-Power and Clickable Fixed-Icon Laser Projections. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST'14), 389--394. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Jess McIntosh, Charlie McNeill, Mike Fraaser, Frederic Kerber, Markus Lochtefeld and Antonio Krüger. EMPress: Practical Hand Gesture Classification with Wrist-Mounted EMG and Pressure Sensing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 2232--2342. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Ian Oakley, Carina Lindahl, Khanh Le, Do Young Lee and MD Rasel Islam. 2016. The Flat Finger: Exploring Area Touches on Smartwatches. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 4238--4249. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Masa Ogata and Michita Imai. 2015. SkinWatch: Skin Gesture Interaction for Smart Watch. In Proceedings of the 6th Augmented Human International Conference (AH'15), 21--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Kurt Partridge, Saurav Chatterjee and Roy Want. 2002. TiltType: Accelerometer-Supported Text Entry for Very Small Devices. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (UIST'02), 201--204. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Akilesh Rajavenkatanarayanan, Yoga Vignesh Surathi, Ashwin Ramesh Babu and Michalis Papakostas. 2016. MyoDrive - A new way of interacting with mobile devices. In Proceedings of the 9th ACM International Conference on Pervasive Technologies Related to Assistive Environments (PETRA'16), Article No.18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Jun Rekimoto. 1996. Tilting Operations for Small Screen Interfaces. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology (UIST'96), 167--168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Gabriel Reyes, Dingtian Zhang, Sarthak Ghosh, Pratik Shah, Jason Wu, Aman Parnami, Bailey Bercik, Thad Starner, Gregory D. Abowd and W. Keith Edwards. 2016. Whoosh: Non-Voice Acoustics for Low-Cost, Hands-Free, and Rapid Input on Smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC'16), 120--127. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Tomoki Shibata, Daniel Afergan, Danielle Kong, Beste F. Yuksel, I. Scott MacKenzie and Robert J. K. Jacob. 2016. Text Entry for Ultra-Small Touchscreens Using a Fixed Cursor and Movable Keyboard. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 3770--3773. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Keigo Shima, Kazusa Ohnishi, Ryosuke Takeda, Takuya Adachi, Buntarou Shizuki and Jiro Tanaka. 2016. Investigating Accuracy of Operation on Wrist-worn Devices with Touchscreens. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 2705--2711. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. K. A. Siek, Y. Rogers, Y. and K. H. Connelly. 2005. Fat Finger Worries: How Older and Younger Users Physically Interact with PDAs. In Proceedings of the 2005 IFIP TC13 International Conference on Human-Computer Interaction (INTERACT'05), 267--280. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Ke Sun, Yuntao Wang, Chun Yu, Yukang Yan, Hongyi Wen and Yuanchun Shi. 2017. Float: One-Handed and Touch-Free Target Selection on Smartwatches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17), 692--704. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Hongyi Wen, Julian Ramos Rojas and Anind K. Dey. 2016. Serendipity: Finger Gesture Recognition using an Off-the-Shelf Smartwatch. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 3847--3851. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Dirk Wenig, Johannes Schöning, Alex Olwal, Mathias Oben and Rainer Malaka. 2017. WatchThru: Expanding Smartwatch Displays with Mid-air Visuals and Wrist-worn Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17), 716--721. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Haijun Xia, Tovi Grossman and George Fitzmaurice. 2015. NanoStylus: Enhancing Input on Ultra-Small Displays with a Finger-Mounted Stylus. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST'05), 447--456. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Robert Xiao, Gierad Laput and Chris Harrison. 2014. Expanding the Input Expressivity of Smartwatches with Mechanical Pan, Twist, Tilt and Click. In Proceedings of the 2014 CHI Conference on Human Factors in Computing Systems (CHI'14), 193--196. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Xin Yi, Chun Yu, Weijie Xu, Xiaojun Bi and Yuanchun Shi. 2017. COMPASS: Rotational Keyboard on Non-Touch Smartwatches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17), 705--715. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Yang Zhang, Junhan Zhou, Gierad Laput and Chris Harrison. 2016. SkinTrack: Using the Body as an Electrical Waveguide for Continuous Finger Tracking on the Skin. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI'16), 1491--1503. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Yixin Zhao, Parth H. Pathak, Chao Xu and Prasant Mohapatra. 2015. Demo: Finger and Hand Gesture Recognition using Smartwatch. In Proceedings of the 13th Annual International Congerence on Mobile Systems, Applications, and Services (MobySys'15), 471--471. Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services
    September 2018
    552 pages
    ISBN:9781450358989
    DOI:10.1145/3229434

    Copyright © 2018 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 3 September 2018

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article

    Acceptance Rates

    Overall Acceptance Rate202of906submissions,22%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader