Liwei Chan
Bing-Yu Chen
ABSTRACT
This paper presents CyclopsRing, a ring-style fisheye imaging wearable device that can be worn on hand webbings to en- able whole-hand and context-aware interactions. Observing from a central position of the hand through a fisheye perspective, CyclopsRing sees not only the operating hand, but also the environmental contexts that involve with the hand-based interactions. Since CyclopsRing is a finger-worn device, it also allows users to fully preserve skin feedback of the hands. This paper demonstrates a proof-of-concept device, reports the performance in hand-gesture recognition using random decision forest (RDF) method, and, upon the gesture recognizer, presents a set of interaction techniques including on-finger pinch-and-slide input, in-air pinch-and-motion input, palm-writing input, and their interactions with the environ- mental contexts. The experiment obtained an 84.75% recognition rate of hand gesture input from a database of seven hand gestures collected from 15 participants. To our knowledge, CyclopsRing is the first ring-wearable device that supports whole-hand and context-aware interactions.
Supplemental Material
- Bailly, G., Müller, J., Rohs, M., Wigdor, D., and Kratz, S. ShoeSense: A new perspective on gestural interaction and wearable applications. In Proc. ACM CHI '12 (2012), 1239--1248. Google Scholar
Digital Library
- Bay, H., Tuytelaars, T., and Van Gool, L. Surf: Speeded up robust features. In Computer Vision ECCV 2006, vol. 3951 of Lecture Notes in Computer Science. 2006, 404--417. Google ScholarDigital Library
- Chan, L., Hsieh, C.-H., Chen, Y.-L., Yang, S., Huang, D.-Y., Liang, R.-H., and Chen, B.-Y. Cyclops: Wearable and single-piece full-body gesture input devices. In Proc. ACM CHI '15 (2015), 3001--3009. Google ScholarDigital Library
- Chan, L., Liang, R.-H., Tsai, M.-C., Cheng, K.-Y., Su, C.-H., Chen, M. Y., Cheng, W.-H., and Chen, B.-Y. FingerPad: Private and subtle interaction using fingertips. In Proc. ACM UIST '13 (2013), 255--260. Google ScholarDigital Library
- Chen, K.-Y., Lyons, K., White, S., and Patel, S. uTrack: 3D input using two magnetic sensors. In Proc. ACM UIST '13 (2013), 237--244. Google ScholarDigital Library
- Colaco, A., Kirmani, A., Yang, H. S., Gong, N.-W., Schmandt, C., and Goyal, V. K. Mime: Compact, low power 3D gesture sensing for interaction with head mounted displays. In Proc. ACM UIST '13 (2013), 227--236. Google ScholarDigital Library
- Criminisi, A., and Shotton, J. Decision Forests for Computer Vision and Medical Image Analysis. Springer, 2013. Google ScholarCross Ref
- Dementyev, A., and Paradiso, J. A. WristFlex: Low-power gesture input with wrist-worn pressure sensors. In Proc. ACM UIST '14 (2014), 161--166. Google ScholarDigital Library
- Fiala, M. ARTag, a fiducial marker system using digital techniques. In Proc. IEEE CVPR '05, vol. 2 (June 2005), 590--596 vol. 2. Google ScholarDigital Library
- Fukui, R., Watanabe, M., Gyota, T., Shimosaka, M., and Sato, T. Hand shape classification with a wrist contour sensor: Development of a prototype device. In Proc. UbiComp '11 (2011), 311--314. Google ScholarDigital Library
- Gustafson, S., Bierwirth, D., and Baudisch, P. Imaginary interfaces: Spatial interaction with empty hands and without visual feedback. In Proc. ACM UIST '10 (2010), 3--12. Google ScholarDigital Library
- Harrison, C., Benko, H., and Wilson, A. D. OmniTouch: Wearable multitouch interaction everywhere. In Proc. ACM UIST '11 (2011), 441--450. Google ScholarDigital Library
- Harrison, C., and Hudson, S. E. Abracadabra: Wireless, high-precision, and unpowered finger input for very small mobile devices. In Proc. ACM UIST '09 (2009), 121--124. Google ScholarDigital Library
- Harrison, C., Tan, D., and Morris, D. Skinput: Appropriating the body as an input surface. In Proc. ACM CHI '10 (2010), 453--462. Google ScholarDigital Library
- Jing, L., Cheng, Z., Zhou, Y., Wang, J., and Huang, T. Magic ring: A self-contained gesture input device on finger. In Proc. ACM MUM '13 (2013), 39:1--39:4. Google ScholarDigital Library
- Kienzle, W., and Hinckley, K. Lightring: Always-available 2D input on any surface. In Proc. ACM UIST '14 (2014), 157--160. Google ScholarDigital Library
- Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., and Olivier, P. Digits: Freehand 3D interactions anywhere using a wrist-worn gloveless sensor. In Proc. ACM UIST '12 (2012), 167--176. Google ScholarDigital Library
- Loclair, Christian, G. S., and Baudisch, P. Pinchwatch: A wearable device for one-handed microinteractions.Google Scholar
- Mistry, P., and Maes, P. SixthSense: A wearable gestural interface. In Proc. ACM SIGGRAPH Asia '09 Sketches (2009), 11:1--11:1. Google ScholarDigital Library
- Mistry, P., Maes, P., and Chang, L. WUW - wear ur world: A wearable gestural interface. In Proc. ACM CHI EA '09 (2009), 4111--4116. Google ScholarDigital Library
- Mujibiya, A., Cao, X., Tan, D. S., Morris, D., Patel, S. N., and Rekimoto, J. The sound of touch: On-body touch and gesture sensing based on transdermal ultrasound propagation. In Proc. ACM ITS '13 (2013), 189--198. Google ScholarDigital Library
- Nanayakkara, S., Shilkrot, R., Yeo, K. P., and Maes, P. Eyering: A finger-worn input device for seamless interactions with our surroundings. In Proc. ACM AH '13 (2013), 13--20. Google ScholarDigital Library
- Ogata, M., Sugiura, Y., Osawa, H., and Imai, M. iRing: Intelligent ring using infrared reflection. In Proc. ACM UIST '12 (2012), 131--136. Google ScholarDigital Library
- Pratorius, M., Valkov, D., Burgbacher, U., and Hinrichs, K. DigiTap: An eyes-free VR/AR symbolic input device. In Proc. ACM VRST '14 (2014), 9--18. Google ScholarDigital Library
- Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J., and Landay, J. A. Enabling always-available input with muscle-computer interfaces. In Proc. ACM UIST '09 (2009), 167--176. Google ScholarDigital Library
- Sato, M., Poupyrev, I., and Harrison, C. Touche;: Enhancing touch interaction on humans, screens, liquids, and everyday objects. In Proc. ACM CHI '12 (2012), 483--492. Google ScholarDigital Library
- Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A. Real-time human pose recognition in parts from single depth images. In Proc. IEEE CVPR '11 (2011), 1297--1304. Google ScholarDigital Library
- Song, J., Sörös, G., Pece, F., Fanello, S. R., Izadi, S., Keskin, C., and Hilliges, O. In-air gestures around unmodified mobile devices. In Proc. ACM UIST '14 (2014), 319--329. Google ScholarDigital Library
- Tamaki, E., Miyaki, T., and Rekimoto, J. Brainy hand: An ear-worn hand gesture interaction device. In Proc. ACM CHI EA '09 (2009), 4255--4260. Google ScholarDigital Library
- Taylor, S., Keskin, C., Hilliges, O., Izadi, S., and Helmes, J. Type-hover-swipe in 96 bytes: A motion sensing mechanical keyboard. In Proc. ACM CHI '14 (2014), 1695--1704. Google ScholarDigital Library
- Viola, P., and Jones, M. Rapid object detection using a boosted cascade of simple features. In Proc. IEEE CVPR '01 (2001), 511--518.Google ScholarCross Ref
- Yang, X.-D., Hasan, K., Bruce, N., and Irani, P. Surround-see: Enabling peripheral vision on smartphones during active use. In Proc. ACM UIST '13 (2013). Google ScholarDigital Library
Index Terms
- CyclopsRing: Enabling Whole-Hand and Context-Aware Interactions Through a Fisheye Ring
Recommendations
FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures
ISS '18: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and SpacesSingle-hand thumb-to-finger microgestures have shown great promise for expressive, fast and direct interactions. However, pioneering gesture recognition systems each focused on a particular subset of gestures. We are still in lack of systems that can ...
PrinType: Text Entry via Fingerprint Recognition
We present PrinType, a fingerprint recognition based typing technique for virtual reality. Different regions of fingers covered by friction ridges are assigned to different keys (i.e. letters, numbers, punctuation, or functions). Once the thumb-worn ...
FingOrbits: interaction with wearables using synchronized thumb movements
ISWC '17: Proceedings of the 2017 ACM International Symposium on Wearable ComputersWe present FingOrbits, a wearable interaction technique using synchronized thumb movements. A thumb-mounted ring with an inertial measurement unit and a contact microphone are used to capture thumb movements when rubbing against the other fingers. ...
Comments