Pedro Melgarejo
David Chu
ABSTRACT
This paper presents a recognition scheme for fine-grain gestures. The scheme leverages directional antenna and short-range wireless propagation properties to recognize a vocabulary of action-oriented gestures from the American Sign Language. Since the scheme only relies on commonly available wireless features such as Received Signal Strength (RSS), signal phase differences, and frequency subband selection, it is readily deployable on commercial-off-the-shelf IEEE 802.11 devices. We have implemented the proposed scheme and evaluated it in two potential application scenarios: gesture-based electronic activation from wheelchair and gesture-based control of car infotainment system. The results show that the proposed scheme can correctly identify and classify up to 25 fine-grain gestures with an average accuracy of 92% for the first application scenario and 84% for the second scenario.
Supplemental Material
- Adib, F., and Katabi, D. See Through Walls with WiFi! In Proc. of ACM SIGCOMM (2013). Google Scholar
Digital Library
- Agrawal, S., Constandache, I., Gaonkar, S., Roy Choudhury, R., Caves, K., and DeRuyter, F. Using Mobile Phones to Write in Air. In Proc. of ACM MobiSys (2011). Google ScholarDigital Library
- Cohn, G., Morris, D., Patel, S., and Tan, D. Humantenna: Using the Body As an Antenna for Real-time Whole-body Interaction. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (2012). Google ScholarDigital Library
- Gupta, S., Morris, D., Patel, S., and Tan, D. SoundWave: Using the Doppler Effect to Sense Gestures. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (2012). Google ScholarDigital Library
- Halperin, D., Hu, W., Sheth, A., and Wetherall, D. Predictable 802.11 Packet Delivery from Wireless Channel Measurements. In Proc. of ACM SIGCOMM (2010). Google ScholarDigital Library
- IEEE Standard. 802.11#8482;: Amendment 3: Enhancements for Very High Throughput in the 60 GHz Band, 2012.Google Scholar
- Ketabdar, H., Moghadam, P., Naderi, B., and Roshandel, M. Magnetic Signatures in Air for Mobile Devices. In Proc. of International Conference on Human-computer Interaction with Mobile Devices and Services Companion (Mobile HCI) (2012). Google ScholarDigital Library
- Ketabdar, H., Roshandel, M., and Yüksel, K. A. Towards Using Embedded Magnetic Field Sensor for Around Mobile Device 3D Interaction. In Proc. of International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI) (2010). Google ScholarDigital Library
- Kirk McElhearn. Leap Motion Controller Fails in Normal Conditions, http://www.mcelhearn.com/not-a-review-leap-motion-controller-fails-in-normal-conditions/, 2014.Google Scholar
- Kruskal, J. B., and Liberman, M. The symmetric time-warping problem: from continuous to discrete. In Time Warps, String Edits, and Macromolecules - The Theory and Practice of Sequence Comparison, D. Sankoff and J. B. Kruskal, Eds. CSLI Publications, 1999.Google Scholar
- Leap Motion, Inc. Leap Motion: Mac & PC Gesture Controller for Game, Design and More. https://www.leapmotion.com/, 2013.Google Scholar
- Mango Communications.WARP 802.11 Reference Design. http://warpproject.org/trac/wiki/802.11, 2013.Google Scholar
- Park, T., Lee, J., Hwang, I., Yoo, C., Nachman, L., and Song, J. E-Gesture: A Collaborative Architecture for Energy-efficient Gesture Recognition with Hand-worn Sensor and Mobile Devices. In Proc. of ACM SenSys (2011). Google ScholarDigital Library
- Pickering, C. A., Burnham, K. J., and Richardson, M. J. A Research Study of Hand Gesture Recognition Technologies and Applications for Human Vehicle Interaction. In Institution of Engineering and Technology Conference on Automotive Electronics (2007).Google Scholar
- Pu, Q., Gupta, S., Gollakota, S., and Patel, S. Whole-home Gesture Recognition Using Wireless Signals. In Proc. of ACM MobiCom (2013). Google ScholarDigital Library
- Rehg, J., and Knade, T. Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking. In European Conference on Computer Vision (1994). Google ScholarDigital Library
- RoboRealm. Microsoft Kinect, http://www.roborealm.com/help/Microsoft_Kinect.php, 2013.Google Scholar
- Saba, E., Larson, E., and Patel, S. Dante Vision: In-Air and Touch Gesture Sensing for Natural Surface Interaction With Combined Depth and Thermal Cameras. In IEEE International Conference on Emerging Signal Processing Applications (ESPA) (2012).Google Scholar
- Salvador, S., and Chan, P. Toward accurate dynamic time warping in linear time and space. Intell. Data Anal. 11, 5 (2007). Google ScholarDigital Library
- Scholz, M., Riedel, T., Hock, M., and Beigl, M. Device-free and Device-bound Activity Recognition Using Radio Signal Strength. In Proc. of the Augmented Human International Conference (2013). Google ScholarDigital Library
- Sen, S., Lee, J., Kim, K.-H., and Congdon, P. Avoiding Multipath to Revive Inbuilding WiFi Localization. In Proc. of ACM MobiSys (2013). Google ScholarDigital Library
- Smith, J. R. Field Mice: Extracting Hand Geometry from Electric Field Measurements. IBM Systems Journal, 3/4. Google ScholarDigital Library
- Starner, T., and Pentland, A. Real-time American Sign Language Recognition from Video Using Hidden Markov Models. In Proc. of International Symposium on Computer Vision (1995). Google ScholarDigital Library
- Tarzia, S. P., Dick, R. P., Dinda, P. A., and Memik, G. Sonar-based Measurement of User Presence and Attention. In Proc. of ACM UbiComp (2009). Google ScholarDigital Library
- Tse, D., and Viswanath, P. Fundamentals of Wireless Communication. Cambridge University Press, 2005. Google ScholarDigital Library
- Wachs, J. P., Kölsch, M., Stern, H., and Edan, Y. Vision-based Hand-gesture Applications. Communications of the ACM 54, 2 (2011). Google ScholarDigital Library
- Wilson, J., and Patwari, N. Radio Tomographic Imaging with Wireless Networks. IEEE Transactions on Mobile Computing 9, 5 (2010). Google ScholarDigital Library
- Xie, X., Zhang, X., and Sundaresan, K. Adaptive feedback compression for mimo networks. In Proc. of ACM MobiCom (2013). Google ScholarDigital Library
- Zhao, Y., Patwari, N., Phillips, J. M., and Venkatasubramanian, S. Radio Tomographic Imaging and Tracking of Stationary and Moving People via Kernel Distance. In Proc. of ACM/IEEE IPSN (2013). Google ScholarDigital Library
Index Terms
- Leveraging directional antenna capabilities for fine-grained gesture recognition
Recommendations
Miniaturization of Microstrip Antenna by CRLH-TL Technique
In this paper, an electrically small microstrip antenna has been presented by employing composite right/left-handed transmission line. The prototype antenna was designed by using Interdigital capacitor and spiral inductor. It is fabricated and printed ...
Bandwidth Enhancement of Slotted Rectangular Wideband Microstrip Antenna for the Application of WLAN/WiMAX
AbstractIn this research paper, compact and slotted patch antenna geometry of size (30.8 × 37.2 mm) has been designed and investigated at frequency 3.30 GHz. The proposed antenna covers 2.08–3.99 GHz frequency band suitable for S-band (2–4 GHz) wireless ...
3D human gesture capturing and recognition by the IMMU-based data glove
Gestures recognition provides an intelligent, natural, and convenient way for humanrobot interaction (HRI). This paper presents a novel data glove for gestures capturing and recognition based on inertial and magnetic measurement units (IMMUs), which are ...
Comments