ABSTRACT
Wi-Fi based sensing systems, although sound as being deployed almost everywhere there is Wi-Fi, are still practically difficult to be used without explicit adaptation efforts to new data domains. Various pioneering approaches have been proposed to resolve this contradiction by either translating features between domains or generating domain-independent features at a higher learning level. Still, extra training efforts are necessary in either data collection or model re-training when new data domains appear, limiting their practical usability. To advance cross-domain sensing and achieve fully zero-effort sensing, a domain-independent feature at the lower signal level acts as a key enabler. In this paper, we propose Widar3.0, a Wi-Fi based zero-effort cross-domain gesture recognition system. The key insight of Widar3.0 is to derive and estimate velocity profiles of gestures at the lower signal level, which represent unique kinetic characteristics of gestures and are irrespective of domains. On this basis, we develop a one-fits-all model that requires only one-time training but can adapt to different data domains. We implement this design and conduct comprehensive experiments. The evaluation results show that without re-training and across various domain factors (i.e. environments, locations and orientations of persons), Widar3.0 achieves 92.7% in-domain recognition accuracy and 82.6%-92.4% cross-domain recognition accuracy, outperforming the state-of-the-art solutions. To the best of our knowledge, Widar3.0 is the first zero-effort cross-domain gesture recognition work via Wi-Fi, a fundamental step towards ubiquitous sensing.
- Heba Abdelnasser, Moustafa Youssef, and Khaled A Harras. 2015. Wigest: A Ubiquitous Wifi-based Gesture Recognition System. In Proceedings of IEEE INFOCOM. Kowloon, Hong Kong.Google ScholarCross Ref
- Fadel Adib, Chen-Yu Hsu, Hongzi Mao, Dina Katabi, and Frédo Durand. 2015. Capturing the Human Figure Through a Wall. ACM Transactions on Graphics 34, 6 (November 2015), 219:1--219:13.Google ScholarDigital Library
- Fadel Adib, Zachary Kabelac, and Dina Katabi. 2015. Multi-Person Localization via RF Body Reflections. In Proceedings of USENIX NSDI. Oakland, CA, USA. Google ScholarDigital Library
- Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C Miller. 2014. 3d Tracking via Body Radio Reflections. In Proceedings of USENIX NSDI. Seattle, WA, USA. Google ScholarDigital Library
- Fadel Adib and Dina Katabi. 2013. See Through Walls with Wi-Fi!. In Proceedings of ACM SIGCOMM. Hong Kong, China. Google ScholarDigital Library
- Kamran Ali, Alex X Liu, Wei Wang, and Muhammad Shahzad. 2017. Recognizing keystrokes using WiFi devices. IEEE Journal on Selected Areas in Communications 35, 5 (May 2017), 1175--1190.Google ScholarCross Ref
- Maurizio Bocca, Ossi Kaltiokallio, Neal Patwari, and Suresh Venkatasubramanian. 2014. Multiple Target Tracking with RF Sensor Networks. IEEE Transactions on Mobile Computing 13, 8 (August 2014), 1787--1800.Google ScholarCross Ref
- Andreas Bulling, Ulf Blanke, and Bernt Schiele. 2014. A Tutorial on Human Activity Recognition Using Body-Worn Inertial Sensors. ACM Comput. Surv. 46, 3 (January 2014), 33:1--33:33. Google ScholarDigital Library
- Kaixuan Chen, Lina Yao, Dalin Zhang, Xiaojun Chang, Guodong Long, and Sen Wang. 2018. Distributionally Robust Semi-Supervised Learning for People- Centric Sensing. In Proceedings of AAAI. New Orleans, LA, USA.Google Scholar
- François Chollet et al. 2015. Keras. https://github.com/fchollet/keras.Google Scholar
- Junyoung Chung, Sungjin Ahn, and Yoshua Bengio. 2016. Hierarchical Multiscale Recurrent Neural Networks. CoRR abs/1609.01704 (2016).Google Scholar
- Junyoung Chung, Çaglar Gülçehre, KyungHyun Cho, and Yoshua Bengio. 2014. Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling. CoRR abs/1412.3555 (2014).Google Scholar
- David L Donoho. 2006. Compressed Sensing. IEEE Transactions on Information Theory 52, 4 (April 2006), 1289--1306. Google ScholarDigital Library
- Biyi Fang, Nicholas D Lane, Mi Zhang, Aidan Boran, and Fahim Kawsar. 2016. BodyScan: A Wearable Device for Contact-less Radio-based Sensing of Bodyrelated Activities. In Proceedings of ACM MobiSys. Singapore, Singapore.Google Scholar
- Biyi Fang, Nicholas D Lane, Mi Zhang, and Fahim Kawsar. 2016. HeadScan: A Wearable System for Radio-based Sensing of Head and Mouth-related Activities. In Proceedings of ACM/IEEE IPSN. Vienna, Austria.Google ScholarCross Ref
- Georgia Gkioxari, Ross Girshick, Piotr Dollár, and Kaiming He. 2018. Detecting and Recognizing Human-Object Interactions. In Proceedings of IEEE CVPR. Salt Lake City, UT, USA.Google ScholarCross Ref
- Yu Guan and Thomas Plötz. 2017. Ensembles of Deep LSTM Learners for Activity Recognition Using Wearables. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 2 (June 2017), 11:1--11:28. Google ScholarDigital Library
- Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool Release: Gathering 802.11n Traces with Channel State Information. ACM SIGCOMM Computer Communication Review 41, 1 (January 2011), 53--53. Google ScholarDigital Library
- Donny Huang, Rajalakshmi Nandakumar, and Shyamnath Gollakota. 2014. Feasibility and Limits of Wi-Fi Imaging. In Proceedings of ACM MobiSys. Bretton Woods, NH, USA.Google ScholarDigital Library
- Wenjun Jiang, Chenglin Miao, Fenglong Ma, Shuochao Yao, Yaqing Wang, Ye Yuan, Hongfei Xue, Chen Song, Xin Ma, Dimitrios Koutsonikolas, Wenyao Xu, and Lu Su. 2018. Towards Environment Independent Device Free Human Activity Recognition. In Proceedings of ACM MobiCom. New Delhi, India. Google ScholarDigital Library
- Kiran Joshi, Dinesh Bharadia, Manikanta Kotaru, and Sachin Katti. 2015. Wideo: Fine-grained Device-free Motion Tracing Using RF Backscatter. In Proceedings of USENIX NSDI. Oakland, CA, USA. Google ScholarDigital Library
- Kaustubh Kalgaonkar and Bhiksha Raj. 2009. One-Handed Gesture Recognition Using Ultrasonic Doppler Sonar. In Proceedings of IEEE ICASSP. Taipei, Taiwan. Google ScholarDigital Library
- Hong Li,Wei Yang, JianxinWang, Yang Xu, and Liusheng Huang. 2016. WiFinger: Talk to Your Smart Devices with Finger-grained Gesture. In Proceedings of ACM UbiComp. Heidelberg, Germany. Google ScholarDigital Library
- Tianxing Li, Qiang Liu, and Xia Zhou. 2016. Practical Human Sensing in the Light. In Proceedings of ACM MobiSys. Singapore, Singapore. Google ScholarDigital Library
- Xiang Li, Shengjie Li, Daqing Zhang, Jie Xiong, YashaWang, and Hong Mei. 2016. Dynamic-MUSIC: Accurate Device-Free Indoor Localization. In Proceedings of ACM UbiComp. Heidelberg, Germany. Google ScholarDigital Library
- Xiang Li, Daqing Zhang, Qin Lv, Jie Xiong, Shengjie Li, Yue Zhang, and Hong Mei. 2017. IndoTrack: Device-Free Indoor Human Tracking with Commodity Wi-Fi. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (September 2017), 72:1--72:22.Google ScholarDigital Library
- Cihang Liu, Lan Zhang, Zongqian Liu, Kebin Liu, Xiangyang Li, and Yunhao Liu. 2016. Lasagna: Towards Deep Hierarchical Understanding and Searching over Mobile Sensing Data. In Proceedings of ACM MobiCom. New York City, NY, USA. Google ScholarDigital Library
- Yongsen Ma, Gang Zhou, ShuangquanWang, Hongyang Zhao, andWoosub Jung. 2018. SignFi: Sign Language Recognition Using WiFi. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (March 2018), 23:1--23:21. Google ScholarDigital Library
- Rajalakshmi Nandakumar, Alex Takakuwa, Tadayoshi Kohno, and Shyamnath Gollakota. 2017. Covertband: Activity Information Leakage Using Music. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (September 2017), 87:1--87:24. Google ScholarDigital Library
- Kai Niu, Fusang Zhang, Jie Xiong, Xiang Li, Enze Yi, and Daqing Zhang. 2018. Boosting Fine-grained Activity Sensing by Embracing Wireless Multipath Effects. In Proceedings of ACM CoNEXT. Heraklion/Crete, Greece. Google ScholarDigital Library
- Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole- Home Gesture Recognition Using Wireless Signals. In Proceedings of ACM Mobi- Com. Miami, FL, USA. Google ScholarDigital Library
- Kun Qian, ChenshuWu, Zheng Yang, Yunhao Liu, and Kyle Jamieson. 2017. Widar: Decimeter-Level Passive Tracking via Velocity Monitoring with Commodity Wi- Fi. In Proceedings of ACM MobiHoc. Chennai, India. Google ScholarDigital Library
- Kun Qian, ChenshuWu, Yi Zhang, Guidong Zhang, Zheng Yang, and Yunhao Liu. 2018. Widar2.0: Passive Human Tracking with a Single Wi-Fi Link. In Proceedings of ACM MobiSys. Munich, Germany. Google ScholarDigital Library
- Kun Qian, Chenshu Wu, Zimu Zhou, Yue Zheng, Zheng Yang, and Yunhao Liu. 2017. Inferring Motion Direction Using Commodity Wi-Fi for Interactive Exergames. In Proceedings of ACM CHI. Denver, CO, USA. Google ScholarDigital Library
- Yossi Rubner, Carlo Tomasi, and Leonidas J Guibas. 2000. The Earth Mover's Distance as a Metric for Image Retrieval. International Journal of Computer Vision 40, 2 (November 2000), 99--121. Google ScholarDigital Library
- Sheng Shen, HeWang, and Romit Roy Choudhury. 2016. I am a Smartwatch and I can Track my User's Arm. In Proceedings of ACM MobiSys. Singapore, Singapore. Google ScholarDigital Library
- Rui Shu, Hung H Bui, Hirokazu Narui, and Stefano Ermon. 2018. A DIRT-T Approach to Unsupervised Domain Adaptation. In Proceedings of ICLR. Vancouver, Canada.Google Scholar
- Raghav H. Venkatnarayan, Griffin Page, and Muhammad Shahzad. 2018. Multi- User Gesture Recognition Using WiFi. In Proceedings of ACM MobiSys. Munich, Germany.Google ScholarDigital Library
- Aditya Virmani and Muhammad Shahzad. 2017. Position and Orientation Agnostic Gesture Recognition Using WiFi. In Proceedings of ACM MobiSys. Niagara Falls, NY, USA. Google ScholarDigital Library
- JindongWang, Yiqiang Chen, Lisha Hu, Xiaohui Peng, and Philip S Yu. 2017. Stratified Transfer Learning for Cross-domain Activity Recognition. In Proceedings of IEEE PerCom. Big Island, HI, USA.Google Scholar
- Ju Wang, Hongbo Jiang, Jie Xiong, Kyle Jamieson, Xiaojiang Chen, Dingyi Fang, and Binbin Xie. 2016. LiFS: Low Human-effort, Device-free Localization with Fine-grained Subcarrier Information. In Proceedings of ACM MobiCom. New York City, NY, USA. Google ScholarDigital Library
- Minsi Wang, Bingbing Ni, and Xiaokang Yang. 2017. Recurrent Modeling of Interaction Context for Collective Activity Recognition. In Proceedings of IEEE CVPR. Honolulu, HI, USA.Google ScholarCross Ref
- Wei Wang, Alex X Liu, and Muhammad Shahzad. 2016. Gait Recognition Using WiFi Signals. In Proceedings of ACM UbiComp. Heidelberg, Germany. Google ScholarDigital Library
- Wei Wang, Alex X Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2017. Device-Free Human Activity Recognition Using Commercial WiFi Devices. IEEE Journal on Selected Areas in Communications 35, 5 (May 2017), 1118--1131.Google ScholarDigital Library
- Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. 2014. E-eyes: Device-free Location-oriented Activity Identification Using Fine-grained WiFi Signatures. In Proceedings of ACM MobiCom. Maui, HI, USA. Google ScholarDigital Library
- Zheng Yang, Zimu Zhou, and Yunhao Liu. 2013. From RSSI to CSI: Indoor Localization via Channel Response. ACM Comput. Surv. 46, 2 (November 2013), 25:1--25:32. Google ScholarDigital Library
- Shuochao Yao, Shaohan Hu, Yiran Zhao, Aston Zhang, and Tarek Abdelzaher. 2017. DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing. In Proceedings of ACM WWW. Perth, Australia.Google ScholarDigital Library
- Koji Yatani and Khai N Truong. 2012. BodyScope: A Wearable Acoustic Sensor for Activity Recognition. In Proceedings of ACM UbiComp. Pittsburgh, PA, USA. Google ScholarDigital Library
- Yunze Zeng, Parth H Pathak, and Prasant Mohapatra. 2016. WiWho: WiFi-Based Person Identification in Smart Spaces. In Proceedings of ACM/IEEE IPSN. Vienna, Austria. Google ScholarDigital Library
- Jie Zhang, Zhanyong Tang, Meng Li, Dingyi Fang, Petteri Tapio Nurmi, and Zheng Wang. 2018. CrossSense: Towards Cross-Site and Large-Scale WiFi Sensing. In Proceedings of ACM MobiCom. New Delhi, India.Google ScholarDigital Library
- Mingmin Zhao, Tianhong Li, Mohammad Abu Alsheikh, Yonglong Tian, Hang Zhao, Antonio Torralba, and Dina Katabi. 2018. Through-Wall Human Pose Estimation Using Radio Signals. In Proceedings of IEEE CVPR. Salt Lake City, UT, USA.Google ScholarCross Ref
- Mingmin Zhao, Yonglong Tian, Hang Zhao, Mohammad Abu Alsheikh, Tianhong Li, Rumen Hristov, Zachary Kabelac, Dina Katabi, and Antonio Torralba. 2018. RF-Based 3D Skeletons. In Proceedings of ACM SIGCOMM. Budapest, Hungary. Google ScholarDigital Library
- Zhongtang Zhao, Yiqiang Chen, Junfa Liu, Zhiqi Shen, and Mingjie Liu. 2011. Cross-People Mobile-Phone Based Activity Recognition. In Proceedings of IJCAI. Barcelona, Spain. Google ScholarDigital Library
- Yue Zheng, ChenshuWu, Kun Qian, Zheng Yang, and Yunhao Liu. 2017. Detecting Radio Frequency Interference for CSI Measurements on COTS WiFi Devices. In Proceedings of IEEE ICC. Paris, France.Google ScholarCross Ref
Index Terms
- Zero-Effort Cross-Domain Gesture Recognition with Wi-Fi
Recommendations
Cross-Domain WiFi Sensing with Channel State Information: A Survey
The past years have witnessed the rapid conceptualization and development of wireless sensing based on Channel State Information (CSI) with commodity WiFi devices. Recent studies have demonstrated the vast potential of WiFi sensing in detection, ...
Cross-Domain Wi-Fi Sign Language Recognition with GANs
ICCBN '22: Proceedings of the 10th International Conference on Communications and Broadband NetworkingHuman gesture recognition based on Channel State Information (CSI) is an important area in human-computer interaction. However, most of the previous works are conducted in the same domain (including environment and user), and in fact, the performance ...
Attention-Based Cross-Domain Gesture Recognition Using WiFi Channel State Information
Algorithms and Architectures for Parallel ProcessingAbstractGesture recognition is an important step to realize ubiquitous WiFi-based human-computer interaction. However, most current WiFi-based gesture recognition systems rely on domain-specific training. To address this issue, we propose an attention-...
Comments