skip to main content
10.1145/3241539.3241570acmconferencesArticle/Chapter ViewAbstractPublication PagesmobicomConference Proceedingsconference-collections
research-article
Open Access

CrossSense: Towards Cross-Site and Large-Scale WiFi Sensing

Published:15 October 2018Publication History

ABSTRACT

We present CrossSense, a novel system for scaling up WiFi sensing to new environments and larger problems. To reduce the cost of sensing model training data collection, CrossSense employs machine learning to train, off-line, a roaming model that generates from one set of measurements synthetic training samples for each target environment. To scale up to a larger problem size, CrossSense adopts a mixture-of-experts approach where multiple specialized sensing models, or experts, are used to capture the mapping from diverse WiFi inputs to the desired outputs. The experts are trained offline and at runtime the appropriate expert for a given input is automatically chosen. We evaluate CrossSense by applying it to two representative WiFi sensing applications, gait identification and gesture recognition, in controlled single-link environments. We show that CrossSense boosts the accuracy of state-of-the-art WiFi sensing techniques from 20% to over 80% and 90% for gait identification and gesture recognition respectively, delivering consistently good performance - particularly when the problem size is significantly greater than that current approaches can effectively handle.

References

  1. Heba Abdelnasser et almbox. 2015a. UbiBreathe: A Ubiquitous non-Invasive WiFi-based Breathing Estimator. In MobiHoc . Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Heba Abdelnasser et almbox. 2015b. WiGest: A ubiquitous WiFi-based gesture recognition system. In INFOCOM .Google ScholarGoogle Scholar
  3. Fadel Adib et almbox. 2014a. 3D tracking via body radio reflections. In NSDI . Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Fadel Adib et almbox. 2014b. Demo: real-time breath monitoring using wireless signals. MobiCom . Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Fadel Adib et almbox. 2015a. Capturing the Human Figure Through a Wall. ACM Transactions on Graphics (2015). Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Fadel Adib et almbox. 2015b. Multi-Person Localization via RF Body Reflections. In NSDI . Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Fadel Adib et almbox. 2015c. Smart Homes That Monitor Breathing and Heart Rate. In CHI . Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Fadel Adib and Dina Katabi. 2013. See through walls with WiFi!. In SIGCOMM . Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Kamran Ali et almbox. 2015. Keystroke Recognition Using WiFi Signals. In MobiCom . Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Kamran Ali et almbox. 2017. Recognizing keystrokes using WiFi devices. IEEE Journal on Selected Areas in Communications (2017).Google ScholarGoogle Scholar
  11. Heba Aly and Moustafa Youssef. 2015. An Analysis of Device-Free and Device-Based WiFi-Localization Systems. In IJACI . Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Anthony Bagnall et almbox. 2015. Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles. IEEE Transactions on Knowledge and Data Engineering (2015).Google ScholarGoogle Scholar
  13. L. Chang et almbox. 2017. FitLoc: Fine-Grained and Low-Cost Device-Free Localization for Multiple Targets Over Various Areas. IEEE/ACM Transactions on Networking (2017). Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Bo Chen et almbox. 2015. Tracking Keystrokes Using Wireless Signals. In MobiSys . Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. David A Cohn et almbox. 1996. Active learning with statistical models. Journal of Artificial Intelligence Research (1996). Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Diane Cook et almbox. 2013. Transfer learning for activity recognition: A survey. Knowledge and Information Systems (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Chris Cummins et almbox. 2017. End-to-end deep learning of optimization heuristics. In PACT .Google ScholarGoogle Scholar
  18. Simone Di Domenico et almbox. 2016. A Trained-once Crowd Counting Method Using Differential WiFi Channel State Information. In International on Workshop on Physical Analytics . Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Murali Krishna Emani and Michael O'Boyle. 2015. Celebrating Diversity: A Mixture of Experts Approach for Runtime Mapping in Dynamic Environments. In PLDI . Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Wolfgang Ertel. 1994. On the definition of speedup. In International Conference on Parallel Architectures and Languages Europe . Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Daniel Garcia-Romero et almbox. 2017. Speaker diarization using deep neural network embeddings. In ICASSP .Google ScholarGoogle Scholar
  22. Y. Guan et almbox. 2015. On Reducing the Effect of Covariate Factors in Gait Recognition: A Classifier Ensemble Method. IEEE Transactions on Pattern Analysis and Machine Intelligence (2015).Google ScholarGoogle Scholar
  23. Srinivas Gutta and Harry Wechsler. 1996. Face recognition using hybrid classifier systems. In ICNN .Google ScholarGoogle Scholar
  24. Dan Halperin. {n. d.}. Linux-80211n-csitool. http://dhalperi.github.io/linux-80211n-csitool/.Google ScholarGoogle Scholar
  25. Chunmei Han et almbox. 2014. WiFall: Device-free fall detection by wireless networks. In INFOCOM .Google ScholarGoogle Scholar
  26. Wenfeng He et almbox. 2015. WiG: WiFi-Based Gesture Recognition System. In ICCCN .Google ScholarGoogle Scholar
  27. Feng Hong et almbox. 2016. WFID: Passive Device-free Human Identification Using WiFi Signal. In MOBIQUITOUS . Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Chen-Yu Hsu et almbox. 2017. Extracting Gait Velocity and Stride Length from Surrounding Radio Signals. In CHI . Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Zhiping Jiang et almbox. 2013. Rejecting the attack: Source authentication for wi-fi management frames using csi information. In INFOCOM .Google ScholarGoogle Scholar
  30. Michael I. Jordan and Robert A. Jacobs. 1994. Hierarchical Mixtures of Experts and the EM Algorithm. Neural Comput. (1994). Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Ehud D Karnin. 1990. A simple procedure for pruning back-propagation trained neural networks. IEEE Transactions on Neural Networks (1990). Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Bryce Kellogg et almbox. 2014. Bringing gesture recognition to all devices. In NSDI . Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Jin Kun et almbox. 2017. Vivisnoop: Someone is snooping your typing without seeing it!. In CNS .Google ScholarGoogle Scholar
  34. Mengyuan Li et almbox. 2016. When CSI Meets Public WiFi: Inferring Your Mobile Phone Password via WiFi Signals. In CCS . Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Hongbo Liu et almbox. 2014. Practical User Authentication Leveraging Channel State Information (CSI). In ASIA CCS . Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Xuefeng Liu et almbox. 2015. Wi-Sleep: Contactless Sleep Monitoring via WiFi Signals. In RTSS .Google ScholarGoogle Scholar
  37. Bastien Lyonnet et almbox. 2010. Human gait classification using microdoppler time-frequency signal representations. In RadarConf .Google ScholarGoogle Scholar
  38. B. Mager et almbox. 2013. Fall detection using RF sensor networks. In PIMRC .Google ScholarGoogle Scholar
  39. Vicent Sanz Marco et almbox. 2017. Improving spark application throughput via memory aware task co-location: a mixture of experts approach. In Middleware .Google ScholarGoogle Scholar
  40. Pedro Melgarejo et almbox. 2014. Leveraging directional antenna capabilities for fine-grained gesture recognition. In UbiComp . Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Pavlo Molchanov et almbox. 2015. Short-range FMCW monopulse radar for hand-gesture sensing. In RadarConf .Google ScholarGoogle Scholar
  42. Rajalakshmi Nandakumar et almbox. 2014. Wi-Fi Gesture Recognition on Existing Devices. Arxiv (2014).Google ScholarGoogle Scholar
  43. William Ogilvie et almbox. 2014. Fast automatic heuristic construction using active learning. In LCPC .Google ScholarGoogle Scholar
  44. William F Ogilvie et almbox. 2017. Minimizing the cost of iterative compilation with active learning. In CGO . Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Sameera Palipana et almbox. 2018. FallDeFi: Ubiquitous Fall Detection using Commodity Wi-Fi Devices. In UbiComp . Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Sinno Jialin Pan et almbox. 2008. Transfer learning via dimensionality reduction.. In AAAI .Google ScholarGoogle Scholar
  47. Neal Patwari et almbox. 2011. Monitoring Breathing via Signal Strength in Wireless Networks. In IEEE Transactions on Mobile Computing .Google ScholarGoogle Scholar
  48. Neal Patwari et almbox. 2013. Breathfinding: A Wireless Network That Monitors and Locates Breathing in a Home. IEEE Journal of Selected Topics in Signal Processing (2013).Google ScholarGoogle Scholar
  49. Fabian Pedregosa et almbox. 2011. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research (2011). Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Qifan Pu et almbox. 2013. Whole-home gesture recognition using wireless signals. In MobiCom . Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Kun Qian et almbox. 2017. Inferring Motion Direction using Commodity Wi-Fi for Interactive Exergames. In CHI . Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Stan Salvador and Philip Chan. 2007. Toward accurate dynamic time warping in linear time and space. Intelligent Data Analysis (2007). Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Muhammad Shahzad et almbox. 2017. Behavior Based Human Authentication on Touch Screen Devices Using Gestures and Signatures. IEEE Transactions on Mobile Computing (2017).Google ScholarGoogle Scholar
  54. Jiacheng Shang and Jie Wu. 2017a. A Robust Sign Language Recognition System with Multiple Wi-Fi Devices. In MobiArch . Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Jiacheng Shang and Jie Wu. 2017b. A Robust Sign Language Recognition System with Sparsely Labeled Instances Using Wi-Fi Signals. In MobiHoc .Google ScholarGoogle Scholar
  56. Longfei Shangguan et almbox. 2017. Enabling Gesture-based Interactions with Objects. In MobiSys . Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Cong Shi et almbox. 2017. Smart User Authentication through Actuation of Daily Activities Leveraging WiFi-enabled IoT. In MobiHoc . Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Stephan Sigg et almbox. 2013. Leveraging RF-channel fluctuation for activity recognition: Active and passive systems, continuous and RSSI-based signal features. In MoMM . Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Stephan Sigg et almbox. 2014. RF-Sensing of Activities from Non-Cooperative Subjects in Device-Free Recognition Systems Using Ambient and Local Signals. IEEE Transactions on Mobile Computing (2014). Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Stephan others Sigg. 2014. The telepathic phone: Frictionless activity recognition from WiFi-RSSI. In PerCom .Google ScholarGoogle Scholar
  61. Hichem Snoussi and Cédric Richard. 2006. Ensemble learning online filtering in wireless sensor networks. In ICCS .Google ScholarGoogle Scholar
  62. Sheng Tan and Jie Yang. 2016. WiFinger: leveraging commodity WiFi for fine-grained finger gesture recognition. In MobiHoc . Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Xiaohua Tian et almbox. 2017. Performance Analysis of RSS Fingerprinting Based Indoor Localization. IEEE Transactions on Mobile Computing (2017).Google ScholarGoogle Scholar
  64. Xiaohua Tian et almbox. 2018. Improve Accuracy of Fingerprinting Localization with Temporal Correlation of the RSS. IEEE Transactions on Mobile Computing (2018).Google ScholarGoogle Scholar
  65. H. T. T. Truong et almbox. 2014. Comparing and fusing different sensor modalities for relay attack resistance in Zero-Interaction Authentication. In PerCom .Google ScholarGoogle Scholar
  66. Aditya Virmani and Muhammad Shahzad. 2017. Position and Orientation Agnostic Gesture Recognition Using WiFi. In MobiSys . Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Guanhua Wang et almbox. 2014a. We Can Hear You with Wi-Fi!. In MobiCom . Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Hao Wang et almbox. 2016a. Human respiration detection with commodity wifi devices: do user location and body orientation matter?. In UbiComp . Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Ju Wang et almbox. 2016b. LiFS: low human-effort, device-free localization with fine-grained subcarrier information. In MobiCom . Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Ju Wang et almbox. 2017. TagScan: Simultaneous Target Imaging and Material Identification with Commodity RFID Devices. In MobiCom . Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. J. Wang et almbox. 2018a. Device-free Wireless Sensing in Complex Scenarios Using Spatial Structural Information. IEEE Transactions on Wireless Communications (2018).Google ScholarGoogle Scholar
  72. Jindong Wang et almbox. 2018b. Stratified Transfer Learning for Cross-domain Activity Recognition. In PerCom .Google ScholarGoogle Scholar
  73. Jue Wang and Dina Katabi. 2013. Dude, where's my card?: RFID positioning that works with multipath and non-line of sight. In SIGCOMM . Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Liang Wang et almbox. 2016c. Toward a Wearable RFID System for Real-Time Activity Recognition Using Radio Patterns. IEEE Transactions on Mobile Computing (2016). Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Wei Wang et almbox. 2015. Understanding and Modeling of WiFi Signal Based Human Activity Recognition. In MobiCom . Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Wei Wang et almbox. 2016 d. Gait recognition using wifi signals. In UbiComp . Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Yan Wang et almbox. 2014b. E-eyes: device-free location-oriented activity identification using fine-grained wifi signatures. In MobiCom . Google ScholarGoogle ScholarDigital LibraryDigital Library
  78. Kristen Woyach et almbox. 2006. Sensorless sensing in wireless networks: Implementation and measurements. In WiOpt .Google ScholarGoogle Scholar
  79. Di Wu et almbox. 2012. One shot learning gesture recognition from rgbd images. In CVPRW .Google ScholarGoogle Scholar
  80. Dan Wu et almbox. 2016. WiDir: walking direction estimation using wireless signals. In UbiComp . Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. Dan Wu et almbox. 2017. Device-Free WiFi Human Sensing: From Pattern-Based to Model-Based Approaches. IEEE Communications Magazine (2017).Google ScholarGoogle Scholar
  82. Wei Xi et almbox. 2014. Electronic frog eye: Counting crowd using wifi. In INFOCOM .Google ScholarGoogle Scholar
  83. Fu Xiao et almbox. 2018. One More Tag Enables Fine-Grained RFID Localization and Tracking. IEEE/ACM Transactions on Networking (2018). Google ScholarGoogle ScholarDigital LibraryDigital Library
  84. Jiang Xiao et almbox. 2013. Pilot: Passive device-free indoor localization using channel state information. In ICDCS . Google ScholarGoogle ScholarDigital LibraryDigital Library
  85. Tong Xin et almbox. 2016. FreeSense: Indoor Human Identification with Wi-Fi Signals. In GlobeCom .Google ScholarGoogle Scholar
  86. Shuochao Yao et almbox. 2017. DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing. In WWW . Google ScholarGoogle ScholarDigital LibraryDigital Library
  87. Jason Yosinski et almbox. 2014. How Transferable Are Features in Deep Neural Networks?. In NIPS . Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. Moustafa Youssef. 2016. CoSDEO 2016 Keynote: A decade later? Challenges: Device-free passive localization for wireless environments. In PerCom Workshops .Google ScholarGoogle ScholarCross RefCross Ref
  89. Yunze Zeng et almbox. 2014. Your AP knows how you move:fine-grained device motion recognition through WiFi. In HotWireless . Google ScholarGoogle ScholarDigital LibraryDigital Library
  90. Yunze Zeng et almbox. 2016. WiWho: WiFi-Based Person Identification in Smart Spaces. In IPSN . Google ScholarGoogle ScholarDigital LibraryDigital Library
  91. Cha Zhang and Yunqian Ma. 2012. Ensemble machine learning: methods and applications .Springer.Google ScholarGoogle Scholar
  92. Jin Zhang et almbox. 2016. WiFi-ID: Human Identification Using WiFi Signal. In DCOSS .Google ScholarGoogle Scholar
  93. Ouyang Zhang and Kannan Srinivasan. 2016. Mudra: User-friendly Fine-grained Gesture Recognition using WiFi Signals. In CoNEXT . Google ScholarGoogle ScholarDigital LibraryDigital Library
  94. Mingmin Zhao et almbox. 2017. Emotion recognition using wireless signals. In MobiCom . Google ScholarGoogle ScholarDigital LibraryDigital Library
  95. Zhongtang Zhao et almbox. 2011. Cross-people mobile-phone based activity recognition. In IJCAI . Google ScholarGoogle ScholarDigital LibraryDigital Library
  96. Xiaolong Zheng et almbox. 2016. Smokey: Ubiquitous smoking detection with commercial WiFi infrastructures. In INFOCOM .Google ScholarGoogle Scholar
  97. Zimu Zhou et almbox. 2013. Towards omnidirectional passive human detection. In INFOCOM .Google ScholarGoogle Scholar
  98. Hai Zhu et almbox. 2017. R-TTWD: Robust Device-free Through-The-Wall Detection of Moving Human with WiFi. IEEE Journal on Selected Areas in Communications (2017).Google ScholarGoogle Scholar

Index Terms

  1. CrossSense: Towards Cross-Site and Large-Scale WiFi Sensing

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        MobiCom '18: Proceedings of the 24th Annual International Conference on Mobile Computing and Networking
        October 2018
        884 pages
        ISBN:9781450359030
        DOI:10.1145/3241539

        Copyright © 2018 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 15 October 2018

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        MobiCom '18 Paper Acceptance Rate42of187submissions,22%Overall Acceptance Rate440of2,972submissions,15%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      ePub

      View this article in ePub.

      View ePub