Fusang Zhang
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Despite extensive research effort in contact-free sensing using RF signals in the last few years, there still exist significant barriers preventing their wide adoptions. One key issue is the inability to sense multiple targets due to the intrinsic nature of relying on reflection signals for sensing: the reflections from multiple targets get mixed at the receiver and it is extremely difficult to separate these signals to sense each individual. This problem becomes even more severe in long-range LoRa sensing because the sensing range is much larger compared to WiFi and acoustic based sensing. In this work, we address the challenging multi-target sensing issue, moving LoRa sensing one big step towards practical adoption. The key idea is to effectively utilize multiple antennas at the LoRa gateway to enable spatial beamforming to support multi-target sensing. While traditional beamforming methods adopted in WiFi and Radar systems rely on accurate channel information or transmitter-receiver synchronization, these requirements can not be satisfied in LoRa systems: the transmitter and receiver are not synchronized and no channel state information can be obtained from the cheap LoRa nodes. Another interesting observation is that while beamforming helps to increase signal strength, the phase/amplitude information which is critical for sensing can get corrupted during the beamforming process, eventually compromising the sensing capability. In this paper, we propose novel signal processing methods to address the issues above to enable long-range multi-target reparation sensing with LoRa. Extensive experiments show that our system can monitor the respiration rates of five human targets simultaneously at an average accuracy of 98.1%.
Supplemental Material
Available for Download
zip
zhang.zip (99.4 MB)
Supplemental movie, appendix, image and software files for, Unlocking the Beamforming Potential of LoRa for Long-range Multi-target Respiration Sensing
- D. Zhang, H. Wang, and D. Wu, "Toward Centimeter-Scale Human Activity Sensing with Wi-Fi Signals," IEEE Computer, vol. 50, pp. 48--57, 2017.Google Scholar
Digital Library
- F. Zhang, D. Zhang, J. Xiong, H. Wang, K. Niu, B. Jin, and Y. Wang. 2018. From Fresnel Diffraction Model to Fine-grained Human Respiration Sensing with Commodity Wi-Fi Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., vol. 2, no. 1, Article 53, 2018.Google Scholar
- L. Chen, J. Xiong, X. Chen, S. Lee, D. Zhang, T. Yan, and D. Fang. 2019. LungTrack: Towards Contactless and Zero Dead-Zone Respiration Monitoring with Commodity RFIDs. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., vol. 3, no. 3, Article 79, 2019.Google Scholar
- J. Wang, J. Xiong, X. Chen, H. Jiang, R. K. Balan, and D. Fang, "TagScan: Simultaneous Target Imaging and Material Identification with Commodity RFID Devices," in Proceedings of The 23rd Annual International Conference on Mobile Computing and Networking (Mobicom 2017), pp. 288--300, 2017.Google Scholar
- T. Kao, J. Lin. 2013. Vital sign detection using 60-GHz Doppler radar system. In 2013 IEEE International Wireless Symposium (IWS). IEEE, 1--4.Google ScholarCross Ref
- 60GHz radar, 2016, https://www.infineon.com/cms/en/product/promopages/60GHz/.Google Scholar
- Y. Yang, J. Cao, X. Liu and X. Liu, "Multi-Breath: Separate Respiration Monitoring for Multiple Persons with UWB Radar," 2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC), 2019, pp. 840--849.Google Scholar
- B. Anderson, M. Shi, V. Y. F. Tan, and Y. Wang, "Mobile Gait Analysis Using Foot-Mounted UWB Sensors," Proc. ACM Interact. Mob. Wearable Ubiquitous Technol, vol. 3, no. 3, Article 73, 2019.Google Scholar
- F. Zhang, Z. Wang, B. Jin, J. Xiong, and D. Zhang, "Your Smart Speaker Can "Hear" Your Heartbeat!" Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. vol. 4, no.4, 24 pages, 2020.Google Scholar
- T. Wang, D. Zhang, Y. Zheng, T. Gu, X. Zhou, and B. Dorizzi. 2017. C-FMCW Based Contactless Respiration Detection Using Acoustic Signal. PACM Interact. Mob. Wearable Ubiquitous Technol. 1, 4, Article 170, 2017.Google Scholar
- T. Li, C. An, Z. Tian, A. Campbell, and X. Zhou, "Human Sensing Using Visible Light Communication," In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking (MobiCom 2015), pp. 331--344, 2015.Google ScholarDigital Library
- Y. Li, T. Li, R. Patel, X. Yang, and X. Zhou. 2018. Self-Powered Gesture Recognition with Ambient Light. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST 2018). pp. 595--608, 2018.Google ScholarDigital Library
- Dakulagi, V., Alagirisamy, M. Adaptive Beamformers for High-Speed Mobile Communication. Wireless Wireless Personal Communications volume, 1691-1707 (2020).Google Scholar
- A. Augustin, J. Yi, T. Clausen, and W. Townsley. 2016. A study of LoRa: Long range and low power networks for the internet of things. Sensors 16, 9 (2016), 1466.Google ScholarCross Ref
- A. Hoeller, R. D. Souza, O. L. Alcaraz López, H. Alves, M. de Noronha Neto and G. Brante, "Analysis and Performance Optimization of LoRa Networks With Time and Antenna Diversity," in IEEE Access, vol. 6, pp. 32820--32829, 2018.Google ScholarCross Ref
- K. Niu, F. Zhang, J. Xiong, X. Li, E. Yi, and D. Zhang, "Boosting fine-grained activity sensing by embracing wireless multipath effects," in Proceedings of the International Conference on emerging Networking EXperiments and Technologies (CoNEXT 2018), pp. 139--151, 2018.Google Scholar
- H. Li, A. Shrestha, H. Heidari, J. Le Kernec and F. Fioranelli, "Bi-LSTM Network for Multimodal Continuous Human Activity Recognition and Fall Detection," IEEE Sensors Journal, vol. 20, pp. 1191--1201, 2020.Google ScholarCross Ref
- Z. Meng, S. Fu, J. Yan, H. Liang, A. Zhou, S. Zhu, H. Ma, J. Liu, N. Yang, "Gait Recognition for Co-Existing Multiple People Using Millimeter Wave Sensing," in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 1, 2020.Google Scholar
- F. Zhang, K. Niu, J. Xiong, B. Jin, T. Gu, Y. Jiang, and D. Zhang, "Towards a diffraction-based sensing approach on human activity recognition," in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 3, no. 1, pp. 1--25, 2018.Google Scholar
- https://www.semtech.com/uploads/documents/WiFi_Immunity_App_Notes.pdfGoogle Scholar
- https://www.semtech.com/uploads/documents/DS_SX1276-7-8-9_W_APP_V6.pdf(2019)Google Scholar
- C. Lowanichkiattikul, M. Dhanachai, C. Sitathanee, S. Khachonkham, and P. Khaothong, "Impact of chest wall motion caused by respiration in adjuvant radiotherapy for postoperative breast cancer patients," SpringerPlus 5, Article 144, 2016.Google Scholar
- Semtech SX1276 Transceiver. https://www.semtech.com/products/wireless-rf/lora-transceivers/sx1276.Google Scholar
- Arduino. https://store.arduino.cc/usa/arduino-uno-rev3.Google Scholar
- USRP X310. https://www.ettus.com/all-products/x310-kit/.Google Scholar
- Respiration Monitor Belt logger sensor NUL-236. https://neulog.com/respiration-monitor-belt/.Google Scholar
- WebMD. https://www.webmd.com/sleep-disorders/sleep-apnea/understanding-obstructive-sleep-apnea-syndrome.Google Scholar
- L. Gattinoni, D. Chiumello, P. Caironi, M. Busana, F. Romitti, L. Brazzi and L. Camporota, COVTD-19 pneumonia: different respiratory treatments for different phenotypes?. Intensive Care Med 46, 1099-1102 (2020).Google ScholarCross Ref
- B. K. Jennison. 2000. Performance of a linear frequency-modulated signal detection algorithm. In Record of the IEEE 2000 International Radar Conference. IEEE, 447--450.Google ScholarCross Ref
- X. Wang, C. Yang, and S. Mao, "TensorBeat: Tensor Decomposition for Monitoring Multiperson Breathing Beats with Commodity WiFi," ACM Trans. Intell. Syst. Technol. 9, 1, Article 8 (October 2017), 27 pages.Google ScholarDigital Library
- A. Santra, R. V. Ulaganathan, T. Finke, A. Baheti, "Short-range multi-mode continuous-wave radar for vital sign measurement and imaging," in Proceedings of 2018 IEEE Radar Conference (RadarConf18), pp. 946--950, 2018.Google Scholar
- Mahfoudi, MN, Sivadoss, G, Korachi, OB, Turletti, T, Dabbous, W. Joint range extension and localization for low-power wide-area network. Internet Technology Letters. 2019Google Scholar
- Y. Yang, J. Cao, X. Liu, and X. Liu, "Multi-Breath: Separate Respiration Monitoring for Multiple Persons with UWB Radar," in Proceedings of the 2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC), vol. 1, pp. 840--849, 2019.Google Scholar
- Semtech, "Smart cities transformed using semtech's LoRa technology," white paper, 2017.Google Scholar
- Semtech, "Smart lighting," https://www.semtech.com/lora/lora-applications,WhitePaper.Google Scholar
- S. Liu, C. Xia, and Z. Zhao, "A low-power real-time air quality monitoring system using lpwan based on lora," in Proceedings of the 13th IEEE International Conference on Solid-State and Integrated Circuit Technology (ICSICT), pp. 379--381, 2016.Google Scholar
- T. Ameloot, P. V. Torre, and H. Rogier, "LoRa indoor performance: an office environment case study," in Proceedings of the International Applied Computational Electromagnetics Society Symposium, pp. 1--2, 2018.Google Scholar
- P. Sommer, Y. Maret, and D. Dzung, "Low-Power Wide-Area Networks for Industrial Sensing Applications," in Proceedings of the 2018 IEEE International Conference on Industrial Internet (ICII), pp. 23--32, 2018.Google Scholar
- K. H. Ke, Q. W. Liang, G. Zeng, J. Lin, and H. Lee, "A LoRa wireless mesh networking module for campus-scale monitoring: demo abstract," in Proceedings of the 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), pp. 259--260, 2017.Google Scholar
- S. Mathur, A. Sankar, P. Prasan, and B. Iannucci, "Energy Analysis of LoRaWAN Technology for Traffic Sensing Applications," in Proceedings of the Intelligent Transportation Society of America (ITS) World Congress, vol. 29, 2017.Google Scholar
- N. A. Azmi Ali and N. A. Abdul Latiff, "Environmental Monitoring System Based on LoRa Technology in Island," in Proceedings of the 2019 IEEE International Conference on Signals and Systems (ICSigSys), pp. 160--166, 2019.Google Scholar
- C. Gu, L. Jiang, and R. Tan, "LoRa-Based Localization: Opportunities and Challenges," in Proceedings of the 2019 International Conference on Embedded Wireless Systems and Networks, pp. 413--418, 2019.Google Scholar
- L. Chen, J. Xiong, X. Chen, S. I. Lee, K. Chen, D. Han, D. Fang, Z. Tang, and Z. Wang, "WideSee: towards wide-area contactless wireless sensing," in Proceedings of the 17th Conference on Embedded Networked Sensor Systems (SenSys 2019), pp. 258--270, 2019.Google Scholar
- Rajalakshmi Nandakumar, VikramIyer, ShyamnathGollakota, "3D Localization for Sub-Centimeter Sized Devices," in Proceedings of the 16th ACM Conference on Embedded Networked Sensor Systems, pp. 108--119, 2018.Google ScholarDigital Library
- B. Islam, M. T. Islam, and S. Nirjon, "Feasibility of LoRa for Indoor Localization," on-line, from semanticscholar.org, pp. 1--11, 2017.Google Scholar
- F. Zhang, Z. Chang, K. Niu, J. Xiong, B. Jin, Q. Lv, and D. Zhang. 2020. Exploring LoRa for Long-range Through-wall Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 2, 2020.Google Scholar
- Y. Zeng, D. Wu, J. Xiong, E. Yi, R. Gao, D. Zhang. 2019. FarSense: Pushing the Range Limit of WiFi-based Respiration Sensing with CSI Ratio of Two Antennas. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 121, 2019.Google ScholarDigital Library
- B. Xie, J. Xiong. 2020. Combating interference for long range LoRa sensing. Proceedings of the 18th Conference on Embedded Networked Sensor Systems, 69-81, 2020.Google ScholarDigital Library
- C. Chen, Y. Han, Y. Chen, H. Lai, F. Zhang, B. Wang, and K.J.R. Liu, "TR-BREATH: Time-Reversal Breathing Rate Estimation and Detection," IEEE Transactions on Bio-medical Engineering, vol. 65, no. 3, pp. 489--501, 2018.Google ScholarCross Ref
- F. Adib, H. Mao, Z. Kabelac, D. Katabi, and R. C. Miller, "Smart Homes that Monitor Breathing and Heart Rate," in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015), pp. 837--846, 2015.Google Scholar
- Youwei Zeng, Dan Wu, Jie Xiong, Jinyi Liu, Zhaopeng Liu, and Daqing Zhang. 2020. MultiSense: Enabling Multi-person Respiration Sensing with Commodity WiFi. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 3, Article 102 (September 2020), 29 pages.Google ScholarDigital Library
- Nan Yu, Wei Wang, Alex X Liu, and Lingtao Kong. 2018. QGesture: Quantifying Gesture Distance and Direction with WiFi Signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (2018), 51.Google ScholarDigital Library
- A. Ahmad, J. C. Roh, D. Wang and A. Dubey, "Vital signs monitoring of multiple people using a FMCW millimeter-wave sensor," 2018 IEEE Radar Conference (RadarConf18), 2018, pp. 1450--1455.Google Scholar
- Xethru impulse uwb radar chip, https://www.xethru.com/x4-radarchip.html/, accessed: 2018-03-30.Google Scholar
- J. C. Spall. Introduction to stochastic search and optimization: estimation, simulation, and control. John Wiley and Sons, 2005.Google Scholar
Index Terms
- Unlocking the Beamforming Potential of LoRa for Long-range Multi-target Respiration Sensing
Recommendations
Sensor-free Soil Moisture Sensing Using LoRa Signals
Soil moisture sensing is one of the most important components in smart agriculture. It plays a critical role in increasing crop yields and reducing water waste. However, existing commercial soil moisture sensors are either expensive or inaccurate, ...
Pushing the Limits of Long Range Wireless Sensing with LoRa
Wireless sensing is an exciting new research area which enables a large variety of applications ranging from coarse-grained daily activity recognition to fine-grained vital sign monitoring. While promising in many aspects, one critical issue is the ...
Combating interference for long range LoRa sensing
SenSys '20: Proceedings of the 18th Conference on Embedded Networked Sensor SystemsWireless sensing has become a hot research topic recently, enabling a large range of applications. However, due to the intrinsic nature of employing weak target-reflection signal for sensing, the sensing range is limited. Another issue is the strong ...
Comments