Shichao Yue
Dina Katabi
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Recent advances in wireless systems have demonstrated the possibility of tracking a person's respiration using the RF signals that bounce off her body. The resulting breathing signal can be used to infer the person's sleep quality and stages; it also allows for monitoring sleep apnea and other sleep disordered breathing (SDB); all without any body contact. Unfortunately however past work fails when people are close to each other, e.g., a couple sharing the same bed. In this case, the breathing signals of nearby individuals interfere with each other and super-impose in the received signal.
This paper presents DeepBreath, the first RF-based respiration monitoring system that can recover the breathing signals of multiple individuals even when they are separated by zero distance. To design DeepBreath, we model interference due to multiple reflected RF signals and demonstrate that the original breathing can be recovered via independent component analysis (ICA). We design a full system that eliminates interference and recovers the original breathing signals. We empirically evaluate DeepBreath using 21 nights of sleep and over 150 hours of data from 13 couples who share the bed. Our results show that DeepBreath is very accurate. Specifically, the differences between the breathing signals it recovers and the ground truth are on par with the difference between the same breathing signal measured at the person's chest and belly.
Supplemental Material
Available for Download
zip
yue.zip (58.9 KB)
Supplemental movie, appendix, image and software files for, Extracting Multi-Person Respiration from Entangled RF Signals
- Fadel Adib, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2014. 3D Tracking via Body Radio Reflections.. In NSDI. Google Scholar
Digital Library
- Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart homes that monitor breathing and heart rate. In CHI. Google ScholarDigital Library
- Laiali Almazaydeh, Khaled Elleithy, Miad Faezipour, and Ahmad Abushakra. 2013. Apnea detection based on respiratory signal classification. Procedia Computer Science (2013).Google Scholar
- Richard B Berry, Rohit Budhiraja, Daniel J Gottlieb, David Gozal, Conrad Iber, Vishesh K Kapur, Carole L Marcus, Reena Mehra, and others. 2012. Rules for scoring respiratory events in sleep: update of the 2007 AASM manual for the scoring of sleep and associated events: deliberations of the sleep apnea definitions task force of the American Academy of Sleep Medicine. JCSM (2012).Google Scholar
- Bosch 2018. https://www.boschtools.com/us/en/boschtools-ocs/laser-measuring-glm-50-35087-p/. (2018).Google Scholar
- Mary A Carskadon, William C Dement, and others. 2005. Normal human sleep: an overview. Principles and practice of sleep medicine (2005).Google Scholar
- Ashish Chaddha. 2015. Slow breathing and cardiovascular disease. International journal of yoga (2015).Google Scholar
- Seungjin Choi, Andrzej Cichocki, Hyung-Min Park, and Soo-Young Lee. 2005. Blind source separation and independent component analysis: A review. Neural Information Processing-Letters and Reviews (2005).Google Scholar
- Sergei Churkin and Lesya Anishchenko. 2015. Millimeter-wave radar for vital signs monitoring. In COMCAS. IEEE.Google Scholar
- Luciane de Souza, Ana Amélia Benedito-Silva, Maria Laura Nogueira Pires, Dalva Poyares, Sergio Tufik, and Helena Maria Calil. 2003. Further validation of actigraphy for sleep studies. Sleep (2003).Google Scholar
- Arnaud Delorme and Scott Makeig. 2004. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of neuroscience methods (2004).Google Scholar
- WW Flemons, D Buysse, S Redline, A Oack, K Strohl, J Wheatley, T Young, N Douglas, P Levy, W McNicolas, and others. 1999. Sleep-related breathing disorders in adults: recommendations for syndrome definition and measurement techniques in clinical research. Sleep (1999).Google Scholar
- William F Ganong and William Ganong. 1995. Review of medical physiology. Appleton 8 Lange Norwalk, CT.Google Scholar
- Chen-Yu Hsu, Aayush Ahuja, Shichao Yue, Rumen Hristov, Zachary Kabelac, and Dina Katabi. 2017. Zero-Effort In-Home Sleep and Insomnia Monitoring using Radio Signals. IMWUT (2017). Google ScholarDigital Library
- Chen-Yu Hsu, Yuchen Liu, Zachary Kabelac, Rumen Hristov, Dina Katabi, and Christine Liu. 2017. Extracting Gait Velocity and Stride Length from Surrounding Radio Signals. In CHI. ACM. Google ScholarDigital Library
- Aapo Hyvärinen, Juha Karhunen, and Erkki Oja. 2004. Independent component analysis. John Wiley 8 Sons.Google Scholar
- Aapo Hyvärinen and Erkki Oja. 2000. Independent component analysis: algorithms and applications. Neural networks (2000).Google Scholar
- Swarun Kumar, Stephanie Gil, Dina Katabi, and Daniela Rus. 2014. Accurate indoor localization with zero start-up cost. In MobiCom. ACM. Google ScholarDigital Library
- Mark E Kunik, Kent Roundy, Connie Veazey, Julianne Souchek, Peter Richardson, Nelda P Wray, and Melinda A Stanley. 2005. Surprisingly high prevalence of anxiety and depression in chronic breathing disorders. Chest (2005).Google Scholar
- Ronald Ley. 1994. Breathing and the psychology of emotion, cognition, and behavior. In Behavioral and psychological approaches to breathing disorders.Google Scholar
- Xuefeng Liu, Jiannong Cao, Shaojie Tang, and Jiaqi Wen. 2014. Wi-Sleep: Contactless sleep monitoring via WiFi signals. In RTSS. IEEE.Google Scholar
- Xi Long, Jie Yang, Tim Weysen, Reinder Haakma, Jérôme Foussier, Pedro Fonseca, and Ronald M Aarts. 2014. Measuring dissimilarity between respiratory effort signals based on uniform scaling for sleep staging. Physiological measurement (2014).Google Scholar
- Bassem R Mahafza. 2002. Radar systems analysis and design using MATLAB. CBC Press. Google ScholarDigital Library
- Nikolaos Mitianoudis and Tania Stathaki. 2007. Pixel-based and region-based image fusion schemes using ICA bases. Information Fusion (2007). Google ScholarDigital Library
- Ken Monahan, Amy Storfer-Isser, Reena Mehra, Eyal Shahar, Murray Mittleman, Jeff Rottman, Naresh Punjabi, Mark Sanders, Stuart F Quan, Helaine Resnick, and others. 2009. Triggering of nocturnal arrhythmias by sleep-disordered breathing events. Journal of the American College of Cardiology (2009).Google Scholar
- Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless sleep apnea detection on smartphones. In MobiSys. ACM. Google ScholarDigital Library
- F Javier Nieto, Terry B Young, Bonnie K Lind, Eyal Shahar, Jonathan M Samet, Susan Redline, Ralph B D'agostino, Anne B Newman, Michael D Lebowitz, Thomas G Pickering, and others. 2000. Association of sleep-disordered breathing, sleep apnea, and hypertension in a large community-based study. Jama (2000).Google Scholar
- Erkki Oja. 2004. Applications of independent component analysis. In International Conference on Neural Information Processing. Springer.Google ScholarCross Ref
- Kurt Peek. 2011. Estimation and compensation of frequency sweep nonlinearity in FMCW radar. Master's thesis. University of Twente.Google Scholar
- Pulmonology 2018. https://www.columbiamemorialhealth.org/pulmonology/. (2018).Google Scholar
- Tauhidur Rahman, Alexander T Adams, Ruth Vinisha Ravichandran, Mi Zhang, Shwetak N Patel, Julie A Kientz, and Tanzeem Choudhury. 2015. Dopplesleep: A contactless unobtrusive sleep sensing system using short-range doppler radar. In UbiComp. ACM. Google ScholarDigital Library
- Alejandro Rodríguez-Molinero, Leire Narvaiza, Jorge Ruiz, and César Gálvez-Barrón. 2013. Normal respiratory rate and peripheral blood oxygen saturation in the elderly population. Journal of the American Geriatrics Society (2013).Google Scholar
- Hiroshi Saruwatari, Satoshi Kurita, and Kazuya Takeda. 2001. Blind source separation combining frequency-domain ICA and beamforming. In ICASSP. IEEE. Google ScholarDigital Library
- Nandakumar Selvaraj. 2015. Psychological acute stress measurement using a wireless adhesive biosensor. In EMBC. IEEE.Google Scholar
- Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint (2014).Google Scholar
- Sleepview 2018. https://clevemed.com/sleepview/. (2018).Google Scholar
- Frederick Snyder, J Allan Hobson, Donald F Morrison, and Frederick Goldfrank. 1964. Changes in respiration, heart rate, and systolic blood pressure in human sleep. Journal of Applied Physiology (1964).Google Scholar
- Tania Stathaki. 2011. Image fusion: algorithms and applications. Elsevier. Google ScholarDigital Library
- Yu Takahashi, Tomoya Takatani, Keiichi Osako, Hiroshi Saruwatari, and Kiyohiro Shikano. 2009. Blind spatial subtraction array for speech enhancement in noisy environment. IEEE transactions on audio, speech, and language processing (2009). Google ScholarDigital Library
- Alexander Tataraidze, Lesya Anishchenko, Lyudmila Korostovtseva, Bert Jan Kooij, Mikhail Bochkarev, and Yurii Sviryaev. 2015. Sleep stage classification based on respiratory signal. In EMBC. IEEE.Google Scholar
- Wang Tianben, Daqing Zhang, Yuanqing Zheng, Tao Gu, Xingshe Zhou, and Bernadette Dorizzi. 2017. C-FMCW Based Contactless Respiration Detection Using Acoustic Signal. In IMWUT. Google ScholarDigital Library
- Péter Várady, Szabolcs Bongár, and Zoltán Benyó. 2003. Detection of airway obstructions and sleep apnea by analyzing the phase relation of respiration movement signals. IEEE Transactions on Instrumentation and Measurement (2003).Google Scholar
- Hao Wang, Daqing Zhang, Junyi Ma, Yasha Wang, Yuxiang Wang, Dan Wu, Tao Gu, and Bing Xie. 2016. Human respiration detection with commodity wifi devices: do user location and body orientation matter?. In UbiComp. ACM. Google ScholarDigital Library
- Yang Xu, Wei Yang, Jianxin Wang, Xing Zhou, Hong Li, and Liusheng Huang. 2018. WiStep: Device-free Step Counting with WiFi Signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (2018). Google ScholarDigital Library
- Zhicheng Yang, Parth H Pathak, Yunze Zeng, Xixi Liran, and Prasant Mohapatra. 2016. Monitoring vital signs using millimeter wave. In Mobihoc. ACM. Google ScholarDigital Library
- Terry Young, Laurel Finn, Paul E Peppard, Mariana Szklo-Coxe, Diane Austin, F Javier Nieto, Robin Stubbs, and K Mae Hla. 2008. Sleep disordered breathing and mortality: eighteen-year follow-up of the Wisconsin sleep cohort. Sleep (2008).Google Scholar
- Terry Young, Paul Peppard, Mari Palta, K Mae Hla, Laurel Finn, Barbara Morgan, and James Skatrud. 1997. Population-based study of sleep-disordered breathing as a risk factor for hypertension. Archives of internal medicine (1997).Google Scholar
- Mingmin Zhao, Fadel Adib, and Dina Katabi. 2016. Emotion recognition using wireless signals. In MobiCom. ACM. Google ScholarDigital Library
- Mingmin Zhao, Shichao Yue, Dina Katabi, Tommi S. Jaakkola, and Matt T. Bianchi. 2017. Learning Sleep Stages from Radio Signals: A Conditional Adversarial Architecture. In ICML.Google Scholar
Index Terms
- Extracting Multi-Person Respiration from Entangled RF Signals
Recommendations
Monitoring a Person's Heart Rate and Respiratory Rate on a Shared Bed Using Geophones
SenSys '17: Proceedings of the 15th ACM Conference on Embedded Network Sensor SystemsUsing geophones to sense bed vibrations caused by ballistic force has shown great potential in monitoring a person's heart rate during sleep. It does not require a special mattress or sheets, and the user is free to move around and change position ...
Extraction of Respiration from PPG Signals Using Hilbert Vibration Decomposition
ICBBB '19: Proceedings of the 2019 9th International Conference on Bioscience, Biochemistry and BioinformaticsA new approach using the Hilbert vibration decomposition (HVD) for extracting the respiration from the photoplethysmographic (PPG) signal is proposed. It is suggested that the largest energy component of the PPG signal acquired using the HVD is ...
Multi-User Room-Scale Respiration Tracking Using COTS Acoustic Devices
Continuous domestic respiration monitoring provides vital information for diagnosing assorted diseases. In this article, we introduce RespTracker, the first continuous, multiple-person respiration tracking system in domestic settings using acoustic-based ...
Comments