Skip to main content
Top
Published in: Peer-to-Peer Networking and Applications 3/2022

14-02-2022

HeadSee: Device-free head gesture recognition with commodity RFID

Authors: Kai Chen, Fuwei Wang, Miaoyu Li, Baoying Liu, Hao Chen, Feng Chen

Published in: Peer-to-Peer Networking and Applications | Issue 3/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Research shows that the head posture not only contains important interpersonal information but also is an external manifestation of human psychological activities. Head posture plays an important role in automotive safety, smart home, and other intelligent environments. Rf-based posture recognition method provides a non-contact and privacy protection method to detect and monitor human activities. However, how to separate weak activity state information from reflected signals has been a big challenge for this kind of method. This paper proposes HeadSee, a passive human head gesture sensing system built on a cheap commodity RFID device. Without attaching any device to the human body, HeadSee using ICA extracts the weak reflected RF signals from the human body for gesture sensing. And then HeadSee carefully models the head movement by utilizing the signal’s phase/RSS (received signal strength) changes and successfully quantifies the head gesture with continuous sequences of movement states. Extensive experiments show that even with interfering movements from other body parts, HeadSee can still achieve around 91% recognition accuracy of the head gestures.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
5.
go back to reference Machangpaa JW, Chingtham TS (2018) Head gesture controlled wheelchair for quadriplegic patients. Procedia Comput Ence 132:342–351CrossRef Machangpaa JW, Chingtham TS (2018) Head gesture controlled wheelchair for quadriplegic patients. Procedia Comput Ence 132:342–351CrossRef
6.
go back to reference Adib F, Kabelac Z, Katabi D (2015) Multi-person localization via rf body reflections Adib F, Kabelac Z, Katabi D (2015) Multi-person localization via rf body reflections
7.
go back to reference Adib F, Kabelac Z, Katabi D, Miller RC (2014) 3d tracking via body radio reflections. In: 11Th {USENIX} symposium on networked systems design and implementation ({NSDI} 14), pp 317–329 Adib F, Kabelac Z, Katabi D, Miller RC (2014) 3d tracking via body radio reflections. In: 11Th {USENIX} symposium on networked systems design and implementation ({NSDI} 14), pp 317–329
8.
go back to reference Baker S, Matthews I, Xiao J, Gross R, Kanade T, Ishikawa T (2004) Real-time non-rigid driver head tracking for driver mental state estimation. In: 11Th world congress on intelligent transportation systems Baker S, Matthews I, Xiao J, Gross R, Kanade T, Ishikawa T (2004) Real-time non-rigid driver head tracking for driver mental state estimation. In: 11Th world congress on intelligent transportation systems
9.
go back to reference Basu S, Choudhury T, Clarkson B, Pentland A (2016) Towards measuring human interactions in conversational settings. Proc IEEE Cvpr Workshop on Cues in Communication Basu S, Choudhury T, Clarkson B, Pentland A (2016) Towards measuring human interactions in conversational settings. Proc IEEE Cvpr Workshop on Cues in Communication
10.
go back to reference Bergasa LM, Nuevo J, Sotelo MA, Barea R, Lope ME (2006) Real-time system for monitoring driver vigilance Bergasa LM, Nuevo J, Sotelo MA, Barea R, Lope ME (2006) Real-time system for monitoring driver vigilance
11.
go back to reference Cheng SH (2014) An intelligent fall detection system using triaxial accelerometer integrated by active rfid. In: 2014 International conference on machine learning and cybernetics, vol 2. IEEE, pp 517–522 Cheng SH (2014) An intelligent fall detection system using triaxial accelerometer integrated by active rfid. In: 2014 International conference on machine learning and cybernetics, vol 2. IEEE, pp 517–522
12.
go back to reference Emura S, Tachi S (1993) Sensor fusion based measurement of human head motion. Journal of the Robotics Society of Japan Emura S, Tachi S (1993) Sensor fusion based measurement of human head motion. Journal of the Robotics Society of Japan
13.
go back to reference Fang B, Lane ND, Zhang M, Kawsar F (2016) Headscan: a wearable system for radio-based sensing of head and mouth-related activities. In: International conference on information processing in sensor networks Fang B, Lane ND, Zhang M, Kawsar F (2016) Headscan: a wearable system for radio-based sensing of head and mouth-related activities. In: International conference on information processing in sensor networks
14.
go back to reference Ferrin FJ (1991) Survey of helmet tracking technologies. In: Large screen projection, avionic, & helmet-mounted displays Ferrin FJ (1991) Survey of helmet tracking technologies. In: Large screen projection, avionic, & helmet-mounted displays
15.
go back to reference Foxlin E (2002) Inertial head-tracker sensor fusion by a complementary separate-bias kalman filter. In: IEEE Virtual reality international symposium Foxlin E (2002) Inertial head-tracker sensor fusion by a complementary separate-bias kalman filter. In: IEEE Virtual reality international symposium
16.
go back to reference Guo Z, Liu H, Wang Q, Yang J (2006) A fast algorithm face detection and head pose estimation for driver assistant system. In: 2006 8Th international conference on signal processing, vol 3. IEEE Guo Z, Liu H, Wang Q, Yang J (2006) A fast algorithm face detection and head pose estimation for driver assistant system. In: 2006 8Th international conference on signal processing, vol 3. IEEE
17.
go back to reference Han D, Chen Q, Han J, Ge W, Wei X (2017) Rfipad: Enabling cost-efficient and device-free in-air handwriting using passive tags. In: 2017 IEEE 37Th international conference on distributed computing systems (ICDCS) Han D, Chen Q, Han J, Ge W, Wei X (2017) Rfipad: Enabling cost-efficient and device-free in-air handwriting using passive tags. In: 2017 IEEE 37Th international conference on distributed computing systems (ICDCS)
18.
go back to reference Harbluk J, Noy Y, Trbovich P, Eizenman M (2007) An on-road assessment of cognitive distraction: impacts on drivers’ visual behavior and braking performance. Accid Anal Prev 39(2):372–379CrossRef Harbluk J, Noy Y, Trbovich P, Eizenman M (2007) An on-road assessment of cognitive distraction: impacts on drivers’ visual behavior and braking performance. Accid Anal Prev 39(2):372–379CrossRef
19.
go back to reference Huang KS, Trivedi MM (2003) Video arrays for real-time tracking of person, head, and face in an intelligent room. Springer, New York Huang KS, Trivedi MM (2003) Video arrays for real-time tracking of person, head, and face in an intelligent room. Springer, New York
20.
go back to reference Hussain Z, Sheng Q, Zhang WE (2020) A review and categorization of techniques on device-free human activity recognition. Journal of Network and Computer Applications, pp 102738 Hussain Z, Sheng Q, Zhang WE (2020) A review and categorization of techniques on device-free human activity recognition. Journal of Network and Computer Applications, pp 102738
21.
go back to reference Beirlant J, Dudewicz E, der Meulen, E (1997) Nonparametric entropy estimation: An overview. Int J Math Stat Sci 6:17–39MathSciNetMATH Beirlant J, Dudewicz E, der Meulen, E (1997) Nonparametric entropy estimation: An overview. Int J Math Stat Sci 6:17–39MathSciNetMATH
22.
go back to reference Li H, Yang W, Wang J, Xu Y, Huang L (2016) Wifinger: talk to your smart devices with finger-grained gesture. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp 250–261 Li H, Yang W, Wang J, Xu Y, Huang L (2016) Wifinger: talk to your smart devices with finger-grained gesture. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp 250–261
23.
go back to reference Li Y, Li J, Jiang X, Gao C, Zhang T (2019) A driving attention detection method based on head pose. In: 2019 IEEE Smartworld, ubiquitous intelligence & computing, advanced & trusted computing, scalable computing & communications, cloud & big data computing, internet of people and smart city innovation (smartworld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI). IEEE, pp 483–490 Li Y, Li J, Jiang X, Gao C, Zhang T (2019) A driving attention detection method based on head pose. In: 2019 IEEE Smartworld, ubiquitous intelligence & computing, advanced & trusted computing, scalable computing & communications, cloud & big data computing, internet of people and smart city innovation (smartworld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI). IEEE, pp 483–490
24.
go back to reference Mao W, Wang M, Sun W, Qiu L, Pradhan S, Chen Y (2019) Rnn-based room scale hand motion tracking, pp 1–16 Mao W, Wang M, Sun W, Qiu L, Pradhan S, Chen Y (2019) Rnn-based room scale hand motion tracking, pp 1–16
25.
go back to reference Morency LP, Christoudias CM, Darrell T (2006) Recognizing gaze aversion gestures in embodied conversational discourse. In: Proceedings of the 8th international conference on Multimodal interfaces, pp 287–294 Morency LP, Christoudias CM, Darrell T (2006) Recognizing gaze aversion gestures in embodied conversational discourse. In: Proceedings of the 8th international conference on Multimodal interfaces, pp 287–294
26.
go back to reference Morency LP, Sidner C, Lee C, Darrell T (2007) Head gestures for perceptual interfaces: The role of context in improving recognition. Artifi Intell 171(8-9):568–585CrossRef Morency LP, Sidner C, Lee C, Darrell T (2007) Head gestures for perceptual interfaces: The role of context in improving recognition. Artifi Intell 171(8-9):568–585CrossRef
27.
go back to reference Murphy-Chutorian E (2008) Hybrid head orientation and position estimation (hyhope): a system and evaluation for driver support. In: Proceedings of IEEE intelligent vehicles symposium, 2008 Murphy-Chutorian E (2008) Hybrid head orientation and position estimation (hyhope): a system and evaluation for driver support. In: Proceedings of IEEE intelligent vehicles symposium, 2008
28.
go back to reference Murphychutorian E, Trivedi MM (2009) Head pose estimation in computer vision: a survey. IEEE Trans Pattern Anal Mach Intell 31(4):607–626CrossRef Murphychutorian E, Trivedi MM (2009) Head pose estimation in computer vision: a survey. IEEE Trans Pattern Anal Mach Intell 31(4):607–626CrossRef
29.
go back to reference Padeleris P, Zabulis X, Argyros AA (2012) Head pose estimation on depth data based on particle swarm optimization. In: Workshop on human activity understanding from 3d data (CVRP workshops) Padeleris P, Zabulis X, Argyros AA (2012) Head pose estimation on depth data based on particle swarm optimization. In: Workshop on human activity understanding from 3d data (CVRP workshops)
30.
go back to reference Parada R, Nur K, Melià-seguí J., Pous R (2016) Smart surface: Rfid-based gesture recognition using k-means algorithm. In: 2016 12Th international conference on intelligent environments (IE). IEEE, pp 111–118 Parada R, Nur K, Melià-seguí J., Pous R (2016) Smart surface: Rfid-based gesture recognition using k-means algorithm. In: 2016 12Th international conference on intelligent environments (IE). IEEE, pp 111–118
31.
go back to reference Ruan W, Sheng Q, Yao L, Li X, Falkner N, Yang L (2018) Device-free human localization and tracking with uhf passive rfid tags: a data-driven approach. J Netw Comput Appl 104:78–96CrossRef Ruan W, Sheng Q, Yao L, Li X, Falkner N, Yang L (2018) Device-free human localization and tracking with uhf passive rfid tags: a data-driven approach. J Netw Comput Appl 104:78–96CrossRef
32.
go back to reference Ruiz N, Chong E, Rehg JM (2018) Fine-grained head pose estimation without keypoints Ruiz N, Chong E, Rehg JM (2018) Fine-grained head pose estimation without keypoints
33.
go back to reference Smith P, Shah M, da Vitoria Lobo N (2003) Determining driver visual attention with one camera. IEEE Trans Intell Transp Syst 4(4):205–218CrossRef Smith P, Shah M, da Vitoria Lobo N (2003) Determining driver visual attention with one camera. IEEE Trans Intell Transp Syst 4(4):205–218CrossRef
34.
go back to reference Wang C, Xie L, Wang W, Chen Y, Bu Y, Lu S (2018) Rf-ecg: Heart rate variability assessment based on cots rfid tag array. Proc ACM Interact Mob Wearable Ubiquit Technol 2:1–26 Wang C, Xie L, Wang W, Chen Y, Bu Y, Lu S (2018) Rf-ecg: Heart rate variability assessment based on cots rfid tag array. Proc ACM Interact Mob Wearable Ubiquit Technol 2:1–26
35.
go back to reference Wang G, Gu C, Inoue T, Li C (2014) A hybrid fmcw-interferometry radar for indoor precise positioning and versatile life activity monitoring. IEEE Trans Microwave Theory Techn 62(11):2812–2822CrossRef Wang G, Gu C, Inoue T, Li C (2014) A hybrid fmcw-interferometry radar for indoor precise positioning and versatile life activity monitoring. IEEE Trans Microwave Theory Techn 62(11):2812–2822CrossRef
36.
go back to reference Wang G, Zou Y, Zhou Z, Wu K, Ni LM (2016) We can hear you with wi-fi!. IEEE Trans Mob Comput 15(11):2907–2920CrossRef Wang G, Zou Y, Zhou Z, Wu K, Ni LM (2016) We can hear you with wi-fi!. IEEE Trans Mob Comput 15(11):2907–2920CrossRef
37.
go back to reference Wang J, Vasisht D, Katabi D (2014) Rf-idraw:virtual touch screen in the air using rf signals. Acm Sigcomm Comput Commun Rev 44(4):235–246CrossRef Wang J, Vasisht D, Katabi D (2014) Rf-idraw:virtual touch screen in the air using rf signals. Acm Sigcomm Comput Commun Rev 44(4):235–246CrossRef
38.
go back to reference Wang Y, Zheng Y (2018) Modeling rfid signal reflection for contact-free activity recognition. Proc Acm Interact Mob Wearable Ubiquit Technol 2(4):1–22 Wang Y, Zheng Y (2018) Modeling rfid signal reflection for contact-free activity recognition. Proc Acm Interact Mob Wearable Ubiquit Technol 2(4):1–22
39.
go back to reference Wei T, Zhang X (2015) mtrack: High-precision passive tracking using millimeter wave radios. In: Proceedings of the 21st Annual International Conference on Mobile Computing and Networking, pp 117–129 Wei T, Zhang X (2015) mtrack: High-precision passive tracking using millimeter wave radios. In: Proceedings of the 21st Annual International Conference on Mobile Computing and Networking, pp 117–129
40.
go back to reference Yan C, Jiang H, Zhang B, Coenen F (2015) Recognizing driver inattention by convolutional neural networks. In: 2015 8Th international congress on image and signal processing (CISP). IEEE, pp 680–685 Yan C, Jiang H, Zhang B, Coenen F (2015) Recognizing driver inattention by convolutional neural networks. In: 2015 8Th international congress on image and signal processing (CISP). IEEE, pp 680–685
41.
go back to reference Yang H, Mou W, Zhang Y, Patras I, Gunes H, Robinson P (2015) Face alignment assisted by head pose estimation. Comput Ence:7 Yang H, Mou W, Zhang Y, Patras I, Gunes H, Robinson P (2015) Face alignment assisted by head pose estimation. Comput Ence:7
42.
go back to reference Yang J, Lee J, Choi J (2011) Activity recognition based on rfid object usage for smart mobile devices. J Comput Sci Technol 26(2):239–246CrossRef Yang J, Lee J, Choi J (2011) Activity recognition based on rfid object usage for smart mobile devices. J Comput Sci Technol 26(2):239–246CrossRef
43.
go back to reference Yao L, Sheng Q, Ruan W, Gu T, Li X, Falkner N, Yang Z (2015) Rf-care: Device-free posture recognition for elderly people using a passive rfid tag array Yao L, Sheng Q, Ruan W, Gu T, Li X, Falkner N, Yang Z (2015) Rf-care: Device-free posture recognition for elderly people using a passive rfid tag array
44.
go back to reference Yeredor A (2000) Blind separation of gaussian sources via second-order statistics with asymptotically optimal weighting. IEEE Signal Process Lett 7:197–200CrossRef Yeredor A (2000) Blind separation of gaussian sources via second-order statistics with asymptotically optimal weighting. IEEE Signal Process Lett 7:197–200CrossRef
45.
go back to reference Yi S, Qin Z, Novak E, Yin Y, Li Q (2016) Glassgesture: Exploring head gesture interface of smart glasses. In: Computer communications workshops Yi S, Qin Z, Novak E, Yin Y, Li Q (2016) Glassgesture: Exploring head gesture interface of smart glasses. In: Computer communications workshops
46.
go back to reference Yu Y, Mora KAF, Odobez JM (2017) Robust and accurate 3d head pose estimation through 3dmm and online head model reconstruction. In: 2017 12Th IEEE international conference on automatic face & gesture recognition (FG 2017). IEEE, pp 711–718 Yu Y, Mora KAF, Odobez JM (2017) Robust and accurate 3d head pose estimation through 3dmm and online head model reconstruction. In: 2017 12Th IEEE international conference on automatic face & gesture recognition (FG 2017). IEEE, pp 711–718
47.
go back to reference Yu Y, Wang D, Zhao R, Zhang Q (2019) Rfid based real-time recognition of ongoing gesture with adversarial learning, pp 298–310 Yu Y, Wang D, Zhao R, Zhang Q (2019) Rfid based real-time recognition of ongoing gesture with adversarial learning, pp 298–310
48.
go back to reference Yue S, He H, Wang H, Rahul H, Katabi D (2018) Extracting multi-person respiration from entangled rf signals. Proc ACM Interact Mob Wearable Ubiquit Technol 2:1–22CrossRef Yue S, He H, Wang H, Rahul H, Katabi D (2018) Extracting multi-person respiration from entangled rf signals. Proc ACM Interact Mob Wearable Ubiquit Technol 2:1–22CrossRef
49.
go back to reference Yun F, Huang TS (2007) Hmouse: head tracking driven virtual computer mouse Yun F, Huang TS (2007) Hmouse: head tracking driven virtual computer mouse
50.
go back to reference Zhao M, Adib F, Katabi D (2018) Emotion recognition using wireless signals. Commun ACM 61(9):91–100CrossRef Zhao M, Adib F, Katabi D (2018) Emotion recognition using wireless signals. Commun ACM 61(9):91–100CrossRef
51.
go back to reference Zhao M, Tian Y, Zhao H, Alsheikh M, Li T, Hristov R, Kabelac Z, Katabi D (2018) Torralba, A.: Rf-based 3d skeletons, pp 267–281 Zhao M, Tian Y, Zhao H, Alsheikh M, Li T, Hristov R, Kabelac Z, Katabi D (2018) Torralba, A.: Rf-based 3d skeletons, pp 267–281
Metadata
Title
HeadSee: Device-free head gesture recognition with commodity RFID
Authors
Kai Chen
Fuwei Wang
Miaoyu Li
Baoying Liu
Hao Chen
Feng Chen
Publication date
14-02-2022
Publisher
Springer US
Published in
Peer-to-Peer Networking and Applications / Issue 3/2022
Print ISSN: 1936-6442
Electronic ISSN: 1936-6450
DOI
https://doi.org/10.1007/s12083-021-01126-1

Other articles of this Issue 3/2022

Peer-to-Peer Networking and Applications 3/2022 Go to the issue

Premium Partner