Skip to main content
Top
Published in: Neural Computing and Applications 14/2022

14-03-2022 | Original Article

Toward robust and adaptive pedestrian monitoring using CSI: design, implementation, and evaluation

Authors: Jialai Liu, Kai Liu, Feiyu Jin, Liangyi Gong

Published in: Neural Computing and Applications | Issue 14/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This work puts the first effort on investigating robust and adaptive pedestrian passing detection and direction recognition based on WiFi Channel State Information (CSI). Specifically, we first give an insight into the challenges as well as opportunities of realizing cross-scenario pedestrian monitoring based on comprehensive analysis of CSI patterns. In light of the findings, we design a novel system framework, which consists of an offline pattern clustering and training module for constructing a unified offline database, and an online adaptive monitoring module for enabling real-time pedestrian passing detection and direction recognition. Further, we propose four mechanisms, including a CSI pre-processing method to enhance system robustness by extracting stable and distinct CSI features, a Two-stage Clustering (TC) method to enable cross-scenario CSI feature classification by segmenting the offline datasets automatically, a unified segmenting and detecting (USD) method to enable adaptive pedestrian passing detection by training a component classifier and a sample classifier, and a dynamic direction calculation (DDC) method to recognize the passing direction based on time of passing estimation, link confidence calculation, and direction indicator calculation. Finally, we implement the system prototype and evaluate the system performance in real-world scenarios. A comprehensive experimental study demonstrates that the proposed framework and the mechanisms can effectively enhance system robustness and adaptiveness on pedestrian monitoring.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Huang B, Mao G, Qin Y, Wei Y (2021) Pedestrian flow estimation through passive wifi sensing. IEEE Trans Mob Comput 20(4):1529–1542CrossRef Huang B, Mao G, Qin Y, Wei Y (2021) Pedestrian flow estimation through passive wifi sensing. IEEE Trans Mob Comput 20(4):1529–1542CrossRef
2.
go back to reference Wang H, Gong W (2020) Rf-pen: Practical real-time rfid tracking in the air. IEEE Trans Mob Comput 20(11):3227–3238CrossRef Wang H, Gong W (2020) Rf-pen: Practical real-time rfid tracking in the air. IEEE Trans Mob Comput 20(11):3227–3238CrossRef
3.
go back to reference Li D, Zhang Z, Chen X, Huang K (2018) A richly annotated pedestrian dataset for person retrieval in real surveillance scenarios. IEEE Trans Image Process 28(4):1575–1590MathSciNetCrossRef Li D, Zhang Z, Chen X, Huang K (2018) A richly annotated pedestrian dataset for person retrieval in real surveillance scenarios. IEEE Trans Image Process 28(4):1575–1590MathSciNetCrossRef
4.
go back to reference Ye M, Li J, Ma AJ, Zheng L, Yuen PC (2019) Dynamic graph co-matching for unsupervised video-based person re-identification. IEEE Trans Image Process 28(6):2976–2990MathSciNetCrossRef Ye M, Li J, Ma AJ, Zheng L, Yuen PC (2019) Dynamic graph co-matching for unsupervised video-based person re-identification. IEEE Trans Image Process 28(6):2976–2990MathSciNetCrossRef
5.
go back to reference Gomez A, Conti F, Benini L Thermal image-based cnn’s for ultra-low power people recognition. In: Proceedings of the 15th ACM international conference on computing frontiers, pp. 326–331 (2018) Gomez A, Conti F, Benini L Thermal image-based cnn’s for ultra-low power people recognition. In: Proceedings of the 15th ACM international conference on computing frontiers, pp. 326–331 (2018)
6.
go back to reference Jin F, Liu K, Zhang H, Ng JKY, Guo S, Lee VC, Son SH (2019) Toward scalable and robust indoor tracking: design, implementation, and evaluation. IEEE Internet Things J 7(2):1192–1204CrossRef Jin F, Liu K, Zhang H, Ng JKY, Guo S, Lee VC, Son SH (2019) Toward scalable and robust indoor tracking: design, implementation, and evaluation. IEEE Internet Things J 7(2):1192–1204CrossRef
7.
go back to reference Liu K, Zhang H, Ng JKY, Xia Y, Feng L, Lee VC, Son SH (2017) Toward low-overhead fingerprint-based indoor localization via transfer learning: design, implementation, and evaluation. IEEE Trans Industr Inf 14(3):898–908CrossRef Liu K, Zhang H, Ng JKY, Xia Y, Feng L, Lee VC, Son SH (2017) Toward low-overhead fingerprint-based indoor localization via transfer learning: design, implementation, and evaluation. IEEE Trans Industr Inf 14(3):898–908CrossRef
8.
go back to reference Zhang H, Liu K, Jin, F, Chen C, Zhan, C, Li J, Feng L An annulus local search based localization (alsl) algorithm in indoor wi-fi environments. In: Proceeding of IEEE international conference ubiquitous intelligence computing, pp. 887–892 (2018) Zhang H, Liu K, Jin, F, Chen C, Zhan, C, Li J, Feng L An annulus local search based localization (alsl) algorithm in indoor wi-fi environments. In: Proceeding of IEEE international conference ubiquitous intelligence computing, pp. 887–892 (2018)
9.
go back to reference Halperin D, Hu W, Sheth A, Wetherall D (2011) Tool release: gathering 802.11 n traces with channel state information. ACM SIGCOMM Comput Commun Rev 41(1):53CrossRef Halperin D, Hu W, Sheth A, Wetherall D (2011) Tool release: gathering 802.11 n traces with channel state information. ACM SIGCOMM Comput Commun Rev 41(1):53CrossRef
10.
go back to reference Wang Y, Wu K, Ni LM (2016) Wifall: device-free fall detection by wireless networks. IEEE Trans Mob Comput 16(2):581–594CrossRef Wang Y, Wu K, Ni LM (2016) Wifall: device-free fall detection by wireless networks. IEEE Trans Mob Comput 16(2):581–594CrossRef
11.
go back to reference Qian K, Wu C, Yang Z, Liu Y, Jamieson K Widar: Decimeter-level passive tracking via velocity monitoring with commodity wi-fi. In: Proceedings of the 18th ACM international symposium on mobile Ad Hoc networking and computing, pp. 1–10 (2017) Qian K, Wu C, Yang Z, Liu Y, Jamieson K Widar: Decimeter-level passive tracking via velocity monitoring with commodity wi-fi. In: Proceedings of the 18th ACM international symposium on mobile Ad Hoc networking and computing, pp. 1–10 (2017)
12.
go back to reference Qian K, Wu C, Zhang Y, Zhang G, Yang Z, Liu Y Widar2. 0: Passive human tracking with a single wi-fi link. In: Proceedings of the 16th annual international conference on mobile systems, applications, and services, pp. 350–361 (2018) Qian K, Wu C, Zhang Y, Zhang G, Yang Z, Liu Y Widar2. 0: Passive human tracking with a single wi-fi link. In: Proceedings of the 16th annual international conference on mobile systems, applications, and services, pp. 350–361 (2018)
13.
go back to reference Zheng Y, Zhang Y, Qian K, Zhang G, Liu Y, Wu C, Yang Z Zero-effort cross-domain gesture recognition with wi-fi. In: Proceedings of the 17th annual international conference on mobile systems, applications, and services, pp. 313–325 (2019) Zheng Y, Zhang Y, Qian K, Zhang G, Liu Y, Wu C, Yang Z Zero-effort cross-domain gesture recognition with wi-fi. In: Proceedings of the 17th annual international conference on mobile systems, applications, and services, pp. 313–325 (2019)
14.
go back to reference Li H, Ng J.K, Liu K Handling fingerprint sparsity for wi-fi based indoor localization in complex environments. In: Proceeding of IEEE international conference ubiquitous intelligence computing, pp. 1109–1116 (2019) Li H, Ng J.K, Liu K Handling fingerprint sparsity for wi-fi based indoor localization in complex environments. In: Proceeding of IEEE international conference ubiquitous intelligence computing, pp. 1109–1116 (2019)
15.
go back to reference Zhang H, Liu K, Jin F, Feng L, Lee V, Ng J (2020) A scalable indoor localization algorithm based on distance fitting and fingerprint mapping in wi-fi environments. Neural Comput Appl 32(9):5131–5145CrossRef Zhang H, Liu K, Jin F, Feng L, Lee V, Ng J (2020) A scalable indoor localization algorithm based on distance fitting and fingerprint mapping in wi-fi environments. Neural Comput Appl 32(9):5131–5145CrossRef
16.
go back to reference Jin F, Liu K, Zhang H, Wu W, Cao J, Zhai X A zero site-survey overhead indoor tracking system using particle filter. In: IEEE international conference on communications, pp. 1–7 (2019) Jin F, Liu K, Zhang H, Wu W, Cao J, Zhai X A zero site-survey overhead indoor tracking system using particle filter. In: IEEE international conference on communications, pp. 1–7 (2019)
17.
go back to reference Zhang H, Liu K, Shang Q, Feng L, Chen C, Wu Z, Guo S Dual-band wi-fi based indoor localization via stacked denosing autoencoder. In: IEEE global communications conference, pp. 1–6 (2019) Zhang H, Liu K, Shang Q, Feng L, Chen C, Wu Z, Guo S Dual-band wi-fi based indoor localization via stacked denosing autoencoder. In: IEEE global communications conference, pp. 1–6 (2019)
18.
go back to reference Hoang MT, Yuen B, Dong X, Lu T, Westendorp R, Reddy K (2019) Recurrent neural networks for accurate rssi indoor localization. IEEE Internet Things J 6(6):10639–10651CrossRef Hoang MT, Yuen B, Dong X, Lu T, Westendorp R, Reddy K (2019) Recurrent neural networks for accurate rssi indoor localization. IEEE Internet Things J 6(6):10639–10651CrossRef
19.
go back to reference Jie H, Liu K, Zhang H, Xie R, Wu W, Guo S (2020) Aodc: automatic offline database construction for indoor localization in a hybrid uwb/wi-fi environment. In: IEEE international conference on communications in China, pp. 324–329 Jie H, Liu K, Zhang H, Xie R, Wu W, Guo S (2020) Aodc: automatic offline database construction for indoor localization in a hybrid uwb/wi-fi environment. In: IEEE international conference on communications in China, pp. 324–329
20.
go back to reference Ma Y, Zhou G, Wang S (2019) Wifi sensing with channel state information: a survey. ACM Comput Surv 52(3):1–36CrossRef Ma Y, Zhou G, Wang S (2019) Wifi sensing with channel state information: a survey. ACM Comput Surv 52(3):1–36CrossRef
21.
go back to reference Wang H, Zhang D, Ma J, Wang Y, Wang Y, Wu D, Gu T, Xie B (2016) Human respiration detection with commodity wifi devices: do user location and body orientation matter? In: Proceedings of ACM international joint conference on pervasive and ubiquitous computing, pp. 25–36 Wang H, Zhang D, Ma J, Wang Y, Wang Y, Wu D, Gu T, Xie B (2016) Human respiration detection with commodity wifi devices: do user location and body orientation matter? In: Proceedings of ACM international joint conference on pervasive and ubiquitous computing, pp. 25–36
22.
go back to reference Cao Y, Wang F, Lu X, Lin N, Zhang B, Liu Z, Sigg S (2019) Contactless body movement recognition during sleep via wifi signals. IEEE Internet Things J 7(3):2028–2037CrossRef Cao Y, Wang F, Lu X, Lin N, Zhang B, Liu Z, Sigg S (2019) Contactless body movement recognition during sleep via wifi signals. IEEE Internet Things J 7(3):2028–2037CrossRef
23.
go back to reference Khan U.M, Kabir Z, Hassan SA, Ahmed SH (2017) A deep learning framework using passive wifi sensing for respiration monitoring. In: IEEE global communications conference, pp. 1–6 Khan U.M, Kabir Z, Hassan SA, Ahmed SH (2017) A deep learning framework using passive wifi sensing for respiration monitoring. In: IEEE global communications conference, pp. 1–6
24.
go back to reference Zhu X, Jing XY, You X, Zhang X, Zhang T (2018) Video-based person re-identification by simultaneously learning intra-video and inter-video distance metrics. IEEE Trans Image Process 27(11):5683–5695MathSciNetCrossRef Zhu X, Jing XY, You X, Zhang X, Zhang T (2018) Video-based person re-identification by simultaneously learning intra-video and inter-video distance metrics. IEEE Trans Image Process 27(11):5683–5695MathSciNetCrossRef
25.
go back to reference Liu J, Liu K, Jin F, Wang D, Yan G, Xiao K (2021) An efficient csi-based pedestrian monitoring approach via single pair of wifi transceivers. In: International conference on neural computing for advanced applications, pp 685–700 Liu J, Liu K, Jin F, Wang D, Yan G, Xiao K (2021) An efficient csi-based pedestrian monitoring approach via single pair of wifi transceivers. In: International conference on neural computing for advanced applications, pp 685–700
26.
go back to reference Ma C, Li W, Cao J, Du J, Li Q, Gravina R (2020) Adaptive sliding window based activity recognition for assisted livings. Information Fusion 53:55–65CrossRef Ma C, Li W, Cao J, Du J, Li Q, Gravina R (2020) Adaptive sliding window based activity recognition for assisted livings. Information Fusion 53:55–65CrossRef
27.
go back to reference Qian K, Wu C, Zhou Z, Zheng Y, Yang Z, Liu Y (2017) Inferring motion direction using commodity wi-fi for interactive exergames. In: Proceedings of the conference on human factors in computing systems, pp. 1961–1972 Qian K, Wu C, Zhou Z, Zheng Y, Yang Z, Liu Y (2017) Inferring motion direction using commodity wi-fi for interactive exergames. In: Proceedings of the conference on human factors in computing systems, pp. 1961–1972
28.
go back to reference Gao R, Wang H, Wu D, Niu K, Yi E, Zhang D (2017) A model based decimeter-scale device-free localization system using cots wi-fi devices. In: Proceedings of the ACM international joint conference on pervasive and ubiquitous computing and proceedings of the 2017 ACM international symposium on wearable computers, pp 241–244 Gao R, Wang H, Wu D, Niu K, Yi E, Zhang D (2017) A model based decimeter-scale device-free localization system using cots wi-fi devices. In: Proceedings of the ACM international joint conference on pervasive and ubiquitous computing and proceedings of the 2017 ACM international symposium on wearable computers, pp 241–244
Metadata
Title
Toward robust and adaptive pedestrian monitoring using CSI: design, implementation, and evaluation
Authors
Jialai Liu
Kai Liu
Feiyu Jin
Liangyi Gong
Publication date
14-03-2022
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 14/2022
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-022-07094-8

Other articles of this Issue 14/2022

Neural Computing and Applications 14/2022 Go to the issue

Premium Partner