Skip to main content
Erschienen in: Neural Computing and Applications 15/2021

18.01.2021 | Original Article

Application of solely self-attention mechanism in CSI-fingerprinting-based indoor localization

verfasst von: Kabo Poloko Nkabiti, Yueyun Chen

Erschienen in: Neural Computing and Applications | Ausgabe 15/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the growth of IoT services, there has been an increased demand for indoor localization-based services. Wi-Fi access is omnipresent; its high accuracy and ability to use commodity devices makes it suitable to be widely adopted for localization in indoor environments. Recent sequence transduction models such as recurrent neural network (RNN) and long short-term memory (LSTM) mostly rely on recurrent and convolution. Both LSTM and RNN have achieved tremendous results in the localization tasks, but their sequential character prevents them from effectively performing parallel computing, therefore, limiting their performance in processing extremely long sequences. Lately, there have been different models developed for natural language processing transduction tasks that relied solely on attention mechanism, and they performed remarkably well with less computation. This paper is the first to propose the sole utilization of self-attention mechanism for localization time-series modeling. We introduce a self-attention mechanism fingerprinting-based model (SAMFI) which uses positional encoding and masking mechanism. To capture the temporal ordering information, we used the extended symbolic aggregate approximation strategy. Moreover, the proposed model utilizes calibrated channel state information as location fingerprints. SAMFI's pivotal concept is simple and empirically potent. The obtained results significantly minimized the location error on the collected dataset with an accuracy level score of 86.5% outperforming both RNN and LSTM models which scored 82.6 and 67.5%, respectively.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Magnago V, Palopoli L, Passerone R, Fontanelli D, Macii D (2017) A nearly optimal landmark deployment for indoor localisation with limited sensing. In: 2017 international conference on indoor positioning and indoor navigation (IPIN), pp 1–8 Magnago V, Palopoli L, Passerone R, Fontanelli D, Macii D (2017) A nearly optimal landmark deployment for indoor localisation with limited sensing. In: 2017 international conference on indoor positioning and indoor navigation (IPIN), pp 1–8
4.
Zurück zum Zitat Comiter M (2018) Localization convolutional neural networks using angle of arrival images. In: 2018 IEEE global communications conference (GLOBECOM), pp 1–7 Comiter M (2018) Localization convolutional neural networks using angle of arrival images. In: 2018 IEEE global communications conference (GLOBECOM), pp 1–7
5.
Zurück zum Zitat Hamza L, Nerguizian C (2009) Neural network and fingerprinting based localization Neural Network and Fingerprinting-based in dynamic channels localization in dynamic channels. In: 2009 IEEE international symposium on intelligent signal processing, pp 253–258. https://doi.org/10.1109/WISP.2009.5286554 Hamza L, Nerguizian C (2009) Neural network and fingerprinting based localization Neural Network and Fingerprinting-based in dynamic channels localization in dynamic channels. In: 2009 IEEE international symposium on intelligent signal processing, pp 253–258. https://​doi.​org/​10.​1109/​WISP.​2009.​5286554
12.
Zurück zum Zitat Wang X, Gao L, Mao S (2017) BiLoc: bi-modal deep learning for indoor localization with commodity 5GHz WiFi. IEEE Access 5:4209–4220CrossRef Wang X, Gao L, Mao S (2017) BiLoc: bi-modal deep learning for indoor localization with commodity 5GHz WiFi. IEEE Access 5:4209–4220CrossRef
15.
Zurück zum Zitat Khatab ZE, Hajihoseini A, Ghorashi SA (2018) A fingerprint method for indoor localization using autoencoder based deep extreme learning machine. IEEE Sens Lett 2(1):1–4CrossRef Khatab ZE, Hajihoseini A, Ghorashi SA (2018) A fingerprint method for indoor localization using autoencoder based deep extreme learning machine. IEEE Sens Lett 2(1):1–4CrossRef
17.
Zurück zum Zitat Chan S, Sohn G (2012) Indoor localization using Wi-Fi based fingerprinting and trilateration techniques for LBS applications. Int Arch Photogramm Remote Sens Spat Inf Sci XXXVIII:3–7 Chan S, Sohn G (2012) Indoor localization using Wi-Fi based fingerprinting and trilateration techniques for LBS applications. Int Arch Photogramm Remote Sens Spat Inf Sci XXXVIII:3–7
19.
Zurück zum Zitat Celso A, Dantes JD, Ravelo LA, Limjoco WJ, Tiglao NM (2018) Improving WiFi indoor localization through a peer-to-peer architecture. In: TENCON 2018–2018 IEEE region 10 conference, October, pp 2060–2065 Celso A, Dantes JD, Ravelo LA, Limjoco WJ, Tiglao NM (2018) Improving WiFi indoor localization through a peer-to-peer architecture. In: TENCON 2018–2018 IEEE region 10 conference, October, pp 2060–2065
20.
Zurück zum Zitat Song H, Rajan D, Thiagarajan JJ, Spanias A (2018) Attend and diagnose: clinical time series analysis using attention models. Mach Learn (stat.ML); Mach Learn Song H, Rajan D, Thiagarajan JJ, Spanias A (2018) Attend and diagnose: clinical time series analysis using attention models. Mach Learn (stat.ML); Mach Learn
21.
Zurück zum Zitat Zhang W, Sengupta R, Fodero J, Li X (2017) DeepPositioning: intelligent fusion of pervasive magnetic field and WiFi fingerprinting for smartphone indoor localization via deep learning. In: 2017 16th IEEE international conference on machine learning and applications, pp 1–7. https://doi.org/10.1109/ICMLA.2017.0-185 Zhang W, Sengupta R, Fodero J, Li X (2017) DeepPositioning: intelligent fusion of pervasive magnetic field and WiFi fingerprinting for smartphone indoor localization via deep learning. In: 2017 16th IEEE international conference on machine learning and applications, pp 1–7. https://​doi.​org/​10.​1109/​ICMLA.​2017.​0-185
22.
23.
Zurück zum Zitat Bahl P, Padmanabhan VN (2000) RADAR: an in-building RF-based user location and tracking system. In: Proceedings of IEEE INFOCOM 2000, no. Cat. No.00CH37064 Bahl P, Padmanabhan VN (2000) RADAR: an in-building RF-based user location and tracking system. In: Proceedings of IEEE INFOCOM 2000, no. Cat. No.00CH37064
25.
Zurück zum Zitat Vaswani A et al (2017) Attention is all you need. In: Advances in neural information processing systems, vol. 2017–Decem, no. Nips, pp 5999–6009 Vaswani A et al (2017) Attention is all you need. In: Advances in neural information processing systems, vol. 2017–Decem, no. Nips, pp 5999–6009
27.
Zurück zum Zitat Shen T, Zhou T, Long G, Jiang J, Zhang C (2018) Bi-directional block self-attention for fast and memory-efficient sequence modeling. In: 6th international conference on learning representations (ICLR) 2018—conference track proceedings, pp 1–18 Shen T, Zhou T, Long G, Jiang J, Zhang C (2018) Bi-directional block self-attention for fast and memory-efficient sequence modeling. In: 6th international conference on learning representations (ICLR) 2018—conference track proceedings, pp 1–18
28.
Zurück zum Zitat Yang B, Wang L, Wong DF, Chao LS, Tu Z (2019) Convolutional self-attention networks. In: NAACL HLT 2019—2019 conference of the North American chapter of the association for computational linguistics: human language technologies—Proceedings conference, vol 1, pp 4040–4045. https://doi.org/10.18653/v1/n19-1407 Yang B, Wang L, Wong DF, Chao LS, Tu Z (2019) Convolutional self-attention networks. In: NAACL HLT 2019—2019 conference of the North American chapter of the association for computational linguistics: human language technologiesProceedings conference, vol 1, pp 4040–4045. https://​doi.​org/​10.​18653/​v1/​n19-1407
29.
Zurück zum Zitat Kenton MC, Kristina L, Devlin J (1953) BERT: pre-training of deep bidirectional transformers for language understanding. Mlm Kenton MC, Kristina L, Devlin J (1953) BERT: pre-training of deep bidirectional transformers for language understanding. Mlm
32.
36.
Zurück zum Zitat Taylor WL (1953) “Cloze procedure”: a new tool for measuring readability. Journal Q 30(4):415–433CrossRef Taylor WL (1953) “Cloze procedure”: a new tool for measuring readability. Journal Q 30(4):415–433CrossRef
39.
Zurück zum Zitat Hertel L, Collado J, Sadowski P, Ott J, Baldi P (2020) Sherpa: robust hyperparameter optimization for machine learning. NIPS Work, no. Nips. arXiv:2005.04048 Hertel L, Collado J, Sadowski P, Ott J, Baldi P (2020) Sherpa: robust hyperparameter optimization for machine learning. NIPS Work, no. Nips. arXiv:​2005.​04048
40.
Zurück zum Zitat Li L, Jamieson K, Rostamizadeh A, Gonina E, Moritz JB, Mar LG (2020) A system for massively parallel hyperparameter tuning. In: Conference on machine learning and systems Li L, Jamieson K, Rostamizadeh A, Gonina E, Moritz JB, Mar LG (2020) A system for massively parallel hyperparameter tuning. In: Conference on machine learning and systems
41.
Zurück zum Zitat Liu L et al (2019) On the variance of the adaptive learning rate and beyond. Mach Learn (cs.LG); Comput Lang (cs.CL); Mach Learn, pp 1–14. arXiv preprint arXiv:1908.03265 Liu L et al (2019) On the variance of the adaptive learning rate and beyond. Mach Learn (cs.LG); Comput Lang (cs.CL); Mach Learn, pp 1–14. arXiv preprint arXiv:​1908.​03265
Metadaten
Titel
Application of solely self-attention mechanism in CSI-fingerprinting-based indoor localization
verfasst von
Kabo Poloko Nkabiti
Yueyun Chen
Publikationsdatum
18.01.2021
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 15/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05681-1

Weitere Artikel der Ausgabe 15/2021

Neural Computing and Applications 15/2021 Zur Ausgabe