Skip to main content
Top
Published in: The Journal of Supercomputing 7/2021

08-01-2021

CamNav: a computer-vision indoor navigation system

Authors: Abdel Ghani Karkar, Somaya Al-Maadeed, Jayakanth Kunhoth, Ahmed Bouridane

Published in: The Journal of Supercomputing | Issue 7/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We present CamNav, a vision-based navigation system that provides users with indoor navigation services. CamNav captures images in real time while the user is walking to recognize their current location. It does not require any installation of indoor localization devices. In this paper, we describe the techniques of our system that improve the recognition accuracy of an existing system that uses oriented FAST and rotated BRIEF (ORB) as part of its location-matching procedure. We employ multiscale local binary pattern (MSLBP) features to recognize places. We implement CamNav and conduct required experiments to compare the obtained accuracy when using ORB, the scale-invariant feature transform (SIFT), MSLBP features, and the combination of both ORB and SIFT features with MSLBP. A dataset composed of 42 classes was constructed for assessment. Each class contains 100 pictures designed for training one location and 24 pictures dedicated for testing. The evaluation results demonstrate that the place recognition accuracy while using MSLBP features is better than the accuracy when using SIFT features. The accuracy when using SIFT, MSLBP, and ORB features is 88.19%, 91.27%, and 96.33%, respectively. The overall accuracy of recognizing places increased to 93.55% and 97.52% after integrating MSLBP with SIFT with ORB, respectively.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Adorno J, DeLaHoz Y, Labrador MA (2016) Smartphone-based floor detection in unstructured and structured environments. In: 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops). IEEE, pp 1–6 Adorno J, DeLaHoz Y, Labrador MA (2016) Smartphone-based floor detection in unstructured and structured environments. In: 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops). IEEE, pp 1–6
2.
go back to reference Ahmetovic D, Gleason C, Ruan C, Kitani K, Takagi H, Asakawa C (2016) Navcog: a navigational cognitive assistant for the blind. In: Proceedings of the 18th International Conference on Human–Computer Interaction with Mobile Devices and Services. ACM, pp 90–99 Ahmetovic D, Gleason C, Ruan C, Kitani K, Takagi H, Asakawa C (2016) Navcog: a navigational cognitive assistant for the blind. In: Proceedings of the 18th International Conference on Human–Computer Interaction with Mobile Devices and Services. ACM, pp 90–99
3.
go back to reference Athira SV, George M, Jose BR, Mathew J (2017) A global image descriptor based navigation system for indoor environment. Procedia Comput Sci 115:466–473CrossRef Athira SV, George M, Jose BR, Mathew J (2017) A global image descriptor based navigation system for indoor environment. Procedia Comput Sci 115:466–473CrossRef
4.
go back to reference Beis JS, Lowe DG (1997) Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. In: CVPR, vol 97. Citeseer, p 1000 Beis JS, Lowe DG (1997) Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. In: CVPR, vol 97. Citeseer, p 1000
5.
go back to reference Canny J (1987) A computational approach to edge detection. In: Readings in Computer Vision. Elsevier, Amsterdam, pp 184–203 Canny J (1987) A computational approach to edge detection. In: Readings in Computer Vision. Elsevier, Amsterdam, pp 184–203
6.
go back to reference Chen Y, Chen R, Liu M, Xiao A, Wu D, Zhao S (2018) Indoor visual positioning aided by CNN-based image retrieval: training-free, 3d modeling-free. Sensors 18(8):2692CrossRef Chen Y, Chen R, Liu M, Xiao A, Wu D, Zhao S (2018) Indoor visual positioning aided by CNN-based image retrieval: training-free, 3d modeling-free. Sensors 18(8):2692CrossRef
7.
go back to reference Cheng J, Zhu X, Ding W, Gao G (2016) A robust real-time indoor navigation technique based on GPU-accelerated feature matching. In: 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN). IEEE, pp 1–4 Cheng J, Zhu X, Ding W, Gao G (2016) A robust real-time indoor navigation technique based on GPU-accelerated feature matching. In: 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN). IEEE, pp 1–4
8.
go back to reference Costa P, Fernandes H, Martins P, Barroso J, Hadjileontiadis LJ (2012) Obstacle detection using stereo imaging to assist the navigation of visually impaired people. Procedia Comput Sci 14:83–93CrossRef Costa P, Fernandes H, Martins P, Barroso J, Hadjileontiadis LJ (2012) Obstacle detection using stereo imaging to assist the navigation of visually impaired people. Procedia Comput Sci 14:83–93CrossRef
9.
go back to reference Deniz O, Paton J, Salido J, Bueno G, Ramanan J (2014) A vision-based localization algorithm for an indoor navigation app. In: 2014 Eighth International Conference on Next Generation Mobile Apps, Services and Technologies. IEEE, pp 7–12 Deniz O, Paton J, Salido J, Bueno G, Ramanan J (2014) A vision-based localization algorithm for an indoor navigation app. In: 2014 Eighth International Conference on Next Generation Mobile Apps, Services and Technologies. IEEE, pp 7–12
10.
go back to reference Doush IA, Alshatnawi S, Al-Tamimi AK, Alhasan B, Hamasha S (2017) Isab: integrated indoor navigation system for the blind. Interact Comput 29(2):181–202 Doush IA, Alshatnawi S, Al-Tamimi AK, Alhasan B, Hamasha S (2017) Isab: integrated indoor navigation system for the blind. Interact Comput 29(2):181–202
11.
go back to reference Eshratifar AE, Pedram M (2018) Energy and performance efficient computation offloading for deep neural networks in a mobile cloud computing environment. In: Proceedings of the 2018 on Great Lakes Symposium on VLSI. ACM, pp 111–116 Eshratifar AE, Pedram M (2018) Energy and performance efficient computation offloading for deep neural networks in a mobile cloud computing environment. In: Proceedings of the 2018 on Great Lakes Symposium on VLSI. ACM, pp 111–116
12.
go back to reference Garcia G, Nahapetian A (2015) Wearable computing for image-based indoor navigation of the visually impaired. In: Proceedings of the Conference on Wireless Health. ACM, p 17 Garcia G, Nahapetian A (2015) Wearable computing for image-based indoor navigation of the visually impaired. In: Proceedings of the Conference on Wireless Health. ACM, p 17
13.
go back to reference Huang Z, Gu N, Hao J, Shen J (2018) 3dloc: 3d features for accurate indoor positioning. Proc ACM Interact Mob Wear Ubiq Technol 1(4):141 Huang Z, Gu N, Hao J, Shen J (2018) 3dloc: 3d features for accurate indoor positioning. Proc ACM Interact Mob Wear Ubiq Technol 1(4):141
14.
go back to reference Ivanov R (2012) Rsnavi: an RFID-based context-aware indoor navigation system for the blind. In: Proceedings of the 13th International Conference on Computer Systems and Technologies. ACM, pp 313–320 Ivanov R (2012) Rsnavi: an RFID-based context-aware indoor navigation system for the blind. In: Proceedings of the 13th International Conference on Computer Systems and Technologies. ACM, pp 313–320
15.
go back to reference Jafri R, Campos RL, Ali SA, Arabnia HR (2018) Visual and infrared sensor data-based obstacle detection for the visually impaired using the Google project tango tablet development kit and the unity engine. IEEE Access 6:443–454CrossRef Jafri R, Campos RL, Ali SA, Arabnia HR (2018) Visual and infrared sensor data-based obstacle detection for the visually impaired using the Google project tango tablet development kit and the unity engine. IEEE Access 6:443–454CrossRef
16.
go back to reference Kacorri H, Mascetti S, Gerino A, Ahmetovic D, Takagi H, Asakawa C (2016) Supporting orientation of people with visual impairment: analysis of large scale usage data. In: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, pp 151–159 Kacorri H, Mascetti S, Gerino A, Ahmetovic D, Takagi H, Asakawa C (2016) Supporting orientation of people with visual impairment: analysis of large scale usage data. In: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, pp 151–159
17.
go back to reference Karami E, Prasad S, Shehata M (2017) Image matching using sift, surf, brief and orb: performance comparison for distorted images. arXiv preprint arXiv:1710.02726 Karami E, Prasad S, Shehata M (2017) Image matching using sift, surf, brief and orb: performance comparison for distorted images. arXiv preprint arXiv:​1710.​02726
18.
go back to reference Kawaji H, Hatada K, Yamasaki T, Aizawa K (2010) Image-based indoor positioning system: fast image matching using omnidirectional panoramic images. In: Proceedings of the 1st ACM International Workshop on Multimodal Pervasive Video Analysis. ACM, pp 1–4 Kawaji H, Hatada K, Yamasaki T, Aizawa K (2010) Image-based indoor positioning system: fast image matching using omnidirectional panoramic images. In: Proceedings of the 1st ACM International Workshop on Multimodal Pervasive Video Analysis. ACM, pp 1–4
19.
20.
go back to reference Lee YH, Medioni G (2016) RGB-D camera based wearable navigation system for the visually impaired. Comput Vis Image Underst 149:3–20CrossRef Lee YH, Medioni G (2016) RGB-D camera based wearable navigation system for the visually impaired. Comput Vis Image Underst 149:3–20CrossRef
21.
go back to reference Li L, Xu Q, Chandrasekhar V, Lim JH, Tan C, Mukawa MA (2016) A wearable virtual usher for vision-based cognitive indoor navigation. IEEE Trans Cybern 47(4):841–854CrossRef Li L, Xu Q, Chandrasekhar V, Lim JH, Tan C, Mukawa MA (2016) A wearable virtual usher for vision-based cognitive indoor navigation. IEEE Trans Cybern 47(4):841–854CrossRef
22.
go back to reference Manlises C, Yumang A, Marcelo M, Adriano A, Reyes J (2016) Indoor navigation system based on computer vision using camshift and d* algorithm for visually impaired. In: 2016 6th IEEE International Conference on Control System, Computing and Engineering (ICCSCE). IEEE, pp 481–484 Manlises C, Yumang A, Marcelo M, Adriano A, Reyes J (2016) Indoor navigation system based on computer vision using camshift and d* algorithm for visually impaired. In: 2016 6th IEEE International Conference on Control System, Computing and Engineering (ICCSCE). IEEE, pp 481–484
23.
go back to reference Murillo AC, Gutiérrez-Gómez D, Rituerto A, Puig L, Guerrero JJ (2012) Wearable omnidirectional vision system for personal localization and guidance. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. IEEE, pp 8–14 Murillo AC, Gutiérrez-Gómez D, Rituerto A, Puig L, Guerrero JJ (2012) Wearable omnidirectional vision system for personal localization and guidance. In: 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. IEEE, pp 8–14
24.
go back to reference Noh Y, Yamaguchi H, Lee U (2018) Infrastructure-free collaborative indoor positioning scheme for time-critical team operations. IEEE Trans Syst Man Cybern Syst 48(3):418–432CrossRef Noh Y, Yamaguchi H, Lee U (2018) Infrastructure-free collaborative indoor positioning scheme for time-critical team operations. IEEE Trans Syst Man Cybern Syst 48(3):418–432CrossRef
25.
26.
go back to reference Pietikäinen M, Hadid A, Zhao G, Ahonen T (2011) Computer vision using local binary patterns, vol 40. Springer, BerlinCrossRef Pietikäinen M, Hadid A, Zhao G, Ahonen T (2011) Computer vision using local binary patterns, vol 40. Springer, BerlinCrossRef
27.
go back to reference Raikwal J, Saxena K (2012) Performance evaluation of SVM and k-nearest neighbor algorithm over medical data set. Int J Comput Appl 50(14):35–39 Raikwal J, Saxena K (2012) Performance evaluation of SVM and k-nearest neighbor algorithm over medical data set. Int J Comput Appl 50(14):35–39
28.
go back to reference Raja Y, Gong S (2006) Sparse multiscale local binary patterns. In: BMVC, pp 799–808 Raja Y, Gong S (2006) Sparse multiscale local binary patterns. In: BMVC, pp 799–808
29.
go back to reference Riggs W, Gordon K (2017) How is mobile technology changing city planning? developing a taxonomy for the future. Environ Plan B Urban Anal City Sci 44(1):100–119CrossRef Riggs W, Gordon K (2017) How is mobile technology changing city planning? developing a taxonomy for the future. Environ Plan B Urban Anal City Sci 44(1):100–119CrossRef
30.
go back to reference Rublee E, Rabaud V, Konolige K, Bradski GR (2011) Orb: an efficient alternative to sift or surf. In: ICCV, vol 11. Citeseer, p 2 Rublee E, Rabaud V, Konolige K, Bradski GR (2011) Orb: an efficient alternative to sift or surf. In: ICCV, vol 11. Citeseer, p 2
31.
go back to reference Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117CrossRef Schmidhuber J (2015) Deep learning in neural networks: an overview. Neural Netw 61:85–117CrossRef
32.
33.
go back to reference Sonka M, Hlavac V, Boyle R (2014) Image processing, analysis, and machine vision. In: Cengage Learning Sonka M, Hlavac V, Boyle R (2014) Image processing, analysis, and machine vision. In: Cengage Learning
34.
go back to reference Srivastava P, Khare A (2018) Utilizing multiscale local binary pattern for content-based image retrieval. Multimed Tools Appl 77(10):12377–12403CrossRef Srivastava P, Khare A (2018) Utilizing multiscale local binary pattern for content-based image retrieval. Multimed Tools Appl 77(10):12377–12403CrossRef
35.
go back to reference Starner T (2013) Project glass: an extension of the self. IEEE Pervas Comput 12(2):14–16CrossRef Starner T (2013) Project glass: an extension of the self. IEEE Pervas Comput 12(2):14–16CrossRef
36.
go back to reference Tian Y, Yang X, Arditi A (2010) Computer vision-based door detection for accessibility of unfamiliar environments to blind persons. In: International Conference on Computers for Handicapped Persons. Springer, Berlin, pp 263–270 Tian Y, Yang X, Arditi A (2010) Computer vision-based door detection for accessibility of unfamiliar environments to blind persons. In: International Conference on Computers for Handicapped Persons. Springer, Berlin, pp 263–270
37.
go back to reference Tian Y, Yang X, Yi C, Arditi A (2013) Toward a computer vision-based wayfinding aid for blind persons to access unfamiliar indoor environments. Mach Vis Appl 24(3):521–535CrossRef Tian Y, Yang X, Yi C, Arditi A (2013) Toward a computer vision-based wayfinding aid for blind persons to access unfamiliar indoor environments. Mach Vis Appl 24(3):521–535CrossRef
38.
go back to reference Tuta J, Juric MB (2018) Mfam: multiple frequency adaptive model-based indoor localization method. Sensors 18(4):963CrossRef Tuta J, Juric MB (2018) Mfam: multiple frequency adaptive model-based indoor localization method. Sensors 18(4):963CrossRef
39.
go back to reference Wang E, Yan W (2014) inavigation: an image based indoor navigation system. Multimed Tools Appl 73(3):1597–1615CrossRef Wang E, Yan W (2014) inavigation: an image based indoor navigation system. Multimed Tools Appl 73(3):1597–1615CrossRef
40.
go back to reference Weigend AS (2018) Time series prediction: forecasting the future and understanding the past. Routledge, LondonCrossRef Weigend AS (2018) Time series prediction: forecasting the future and understanding the past. Routledge, LondonCrossRef
41.
go back to reference Xiao A, Chen R, Li D, Chen Y, Wu D (2018) An indoor positioning system based on static objects in large indoor scenes by using smartphone cameras. Sensors 18(7):2229CrossRef Xiao A, Chen R, Li D, Chen Y, Wu D (2018) An indoor positioning system based on static objects in large indoor scenes by using smartphone cameras. Sensors 18(7):2229CrossRef
42.
go back to reference Zheng Y, Luo P, Chen S, Hao J, Cheng H (2017) Visual search based indoor localization in low light via RGB-D camera. World Acad Sci Eng Technol Int J Comput Electr Autom Control Inf Eng 11(3):349–352 Zheng Y, Luo P, Chen S, Hao J, Cheng H (2017) Visual search based indoor localization in low light via RGB-D camera. World Acad Sci Eng Technol Int J Comput Electr Autom Control Inf Eng 11(3):349–352
43.
go back to reference Zheng Y, Shen G, Li L, Zhao C, Li M, Zhao F (2017) Travi-navi: self-deployable indoor navigation system. IEEE/ACM Trans Netw 25(5):2655–2669CrossRef Zheng Y, Shen G, Li L, Zhao C, Li M, Zhao F (2017) Travi-navi: self-deployable indoor navigation system. IEEE/ACM Trans Netw 25(5):2655–2669CrossRef
Metadata
Title
CamNav: a computer-vision indoor navigation system
Authors
Abdel Ghani Karkar
Somaya Al-Maadeed
Jayakanth Kunhoth
Ahmed Bouridane
Publication date
08-01-2021
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 7/2021
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-020-03568-5

Other articles of this Issue 7/2021

The Journal of Supercomputing 7/2021 Go to the issue

Premium Partner