Top

Published in:

2016 | OriginalPaper | Chapter

ISANA: Wearable Context-Aware Indoor Assistive Navigation with Obstacle Avoidance for the Blind

Authors : Bing Li, J. Pablo Muñoz, Xuejian Rong, Jizhong Xiao, Yingli Tian, Aries Arditi

Published in: Computer Vision – ECCV 2016 Workshops

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

This paper presents a novel mobile wearable context-aware indoor maps and navigation system with obstacle avoidance for the blind. The system includes an indoor map editor and an App on Tango devices with multiple modules. The indoor map editor parses spatial semantic information from a building architectural model, and represents it as a high-level semantic map to support context awareness. An obstacle avoidance module detects objects in front using a depth sensor. Based on the ego-motion tracking within the Tango, localization alignment on the semantic map, and obstacle detection, the system automatically generates a safe path to a desired destination. A speech-audio interface delivers user input, guidance and alert cues in real-time using a priority-based mechanism to reduce the user’s cognitive load. Field tests involving blindfolded and blind subjects demonstrate that the proposed prototype performs context-aware and safety indoor assistive navigation effectively.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter A 3D Human Posture Approach for Activity Recognition Based on Depth Camera

next chapter An Integrated Framework for 24-hours Fire Detection

https://developers.google.com/tango/.

http://tinyurl.com/Android-TTS.

http://cmusphinx.sourceforge.net.

World Health Organization: Towards universal eye health: a global action plan 2014 to 2019 report (2013)

United States National Eye Institute: United states prevalent cases of blindness (in thousands): Changes of cases between 2000 and 2010 (2010)

Xiao, J., Joseph, S.L., Zhang, X., Li, B., Li, X., Zhang, J.: An assistive navigation framework for the visually impaired. IEEE Trans. Hum.-Mach. Syst. 45(5), 635–640 (2015)CrossRef

Zhang, X., Li, B., Joseph, S.L., Xiao, J., Sun, Y., Tian, Y., Muñoz, J.P., Yi, C.: A slam based semantic indoor navigation system for visually impaired users. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1458–1463. IEEE (2015)

Muñoz, J.P., Li, B., Rong, X., Xiao, J., Tian, Y., Arditi, A.: Demo: assisting visually impaired people navigate indoors. In: International Joint Conference on Artificial Intelligence (2016)

Li, B., Zhang, X., Muñoz, J.P., Xiao, J., Rong, X., Tian, Y.: Assisting blind people to avoid obstacles: a wearable obstacle stereo feedback system based on 3d detection. In: 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 2307–2311. IEEE (2015)

Munoz, R., Rong, X., Tian, Y.: Depth-aware indoor staircase detection and recognition for the visually impaired. In: IEEE ICME Workshop on Mobile Multimedia Computing (MMC) (2016)

Jia, B., Liu, R., Zhu, M.: Real-time obstacle detection with motion features using monocular vision. Vis. Comput. 31(3), 281–293 (2015)CrossRef

He, H., Li, Y., Guan, Y., Tan, J.: Wearable ego-motion tracking for blind navigation in indoor environments. IEEE Trans. Autom. Sci. Eng. 12(4), 1181–1190 (2015)CrossRef

10.

Apostolopoulos, I., Fallah, N., Folmer, E., Bekris, K.E.: Integrated online localization and navigation for people with visual impairments using smart phones. ACM Trans. Interact. Intell. Syst. (TiiS) 3(4), 21 (2014)

11.

Mattoccia, S., Macrı, P.: 3D glasses as mobility aid for visually impaired people. In: Agapito, L., Bronstein, M.M., Rother, C. (eds.) ECCV 2014. LNCS, vol. 8927, pp. 539–554. Springer, Heidelberg (2015). doi:10.1007/978-3-319-16199-0_38

12.

Howard, A.: Real-time stereo visual odometry for autonomous ground vehicles. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2008, pp. 3946–3952. IEEE (2008)

13.

Pradeep, V., Medioni, G., Weiland, J.: Robot vision for the visually impaired. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 15–22. IEEE (2010)

14.

Schwarze, T., Lauer, M., Schwaab, M., Romanovas, M., Böhm, S., Jürgensohn, T.: A camera-based mobility aid for visually impaired people. KI-Künstliche Intelligenz 30(1), 29–36 (2016)CrossRef

15.

Courbon, J., Mezouar, Y., Eck, L., Martinet, P.: A generic fisheye camera model for robotic applications. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2007, pp. 1683–1688. IEEE (2007)

16.

Terashima, K., Watanabe, K., Ueno, Y., Masui, Y.: Auto-tuning control of power assist system based on the estimation of operator’s skill level for forward and backward driving of omni-directional wheelchair. In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 6046–6051. IEEE (2010)

17.

Lee, Y.H., Medioni, G.: A rgb-d camera based navigation for the visually impaired. In: RSS 2011 RGBD: Advanced Reasoning with Depth Camera Workshop, pp. 1–6 (2011)

18.

Lee, Y.H., Medioni, G.: Wearable RGBD indoor navigation system for the blind. In: Agapito, L., Bronstein, M.M., Rother, C. (eds.) ECCV 2014. LNCS, vol. 8927, pp. 493–508. Springer, Heidelberg (2015). doi:10.1007/978-3-319-16199-0_35

19.

Milotta, F.L.M., Allegra, D., Stanco, F., Farinella, G.M.: An electronic travel aid to assist blind and visually impaired people to avoid obstacles. In: Azzopardi, G., Petkov, N. (eds.) CAIP 2015. LNCS, vol. 9257, pp. 604–615. Springer, Heidelberg (2015). doi:10.1007/978-3-319-23117-4_52 CrossRef

20.

Lee, Y.H., Medioni, G.: Rgb-d camera based wearable navigation system for the visually impaired. Comput. Vis. Image Underst. 149, 3–20 (2016)CrossRef

21.

Zöllner, M., Huber, S., Jetter, H.-C., Reiterer, H.: NAVI – a proof-of-concept of a mobile navigational aid for visually impaired based on the microsoft kinect. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011. LNCS, vol. 6949, pp. 584–587. Springer, Heidelberg (2011). doi:10.1007/978-3-642-23768-3_88 CrossRef

22.

Brock, M., Kristensson, P.O.: Supporting blind navigation using depth sensing and sonification. In: Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, pp. 255–258. ACM (2013)

23.

Schilit, B., Adams, N., Want, R.: Context-aware computing applications. In: First Workshop on Mobile Computing Systems and Applications, WMCSA 1994, pp. 85–90. IEEE (1994)

24.

Gribble, W.S., Browning, R.L., Hewett, M., Remolina, E., Kuipers, B.J.: Integrating vision and spatial reasoning for assistive navigation. In: Mittal, V.O., Yanco, H.A., Aronis, J., Simpson, R. (eds.) Assistive Technology and Artificial Intelligence. LNCS, vol. 1458, pp. 179–193. Springer, Heidelberg (1998). doi:10.1007/BFb0055978 CrossRef

25.

Lyardet, F., Grimmer, J., Muhlhauser, M.: Coins: context sensitive indoor navigation system. In: Eighth IEEE International Symposium on Multimedia, ISM 2006, pp. 209–218. IEEE (2006)

26.

Lyardet, F., Szeto, D.W., Aitenbichler, E.: Context-aware indoor navigation. In: Aarts, E., Crowley, J.L., de Ruyter, B., Gerhäuser, H., Pflaum, A., Schmidt, J., Wichert, R. (eds.) AmI 2008. LNCS, vol. 5355, pp. 290–307. Springer, Heidelberg (2008)CrossRef

27.

Ferraiolo, D., Kuhn, D.R., Chandramouli, R.: Role-Based Access Control. Artech House, Boston (2003)MATH

28.

Afyouni, I., Cyril, R., Christophe, C.: Spatial models for context-aware indoor navigation systems: a survey. J. Spat. Inf. Sci. 1(4), 85–123 (2012)

29.

Afyouni, I.: Knowledge Representation and Management in Indoor Mobile Environments. Ph.D. thesis, Université de Bretagne occidentale-Brest (2013)

30.

Rong, X., Yi, C., Tian, Y.: Recognizing text-based traffic guide panels with cascaded localization network. In: Hua, G., Jégou, H. (eds.) ECCV 2016 Workshops. LNCS, vol. 9913, pp. 109–121. Springer, Heidelberg (2016). doi:10.1007/978-3-319-46604-0_8 CrossRef

31.

Hart, P.E., Nilsson, N.J., Raphael, B.: A formal basis for the heuristic determination of minimum cost paths. IEEE Trans. Syst. Sci. Cybern. 4(2), 100–107 (1968)CrossRef

32.

Rosenfeld, A., Pfaltz, J.L.: Sequential operations in digital picture processing. J. ACM (JACM) 13(4), 471–494 (1966)CrossRefMATH

33.

Cabaret, L., Lacassagne, L.: What is the world’s fastest connected component labeling algorithm? In: SiPS: IEEE International Workshop on Signal Processing Systems, p. 6. IEEE (2014)

34.

Borenstein, J., Koren, Y.: Histogramic in-motion mapping for mobile robot obstacle avoidance. IEEE Trans. Robot. Autom. 7(4), 535–539 (1991)CrossRef

Title: ISANA: Wearable Context-Aware Indoor Assistive Navigation with Obstacle Avoidance for the Blind
Authors: Bing Li
J. Pablo Muñoz
Xuejian Rong
Jizhong Xiao
Yingli Tian
Aries Arditi
Publisher: Springer International Publishing
Book: Computer Vision – ECCV 2016 Workshops
Print ISBN: 978-3-319-48880-6

Electronic ISBN: 978-3-319-48881-3

Copyright Year: 2016
DOI: https://doi.org/10.1007/978-3-319-48881-3_31

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner