skip to main content
review-article

NavCog3 in the Wild: Large-scale Blind Indoor Navigation Assistant with Semantic Features

Published:31 August 2019Publication History
Skip Abstract Section

Abstract

NavCog3 is a smartphone turn-by-turn navigation assistant system we developed specifically designed to enable independent navigation for people with visual impairments. Using off-the-shelf Bluetooth beacons installed in the surrounding environment and a commodity smartphone carried by the user, NavCog3 achieves unparalleled localization accuracy in real-world large-scale scenarios. By leveraging its accurate localization capabilities, NavCog3 guides the user through the environment and signals the presence of semantic features and points of interest in the vicinity (e.g., doorways, shops).

To assess the capability of NavCog3 to promote independent mobility of individuals with visual impairments, we deployed and evaluated the system in two challenging real-world scenarios. The first scenario demonstrated the scalability of the system, which was permanently installed in a five-story shopping mall spanning three buildings and a public underground area. During the study, 10 participants traversed three fixed routes, and 43 participants traversed free-choice routes across the environment. The second scenario validated the system’s usability in the wild in a hotel complex temporarily equipped with NavCog3 during a conference for individuals with visual impairments. In the hotel, almost 14.2h of system usage data were collected from 37 unique users who performed 280 travels across the environment, for a total of 30,200m traversed.

References

  1. Ali Abdolrahmani, Ravi Kuber, and Amy Hurst. 2016. An empirical investigation of the situationally induced impairments experienced by blind mobile device users. In Proceedings of the 13th Web for All Conference (W4A’16). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Dragan Ahmetovic, Cole Gleason, Kris M. Kitani, Hironobu Takagi, and Chieko Asakawa. 2016. NavCog: Turn-by-turn smartphone navigation assistant for people with visual impairments or blindness. In Proceedings of the 13th Web for All Conference (W4A’16). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Dragan Ahmetovic, Cole Gleason, Chengxiong Ruan, Kris Kitani, Hironobu Takagi, and Chieko Asakawa. 2016. NavCog: A navigational cognitive assistant for the blind. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI’16). ACM, New York, NY, 90--99. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Dragan Ahmetovic, João Guerreiro, Eshed Ohn-Bar, Kris Kitani, and Chieko Asakawa. 2019. Impact of expertise on interaction preferences for navigation assistance of visually impaired individuals. In Proceedings of the 16th Web for All Conference (W4A’19). Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Dragan Ahmetovic, Masayuki Murata, Cole Gleason, Erin Brady, Hironobu Takagi, Kris Kitani, and Chieko Asakawa. 2017. Achieving practical and accurate indoor navigation for people with visual impairments. In Proceedings of the 14th Web for All Conference on the Future of Accessible Work (W4A’17). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Dragan Ahmetovic, Uran Oh, Sergio Mascetti, and Chieko Asakawa. 2018. Turn right: Analysis of rotation errors in turn-by-turn navigation for individuals with visual impairments. In Proceedings of the Conference on Computers and Accessibility. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Aplix. {n.d.}. MyBeacon general purpose type MB004 Ac—Aplix. Retrieved from http://business.aplix.co.jp/product/mybeacon/mb004ac/.Google ScholarGoogle Scholar
  8. Ariadne GPS. {n.d.}. Ariadne GPS—An innovative app for your mobility. Retrieved from http://www.ariadnegps.eu/.Google ScholarGoogle Scholar
  9. Saki Asakawa, João Guerreiro, Daisuke Sato, Hironobu Takagi, Dragan Ahmetovic, Desi Gonzalez, Kris Kitani, and Chieko Asakawa. 2019. An independent and interactive museum experience for blind people. In Proceedings of the 16th Web for All Conference (W4A’19). Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Shiri Azenkot and Nicole B. Lee. 2013. Exploring the use of speech input by blind people on mobile devices. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’13). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. J. M. Barlow, B. L. Bentzen, D. Sauerburger, and L. Franck. 2010. Teaching travel at complex intersections. Found. Orient. Mobil. 2 (2010), 352--419.Google ScholarGoogle Scholar
  12. Pauline M. Berry, Karen Myers, Tomás E. Uribe, and Neil Yorke-Smith. 2005. Task management under change and uncertainty. In Proceedings of the Workshop on Constraint Solving under Change.Google ScholarGoogle Scholar
  13. Alex Black, Jan E. Lovie-Kitchin, Russell L. Woods, Nicole Arnold, John Byrnes, and Jane Murrish. 1997. Mobility performance with retinitis pigmentosa. Clin. Exper. Optom. 80, 1 (1997), 1--12.Google ScholarGoogle ScholarCross RefCross Ref
  14. Bruce B. Blasch, William R. Wiener, and Richard L. Welsh. 1997. Foundations of Orientation and Mobility. American Foundation for the Blind.Google ScholarGoogle Scholar
  15. BlindSquare. {n.d.}. BlindSquare—Pioneering accessible navigation—indoors and outdoors. Retrieved from http://www.blindsquare.com/.Google ScholarGoogle Scholar
  16. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitat. Res. Psychol. 3, 2 (2006), 77--101.Google ScholarGoogle ScholarCross RefCross Ref
  17. Yu-Chung Cheng, Yatin Chawathe, Anthony LaMarca, and John Krumm. 2005. Accuracy characterization for metropolitan-scale Wi-Fi localization. In Proceedings of the 3rd International Conference on Mobile Systems, Applications, and Services (MobiSys’05). ACM, New York, NY, 233--245. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Contact. {n.d.}. Double Battery Beacon. Retrieved from https://store.kontakt.io/our-products/30-double-battery-beacon.html.Google ScholarGoogle Scholar
  19. Ádám Csapó, György Wersényi, Hunor Nagy, and Tony Stockman. 2015. A survey of assistive technologies and applications for blind users on mobile platforms: A review and foundation for research. J. Multimod. User Interfaces 9, 4 (2015), 275--286.Google ScholarGoogle ScholarCross RefCross Ref
  20. M. Bernardine Dias, Ermine A. Teves, George J. Zimmerman, Hend K. Gedawy, Sarah M. Belousov, and M. Bernardine Dias. 2015. Indoor navigation challenges for visually impaired people. In Indoor Wayfinding and Navigation. CRC Press, 141--164.Google ScholarGoogle Scholar
  21. Draft. 2017. Draft Development Specification for Spatial Network Model for Pedestrians. Ministry of Land, Infrastructure, Transport and Tourism, Japan. Retrieved from http://www.mlit.go.jp/common/001177505.pdf.Google ScholarGoogle Scholar
  22. Navid Fallah, Ilias Apostolopoulos, Kostas Bekris, and Eelke Folmer. 2012. The user as a sensor: Navigating users with visual impairments in indoor spaces using tactile landmarks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). ACM, New York, NY, 425--432. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Navid Fallah, Ilias Apostolopoulos, Kostas Bekris, and Eelke Folmer. 2013. Indoor human navigation systems: A survey. Interact. Comput. 25, 1 (Jan. 2013), 21--33.Google ScholarGoogle Scholar
  24. José Faria, Sérgio Lopes, Hugo Fernandes, Paulo Martins, and João Barroso. 2010. Electronic white cane for blind people navigation assistance. In Proceedings of the World Automation Congress. 1--7.Google ScholarGoogle Scholar
  25. German Flores and Roberto Manduchi. 2018. Easy return: An app for indoor backtracking assistance. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Giovanni Fusco and James M. Coughlan. 2018. Indoor localization using computer vision and visual-inertial odometry. In Proceedings of the International Conference on Computers Helping People with Special Needs. Springer, 86--93.Google ScholarGoogle Scholar
  27. Nicholas A. Giudice. 2018. 15. Navigating without vision: Principles of blind spatial cognition. Handbook Behav. Cogn. Geogr. (2018). Edward Elgar Publishing, 260--290.Google ScholarGoogle Scholar
  28. Nicholas A. Giudice and Gordon E. Legge. 2008. Blind Navigation and the Role of Technology. John Wiley 8 Sons, Inc., 479--500.Google ScholarGoogle Scholar
  29. Cole Gleason, Dragan Ahmetovic, Saiph Savage, Carlos Toxtli, Carl Posthuma, Chieko Asakawa, Kris M. Kitani, and Jeffrey P. Bigham. 2018. Crowdsourcing the installation and maintenance of indoor localization infrastructure to support blind navigation. Proc. ACM Interact. Mob. Wearable Ubiq. Technol. 2, 1, Article 9 (Mar. 2018). Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Cole Gleason, Dragan Ahmetovic, Carlos Toxtli, Saiph Savage, Jeffrey P. Bigham, and Chieko Asakawa. 2017. LuzDeploy: A collective action system for installing navigation infrastructure for blind people. In Proceedings of the 14th Web for All Conference on the Future of Accessible Work (W4A’17). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Cole Gleason, Alexander J. Fiannaca, Melanie Kneisel, Edward Cutrell, and Meredith Ringel Morris. 2018. FootNotes: Geo-referenced audio annotations for nonvisual exploration. Proc. ACM Interact. Mob. Wearable Ubiq. Technol. 2, 3 (2018), 109. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Google Maps. {n.d.}. Google Maps—See What We’re up to. Retrieved from https://www.google.com/intl/en/maps/about/.Google ScholarGoogle Scholar
  33. João Guerreiro, Dragan Ahmetovic, Kris M. Kitani, and Chieko Asakawa. 2017. Virtual navigation for blind people: Building sequential representations of the real-world. In The Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. João Guerreiro, Dragan Ahmetovic, Daisuke Sato, Kris Kitani, and Chieko Asakawa. 2019. Airport accessibility and navigation assistance for people with visual impairments. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI’19). Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. João Guerreiro, Eshed Ohn-Bar, Dragan Ahmetovic, Kris Kitani, and Chieko Asakawa. 2018. How context and user behavior affect indoor navigation assistance for blind people. In Proceedings of the Internet of Accessible Things (W4A’18). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Simon Harper, Stephen Pettitt, and Carole Goble. 2003. Sentinel: Towards an ambient mobility network. Disabil. Rehab. 25, 16 (2003), 940--948.Google ScholarGoogle ScholarCross RefCross Ref
  37. Sumi Helal, Carlos Giraldo, Youssef Kaddoura, Choonhwa Lee, Hicham El Zabadani, and William Mann. 2003. Smart phone-based cognitive assistant. In Proceedings of the 2nd International Workshop on Ubiquitous Computing for Pervasive Healthcare Applications (UbiHealth’03).Google ScholarGoogle Scholar
  38. Andreas Hub, Joachim Diepstraten, and Thomas Ertl. 2004. Design and development of an indoor navigation and object identification system for the blind. In Proceedings of the 6th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’04). ACM, New York, NY, 147--152. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. HULOP0. {n.d.}. Human-scale Localization Platform (HULOP) - GitHub. Retrieved from https://github.com/hulop.Google ScholarGoogle Scholar
  40. HULOP1. {n.d.}. hulop/NavCogIOSv3—GitHub, NavCog version 3 for iOS. Retrieved from https://github.com/hulop/NavCogIOSv3.Google ScholarGoogle Scholar
  41. HULOP2. {n.d.}. hulop/blelocpp—GitHub, BLE localization C++ library. Retrieved from https://github.com/hulop/blelocpp.Google ScholarGoogle Scholar
  42. HULOP3. {n.d.}. hulop/MapService—GitHub, map editing and routing server app. Retrieved from https://github.com/hulop/MapService.Google ScholarGoogle Scholar
  43. Amy Hurst, Jennifer Mankoff, and Scott E. Hudson. 2008. Understanding pointing problems in real world computing environments. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 43--50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Tatsuya Ishihara, Jayakorn Vongkulbhisal, Kris M. Kitani, and Chieko Asakawa. 2017. Beacon-guided structure from motion for smartphone-based navigation. In Proceedings of the Winter Conference on the Applications of Computer Vision. IEEE.Google ScholarGoogle ScholarCross RefCross Ref
  45. Suk Hoon Jung, Byeong-Cheol Moon, and Dongsoo Han. 2017. Performance evaluation of radio map construction methods for Wi-Fi positioning systems. Trans. Intell. Transport. Sys. 18, 4 (Apr. 2017), 880--889. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Hernisa Kacorri, Sergio Mascetti, Andrea Gerino, Dragan Ahmetovic, Valeria Alampi, Hironobu Takagi, and Chieko Asakawa. 2018. Insights on assistive orientation and mobility of people with visual impairment based on large-scale longitudinal data. ACM Trans. Access. Comput. 11, 1, Article 5 (2018), 28 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Hernisa Kacorri, Sergio Mascetti, Andrea Gerino, Dragan Ahmetovic, Hironobu Takagi, and Chieko Asakawa. 2016. Supporting orientation of people with visual impairment: Analysis of large scale usage data. In Proceedings of the International ACM SIGACCESS Conference on Computers and Accessibility. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Hernisa Kacorri, Eshed Ohn-Bar, Kris M. Kitani, and Chieko Asakawa. 2018. Environmental factors in indoor navigation based on real-world trajectories of blind users. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI’18). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Slim Kammoun, Florian Dramas, Bernard Oriolaand, and Christophe Jouffrais. 2010. Route selection algorithm for blind pedestrian. In Proceedings of the International Conference on Control Automation and Systems (ICCAS’10). IEEE, 2223--2228.Google ScholarGoogle ScholarCross RefCross Ref
  50. Shaun K. Kane, Chandrika Jayant, Jacob O. Wobbrock, and Richard E. Ladner. 2009. Freedom to Roam: A study of mobile device adoption and accessibility for people with visual and motor disabilities. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (Assets’09). ACM, New York, NY, 115--122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Dierna Giovanni Luca and Macha Alberto. 2016. Towards accurate indoor localization using iBeacons, fingerprinting and particle filtering. In Proceedings of the International Conference on Indoor Positioning and Indoor Navigation (IPIN).Google ScholarGoogle Scholar
  52. Roberto Manduchi and James M. Coughlan. 2014. The last meter: Blind visual guidance to a target. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’14). ACM, New York, NY, 3113--3122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Roberto Manduchi and Sri Kurniawan. 2011. Mobility-related accidents experienced by people with visual impairment. AER J.: Res. Pract. Visual Impair. Blind. 4, 2 (2011), 44--54.Google ScholarGoogle Scholar
  54. Roberto Manduchi, Sri Kurniawan, and Homayoun Bagherinia. 2010. Blind guidance using mobile computer vision: A usability study. In Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’10). ACM, New York, NY, 241--242. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Sergio Mascetti, Dragan Ahmetovic, Andrea Gerino, and Cristian Bernareggi. 2016. Zebrarecognizer: Pedestrian crossing recognition for people with visual impairment or blindness. Pattern Recogn. 60 (2016), 405--419. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Sergio Mascetti, Dragan Ahmetovic, Andrea Gerino, Cristian Bernareggi, Mario Busso, and Alessandro Rizzi. 2016. Robust traffic lights detection on mobile devices for pedestrians with visual impairment. Comput. Vision Image Understand. 148 (2016), 123--135. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Sergio Mascetti, Lorenzo Picinali, Andrea Gerino, Dragan Ahmetovic, and Cristian Bernareggi. 2016. Sonification of guidance data during road crossing for people with visual impairments or blindness. Int. J. Hum.-Comput. Studies 85 (2016), 16--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Mei Miao, Martin Spindler, and Gerhard Weber. 2011. Requirements of indoor navigation system from blind users. In Proceedings of the Symposium of the Austrian HCI and Usability Engineering Group. Springer, 673--679. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Microsoft. {n.d.}. Microsoft Indoor Localization Competition—IPSN 2016. Retrieved from https://www.microsoft.com/en-us/research/event/microsoft-indoor-localization-competition-ipsn-2016/.Google ScholarGoogle Scholar
  60. Microsoft. {n.d.}. Microsoft Soundscape, a map delivered in 3D sound. Retrieved from https://www.microsoft.com/en-us/research/product/soundscape/.Google ScholarGoogle Scholar
  61. Kyle Montague, Hugo Nicolau, and Vicki L. Hanson. 2014. Motor-impaired touchscreen interactions in the wild. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 123--130. Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Masayuki Murata, Dragan Ahmetovic, Daisuke Sato, Hironobu Takagi, Kris M. Kitani, and Chieko Asakawa. 2018. Smartphone-based indoor localization for blind navigation across building complexes. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom’18). IEEE, 254--263.Google ScholarGoogle ScholarCross RefCross Ref
  63. NavCog. {n.d.}. NavCog on the App Store. Retrieved from https://itunes.apple.com/app/navcog/id1042163426?mt=8.Google ScholarGoogle Scholar
  64. Hugo Nicolau, Joaquim Jorge, and Tiago Guerreiro. 2009. Blobby: How to guide a blind person. In Proceedings of the CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 3601--3606. Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Uran Oh and Leah Findlater. 2014. Design of and subjective response to on-body input for people with visual impairments. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers 8 Accessibility (ASSETS’14). ACM, New York, NY, 115--122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Eshed Ohn-Bar, João Guerreiro, Kris Kitani, and Chieko Asakawa. 2018. Variability in reactions to instructional guidance during smartphone-based assisted navigation of blind users. Proc. ACM Interact. Mob. Wearable Ubiq. Technol. 2, 3 (2018), 131. Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Eshed Ohn-Bar, João Guerreiro, Dragan Ahmetovic, Kris M. Kitani, and Chieko Asakawa. 2018. Modeling expertise in assistive navigation interfaces for blind people. In Proceedings of the 23rd International Conference on Intelligent User Interfaces (IUI’18). ACM, New York, NY, 403--407. Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Rajchandar Padmanaban and Jakub Krukar. 2017. Increasing the density of local landmarks in wayfinding instructions for the visually impaired. In Progress in Location-Based Services 2016. Springer, 131--150.Google ScholarGoogle Scholar
  69. Sabrina A. Panëels, Adriana Olmos, Jeffrey R. Blum, and Jeremy R. Cooperstock. 2013. Listen to it yourself!: Evaluating usability of what’s around me? For the blind. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2107--2116. Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. PCB. 2017. PCB Conference Schedule—Pennsylvania Council of the Blind. Retrieved from http://pcb1.org/2017-pcb-conference-schedule/.Google ScholarGoogle Scholar
  71. J. Eduardo Pérez, Myriam Arrue, Masatomo Kobayashi, Hironobu Takagi, and Chieko Asakawa. 2017. Assessment of semantic taxonomies for blind indoor navigation based on a shopping center use case. In Proceedings of the 14th Web for All Conference on the Future of Accessible Work (W4A’17). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Pablo-Alejandro Quinones, Tammy Greene, Rayoung Yang, and Mark Newman. 2011. Supporting visually impaired navigation: A needs-finding study. In CHI’11 Extended Abstracts on Human Factors in Computing Systems (CHI EA’11). ACM, New York, NY, 1645--1650. Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. Lisa Ran, Sumi Helal, and Steve Moore. 2004. Drishti: An integrated indoor/outdoor blind navigation system and service. In Proceedings of the 2nd IEEE Annual Conference on Pervasive Computing and Communications (PerCom’04). IEEE, 23--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Timothy H. Riehle, P. Lichter, and Nicholas A. Giudice. 2008. An indoor navigation system to support the visually impaired. In Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS’08). IEEE, 4435--4438.Google ScholarGoogle Scholar
  75. David A. Ross. 2001. Implementing assistive technology on wearable computers. IEEE Intell. Syst. 16, 3 (2001), 47--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Daisuke Sato, Uran Oh, Kakuya Naito, Hironobu Takagi, Kris Kitani, and Chieko Asakawa. 2017. NavCog3: An evaluation of a smartphone-based blind indoor navigation assistant with semantic features in a large-scale environment. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’17). ACM, New York, NY, 270--279. Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. SFO. 2014. SFO app for visually impaired navigation by indoo.rs. Retrieved from https://indoo.rs/sfo/.Google ScholarGoogle Scholar
  78. Speech | Apple Developer Documentation {n.d.}. Speech | Apple Developer Documentation. Retrieved from https://developer.apple.com/documentation/speech.Google ScholarGoogle Scholar
  79. P. Strumillo, M. Bujacz, P. Baranski, P. Skulimowski, P. Korbel, M. Owczarek, K. Tomalczyk, A. Moldoveanu, and R. Unnthorsson. 2018. Different approaches to aiding blind persons in mobility and navigation in the “Naviton” and “Sound of Vision” projects. In Mobility of Visually Impaired People. Springer, 435--468.Google ScholarGoogle Scholar
  80. Frank van Diggelen and Per Enge. 2015. The world’s first GPS MOOC and worldwide laboratory using smartphones. In Proceedings of the 28th International Technical Meeting of The Satellite Division of the Institute of Navigation (ION GNSS’15). 361--369.Google ScholarGoogle Scholar
  81. Ramiro Velázquez. 2010. Wearable Assistive Devices for the Blind. Springer, Berlin, 331--349.Google ScholarGoogle Scholar
  82. Watson Assistant. {n.d.}. Watson Assistant—Formerly Watson Conversation. Retrieved from https://www.ibm.com/watson/developercloud/conversation.html.Google ScholarGoogle Scholar
  83. Wayfinder. 2014. Wayfinder app helps the blind navigate the Tube. Retrieved from http://www.wired.co.uk/article/wayfindr-app.Google ScholarGoogle Scholar
  84. Michele A. Williams, Amy Hurst, and Shaun K. Kane. 2013. “Pray before you step out”: Describing personal and situational blind navigation behaviors. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’13). ACM, New York, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  85. Hanlu Ye, Meethu Malu, Uran Oh, and Leah Findlater. 2014. Current and future mobile and wearable device use by people with visual impairments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’14). ACM, New York, NY, 3123--3132. Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. Da Zhang, Feng Xia, Zhuo Yang, Lin Yao, and Wenhong Zhao. 2010. Localization technologies for indoor human tracking. In Proceedings of the 5th International Conference on Future Information Technology (FutureTech’10). IEEE, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  87. Yuhang Zhao, Cynthia L. Bennett, Hrvoje Benko, Edward Cutrell, Christian Holz, Meredith Ringel Morris, and Mike Sinclair. 2018. Enabling people with visual impairments to navigate virtual reality with a haptic and auditory cane simulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. NavCog3 in the Wild: Large-scale Blind Indoor Navigation Assistant with Semantic Features

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Accessible Computing
          ACM Transactions on Accessible Computing  Volume 12, Issue 3
          Special Issue on ASSETS 2017 (Part 2)
          September 2019
          93 pages
          ISSN:1936-7228
          EISSN:1936-7236
          DOI:10.1145/3360012
          Issue’s Table of Contents

          Copyright © 2019 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 31 August 2019
          • Accepted: 1 June 2019
          • Revised: 1 March 2019
          • Received: 1 May 2018
          Published in taccess Volume 12, Issue 3

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • review-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format