João Guerreiro
Dragan Ahmetovic
ABSTRACT
When preparing to visit new locations, sighted people often look at maps to build an a priori mental representation of the environment as a sequence of step-by-step actions and points of interest (POIs), e.g., turn right after the coffee shop. Based on this observation, we would like to understand if building the same type of sequential representation, prior to navigating in a new location, is helpful for people with visual impairments (VI). In particular, our goal is to understand how the simultaneous interplay between turn-by-turn navigation instructions and the relevant POIs in the route can aid the creation of a memorable sequential representation of the world. To this end, we present two smartphone-based virtual navigation interfaces: VirtualLeap, which allows the user to jump through a sequence of street intersection labels, turn-by-turn instructions and POIs along the route; and VirtualWalk, which simulates variable speed step-by-step walking using audio effects, whilst conveying similar route information. In a user study with 14 VI participants, most were able to create and maintain an accurate mental representation of both the sequential structure of the route and the approximate locations of the POIs. While both virtual navigation modalities resulted in similar spatial understanding, results suggests that each method is useful in different interaction contexts.
- Blindsquare ios application. http://blindsquare.com/. Accessed: 2017-05-04.Google Scholar
- D. Ahmetovic, C. Gleason, C. Ruan, K. Kitani, H. Takagi, and C. Asakawa. Navcog: a navigational cognitive assistant for the blind. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, pages 90-99. ACM, 2016. Google ScholarDigital Library
- N. Banovic, R. L. Franz, K. N. Truong, J. Mankoff, and A. K. Dey. Uncovering information needs for independent spatial learning for users who are visually impaired. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, page 24. ACM, 2013. Google ScholarDigital Library
- J. R. Blum, M. Bouchard, and J. R. Cooperstock. What's around me? spatialized audio augmented reality for blind users with a smartphone. In International Conference on Mobile and Ubiquitous Systems: Computing, Networking, and Services, pages 49-62. Springer, 2011.Google Scholar
- A. M. Brock, P. Truillet, B. Oriola, D. Picard, and C. Jouffrais. Interactivity improves usability of geographic maps for visually impaired people. Human-Computer Interaction, 30(2):156-194, 2015. Google ScholarDigital Library
- J. L. Campbell, C. Quincy, J. Osserman, and O. K. Pedersen. Coding in-depth semistructured interviews: Problems of unitization and intercoder reliability and agreement. Sociological Methods & Research, 42(3):294-320, 2013.Google ScholarCross Ref
- E. C. Connors, E. R. Chrastil, J. Sánchez, and L. B. Merabet. Virtual environments for the transfer of navigation skills in the blind: a comparison of directed instruction vs. video game based learning approaches. Frontiers in human neuroscience, 8:223, 2014.Google Scholar
- R. G. Golledge. Wayfinding behavior: Cognitive mapping and other spatial processes. JHU press, 1999.Google Scholar
- W. H. Gomaa and A. A. Fahmy. A survey of text similarity approaches. International Journal of Computer Applications, 68(13), 2013.Google ScholarCross Ref
- T. Guerreiro, K. Montague, J. Guerreiro, R. Nunes, H. Nicolau, and D. J. Goncalves. Blind people interacting with large touch surfaces: Strategies for one-handed and two-handed exploration. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces, pages 25-34. ACM, 2015. Google ScholarDigital Library
- H. Kacorri, S. Mascetti, A. Gerino, D. Ahmetovic, H. Takagi, and C. Asakawa. Supporting orientation of people with visual impairment: Analysis of large scale usage data. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility, pages 151-159. ACM, 2016. Google ScholarDigital Library
- S. K. Kane, M. R. Morris, A. Z. Perkins, D. Wigdor, R. E. Ladner, and J. O. Wobbrock. Access overlays: improving non-visual access to large touch screens for blind users. In Proceedings of the 24th annual ACM symposium on User interface software and technology, pages 273-282. ACM, 2011. Google ScholarDigital Library
- B. F. Katz, S. Kammoun, G. Parseihian, O. Gutierrez, A. Brilhault, M. Auvray, P. Truillet, M. Denis, S. Thorpe, and C. Jouffrais. Navig: augmented reality guidance system for the visually impaired. Virtual Reality, 16(4):253-269, 2012.Google ScholarDigital Library
- R. Kitchin and R. Jacobson. Techniques to collect and analyze the cognitive map knowledge of persons with visual impairment or blindness: issues of validity. Journal of Visual Impairment and Blindness, 91(4):360-376, 1997.Google ScholarCross Ref
- R. L. Klatzky, J. M. Loomis, A. C. Beall, S. S. Chance, and R. G. Golledge. Spatial updating of self-position and orientation during real, imagined, and virtual locomotion. Psychological science, 9(4):293-298, 1998.Google ScholarCross Ref
- R. L. Klatzky, J. M. Loomis, R. G. Golledge, J. G. Cicinelli, S. Doherty, and J. W. Pellegrino. Acquisition of route and survey knowledge in the absence of vision. Journal of motor behavior, 22(1):19-43, 1990.Google Scholar
- V. I. Levenshtein. Binary codes capable of correcting deletions, insertions, and reversals. In Soviet physics doklady, volume 10, pages 707-710, 1966.Google Scholar
- J. M. Loomis, R. G. Golledge, and R. L. Klatzky. Navigation system for the blind: Auditory display modes and guidance. Presence: Teleoperators and Virtual Environments, 7(2):193-203, 1998. Google ScholarDigital Library
- M. Lumbreras and J. Sanchez. Interactive 3d sound hyperstories for blind children. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pages 318-325. ACM, 1999. Google ScholarDigital Library
- S. Mascetti, D. Ahmetovic, A. Gerino, and C. Bernareggi. Zebrarecognizer: Pedestrian crossing recognition for people with visual impairment or blindness. Pattern Recognition, 2016. Google ScholarDigital Library
- S. Millar. Understanding and representing space: Theory and evidence from studies with blind and sighted children. Clarendon Press/Oxford University Press, 1994.Google Scholar
- D. R. Montello. Spatial cognition. In N. J. Smelser and B. Baltes, editors, International Encyclopedia of the Social and Behavioral Sciences, pages 7-14771. 2001.Google Scholar
- C. Morency, M. Trepanier, and M. Demers. Walking to transit: an unexpected source of physical activity. Transport Policy, 18(6):800-806, 2011.Google ScholarCross Ref
- H. Nicolau, J. Jorge, and T. Guerreiro. Blobby: how to guide a blind person. In CHI'09 Extended Abstracts on Human Factors in Computing Systems, pages 3601-3606. ACM, 2009. Google ScholarDigital Library
- R. Nordahl, S. Serafin, N. C. Nilsson, and L. Turchet. Enhancing realism in virtual environments by simulating the audio-haptic sensation of walking on ground surfaces. In Virtual Reality Short Papers and Posters (VRW), 2012 IEEE, pages 73-74. IEEE, 2012. Google ScholarDigital Library
- S. A. Panëels, A. Olmos, J. R. Blum, and J. R. Cooperstock. Listen to it yourself!: evaluating usability of what's around me? for the blind. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 2107-2116. ACM, 2013. Google ScholarDigital Library
- R. Passini, G. Proulx, and C. Rainville. The spatio-cognitive abilities of the visually impaired population. Environment and Behavior, 22(1):91-118, 1990.Google ScholarCross Ref
- L. Picinali, A. Afonso, M. Denis, and B. F. Katz. Exploration of architectural spaces by blind people using auditory virtual reality for the construction of spatial knowledge. International Journal of Human-Computer Studies, 72(4):393-407, 2014. Google ScholarDigital Library
- J. J. Rieser. Access to knowledge of spatial structure at novel points of observation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 15(6):1157, 1989.Google Scholar
- J. Rowell and S. Ungar. Feeling our way: tactile map user requirements-a survey. In International Cartographic Conference, La Coruna, 2005.Google Scholar
- J. Su, A. Rosenzweig, A. Goel, E. de Lara, and K. N. Truong. Timbremap: enabling the visually-impaired to use maps on touch-enabled devices. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services, pages 17-26. ACM, 2010. Google ScholarDigital Library
- C. Thinus-Blanc and F. Gaunet. Representation of space in blind persons: vision as a spatial sense? Psychological bulletin, 121(1):20, 1997.Google Scholar
- W. R. Wiener, R. L. Welsh, and B. B. Blasch. Foundations of orientation and mobility, volume 1. American Foundation for the Blind, 2010.Google Scholar
- R. Yang, S. Park, S. R. Mishra, Z. Hong, C. Newsom, H. Joo, E. Hofer, and M. W. Newman. Supporting spatial awareness and independent wayfinding for pedestrians with visual impairments. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility, pages 27-34. ACM, 2011. Google ScholarDigital Library
- K. Yatani, N. Banovic, and K. Truong. Spacesense: representing geographical information to visually impaired people using spatial tactile feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 415-424. ACM, 2012. Google ScholarDigital Library
Index Terms
- Virtual Navigation for Blind People: Building Sequential Representations of the Real-World
Recommendations
CaBot: Designing and Evaluating an Autonomous Navigation Robot for Blind People
ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and AccessibilityNavigation robots have the potential to overcome some of the limitations of traditional navigation aids for blind people, specially in unfamiliar environments. In this paper, we present the design of CaBot (Carry-on roBot), an autonomous suitcase-shaped ...
Airport Accessibility and Navigation Assistance for People with Visual Impairments
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsPeople with visual impairments often have to rely on the assistance of sighted guides in airports, which prevents them from having an independent travel experience. In order to learn about their perspectives on current airport accessibility, we ...
Autonomous navigation through the city for the blind
ASSETS '10: Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibilityAutonomous navigation in the city has become a necessity for people with visual disabilities, due to the fact that they now enjoy a higher degree of social insertion. As such, several technological solutions seek to assist with this autonomy. In this ...
Comments