Sandra Bardot
Marcos Serrano
ABSTRACT
Tactile raised-line maps are paper maps widely used by visually impaired people. We designed a mobile technique, based on hand tracking and a smartwatch, in order to leverage pervasive access to virtual maps. We use the smartwatch to render localized text-to-speech and vibratory feedback during hand exploration, but also to provide filtering functions activated by swipe gestures. We conducted a first study to compare the usability of a raised-line map with three virtual maps (plain, with filter, with filter and grid). The results show that virtual maps are usable, and that adding a filter, or a filter and a grid, significantly speeds up data exploration and selection. The results of a following case study showed that visually impaired users were able to achieve a complex task with the device, i.e. finding spatial correlations between two sets of data.
- Brock, A. M., Lebaz, S., Oriola, B., Picard, D., Jouffrais, C., and Truillet, P. 2012. Kin' touch: Understanding How Visually Impaired People Explore Tactile Maps. Conference on Human Factors in Computing Systems - CHI, ACM, 2471--2476. Google Scholar
Digital Library
- Brock, A. M., Truillet, P., Oriola, B., and Jouffrais, C. 2010. Usage of multimodal maps for blind people: why and how. ITS'10: International Conference on Interactive Tabletops and Surfaces, ACM Press, 247--248. Google ScholarDigital Library
- Brock, A. M., Truillet, P., Oriola, B., Picard, D., and Jouffrais, C. 2015. Interactivity Improves Usability of Geographic Maps for Visually Impaired People. Human-Computer Interaction 30: 156--194. Google ScholarDigital Library
- Carter, T., Seah; S. A., Long, B., Drinkwater, B., and Subramanian S. 2013. UltraHaptics. Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13, ACM Press, 505--514. Google ScholarDigital Library
- Colaço, A, Kirmani, A., Yang, H. S., Gong, N., Schmandt, C, and Goyal, V. K. 2013. Mime. Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13, ACM Press, 227--236.Google Scholar
- Delogu, F., Palmiero, M., Federici, S., Plaisant, C, Zhao, H., and Belardinelli, O. 2010. Non-visual exploration of geographic maps: Does sonification help? Disability & Rehabilitation: Assistive Technology 5, 3: 164--174.Google ScholarCross Ref
- Ducasse, J., Macé, M., Serrano, M., and Jouffrais, C. 2016. Tangible Reels: Construction and Exploration of Tangible Maps by Visually Impaired Users. CHI'16 - To appear, 2186--2197. Google ScholarDigital Library
- Fortune, S. 1987. A sweepline algorithm for Voronoi diagrams. Algorithmica 2, 1--4: 153--174.Google ScholarDigital Library
- Goncu, C, Madugalla, A., Marinai, S., and Marriott, K. 2015. Accessible On-Line Floor Plans. World Wide Web Conference Comittee (IW3C2), 388--398. Google ScholarDigital Library
- Hart, S. G., and Staveland, L. E. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (eds.). Elsevier, 139--183.Google Scholar
- Hill, E. W., and Rieser, J. J. 1993. How persons with visual impairments explore novel spaces: Strategies of good and poor performers. Journal of Visual Impairment and Blindness 87: 8--15.Google ScholarCross Ref
- Jetter, H., Leifert, S., Gerken, J., Schubert, S., and Reiterer, H. 2012. Does (multi-)touch aid users' spatial memory and navigation in "panning" and in "zooming & panning" UIs? Proceedings of the International Working Conference on Advanced Visual Interfaces - AVI '12, ACM Press, 83--90. Google ScholarDigital Library
- Kane, S. K, Morris, M. R., Perkins, A. Z., Wigdor, D., Ladner, R. E., and Wobbrock, J. O. 2011. Access overlays: Improving non-visual access to large touch screens for blind users. Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST '11, ACM Press, 273--282. Google ScholarDigital Library
- Lawrence, M. M., Martinelli, N., and Nehmer, R. 2009. A Haptic Soundscape Map of the University of Oregon. Journal of Maps 5, 1: 19--29.Google ScholarCross Ref
- Marin, G., Dominio, F., and Zanuttigh, P. 2014. Hand gesture recognition with leap motion and kinect devices. 2014 IEEE International Conference on Image Processing (ICIP), IEEE, 1565--1569.Google Scholar
- McGookin, D., Robertson, E., and Brewster, S. 2010. Clutching at Straws: Using Tangible Interaction to Provide Non-Visual Access to Graphs. Proceedings of the 28th international conference on Human factors in computing systems - CHI '10, ACM Press, 1715--1724. Google ScholarDigital Library
- Paneels, S., Anastassova, M., Strachan, S., Van, S. P., Sivacoumarane, S., and Bolzmacher, C. 2013. What's around me? Multi-actuator haptic feedback on the wrist. 2013 World Haptics Conference (WHC), IEEE, 407--412.Google Scholar
- Parente, P., and Bishop, G. 2003. BATS: The Blind Audio Tactile Mapping System. Proceedings of ACM South Eastern Conference, ACM Press.Google Scholar
- Pietrzak, T., Crossan, A., Brewster, S. A., Martin, B., and Pecci, I. 2009. Creating usable pin array tactons for non-visual information. IEEE Transactions on Haptics 2, 2: 61--72. Google ScholarDigital Library
- Poppinga, B., Magnusson C., Pielot, M., and Rassmus-Gröhn, K. 2011. TouchOver map: Audio-Tactile Exploration of Interactive Maps. Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services - MobileHCI '11, ACM Press, 545--550. Google ScholarDigital Library
- Profita, H. P., Clawson, J., Gilliland, S., et al. 2013. Don't mind me touching my wrist. Proceedings of the 17th International symposium on wearable computers - ISWC '13, ACM Press, 89--96. Google ScholarDigital Library
- Rao, A., and Gordon, A. 2001. Contribution of tactile information to accuracy in pointing movements. Experimental Brain Research 138, 4: 438--445.Google ScholarCross Ref
- Rastogi, R., and Pawluk, D. T. V. 2010. Automatic, intuitive zooming for people who are blind or visually impaired. Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility - ASSETS '10, ACM Press, 239--240. Google ScholarDigital Library
- Rice, M. T., Jacobson, R. D., Golledge, R. G., and Jones, D. 2005. Design considerations for haptic and auditory map interfaces. Cartography and Geographic Information Science 32, 4: 381--391.Google ScholarCross Ref
- Su, J., Rosenzweig, A., Goel, A., Lara, E. de, and Truong, K. N. 2010. Timbremap: Enabling the Visually-Impaired to Use Maps on Touch-Enabled Devices. Proceedings of the 12th international conference on Human computer interaction with mobile devices and services - MobileHCI '10, ACM Press, 17. Google ScholarDigital Library
- The Braille Authority of North America. 2010. Guidelines and Standards for Tactile Graphics. Retrieved from http://brailleauthority.org/tg/web-manual/Google Scholar
- Ye, H., Malu, M., Oh, U., and Findlater, L. 2014. Current and future mobile and wearable device use by people with visual impairments. Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14, ACM Press, 3123--3132. Google ScholarDigital Library
- Zhao, H., Plaisant, C., Shneiderman, B., and Lazar, J. 2008. Data Sonification for Users with Visual Impairment. ACM Transactions on Computer-Human Interaction 15, 1: 1--28. Google ScholarDigital Library
Index Terms
- From tactile to virtual: using a smartwatch to improve spatial map exploration for visually impaired users
Recommendations
Signing on the tactile line: A multimodal system for teaching handwriting to blind children
We present McSig, a multimodal system for teaching blind children cursive handwriting so that they can create a personal signature. For blind people handwriting is very difficult to learn as it is a near-zero feedback activity that is needed only ...
Quick-glance and in-depth exploration of a tabletop map for visually impaired people
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-MachineInteractive tactile maps provide visually impaired people with accessible geographic information. However, when these maps are presented on large tabletops, tactile exploration without sight is long and tedious due to the size of the surface. In this ...
Investigating Feedback for Two-Handed Exploration of Digital Maps Without Vision
Human-Computer Interaction – INTERACT 2019AbstractDigital Interactive Maps on touch surfaces are a convenient alternative to physical raised-line maps for users with visual impairments. To compensate for the absence of passive tactile information, they provide vibrotactile and auditory feedback. ...
Comments