Cole Gleason
Alexander J. Fiannaca
Melanie Kneisel
Edward Cutrell
Meredith Ringel Morris
Skip Abstract Section
Skip Supplemental Material SectionAbstract
The majority of information in the physical environment is conveyed visually, meaning that people with vision impairments often lack access to the shared cultural, historical, and practical features that define a city. How can someone who is blind find out about the sleek skyscrapers that dot a modern city's skyline, historic cannons that have been remade into traffic pillars, or ancient trees that uproot a neighborhood's sidewalks? We present FootNotes, a system that embeds rich textual descriptions of objects and locations in OpenStreetMap, a popular geowiki. Both sighted and blind users can annotate the physical environment with functional, visual, historical, and social descriptions. We report on the experience of ten participants with vision impairments who used a spatialized audio application to interact with these annotations while exploring a city. By sharing rich annotations of physical objects and areas, FootNotes helps people thoroughly explore a new location or serendipitously discover previously unknown features of familiar environments.
Supplemental Material
Available for Download
zip
gleason.zip (56.9 MB)
Supplemental movie, appendix, image and software files for, FootNotes: Geo-referenced Audio Annotations for Nonvisual Exploration
- Aira. 2017. Aira | Instant Access to Information. https://aira.ioGoogle Scholar
- Frank Bentley and Santosh Basapur. 2012. StoryPlace.Me: The Path from Studying Elder Communication to a Public Location-based Video Service. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHIEA '12). ACM, New York, NY, USA, 777--792. Google ScholarDigital Library
- Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Aubrey Tatarowicz, Brandyn White, Samuel White, and Tom Yeh. 2010. VizWiz: Nearly Real-time Answers to Visual Questions. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A) (W4A '10). ACM, New York, NY, USA, Article 24, 2 pages. Google ScholarDigital Library
- Jeffrey P. Bigham, Ryan S. Kaminsky, Richard E. Ladner, Oscar M. Danielsson, and Gordon L. Hempton. 2006. WebInSight:: Making Web Images Accessible. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '06). ACM, New York, NY, USA, 181--188. Google ScholarDigital Library
- Erin Brady, Meredith Ringel Morris, and Jeffrey P. Bigham. 2015. Gauging Receptiveness to Social Microvolunteering. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1055--1064. Google ScholarDigital Library
- Erin L. Brady, Yu Zhong, Meredith Ringel Morris, and Jeffrey P. Bigham. 2013. Investigating the Appropriateness of Social Network Question Asking As a Resource for Blind Users. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW '13). ACM, New York, NY, USA, 1225--1236. Google ScholarDigital Library
- OpenStreetMap Wiki contributors. 2017. Changeset. https://wiki.openstreetmap.org/wiki/ChangesetGoogle Scholar
- OpenStreetMap Wiki contributors. 2017. Changeset. https://wiki.openstreetmap.org/wiki/ChangesetGoogle Scholar
- OpenStreetMap Wiki contributors. 2017. Elements. https://wiki.openstreetmap.org/wiki/ElementsGoogle Scholar
- OpenStreetMap Wiki contributors. 2017. Key:oneway. https://wiki.openstreetmap.org/wiki/Key:onewayGoogle Scholar
- Daniel Dardailler. 1997. The ALT-server (" An eye for an alt").Google Scholar
- Navid Fallah, Ilias Apostolopoulos, Kostas Bekris, and Eelke Folmer. 2012. The User As a Sensor: Navigating Users with Visual Impairments in Indoor Spaces Using Tactile Landmarks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 425--432. Google ScholarDigital Library
- Navid Fallah, Ilias Apostolopoulos, Kostas Bekris, and Eelke Folmer. 2013. Indoor Human Navigation Systems: A Survey. Interacting with Computers () 25, 1 (2013), 21--33.Google Scholar
- Alexander Fiannaca, Ilias Apostolopoulous, and Eelke Folmer. 2014. Headlock: A Wearable Navigation Aid That Helps Blind Cane Users Traverse Large Open Spaces. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers 8 Accessibility (ASSETS '14). ACM, New York, NY, USA, 19--26. Google ScholarDigital Library
- Elizabeth FitzGerald. 2012. Creating user-generated content for location-based learning: an authoring framework. Journal of Computer Assisted Learning 28, 3 (2012), 195--207. Google ScholarDigital Library
- REGINALD G. GOLLEDGE, ROBERTA L. KLATZKY, JACK M. LOOMIS, JON SPEIGLE, and JEROME TIETZ. 1998. A geographical information system for a GPS based personal guidance system. International Journal of Geographical Information Science 12, 7 (1998), 727--749. arXiv:https://doi.org/10.1080/136588198241635Google ScholarCross Ref
- W. G. Griswold, P. Shanahan, S. W. Brown, R. Boyer, M. Ratto, R. B. Shapiro, and T. M. Truong. 2004. ActiveCampus: experiments in community-oriented ubiquitous computing. Computer 37, 10 (Oct 2004), 73--81. Google ScholarDigital Library
- João Guerreiro, Dragan Ahmetovic, Kris M. Kitani, and Chieko Asakawa. 2017. Virtual Navigation for Blind People: Building Sequential Representations of the Real-World. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17). ACM, New York, NY, USA, 280--289. Google ScholarDigital Library
- Mordechai Haklay. 2010. How Good is Volunteered Geographical Information? A Comparative Study of OpenStreetMap and Ordnance Survey Datasets. Environment and Planning B: Planning and Design 37, 4 (2010), 682--703. arXiv:https://doi.org/10.1068/b35097Google ScholarCross Ref
- Kotaro Hara, Shiri Azenkot, Megan Campbell, Cynthia L. Bennett, Vicki Le, Sean Pannella, Robert Moore, Kelly Minckler, Rochelle H. Ng, and Jon E. Froehlich. 2013. Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13). ACM, New York, NY, USA, Article 16, 8 pages. Google ScholarDigital Library
- Kotaro Hara, Vicki Le, and Jon Froehlich. 2013. Combining Crowdsourcing and Google Street View to Identify Street-level Accessibility Problems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 631--640. Google ScholarDigital Library
- Bill Holton. 2014. BlindSquare App for iOS: A Solution for Accessible Navigation. Issue 7. https://www.afb.org/afbpress/pubnew.asp?DocID=aw150704Google Scholar
- Hernisa Kacorri, Kris M. Kitani, Jeffrey P. Bigham, and Chieko Asakawa. 2017. People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5839--5849. Google ScholarDigital Library
- Shaun K. Kane, Chandrika Jayant, Jacob O. Wobbrock, and Richard E. Ladner. 2009. Freedom to Roam: A Study of Mobile Device Adoption and Accessibility for People with Visual and Motor Disabilities. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '09). ACM, New York, NY, USA, 115--122. Google ScholarDigital Library
- Aniket Kittur and Robert E. Kraut. 2008. Harnessing the Wisdom of Crowds in Wikipedia: Quality Through Coordination. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW '08). ACM, New York, NY, USA 37--46. Google ScholarDigital Library
- Jacobus Lock, Grzegorz Cielniak, and Nicola Bellotto. 2017. Portable navigations system with adaptive multimodal interface for the blind. In The 2017 AAAI Spring Symposium Series. AAAI, The AAAI Press, Palo Alto, CA, USA, 395--400.Google Scholar
- Microsoft. 2017. Seeing AI | Talking camera app for those with a visual impairment. https://www.microsoft.com/en-us/seeing-ai/Google Scholar
- Per Persson, Fredrik Espinoza, Petra Fagerberg, Anna Sandin, and Rickard Coster. 2003. GeoNotes: A Location-Based Information System for Public Spaces. In Designing Information Spaces: The Social Navigation Approach, Krishna Hook, David Benyon, and Alan J. Munro (Eds.). Springer London, London, 151--173. Google ScholarDigital Library
- Reid Priedhorsky, Mikhil Masli, and Loren Terveen. 2010. Eliciting and Focusing Geographic Volunteer Work. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA 61--70. Google ScholarDigital Library
- Reid Priedhorsky and Loren Terveen. 2008. The Computational Geowiki: What, Why, and How. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW '08). ACM, New York, NY, USA, 267--276. Google ScholarDigital Library
- Microsoft Research. 2018. Microsoft Soundscape, https://www.microsoft.com/en-us/research/product/soundscape/Google Scholar
- Hironobu Takagi, Shinya Kawanaka, Masatomo Kobayashi, Takashi Itoh, and Chieko Asakawa. 2008. Social Accessibility: Achieving Accessibility Through Collaborative Metadata Authoring. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '08). ACM, New York, NY, USA, 193--200. Google ScholarDigital Library
- Fernando Torre, S. Andrew Sheppard, Reid Priedhorsky, and Loren Terveen. 2010. Bumpy, Caution with Merging: An Exploration of Tagging in a Geowiki. In Proceedings of the 16th ACM International Conference on Supporting Group Work (GROUP '10). ACM, New York, NY, USA, 155--164. Google ScholarDigital Library
- Luis von Ahn, Shiry Ginosar, Mihir Kedia, Ruoran Liu, and Manuel Blum. 2006. Improving Accessibility of the Web with a Computer Game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, New York, NY, USA, 79--82. Google ScholarDigital Library
- Yuhang Zhao, Cynthia L. Bennett, Hrvoje Benko, Edward Cutrell, Christian Holz, Meredith Ringel Morris, and Mike Sinclair. 2018. Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 116, 14 pages. Google ScholarDigital Library
Index Terms
- FootNotes: Geo-referenced Audio Annotations for Nonvisual Exploration
Recommendations
Towards a real-time system for finding and reading signs for visually impaired users
ICCHP'12: Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part IIPrinted text is a ubiquitous form of information that is inaccessible to many blind and visually impaired people unless it is represented in a non-visual form such as Braille. OCR (optical character recognition) systems have been used by blind and ...
Implementing Assistive Technology on Wearable Computers
The article presents the author's work in developing assistive technology for disabled users. He makes a case for wearable computers and focuses on design strategies that accommodate the users' changing needs. He points out that what might seem ...
A Refreshable Tactile Display Effectively Supports Cognitive Mapping Followed by Orientation and Mobility Tasks: A Comparative Multi-modal Study Involving Blind and Low-vision Participants
MAHCI '19: Proceedings of the 2nd Workshop on Multimedia for Accessible Human Computer InterfacesWe investigate the role of refreshable tactile display in supporting the learning of cognitive maps, followed by actual exploration of a real environment that matches that map. We test both blind and low-vision persons and compare displaying maps in ...
Comments