skip to main content
10.1145/3033701.3033703acmotherconferencesArticle/Chapter ViewAbstractPublication PagesihcConference Proceedingsconference-collections
research-article

Mobile Device Accessibility for the Visually Impaired: Problems Mapping and Empirical Study of Touch Screen Gestures

Published:04 October 2016Publication History

ABSTRACT

Mobile devices can be a valuable in improving the quality of life of visually impaired people, enabling greater independence to perform daily tasks. A review was carried out to map the existing accessibility problems in the interaction of people with visual impairment with mobile devices. Seven groups of problems were found, which allowed establishment a set of recommendations and future studies to improve accessibility on mobile devices. A case study was planned and conducted addressing the group "gesture-based interaction", which had the highest number of problems in the literature review. The empirical study aimed to evaluate touch gestures made by 12 visually impaired people by using an application developed for this purpose. Gestures represented by the letters "V" and "Z" had performance similar to those already available on the Android Platform. Other factors have influenced the recognition with speed being the main factor in reducing the performance of gestures.

References

  1. Ana Flavia de Andrade da Silva, Annibal Biondi Mendes da Silva, Veronica Oliveira Pontes, Elaine Naomi Watanabe, Marcia Ito, and Vagner Figueredo de Santana. 2013. Estudo sobre o uso de tablets como ferramenta de suporte à interação De pessoas cegas com painéis digitais. In Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems. Brazilian Computer Society, 268--271. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Rita Bersch. 2008. Introdução à tecnologia assistiva. Porto Alegre: CEDI (2008).Google ScholarGoogle Scholar
  3. Matthew N. Bonner, Jeremy T. Brudvik, Gregory D. Abowd, and W. Keith Edwards. 2010. No-look notes: accessible eyes-free multi-touch text entry. In Proceedings of the 8th International Conference on Pervasive Computing. Springer, 409--426. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Maria Claudia Buzzi, Marina Buzzi, Barbara Leporini, and Maria Teresa Paratore. 2013. Vibro-tactile enrichment improves blind user interaction with mobile touchscreens. In Human-Computer Interaction - INTERACT 2013. Springer, 641--648.Google ScholarGoogle Scholar
  5. Dustin Carroll, Suranjan Chakraborty, and Jonathan Lazar. 2013. Designing accessible visualizations: The case of designing a weather map for blind users. In Proceedings of the 7th International Conference on Universal Access in Human-Computer Interaction: Design Methods, Tools, and Interaction Techniques for eInclusion. Springer, 436--445. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Tamal Chakraborty and Debasis Samanta. 2012. BlindGuide: An audio based eyes-free caller guide for people with visual impairment. In 4th International Conference on Intelligent Human Computer Interaction. IEEE, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  7. Tuhin Chakraborty and Debasis Samanta. 2013. Exploring an effective interaction mode for blind mobile users in india. In Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction. ACM, 371--378. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Sarah Chiti and Barbara Leporini. 2012. Accessibility of Android-based mobile devices: A prototype to investigate interaction with blind users. In Computers Helping People with Special Needs: 13th International Conference. Springer, 607--614. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Yoonjung Choi and Ki-Hyung Hong. 2012. User requirements for camera-based mobile applications on touch screen devices for blind people. In Computers Helping People with Special Needs: 13th International Conference. Springer, 48--51. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Laisa C.P. Costa, Nicholas S. Almeida, Ana G.D. Correa, Roseli D. Lopes, and Marcelo K. Zuffo. 2013. Accessible display design to control home area networks. IEEE Transactions on Consumer Electronics 59, 2(2013): 422--427.Google ScholarGoogle ScholarCross RefCross Ref
  11. Sabine Croxford and Cathy Rundle. 2013. Blind people and apps on mobile phones and tablets - Challenges and possibilities. In Proceedings of the International Conference on Ergonomics & Human Factors. Taylor & Francis, 343--346.Google ScholarGoogle ScholarCross RefCross Ref
  12. Yasmine N. El-Glaly, Francis Quek, Tonya Smith-Jackson, and Gurjot Dhillon. 2013. Touch-screens are not tangible: fusing tangible interaction with touch glass in readers for the blind. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 245--253. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Agebson Rocha Façanha, Windson Viana, Mauro Cavalcante Pequeno, Márcia de Borba Campos, and Jaime Sánchez. 2014. Touchscreen mobile phones virtual keyboarding for people with visual disabilities. In Human-Computer Interaction. Applications and Services. Springer, 134--145.Google ScholarGoogle Scholar
  14. Aura Ganz, James M. Schafer, Yang Tao, Carole Wilson, and Meg Robertson. 2014. PERCEPT-II: Smartphone based indoor navigation system for the blind. In 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 3662--3665.Google ScholarGoogle ScholarCross RefCross Ref
  15. Marta Gil. 2000. Deficiência Visual. Ministério da Educação, Brasília (2000).Google ScholarGoogle Scholar
  16. John C Gower. 1975. Generalized procrustes analysis. Psychometrika 40, 1 (1975): 33--51.Google ScholarGoogle Scholar
  17. João Guerreiro, André Rodrigues, Kyle Montague, Tiago João Vieira Guerreiro, Hugo Nicolau, and Daniel Gonçalves. 2015. Tablets get physical: non-visual text entry on tablet devices. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 39--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Tiago Guerreiro, Hugo Nicolau, Joaquim Jorge, and Daniel Gonçalves. 2009. NavTap: a long term study with excluded blind users. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 99--106. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Lilit Hakobyan, Jo Lumsden, Dympna O'Sullivan, and Hannah Bartlett. 2013. Mobile assistive technologies for the visually impaired. Survey of Ophthalmology 58, 6 (2013): 513--528.Google ScholarGoogle Scholar
  20. Shaun K Kane, Jeffrey P Bigham, and Jacob O Wobbrock. 2008. Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility. ACM, 73--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Shaun K. Kane, Chandrika Jayant, Jacob O. Wobbrock, and Richard E. Ladner. 2009. Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 115--122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Shaun K. Kane, Jacob O. Wobbrock, and Richard E. Ladner. 2011. Usable gestures for blind people: understanding preference and performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 413--422. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Barbara Leporini, Maria Claudia Buzzi, and Marina Buzzi. 2012. Interacting with mobile devices via VoiceOver: usability and accessibility issues. In Proceedings of the 24th Australian Computer-Human Interaction Conference. ACM, 339--348. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Frank Chun Yat Li, David Dearman, and Khai N. Truong. 2010. Leveraging proprioception to make mobile phones more accessible to users with visual impairments. In Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 187--194. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Yang Li. 2010. Protractor: a fast and accurate gesture recognizer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2169--2172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Vikas Luthra and Sanjay Ghosh. 2015. Understanding, evaluating and analyzing touch screen gestures for visually impaired users in mobile environment. In Universal Access in Human-Computer Interaction. Access to Interaction. Springer, 25--36.Google ScholarGoogle Scholar
  27. Norbert Markus, Szabolcs Malik, Zoltan Juhasz, and András Arató. 2012. Accessibility for the blind on an open-source mobile platform: Mobile Slate Talker (MOST) for Android. In Proceedings of the 13th International Conference on Computers Helping People with Special Needs. Springer, 599--606. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. David McGookin, Stephen Brewster, and WeiWei Jiang. 2008. Investigating touchscreen accessibility for people with visual impairments. In Proceedings of the 5th Nordic Conference on Human-computer Interaction: Building Bridges. ACM, 298--307. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Na Mi, Lora A. Cavuoto, Kenneth Benson, Tonya Smith-Jackson, and Maury A. Nussbaum. 2014. A heuristic checklist for an accessible smartphone interface design. Universal Access in the Information Society 13, 4 (2014): 351--365. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. S. Misra, S.M. Banubakode, and C.A. Dhawale. 2014. Novel user interface for text entry on touch screen mobile device for visually impaired users. In Global Summit on Computer Information Technology. IEEE, 1--5.Google ScholarGoogle Scholar
  31. T. Miura, H. Matsuzaka, M. Sakajiri, and T. Ono. 2012. Usages and demands to touchscreen interface: A questionnaire survey in Japanese visually impaired people. In IEEE International Conference on Systems, Man, and Cybernetics. IEEE, 2933--2938.Google ScholarGoogle Scholar
  32. Hugo Nicolau, Kyle Montague, André Rodrigues, Tiago Guerreiro, and Vicki Hanson. 2015. Typing performance of blind users: An analysis of touch behaviors, learning effect, and in-situ usage. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility (2015). Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Uran Oh, Shaun K. Kane, and Leah Findlater. 2013. Follow that sound: using sonification and corrective verbal feedback to teach touchscreen gestures. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Kyudong Park, Taedong Goh, and Hyo-Jeong So. 2014. Toward accessible mobile application design: developing mobile application accessibility guidelines for people with visual impairment. In Proceedings of HCI Korea, Hanbit Media, Inc., 31--38. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Marc Pous, Circe Serra-Vallmitjana, Rafael Giménez, Marc Torrent-Moreno, and David Boix. 2012. Enhancing accessibility: Mobile to ATM case study. In IEEE Consumer Communications and Networking Conference. IEEE 404--408.Google ScholarGoogle ScholarCross RefCross Ref
  36. Mihály Radványi, Zóra Solymár, Attila Stubendek, and Kristóf Karacs. 2011. Mobile banknote recognition: Topological models in scene understanding. In Proceedings of the 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies. ACM, 185:1--185:5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. André Rodrigues, Kyle Montague, Hugo Nicolau, and Tiago Guerreiro. 2015. Getting smartphones to TalkBack: Understanding the smartphone adoption process of blind users. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility (2015). Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. MC Rodriguez-Sanchez, MA Moreno-Alvarez, E Martin, S Borromeo, and JA Hernandez-Tamames. 2014. Accessible smartphones for blind users: A case study for a wayfinding system. Expert Systems with Applications 41, 16 (2014): 7210--7222. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Vaspol Ruamviboonsuk, Shiri Azenkot, and Richard E. Ladner. 2012. Tapulator: A non-visual calculator using natural prefix-free codes. In Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility, ACM, 221--222. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Janaina Silva, Juliana Cristina Braga, and Rafael Jeferson Pezzuto Damaceno. 2015. Estudo de Aplicativos Móveis para Deficientes Visuais no Âmbito Acadêmico. In Anais do Simpósio Brasileiro de Informática na Educação, Vol. 26. 722.Google ScholarGoogle Scholar
  41. Pawel Strumillo, Piotr Skulimowski, and Maciej Polanczyk. 2009. Programming Symbian smartphones for the blind and visually impaired. In Computers in Medical Activity. Springer. 129--136.Google ScholarGoogle Scholar
  42. World Health Organization (WHO). 1993. International Classification of Impairments, Disabilities, and Handicaps: A Manual of Classification Relating to the Consequences of Disease. Geneva: World Health Organization (WHO).Google ScholarGoogle Scholar
  43. Yu Zhong, T. V. Raman, Casey Burkhardt, Fadi Biadsy, and Jeffrey P. Bigham. 2014. JustSpeak: enabling universal voice control on Android. In Proceedings of the 11th Web for All Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Mobile Device Accessibility for the Visually Impaired: Problems Mapping and Empirical Study of Touch Screen Gestures

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      IHC '16: Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems
      October 2016
      431 pages
      ISBN:9781450352352
      DOI:10.1145/3033701

      Copyright © 2016 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 4 October 2016

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      IHC '16 Paper Acceptance Rate58of158submissions,37%Overall Acceptance Rate331of973submissions,34%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader