skip to main content
10.1145/3173574.3174033acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

"Accessibility Came by Accident": Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities

Published:21 April 2018Publication History

ABSTRACT

From an accessibility perspective, voice-controlled, home-based intelligent personal assistants (IPAs) have the potential to greatly expand speech interaction beyond dictation and screen reader output. To examine the accessibility of off-the-shelf IPAs (e.g., Amazon Echo) and to understand how users with disabilities are making use of these devices, we conducted two exploratory studies. The first, broader study is a content analysis of 346 Amazon Echo reviews that include users with disabilities, while the second study more specifically focuses on users with visual impairments, through interviews with 16 current users of home-based IPAs. Findings show that, although some accessibility challenges exist, users with a range of disabilities are using the Amazon Echo, including for unexpected cases such as speech therapy and support for caregivers. Richer voice-based applications and solutions to support discoverability would be particularly useful to users with visual impairments. These findings should inform future work on accessible voice-based IPAs.

References

  1. Eric T. Anderson and Duncan I. Simester. 2014. Reviews Without a Purchase: Low Ratings, Loyal Customers, and Deception. Journal of Marketing Research 51, 3: 249--269.Google ScholarGoogle ScholarCross RefCross Ref
  2. Lisa Anthony, Yoojin Kim, and Leah Findlater. 2013. Analyzing User-Generated YouTube Videos to Understand Touchscreen Use by People with Motor Impairments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 1223--1232. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Vikas Ashok, Yevgen Borodin, Svetlana Stoyanchev, Yuri Puzis, and I. V. Ramakrishnan. 2014. Wizard-ofOz evaluation of speech-driven web browsing interface for people with vision impairments. In Proceedings of the 11th Web for All Conference (W4A '14), 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Shiri Azenkot and Nicole B. Lee. 2013. Exploring the use of speech input by blind people on mobile devices. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13), 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. James P. Barber and Kelley K. Walczak. 2009. Conscience and Critic: Peer Debriefing Strategies in Grounded Theory Research. In Paper presented at the Annual Meeting of the American Educational Research Association, San Diego, California, April 13--17, 2009.Google ScholarGoogle Scholar
  6. Scott Beach, Richard Schulz, Julie Downs, Judith Matthews, Bruce Barron, and Katherine Seelman. 2009. Disability, Age, and Informational Privacy Attitudes in Quality of Life Technology Applications. ACM Transactions on Accessible Computing (TACCESS) 2, 1: 1--21. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Virginia Braun and Victoria Clarke. 2006. Using Thematic Analysis in Psychology. Qualitative Research in Pyschology 3, 2: 77--101.Google ScholarGoogle ScholarCross RefCross Ref
  8. A J Bernheim Brush, Bongshin Lee, Ratul Mahajan, Sharad Agarwal, Stefan Saroiu, and Colin Dixon. 2011. Home Automation in the Wild: Challenges and Opportunities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 2115--2124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Erin Buehler, Stacy Branham, Abdullah Ali, Jeremy J. Chang, Megan Kelly Hofmann, Amy Hurst, and Shaun K. Kane. 2015. Sharing is Caring: Assistive Technology Designs on Thingiverse. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 525--534. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Zoraida Callejas and Ramón López-Cózar. 2009. Designing smart home interfaces for the elderly. ACM SIGACCESS Accessibility and Computing, 10--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Clare Carroll, Catherine Chiodo, Xin Adena Lin, Meg Nidever, and Jayanth Prathipati. 2017. Robin: Enabling Independence For Individuals With Cognitive Disabilities Using Voice Assistive Technology. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI '17), 46--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Eric Corbett and Astrid Weber. 2016. What can I say? Addressing User Experience Challenges of a Mobile Voice User Interface for Accessibility. In Proceedings of the 18th International Conference on HumanComputer Interaction with Mobile Devices and Services (MobileHCI '16), 72--82. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. George Demiris, Marilyn J Rantz, Myra A Aud, Karen D Marek, Harry W Tyrer, Marjorie Skubic, and Ali A Hussam. 2004. Older adults' attitudes towards and perceptions of "smart home" technologies: a pilot study. Medical Informatics and the Internet in Medicine 29, 2: 87--94.Google ScholarGoogle ScholarCross RefCross Ref
  14. Jan Derboven, Jonathan Huyghe, and Dirk De Grooff. 2014. Designing voice interaction for people with physical and speech impairments. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14), 217--226. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Mari Carmen Domingo. 2012. An overview of the Internet of Things for people with disabilities. Journal of Network and Computer Applications 35, 2: 584--596. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Stefania Druga, Randi Williams, Cynthia Breazeal, and Mitchel Resnick. 2017. "Hey Google is it OK if I eat you?" Initial Explorations in Child-Agent Interaction. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC '17), 595--600. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Aarthi Easwara Moorthy and Kim-Phuong L Vu. 2015. Privacy concerns for use of Voice Activated Personal Assistant in the public space. International Journal of Human-Computer Interaction 31, 4: 307--335.Google ScholarGoogle ScholarCross RefCross Ref
  18. Susan Koch Fager. 2017. Speech Recognition as a Practice Tool for Dysarthria. Seminars in Speech and Language 38, 3: 220--228.Google ScholarGoogle ScholarCross RefCross Ref
  19. Anushay Furqan, Chelsea Myers, and Jichen Zhu. 2017. Learnability through Adaptive Discovery Tools in Voice User Interfaces. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI'17), 1617--1623. Google ScholarGoogle ScholarCross RefCross Ref
  20. Susumu Harada, Jacob O. Wobbrock, Jonathan Malkin, Jeff A. Bilmes, and James A. Landay. 2009. Longitudinal study of people learning to use continuous voice-based cursor control. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09), 347--356. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Daniel J. Hruschka, Deborah Schwartz, Daphne Cobb St.John, Erin Picone-Decaro, Richard A. Jenkins, and James W. Carey. 2004. Reliability in Coding OpenEnded Data: Lessons Learned from HIV Behavioral Research. Field Methods 16, 3: 307--331.Google ScholarGoogle ScholarCross RefCross Ref
  22. Shaun K Kane, Meredith Ringel Morris, Ann Paradiso, and Jon Campbell. 2017. "At times avuncular and cantankerous, with the reflexes of a mongoose": Understanding Self-Expression through Augmentative and Alternative Communication Devices. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17), 1166--1179. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Matthew L. Lee and Anind K. Dey. 2008. Lifelogging memory appliance for people with episodic memory impairment. In Proceedings of the 10th international conference on Ubiquitous computing - UbiComp '08, 44--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Ewa Lugar and Abigail Sellen. 2016. "Like Having a Really bad PA": The Gulf between User Expectation and Experience of Conversational Agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 5286--5297. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Michal Luria, Guy Hoffman, and Oren Zuckerman. 2017. Comparing Social Robot, Screen and Voice Interfaces for Smart-Home Control. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), 580--592. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Bill Manaris, Valanne Macgyvers, and Michail Lagoudakis. 2002. A Listening Keyboard for Users with Motor Impairments - A Usability Study *. International Journal of Speech Technology 5, 4: 371-- 388.Google ScholarGoogle ScholarCross RefCross Ref
  27. Alex Mihailidis, Amy Cockburn, Catherine Longley, and Jennifer Boger. 2008. The acceptability of home monitoring technology among community-dwelling older adults and baby boomers. Assistive technology 20, 1: 1--12.Google ScholarGoogle Scholar
  28. Maia Naftali and Leah Findlater. 2014. Accessibility in context: understanding the truly mobile experience of smartphone users with motor impairments. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility (ASSETS '14), 209--216. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Gregor Pačnik, Karl Benkič, and Bojan Brečko. 2005. Voice operated intelligent wheelchair - VOIC. In IEEE International Symposium on Industrial Electronics (IEEE ISIE '05), 1221--1226.Google ScholarGoogle ScholarCross RefCross Ref
  30. Rebecca Palmer, Pam Enderby, and Mark Hawley. 2007. Addressing the needs of speakers with longstanding dysarthria: computerized and traditional therapy compared. International Journal of Language & Communication Disorders 42, Sup1: 61--67.Google ScholarGoogle ScholarCross RefCross Ref
  31. François Portet, Michel Vacher, Caroline Golanski, Camille Roux, and Brigitte Meillon. 2013. Design and evaluation of a smart home voice interface for the elderly: Acceptability and objection aspects. Personal and Ubiquitous Computing 17, 1: 127--144. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Amanda Purington, Jessie G. Taft, Shruti Sannon, Natalya N. Bazarova, and Samuel Hardman Taylor. 2017. "Alexa is my new BFF": Social Roles, User Satisfaction, and Personification. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17), 2853-- 2859. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Frank Rudzicz, Rosalie Wang, Momotaz Begum, and Alex Mihailidis. 2015. Speech Interaction with Personal Assistive Robots Supporting Aging at Home for Individuals with Alzheimer's Disease. ACM Transactions on Accessible Computing (TACCESS) 7, 2: 1--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Richard C. Simpson and Simon P. Levine. 2002. Voice control of a powered wheelchair. IEEE Transactions on Neural Systems and Rehabilitation Engineering 10, 2: 122--125.Google ScholarGoogle ScholarCross RefCross Ref
  35. Christoph Stahl and Pascal Laub. 2017. Maintaining multiple sclerosis patients' quality of life -- a case study on environment control assistance in a smart home. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '17), 83--86. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Matthieu Tixier and Myriam Lewkowicz. 2015. Looking for Respite and Support: Technological Opportunities for Spousal Caregivers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 1155--1158. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Michel Vacher, Benjamin Lecouteux, Dan Istrate, Thierry Joubert, François Portet, Mohamed Sehili, and Pedro Chahuara. 2013. Experimental Evaluation of Speech Recognition Technologies for Voice-based Home Automation Control in a Smart Home. In 4th Workshop on Speech and Language Processing for Assistive Technologies, 99--105.Google ScholarGoogle Scholar
  38. Amber Wagner, Ramaraju Rudraraju, Srinivasa Datla, Avishek Banerjee, Mandar Sudame, and Jeff Gray. 2012. Programming by voice: a hands-free approach for motorically challenged children. In Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts (CHI EA '12), 2087--2092. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Bruce N Walker, Jeffrey Lindsay, Amanda Nance, Yoko Nakano, K Palladino, Tilman Dingler, and Myounghoon Jeon. 2011. Spearcons ( Speech-Based Earcons ) Improve Navigation Performance in Advanced Auditory Menus. Human Factors 55, 1: 157--182.Google ScholarGoogle ScholarCross RefCross Ref
  40. Maria Klara Wolters, Fiona Kelly, and Jonathan Kilgour. 2016. Designing a spoken dialogue interface to an intelligent cognitive assistant for people with dementia. Health informatics journal 22, 4: 854--866.Google ScholarGoogle Scholar
  41. Nicole Yankelovich. 1996. How Do Users Know What to Say? Interactions 3, 32--43. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Hanlu Ye, Meethu Malu, Uran Oh, and Leah Findlater. 2014. Current and Future Mobile and Wearable Device Use by People With Visual Impairments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), 3123--3132. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Eric Zeng, Shrirang Mare, and Franziska Roesner. 2017. End User Security & Privacy Concerns with Smart Homes. In Symposium on Usable Privacy and Security (SOUPS '17).Google ScholarGoogle Scholar
  44. VoiceOver for Mac: VoiceOver overview. Retrieved September 14, 2017 from https://support.apple.com/kb/PH22549?locale=en_USGoogle ScholarGoogle Scholar
  45. JAWS Screen Reader - Best in Class. Retrieved September 14, 2017 from http://www.freedomscientific.com/Products/Blindness/ JAWSGoogle ScholarGoogle Scholar
  46. Dragon NaturallySpeaking - world's best-selling speech recognition software | Nuance. Retrieved September 14, 2017 from https://www.nuance.com/dragon.htmlGoogle ScholarGoogle Scholar

Index Terms

  1. "Accessibility Came by Accident": Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
      April 2018
      8489 pages
      ISBN:9781450356206
      DOI:10.1145/3173574

      Copyright © 2018 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 21 April 2018

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      CHI '18 Paper Acceptance Rate666of2,590submissions,26%Overall Acceptance Rate6,199of26,314submissions,24%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader