Saminda Sundeepa Balasuriya
Andrew A. Bayor
ABSTRACT
People with intellectual disability are keen users of information technology, but the need for spelling and typing skills often presents a barrier to information and media search and access. The paper presents a study to understand how people with intellectual disabilities can use Voice Activated Interfaces (VAIs) to access information and assist in daily activities. The study involves observations and video analysis of 18 adults with intellectual disability using VAIs and performing 4 tasks: calibrating the VAIs, using voice assistant (Siri or Google) to search images, using voice to query Youtube, and using the voice assistant to perform a daily task (managing calendar, finding directions, etc.). 72% of participants stated that this was their preferred form of input. 50% could perform all four tasks they attempted with successful outcomes, and 55% three of the tasks. We identify the main barriers and opportunities for existing VAIs and suggest future improvements mainly around audio feedback given to participants. Notably, we found that participants' mental model of the VAIs was that of a person, implications for which include the user having to speak in long polite sentences and expecting voice responses and feedback about the state of the device. We suggest ways that VAIs can be adjusted so that they are more inclusive.
- Kevin M. Ayres, Linda Mechling, and Frank J Sansosti, F. 2013. The use of mobile technologies to assist with life skills/independence of students with moderate/severe intellectual disability and/or autism spectrum disorders: considerations for the future of school psychology. Psychology In The Schools 50, 3, 259--271.Google Scholar
Cross Ref
- Andrew A. Bayor, Filip Bircanin, Laurianne Sitbon, Bernd Ploderer and Margot Brereton. 2018. Characterizing Participation across Social Media Sites amongst Young Adults with Intellectual Disability, To appear Proceedings of the 30th Australian Conference on Computer-Human Interaction. ACM. Google ScholarDigital Library
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research In Psychology 3, 2, 77--101.Google ScholarCross Ref
- Margot Brereton, Laurianne Sitbon, Muhammad Abdullah, Mark Vanderberg and Stewart Koplick. 2015. Design after design to bridge between people living with cognitive or sensory impairments, their friends and proxies. Codesign 11, 1(Jan 2015), 4--20.Google Scholar
- Darren Chadwick, Caroline Wesson and Chris Fullwood. 2013. Internet Access by People with Intellectual Disabilities: Inequalities and Opportunities. Future Internet 5, 3, 376--397.Google ScholarCross Ref
- David Cihak, Rachel Wright, Cate Smith, Don McMahon and Kelly Kraiss. 2016. Incorporating functional digital literacy skills as part of the curriculum for high school students with intellectual disability. Education And Training In Autism And Developmental Disabilities 50, 2, 155--171.Google Scholar
- James Collins and Lana Collet-Klingenberg. 2017. Portable electronic assistive technology to improve vocational task completion in young adults with an intellectual disability. Journal Of Intellectual Disabilities 22, 3, 213--231.Google ScholarCross Ref
- MC Coppens-Hofman, H Terband, A.F.M Snik and B.A.M Maassen. 2016. Speech Characteristics and Intelligibility in Adults with Mild and Moderate Intellectual Disabilities. Folia Phoniatrica Et Logopaedica 68, 4, 175--182.Google ScholarCross Ref
- Definition. Aaidd.org. Retrieved 6 March 2018, from http://aaidd.org/intellectual-disability/definitionGoogle Scholar
- Jinjuan Feng, Jonathan Lazar, Libby Kumin and Ant Ozok. 2008. Computer Usage by Young Individuals with Down Syndrome: An Exploratory Study. In Assets 08, 35--42. Halifax, Nova Scotia: ACM. Google ScholarDigital Library
- Bjorn Harrysson, A. Svensk and G. Johansson. 2004. How people with developmental disabilities navigate the Internet. British Journal Of Special Education 31, 3, 138--142.Google ScholarCross Ref
- Brigitte Jordan and Austin Henderson. 1995. Interaction Analysis: Foundations and Practice. Journal Of The Learning Sciences 4, 1, 39--103.Google ScholarCross Ref
- Soonil Kwon, Sung-Jae Kim and Joon Yeon Choeh. 2016. Preprocessing for elderly speech recognition of smart devices. Computer Speech & Language 36, 110--121. Google ScholarDigital Library
- Libby Kumin, Jonathan Lazar and Jinjuan Feng. 2012. Expanding Job Options: Potential Computer-Related Employment for Adults with Down Syndrome. ACM SIGACCESS Accessibility And Computing 103, 14--23. Google ScholarDigital Library
- Youngsun Lee, Michael L. Wehmeyer, Susan B. Palmer, Kendra Williams-Diehm, Daniel Davies and Steven E. Stock. 2010. The Effect of Student-Directed Transition Planning With a Computer-Based Reading Support Program on the Self-Determination of Students With Disabilities. The Journal Of Special Education 45, 2, 104--117.Google ScholarCross Ref
- Dixie McCollum, Steven Nation and Sharon Gunn. 2014. The Effects of a Speech-to-Text Software Application on Written Expression for Students with Various Disabilities. National Forum Of Special Education Journal 25, 1, 1--13.Google Scholar
- Asaf Michaely, Frank Zhang, Gabor Simko, Carolina Parada and Petar Aleksic. 2017. Keyword spotting for Google assistant using contextual speech recognition. Automatic Speech Recognition and Understanding Workshop (ASRU), 2017 IEEE (pp. 272--278). IEEE.Google ScholarCross Ref
- Redwhan Nour. 2015. Web searching by individuals with cognitive disabilities. ACM SIGACCESS Accessibility and Computing 111, 19--25 Google ScholarDigital Library
- Thierry Olive. 2004. Working Memory in Writing: Empirical Evidence From the Dual-Task Technique. European Psychologist 9, 1, 32--42.Google ScholarCross Ref
- Susan B. Palmer, Michael L. Wehmeyer, Daniel Davies and Steven E. Stock. 2011. Family members' reports of the technology use of family members with intellectual and developmental disabilities. Journal Of Intellectual Disability Research 56, 4, 402--414.Google ScholarCross Ref
- Ravihansa Rajapakse, Margot Brereton and Laurianne Sitbon. 2018. Design Artefacts to Support People with a Disability to Build Personal Infrastructures. In Proceedings of the 2018 on Designing Interactive Systems Conference 2018, pp. 277--288. ACM, 2018. Google ScholarDigital Library
- Rocha, T., Bessa, M., Gonçalves, M., Cabral, L., Godinho, F., & Peres, E. 2012. The Recognition of Web Pages' Hyperlinks by People with Intellectual Disabilities: An Evaluation Study. Journal Of Applied Research In Intellectual Disabilities 25, 6, 542--552.Google ScholarCross Ref
- Tania Rocha, Diana Carvalho, Maximino Bessa, Sofia Reis and Luis Magalhães. 2016. Usability evaluation of navigation tasks by people with intellectual disabilities: a Google and SAPO comparative study regarding different interaction modalities. Universal Access In The Information Society 16, 3, 581--592. Google ScholarDigital Library
- Laurianne Sitbon, Andrew A. Bayor, Filip Bircanin, Margot Brereton and Stewart Koplick. 2018. An Exploration of How People with Intellectual Disability Engage with Online Information Retrieval. In CHI'18. Montreal: In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, p. LBW536. ACM, 2018. Google ScholarDigital Library
- Laurianne Sitbon, Maria Hoogstrate, Stewart Koplick, Filip Bircanin and Margot Brereton M. 2018. A non-clinical approach to describing participants with intellectual disability, To appear Proceedings of the 30th Australian Conference on Computer-Human Interaction ACM. Google ScholarDigital Library
- Jennifer J. Thistle and Krista M. Wilkinson. 2013. Working Memory Demands of Aided Augmentative and Alternative Communication for Individuals with Developmental Disabilities. Augmentative And Alternative Communication 29, 3, 235--245.Google ScholarCross Ref
- Thomas Welton, David Brown, Lindsay Evett and Nasser Sherkat. 2014. A brain-computer interface for the Dasher alternative text entry system. Universal Access In The Information Society 15, 1, 77--83. Google ScholarDigital Library
- Cara Wilson, Laurianne Sitbon, Margot Brereton, Daniel Johnson and Stewart Koplick. 2016. Put yourself in the picture': designing for futures with young adults with intellectual disability. In Proceedings of the 28th Australian Conference on Computer-Human Interaction (pp. 271--281). ACM. Google ScholarDigital Library
- Alex Wong, Chetwyn Chan, Cecilia Li-Tsang, C and Chow Lam. 2009. Competence of people with intellectual disabilities on using human-computer interface. Research In Developmental Disabilities 30, 1, 107--123.Google ScholarCross Ref
Index Terms
- Use of voice activated interfaces by people with intellectual disability
Recommendations
TapeBlocks: A Making Toolkit for People Living with Intellectual Disabilities
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsThe accessibility and affordability of tangible electronic toolkits are significant barriers to their uptake by people with disabilities. We present the design and evaluation of TapeBlocks, a low-cost, low-fidelity toolkit intended to be accessible for ...
Can the Web Be Made Accessible for People with Intellectual Disabilities?
This article presents the findings of a research project that aimed to contribute to the social inclusion of people with intellectual disabilities (ID) in the World Wide Web (the Web). The Inclusive New Media Design (INMD) project brought together ...
Engaging IT Students in Co-Design with People with Intellectual Disability
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsCurrent and emerging participative design practices are providing opportunities for people with intellectual disability to have a say in how technology can best support them and their individual needs. Yet technological experts and designers are not ...
Comments