Oussama Metatla
ABSTRACT
Voice user interfaces (VUIs) are increasingly popular, particularly in homes. However, little research has investigated their potential in other settings, such as schools. We investigated how VUIs could support inclusive education, particularly for pupils with visual impairments (VIs). We organised focused discussions with educators at a school, with support staff from local authorities and, through bodystorming, with a class of 27 pupils. We then ran a series of co-design workshops with participants with mixed-visual abilities to design an educational VUI application. This provided insights into challenges faced by pupils with VIs in mainstream schools, and opened a space for educators, sighted and visually impaired pupils to reflect on and design for their shared learning experiences through VUIs. We present scenarios, a design space and an example application that show novel ways of using VUIs for inclusive education. We also reflect on co-designing with mixed-visual-ability groups in this space.
Supplemental Material
Available for Download
zip
pn7444.zip (4.6 MB)
Two PDF files; 1) a description of the Lego design language developed as part of the co-design work reported in this paper; 2) a technical specification of the Voxtopus application prototype that resulted from the co-design process
- Roberto Aldunate and Miguel Nussbaum. 2013. Teacher adoption of technology. Computers in Human Behavior 29, 3 (2013), 519--524. Google Scholar
Digital Library
- Mohammed Ibrahim Alhojailan. 2012. Thematic analysis: A critical review of its process and evaluation. West East Journal of Social Sciences 1, 1 (2012), 39--47.Google Scholar
- M Astrid, Nicole C Krämer, Jonathan Gratch, and Sin-Hwa Kang. 2010. "It doesn't matter what you are!" Explaining social effects of agents and avatars. Computers in Human Behavior 26, 6 (2010), 1641--1650. Google ScholarDigital Library
- Julie A Bardin and Sandra Lewis. 2008. A survey of the academic engagement of students with visual impairments in general education classes. Journal of Visual Impairment & Blindness 102, 8 (2008), 472.Google ScholarCross Ref
- Laura Benton and Hilary Johnson. 2015. Widening participation in technology design: A review of the involvement of children with special educational needs and disabilities. International Journal of Child-Computer Interaction 3 (2015), 23--40. Google ScholarCross Ref
- Stacy M Branham and Shaun K Kane. 2015. Collaborative accessibility: How blind and sighted companions co-create accessible home spaces. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2373--2382. Google ScholarDigital Library
- Emeline Brulé and Gilles Bailly. 2018. Taking into Account Sensory Knowledge: The Case of Geo-techologies for Children with Visual Impairments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 236. Google ScholarDigital Library
- Colin Burns, Eric Dishman, William Verplank, and Bud Lassiter. 1994. Actors, Hairdos &Amp; Videotape&Mdash;Informance Design. In Conference Companion on Human Factors in Computing Systems (CHI '94). ACM, New York, NY, USA, 119--120. Google ScholarDigital Library
- Andreea Danielescu and Gwen Christian. 2018. A Bot is Not a Polyglot: Designing Personalities for Multi-Lingual Conversational Agents. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, CS01. Google ScholarDigital Library
- David DeVault, Ron Artstein, Grace Benn, Teresa Dey, Ed Fast, Alesia Gainer, Kallirroi Georgila, Jon Gratch, Arno Hartholt, Margaux Lhommet, et al. 2014. SimSensei Kiosk: A virtual human interviewer for healthcare decision support. In Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems. International Foundation for Autonomous Agents and Multiagent Systems, 1061--1068. Google ScholarDigital Library
- Peter Farrell, Alison Alborz, Andy Howes, and Diana Pearson. 2010. The impact of teaching assistants on improving pupils' academic achievement in mainstream schools: A review of the literature. Educational Review 62, 4 (2010), 435--448.Google ScholarCross Ref
- Daniel Fitton, Janet C Read, Gavin Sim, and Brendan Cassidy. 2018. Co-designing voice user interfaces with teenagers in the context of smart homes. In Proceedings of the 17th ACM Conference on Interaction Design and Children. ACM, 55--66. Google ScholarDigital Library
- German Flores and Roberto Manduchi. 2018. Easy Return: An App for Indoor Backtracking Assistance. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 17. CHI 2019, May 4--9, 2019, Glasgow, Scotland UK O. Metatla et al. Google ScholarDigital Library
- Ashley Flower, Matthew K. Burns, and Nicole A. Bottsford - Miller. 2007. Meta-analysis of disability simulation research. Remedial and Special Education 28, 2 (2007), 72--79.Google ScholarCross Ref
- Christopher Frauenberger, Julia Makhaeva, and Katharina Spiel. 2017. Blending Methods: Developing Participatory Design Sessions for Autistic Children. In Proceedings of the 2017 Conference on Interaction Design and Children. ACM, 39--49. Google ScholarDigital Library
- Euan Freeman, Graham Wilson, Stephen Brewster, Gabriel Baud-Bovy, Charlotte Magnusson, and Hector Caltenco. 2017. Audible Beacons and Wearables in Schools: Helping Young Visually Impaired Children Play and Move Independently. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 4146--4157. Google ScholarDigital Library
- Michael F. Giangreco. 2013. Teacher assistant supports in inclusive schools: Research, practices and alternatives. Australasian Journal of Special Education 37, 2 (2013), 93--106.Google ScholarCross Ref
- Marion Hersh. 2017. Classification framework for ICT-based learning technologies for disabled people. British Journal of Educational Technology 48, 3 (2017), 768--788.Google ScholarCross Ref
- Hernisa Kacorri, Eshed Ohn-Bar, Kris M Kitani, and Chieko Asakawa. 2018. Environmental Factors in Indoor Navigation Based on RealWorld Trajectories of Blind Users. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 56. Google ScholarDigital Library
- Joseph'Jofish' Kaye, Joel Fischer, Jason Hong, Frank R Bentley, Cosmin Munteanu, Alexis Hiniker, Janice Y Tsai, and Tawfiq Ammari. 2018. Panel: Voice Assistants, UX Design and Research. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, panel01. Google ScholarDigital Library
- Alice Kerly, Richard Ellis, and Susan Bull. 2008. CALMsystem: a conversational agent for learner modelling. In Applications and Innovations in Intelligent Systems XV. Springer, 89--102.Google Scholar
- Ewa Luger and Abigail Sellen. 2016. Like having a really bad PA: the gulf between user expectation and experience of conversational agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5286--5297. Google ScholarDigital Library
- Charlotte Magnusson, Héctor Caltenco, Sara Finocchietti, Giulia Cappagli, Graham Wilson, and Monica Gori. 2015. What do you like? early design explorations of sound and haptic preferences. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. ACM, 766--773. Google ScholarDigital Library
- Charlotte Magnusson, Per-Olof Hedvall, and Héctor Caltenco. 2018. Co-designing together with Persons with Visual Impairments. In Mobility of Visually Impaired People. Springer, 411--434.Google Scholar
- Laura Malinverni, Joan Mora-Guiard, Vanesa Padillo, MariaAngeles Mairena, Amaia Hervás, and Narcis Pares. 2014. Participatory design strategies to enhance the creative contribution of children with special needs. In Proceedings of the 2014 conference on Interaction design and children. ACM, 85--94. Google ScholarDigital Library
- Joanne McElligott and Lieselotte Van Leeuwen. 2004. Designing sound tools and toys for blind and visually impaired children. In Proceedings of the 2004 conference on Interaction design and children: building a community. ACM, 65--72. Google ScholarDigital Library
- Michael McTear, Zoraida Callejas, and David Griol. 2016. The conversational interface: Talking to smart devices. Springer. Google ScholarDigital Library
- Oussama Metatla, Nick Bryan-Kinns, and Tony Stockman. 2018. "I Hear You": Understanding Awareness Information Exchange in an Audio-only Workspace. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 546. Google ScholarDigital Library
- Oussama Metatla, Nick Bryan-Kinns, Tony Stockman, and Fiore Martin. 2015. Designing with and for people living with visual impairments: audio-tactile mock-ups, audio diaries and participatory prototyping. CoDesign 11, 1 (2015), 35--48.Google ScholarCross Ref
- Oussama Metatla and Clare Cullen. 2018. "Bursting the Assistance Bubble": Designing Inclusive Technology with Children with Mixed Visual Abilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 346. Google ScholarDigital Library
- Oussama Metatla, Fiore Martin, Adam Parkinson, Nick Bryan-Kinns, Tony Stockman, and Atau Tanaka. 2016. Audio-haptic interfaces for digital audio workstations. Journal on Multimodal User Interfaces 10, 3 (01 Sep 2016), 247--258.Google ScholarCross Ref
- Oussama Metatla, Marcos Serrano, Christophe Jouffrais, Anja Thieme, Shaun Kane, Stacy Branham, Émeline Brulé, and Cynthia L Bennett. 2018. Inclusive Education Technologies: Emerging Opportunities for People with Visual Impairments. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, W13. Google ScholarDigital Library
- Yash Mittal, Paridhi Toshniwal, Sonal Sharma, Deepika Singhal, Ruchi Gupta, and Vinay Kumar Mittal. 2015. A voice-controlled multifunctional smart home automation system. In India Conference (INDICON), 2015 Annual IEEE. IEEE, 1--6.Google Scholar
- Michelle R. Nario-Redmond, Dobromir Gospodinov, and Angela Cobb. 2017. Crip for a day: The unintended negative consequences of disability simulations. Rehabilitation Psychology 62, 3 (2017), 324--333.Google ScholarCross Ref
- Antti Oulasvirta, Esko Kurvinen, and Tomi Kankainen. 2003. Understanding contexts by being there: case studies in bodystorming. Personal and ubiquitous computing 7, 2 (2003), 125--134. Google ScholarDigital Library
- Rebecca Palmer, Pam Enderby, and Mark Hawley. 2007. Addressing the needs of speakers with longstanding dysarthria: computerized and traditional therapy compared. International journal of language & communication disorders 42, sup1 (2007), 61--79.Google ScholarCross Ref
- Martin Porcheron, Joel E Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice Interfaces in Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 640. Google ScholarDigital Library
- François Portet, Michel Vacher, Caroline Golanski, Camille Roux, and Brigitte Meillon. 2013. Design and evaluation of a smart home voice interface for the elderly: acceptability and objection aspects. Personal and Ubiquitous Computing 17, 1 (2013), 127--144. Google ScholarDigital Library
- Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. Accessibility Came by Accident: Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 459. Google ScholarDigital Library
- Amanda Purington, Jessie G Taft, Shruti Sannon, Natalya N Bazarova, and Samuel Hardman Taylor. 2017. Alexa is my new BFF: social roles, user satisfaction, and personification of the amazon echo. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2853--2859. Google ScholarDigital Library
- RNIB. 2013. Key statistics on the prevalence and population of children and young people with vision impairment. (2013).Google Scholar
- Nuzhah Gooda Sahib, Tony Stockman, Anastasios Tombros, and Oussama Metatla. 2013. Participatory design with blind users: a scenariobased approach. In IFIP Conference on Human-Computer Interaction. Springer, 685--701.Google ScholarCross Ref
- Eva-Lotta Sallnas, Jonas Moll, and Kerstin Severinson-Eklundh. 2007. Group work about geometrical concepts among blind and sighted pupils using haptic interfaces. In EuroHaptics Conference, 2007 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2007. Second Joint. IEEE, 330--335. Google ScholarDigital Library
- U Sharma and SJ Salend. 2016. Teaching Assistants in Inclusive Classrooms: A Systematic Analysis of the International Research. Australian Journal of Teacher Education 41, 8 (2016), 118--134.Google ScholarCross Ref
- Arielle M. Silverman, Jennifer S. Pitonyak, Ian K. Nelson, Patricia N. Matsuda, Deborah Kartin, and Ivan R. Molton. 2017. Instilling positive beliefs about disabilities: pilot testing a novel experiential learning activity for rehabilitation students. Disability and Rehabilitation 0 (2017), 1--6. Voice User Interfaces in Schools CHI 2019, May 4--9, 2019, Glasgow, Scotland UKGoogle Scholar
- Miriam D Skjørten. 2001. Towards inclusion and enrichment. Education Special Needs Education: An Introduction. Oslo: Unipub Forlag (2001).Google Scholar
- Iris Soute, Susanne Lagerström, and Panos Markopoulos. 2013. Rapid prototyping of outdoor games for children in an iterative design process. In Proceedings of the 12th International Conference on Interaction Design and Children. ACM, 74--83. Google ScholarDigital Library
- Tony Stockman and Oussama Metatla. 2008. The influence of screenreaders on web cognition. In Proceeding of Accessible design in the digital world conference (ADDW 2008), York, UK.Google Scholar
- Stergios Tegos, Stavros Demetriadis, and Anastasios Karakostas. 2015. Promoting academically productive talk with conversational agent interventions in collaborative learning settings. Computers & Education 87 (2015), 309--325. Google ScholarDigital Library
- Anja Thieme, Cecily Morrison, Nicolas Villar, Martin Grayson, and Siân Lindley. 2017. Enabling Collaboration in Learning Computer Programing Inclusive of Children with Vision Impairments. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 739--752. Google ScholarDigital Library
- Laura Pfeifer Vardoulakis, Lazlo Ring, Barbara Barry, Candace L Sidner, and Timothy Bickmore. 2012. Designing relational agents as long term social companions for older adults. In International Conference on Intelligent Virtual Agents. Springer, 289--302. Google ScholarDigital Library
- Giacomo Vivanti, Ed Duncan, Geraldine Dawson, and Sally J Rogers. 2017. Facilitating Learning Through Peer Interactions and Social Participation. In Implementing the Group-Based Early Start Denver Model for Preschoolers with Autism. Springer, 87--99.Google Scholar
- Amber Wagner, Ramaraju Rudraraju, Srinivasa Datla, Avishek Banerjee, Mandar Sudame, and Jeff Gray. 2012. Programming by voice: a hands-free approach for motorically challenged children. In CHI'12 Extended Abstracts on Human Factors in Computing Systems. ACM, 2087--2092. Google ScholarDigital Library
- Ru Zarin and Daniel Fallman. 2011. Through the troll forest: exploring tabletop interaction design for children with special cognitive needs. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3319--3322. Google ScholarDigital Library
- Li Zhou, Amy T Parker, Derrick W Smith, and Nora Griffin-Shirley. 2011. Assistive technology for students with visual impairments: Challenges and needs in teachers' preparation programs and practice. J. Visual Impairment & Blindness 105, 4 (2011), 197.Google ScholarCross Ref
Index Terms
- Voice User Interfaces in Schools: Co-designing for Inclusion with Visually-Impaired and Sighted Pupils
Recommendations
Robots for Inclusive Play: Co-designing an Educational Game With Visually Impaired and sighted Children
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsDespite being included in mainstream schools, visually impaired children still face barriers to social engagement and participation. Games could potentially help, but games that cater for both visually impaired and sighted players are scarce. We used a ...
“Bursting the Assistance Bubble”: Designing Inclusive Technology with Children with Mixed Visual Abilities
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsChildren living with visual impairments (VIs) are increasingly educated in mainstream rather than special schools. But knowledge about the challenges they face in inclusive schooling environments and how to design technology to overcome them remains ...
Using Experience-Based Participatory Approach to Design Interactive Voice User Interfaces for Delivering Physical Activity Programs with Older Adults
HAI '23: Proceedings of the 11th International Conference on Human-Agent InteractionVoice User Interfaces (VUIs) are popular among older adults, who find them easy to use and perceive them as social companions. However, there is a lack of research on voice-based applications to support physical activities for older adults. To address ...
Comments