Chek Tien Tan
ABSTRACT
Current speech therapy treatments are not easily accessible to the general public due to cost and demand. Therapy sessions are also laborious and maintaining motivation of patients is hard. We propose using popular games and speech recognition technology for speech therapy in an individualised and accessible manner. sPeAK-MAN is a Pac-Man-like game with a core gameplay mechanic that incorporates vocalisation of words generated from a pool commonly used in clinical speech therapy sessions. Other than improving engagement, sPeAK-MAN aims to provide real-time feedback on the vocalisation performance of patients. It also serves as an initial prototype to demonstrate the possibilities of using familiar popular gameplay (instead of building one from scratch) for rehabilitation purposes.
- K. J. Ballard, E. Maas, and D. A. Robin. Treating control of voicing in apraxia of speech with variable practice. Aphasiology, 21(12):1195--1217, Dec. 2007.Google Scholar
Cross Ref
- V. Bernard-Opitz, N. Sriram, and S. Sapuan. Enhancing Vocal Imitations in Children with Autism Using the IBM Speech Viewer. Autism, 3(2):131--147, June 1999.Google ScholarCross Ref
- L. Bourke, C. Sheridan, U. Russell, G. Jones, D. DeWitt, and S.-T. Liaw. Developing a conceptual understanding of rural health practice. The Australian journal of rural health, 12(5):181--186, 2004.Google Scholar
- C. M. Fox, L. O. Ramig, M. R. Ciucci, S. Sapir, D. H. McFarland, and B. G. Farley. The science and practice of LSVT/LOUD: neural plasticity-principled approach to treating individuals with Parkinson disease and other neurological disorders. Seminars in Speech and Language, 27(4):283--299, 2006.Google ScholarCross Ref
- V. Georgopoulos. An investigation of audio-visual speech recognition as applied to multimedia speech therapy applications. In Proceedings IEEE International Conference on Multimedia Computing and Systems, volume 1, pages 481--486. IEEE Comput. Soc, June 1999. Google ScholarDigital Library
- J. Hailpern. Visualizations: Speech, Language & Autistic Spectrum Disorder. Screen, pages 3591--3596, 2008. Google ScholarDigital Library
- J. Hailpern, K. Karahalios, and J. Halle. Creating a spoken impact. In Proceedings of the 27th international conference on Human factors in computing systems CHI 09, CHI '09, page 453. ACM Press, 2009. Google ScholarDigital Library
- L. Herman, J. Horwitz, S. Kent, and S. Miller. The History of Video Games. New York, CE-23(1):1--39, 2002.Google Scholar
- S. Hutchins. SAY & SEE articulation therapy software. In Proceedings of the Johns Hopkins National Search for Computing Applications to Assist Persons with Disabilities, pages 37--40. IEEE Comput. Soc. Press.Google Scholar
- E. Maas, D. A. Robin, S. N. Austermann Hula, S. E. Freedman, G. Wulf, K. J. Ballard, and R. A. Schmidt. Principles of motor learning in treatment of motor speech disorders. American journal of speechlanguage pathology American SpeechLanguageHearing Association, 17(3):277--298, 2008.Google Scholar
- D. Perera, R. T. Jim Eales, and K. Blashki. Supporting the creative drive: investigating paralinguistic voice as a mode of interaction for artists with upper limb disabilities. Universal Access in the Information Society, 8(2):77--88, July 2008. Google ScholarDigital Library
Index Terms
- sPeAK-MAN: towards popular gameplay for speech therapy
Recommendations
Retrogaming as visual feedback for speech therapy
SA '14: SIGGRAPH Asia 2014 Mobile Graphics and Interactive ApplicationsA key problem in speech therapy is the motivation of patients in repetitive vocalization tasks. One important task is the vocalization of vowels. We present a novel solution by incorporating formant speech analysis into retro games to enable intrinsic ...
Designing Towards Maximum Motivation and Engagement in an Interactive Speech Therapy Game
IDC '17: Proceedings of the 2017 Conference on Interaction Design and ChildrenChildren with speech impairments often find speech curriculums tedious, limiting how often children are motivated to practice. A speech therapy game has the potential to make practice fun, may help facilitate increased time and quality of at-home speech ...
Apraxia world: a speech therapy game for children with speech sound disorders
IDC '18: Proceedings of the 17th ACM Conference on Interaction Design and ChildrenThis paper presents Apraxia World, a remote therapy tool for speech sound disorders that integrates speech exercises into an engaging platformer-style game. In Apraxia World, the player controls the avatar with virtual buttons/joystick, whereas speech ...
Comments