Abstract
Using our theoretical framework of multimodal processing, we developed and evaluated a computer-animated tutor, Baldi, to teach vocabulary and grammar for children with autism. Baldi was implemented in a Language Wizard/Player, which allows easy creation and presentation of a language lesson involving the association of pictures and spoken words. The lesson plan includes both the identification of pictures and the production of spoken words. In Experiment 1, eight children were given initial assessment tests, tutorials, and reassessment tests 30 days following mastery of the vocabulary items. All of the students learned a significant number of new words and grammar. A second within-subject design with six children followed a multiple baseline design and documented that the program was responsible for the learning and generalization of new words. The research indicates that children with autism are capable of learning new language within an automated program centered around a computer-animated agent, multimedia, and active participation and can transfer and use the language in a natural, untrained environment.
Similar content being viewed by others
References
American Psychiatric Association (1994). Diagnostic and Statistical Manual of Mental Disorders (4th ed.). Washington, DC: Author.
Baer, D. M., Wolf, M. M., Risley, T. R. (1968). Some current dimenstions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91-97.
Barker, L. J. (2003). Computer-assisted vocabulary acquisition: The CSLU vocabulary tutor in oral-deaf education. Journal of Deaf Studies and Deaf Education, 8, 187-198.
Bjork, R. A. (1994). Memory and metamemory considerations in the training of human beings. In J. Metcalfe and A. Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 185-205). Cambridge, MA: MIT Press.
Calvert, S. L. (1999). Children's journeys through the information age. Boston: McGraw Hill.
Carr, E. G. (1980). Generalization of treatment effects following educational intervention with autistic children and youth. In B. Wilcox & A. Thompson (Eds.), Critical issues in educating autistic children and youth (pp. 118-134). Washington, DC: Department of Education, Office of Special Education.
Carr, E. G. (1982). Sign language. In R. L. Koegel, A. Rincover, & A. L. Egel (Eds.), Educating and understanding autistic children. San Diego, CA: College Hill.
Carr, E. G., & Dores, P. A. (1981). Patterns of language acquisition following simultaneous communication with autistic children. Analysis & Intervention in Developmental Disabilities, 1(3-sup-4), 347-361.
Carr, E. G., & Kologinsky, E. (1983). Acquisition of sign language by autistic children II: spontaneity and generalization effects. Journal of Applied Behavior Analysis, 16, 297-314.
Chun, D. M., & Plass, J. L. (1996). Effects of multimedia annotations on vocabulary acquisition. Modern Language Journal 80, 183-198.
Cohen, M. M., Beskow, J., & Massaro, D. W. (1998). Recent developments in facial animation: An inside view. In Proceedings of Auditory Visual Speech Perception '98. (pp. 201–206). Terrigal-Sydney Australia, December, 1998.
Cohen, M. M., Walker, R. L., & Massaro, D. W. (1996). Perception of synthetic visual speech. In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by humans and machines (pp. 153-168). New York: Springer.
Courchesne, E., Townsend, J., Ashoomoff, N. A., Yeung-Courchesne, R., Press, G., Murakami, J., Lincoln, A., James, H., Saitoh, O., Haas, R., & Schreibman, L. (1994). A new finding in autism: Impairment in shifting attention. In S. H. Broman & J. Grafman (Eds.), Atypical cognitive deficits in developmental disorders: Implications for brain function (pp. 101-137). Hillsdale NJ: Lawrence Erlbaum.
Dubois, M., & Vial, I. (2000). Multimedia design: The effects of relating multimodal information. Journal of Computer Assisted Learning, 16, 157-165.
Gupta, P., & MacWhinney, B. (1997). Vocabulary acquisition and verbal short-term memory: computation and neural bases. Brain and Language, 59, 267-333.
Handleman, J. S. (1979). Generalization by autistic-type children of verbal responses across settings. Journal of Applied Behavior Analysis, 12, 273-282.
Heimann, M., Nelson, K., Tjus, T., & Gilberg, C. (1995). Increasing reading and communication skills in children with autism through an interactive multimedia computer program. Journal of Autism and Developmental Disorders, 25, 459-480.
Horner, R. D., & Baer, D. M. (1978). Multiple-probe technique: A variation of the multiple baseline. Journal of Applied Behavior Analysis, 11, 189-196.
Jahr, E. (2001). Teaching children with autism to answer novel whquestions by utilizing a multiple exemplar strategy. Research in Developmental Disabilities, 22, 407-423.
Koegel, L. K. (2000). Interventions of facilitate communication in autism. Journal of Autism and Developmental Disorders, 2, 383-391.
Koegel, L., Koegel, L. K., Surratt, A. (1992). Language intervention and disruptive behavior in preschool children with autism. Journal of Autism and Developmental Disorders, 22, 141-153.
Lord, C., Rutter, M., & Le Couteur, A. (1994). Autism Diagnostic Interview—Revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism & Developmental Disorders, 24, 659-685.
Lovaas, O. I., Koegel, R., Simmons, J. Q., & Long, J. S. (1973). Some generalization and follow-up measures on autistic children in behavior therapy. Journal of Applied Behavior Analysis, 6, 131-166.
Lovaas, O. I., Schreibman, L., Koegel, R., & Rehm, R. (1971). Selective responding by autistic children to multiple sensory input. Journal of Abnormal Psychology, 77, 211-222.
Massaro, D. W. (1998). Perceiving talking faces: From speech perception to a behavioral principle. Cambridge, MA: MIT Press.
Massaro, D. W. (1999). From theory to practice: Rewards and challenges. In Proceedings of the International Conference of Phonetic Sciences, San Francisco, CA, August.
Massaro, D. W. (2000). From “Speech is Special” to Talking Heads in Language Learning. In Proceedings of Integrating speech technology in the (Language) Learning and Assistive Interface, (InSTIL 2000) August 29-30.
Moore, M., & Calvert, S. (2000). Brief report: Vocabulary acquisition for children with autism: Teacher or computer instruction. Journal of Autism and Developmental Disorders, 30, 359-362.
Prizant, B. M. (1983). Language acquisition and communicative behavior in autism: Toward an understanding of the “whole” of it. Journal of Speech & Hearing Disorders, 48, 296-307.
Rincover, A., & Koegel, R. L. (1975). Setting generality and stimulus control in autistic children. Journal of Applied Behavior Analysis, 8, 235-246.
Schopler, E., Mesibov, G. B., & Hearsey, K. (1995). Structured teaching in the TEACCH system. In E. Schopler & G. B. Mesibov (Eds.), Learning and cognition in autism. Current issues in autism. (pp. 243-268). New York: Plenum Press.
Schopler, E., Reichler, R., Bashford, A., Lansing, M., & Marcus, L. 1990. The Psychoeducational Profile Revised (PEP-R). Austin, TX: Pro-ed.
Sparrow, S. S., Balla, D. A., & Cicchetti, D. V. (1984). Vineland Adaptive Behavior Scales. Circle Pines, MN: American Guidance Service.
Stanovich, K. E. (1986). Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. Reading Research Quarterly, 21, 360-406.
Stokes, T. F., Baer, D. M., & Jackson, R. L. (1974). Programming the generalization of a greeting response in four retarded children. Journal of Applied Behavior Analysis, 7, 599-610.
Tager-Flusberg, H. (1999). A psychological approach to understanding the social and language impairments in autism. International Review of Psychiatry, 11, 355-334.
Tager-Flusberg, H. (2000). Language development in children with autism. In L. Menn & N. Bernstein Ratner (Ed.), Methods For Studying Language Production (pp. 313-332). Mahwah, NJ: Lawrence Erlbaum.
Van Lancker, D., Cornelius, C., Needleman, R. (1991). Comprehension of verbal terms for emotions in normal, autistic, and schizophrenic children. Developmental Neuropsychology, 7, 1-18.
Vermeer, A. (2001). Breadth and depth of vocabulary in relation to L1/L2 acquisition and frequency of input. Applied Psycholinguistics, 22, 217-234.
Wechsler, D. (1989). Wechsler Preschool and Primary Scale of Intelligence–Revised. San Antonio, TX: Psychological Corporation.
Wood, J. (2001). Can software support children's vocabulary development? Language Learning & Technology, 5, 166-201.
Yamamoto, J., & Miya, T. (1999). Acquisition and transfer of sentence construction in autistic students: Analysis of computer-based teaching. Research in Developmental Disabilities, 20, 355-377.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Bosseler, A., Massaro, D.W. Development and Evaluation of a Computer-Animated Tutor for Vocabulary and Language Learning in Children with Autism. J Autism Dev Disord 33, 653–672 (2003). https://doi.org/10.1023/B:JADD.0000006002.82367.4f
Issue Date:
DOI: https://doi.org/10.1023/B:JADD.0000006002.82367.4f