Skip to main content
Top

2022 | OriginalPaper | Chapter

Leveraging Virtual Reality and Machine Learning as Mediated Learning Tools for Social Skill Development in Learners with Autism Spectrum Condition

Authors : Thomas Hughes-Roberts, Vanessa Cui, Mufti Mahmud, David J. Brown

Published in: Universal Access in Human-Computer Interaction. User and Context Diversity

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Learners with Autism Spectrum Condition (ASC) are often characterized as having deficits in core social competencies affecting ability to communicate and interact with other people across multiple contexts. However, such deficit views of ASC lead to narrow interventions that cannot be generalized to wider learning contexts nor the real world. Taking a non-deficit view can offer a means of broadening understanding of ASC by taking a more holistic view of an individual. Thoughtfully designed VR solutions that take a non-deficit view can provide learning tools allow learners to develop their self-determination awareness and skills such as decision-making, self-advocacy, reflective problem-solving. Furthermore, through the use of machine learning approaches such solutions have the potential to provide real-time monitoring of learners during interaction offering a holistic understanding of individuals with ASC. This position paper sets out the support case for utilizing VR through non-deficit models and examines the role machine learning can play in further understanding of learners with ASC. It is intended that this sets out a case for future research directions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Bölte, S.: Is autism curable? Dev. Med. Child Neurol. 56(10), 927–931 (2014)CrossRef Bölte, S.: Is autism curable? Dev. Med. Child Neurol. 56(10), 927–931 (2014)CrossRef
go back to reference Bozgeyikli, L., Raij, A., Katkoori, S., Alqasemi, R.: A survey on virtual reality for individuals with autism spectrum disorder: design considerations. IEEE Trans. Learn. Technol. 11(2), 133–151 (2017)CrossRef Bozgeyikli, L., Raij, A., Katkoori, S., Alqasemi, R.: A survey on virtual reality for individuals with autism spectrum disorder: design considerations. IEEE Trans. Learn. Technol. 11(2), 133–151 (2017)CrossRef
go back to reference Didehbani, N., Allen, T., Kandalaft, M., Krawczyk, D., Chapman, S.: Virtual reality social cognition training for children with high functioning autism. Comput. Hum. Behav. 62, 703–711 (2016)CrossRef Didehbani, N., Allen, T., Kandalaft, M., Krawczyk, D., Chapman, S.: Virtual reality social cognition training for children with high functioning autism. Comput. Hum. Behav. 62, 703–711 (2016)CrossRef
go back to reference Dinishak, J.: The deficit view and its critics. Disabil. Stud. Q. 36(4) (2016). ISSN 2159-8371 (Online), 1041-5718 (Print) Dinishak, J.: The deficit view and its critics. Disabil. Stud. Q. 36(4) (2016). ISSN 2159-8371 (Online), 1041-5718 (Print)
go back to reference Fowler, C.: Virtual reality and learning: where is the pedagogy? Br. J. Edu. Technol. 46(2), 412–422 (2015)CrossRef Fowler, C.: Virtual reality and learning: where is the pedagogy? Br. J. Edu. Technol. 46(2), 412–422 (2015)CrossRef
go back to reference Ghanouni, P., Jarus, T., Zwicker, J.G., Lucyshyn, J., Mow, K., Ledingham, A.: Social stories for children with autism spectrum disorder: validating the content of a virtual reality program. J. Autism Dev. Disord. 49(2), 660–668 (2019)CrossRef Ghanouni, P., Jarus, T., Zwicker, J.G., Lucyshyn, J., Mow, K., Ledingham, A.: Social stories for children with autism spectrum disorder: validating the content of a virtual reality program. J. Autism Dev. Disord. 49(2), 660–668 (2019)CrossRef
go back to reference Halabi, O., El-Seoud, S.A., Alja'am, J.M., Alpona, H., Al-Hemadi, M., Al-Hassan, D.: Design of immersive virtual reality system to improve communication skills in individuals with autism. Int. J. Emerg. Technol. Learn. 12(5) (2017) Halabi, O., El-Seoud, S.A., Alja'am, J.M., Alpona, H., Al-Hemadi, M., Al-Hassan, D.: Design of immersive virtual reality system to improve communication skills in individuals with autism. Int. J. Emerg. Technol. Learn. 12(5) (2017)
go back to reference Hughes-Roberts, T., et al.: Examining engagement and achievement in learners with individual needs through robotic-based teaching sessions. Br. J. Edu. Technol. 50(5), 2736–2750 (2019)CrossRef Hughes-Roberts, T., et al.: Examining engagement and achievement in learners with individual needs through robotic-based teaching sessions. Br. J. Edu. Technol. 50(5), 2736–2750 (2019)CrossRef
go back to reference Lahiri, U., Bekele, E., Dohrmann, E., Warren, Z., Sarkar, N.: Design of a virtual reality based adaptive response technology for children with autism. IEEE Trans. Neural Syst. Rehabil. Eng. 21(1), 55–64 (2012)CrossRef Lahiri, U., Bekele, E., Dohrmann, E., Warren, Z., Sarkar, N.: Design of a virtual reality based adaptive response technology for children with autism. IEEE Trans. Neural Syst. Rehabil. Eng. 21(1), 55–64 (2012)CrossRef
go back to reference Marín-Morales, J., et al.: Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors. Sci. Rep. 8(1), 1–15 (2018)CrossRef Marín-Morales, J., et al.: Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors. Sci. Rep. 8(1), 1–15 (2018)CrossRef
go back to reference Mesa-Gresa, P., Gil-Gómez, H., Lozano-Quilis, J.A., Gil-Gómez, J.A.: Effectiveness of virtual reality for children and adolescents with autism spectrum disorder: an evidence-based systematic review. Sensors 18(8), 2486 (2018)CrossRef Mesa-Gresa, P., Gil-Gómez, H., Lozano-Quilis, J.A., Gil-Gómez, J.A.: Effectiveness of virtual reality for children and adolescents with autism spectrum disorder: an evidence-based systematic review. Sensors 18(8), 2486 (2018)CrossRef
go back to reference Mitchell, P., Parsons, S., Leonard, A.: Using virtual environments for teaching social understanding to 6 adolescents with autistic spectrum disorders. J. Autism Dev. Disord. 37(3), 589–600 (2007)CrossRef Mitchell, P., Parsons, S., Leonard, A.: Using virtual environments for teaching social understanding to 6 adolescents with autistic spectrum disorders. J. Autism Dev. Disord. 37(3), 589–600 (2007)CrossRef
go back to reference Pan, X., Gillies, M., Slater, M.: Virtual character personality influences participant attitudes and behavior–an interview with a virtual human character about her social anxiety. Front. Robot. AI 2, 1 (2015)CrossRef Pan, X., Gillies, M., Slater, M.: Virtual character personality influences participant attitudes and behavior–an interview with a virtual human character about her social anxiety. Front. Robot. AI 2, 1 (2015)CrossRef
go back to reference Pan, X., et al.: The responses of medical general practitioners to unreasonable patient demand for antibiotics-a study of medical ethics using immersive virtual reality. PloS ONE 11(2) (2016) Pan, X., et al.: The responses of medical general practitioners to unreasonable patient demand for antibiotics-a study of medical ethics using immersive virtual reality. PloS ONE 11(2) (2016)
go back to reference Parsons, S.: Authenticity in virtual reality for assessment intervention in autism: a conceptual review. Educ. Res. Rev. 19, 138–157 (2016)CrossRef Parsons, S.: Authenticity in virtual reality for assessment intervention in autism: a conceptual review. Educ. Res. Rev. 19, 138–157 (2016)CrossRef
go back to reference Parsons, S., Cobb, S.: State-of-the-art of virtual reality technologies for children on the autism spectrum. Eur. J. Spec. Needs Educ. 26(3), 355–366 (2011)CrossRef Parsons, S., Cobb, S.: State-of-the-art of virtual reality technologies for children on the autism spectrum. Eur. J. Spec. Needs Educ. 26(3), 355–366 (2011)CrossRef
go back to reference Parsons, S., Leonard, A., Mitchell, P.: Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder. Comput. Educ. 47(2), 186–206 (2006)CrossRef Parsons, S., Leonard, A., Mitchell, P.: Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder. Comput. Educ. 47(2), 186–206 (2006)CrossRef
go back to reference Parsons, S., Yuill, N., Good, J., Brosnan, M.: “Whose agenda? Who knows best? Whose voices?”: co-creating a technology research roadmap with autism stakeholders. Disabil. Soc. 35(2), 201–234 (2020)CrossRef Parsons, S., Yuill, N., Good, J., Brosnan, M.: “Whose agenda? Who knows best? Whose voices?”: co-creating a technology research roadmap with autism stakeholders. Disabil. Soc. 35(2), 201–234 (2020)CrossRef
go back to reference Rosqvist, H.B., Stenning, A., Chown, N.: Introduction. In: Stenning, A., Rosqvist, H. B., Chown, N. (eds.) Neurodiversity Studies. Taylor and Francis, Milton Park (2020) Rosqvist, H.B., Stenning, A., Chown, N.: Introduction. In: Stenning, A., Rosqvist, H. B., Chown, N. (eds.) Neurodiversity Studies. Taylor and Francis, Milton Park (2020)
go back to reference Robertson, S.M.: Neurodiversity, quality of life, and autistic adults: shifting research and professional focuses onto real life challenges. Disabil. Stud. Q. 30(1) (2010) Robertson, S.M.: Neurodiversity, quality of life, and autistic adults: shifting research and professional focuses onto real life challenges. Disabil. Stud. Q. 30(1) (2010)
go back to reference Standen, P.J., et al.: An evaluation of an adaptive learning system based on multimodal affect recognition for learners with intellectual disabilities. Br. J. Educ. Technol. (2020) Standen, P.J., et al.: An evaluation of an adaptive learning system based on multimodal affect recognition for learners with intellectual disabilities. Br. J. Educ. Technol. (2020)
go back to reference Stewart Rosenfield, N., Lamkin, K., Re, J., Day, K., Boyd, L., Linstead, E.: A virtual reality system for practicing conversation skills for children with autism. Multimodal Technol. Interact. 3(2), 28 (2019)CrossRef Stewart Rosenfield, N., Lamkin, K., Re, J., Day, K., Boyd, L., Linstead, E.: A virtual reality system for practicing conversation skills for children with autism. Multimodal Technol. Interact. 3(2), 28 (2019)CrossRef
go back to reference Taheri, M.H., Brown, D.J., Sherkat, N.: Modeling engagement with multimodal multisensor data: the continuous performance test as an objective tool to track flow. Int. J. Comput. Inf. Eng. 14(6), 197–208 (2020) Taheri, M.H., Brown, D.J., Sherkat, N.: Modeling engagement with multimodal multisensor data: the continuous performance test as an objective tool to track flow. Int. J. Comput. Inf. Eng. 14(6), 197–208 (2020)
go back to reference Torous, J., et al.: The growing field of digital psychiatry: current evidence and the future of apps, social media, chatbots, and virtual reality. World Psychiatry 20(3), 318–335 (2021)CrossRef Torous, J., et al.: The growing field of digital psychiatry: current evidence and the future of apps, social media, chatbots, and virtual reality. World Psychiatry 20(3), 318–335 (2021)CrossRef
go back to reference Yuan, S.N.V., Ip, H.H.S.: Using virtual reality to train emotional and social skills in children with autism spectrum disorder. Lond. J. Prim. Care 10(4), 110–112 (2018)CrossRef Yuan, S.N.V., Ip, H.H.S.: Using virtual reality to train emotional and social skills in children with autism spectrum disorder. Lond. J. Prim. Care 10(4), 110–112 (2018)CrossRef
go back to reference Zhang, L., Warren, Z., Swanson, A., Weitlauf, A., Sarkar, N.: Understanding performance and verbal-communication of children with ASD in a collaborative virtual environment. J. Autism Dev. Disord. 48(8), 2779–2789 (2018)CrossRef Zhang, L., Warren, Z., Swanson, A., Weitlauf, A., Sarkar, N.: Understanding performance and verbal-communication of children with ASD in a collaborative virtual environment. J. Autism Dev. Disord. 48(8), 2779–2789 (2018)CrossRef
Metadata
Title
Leveraging Virtual Reality and Machine Learning as Mediated Learning Tools for Social Skill Development in Learners with Autism Spectrum Condition
Authors
Thomas Hughes-Roberts
Vanessa Cui
Mufti Mahmud
David J. Brown
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-031-05039-8_16