Skip to main content
Erschienen in: Universal Access in the Information Society 1/2018

05.01.2017 | Long Paper

Interactive testbed for research in autism—the SARA project

verfasst von: Diana Arellano, Reinhold Rauh, Benjamin Krautheim, Marc Spicker, Ulrich Max Schaller, Volker Helzle, Oliver Deussen

Erschienen in: Universal Access in the Information Society | Ausgabe 1/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The project Stylized Animations for Research on Autism (SARA) aims to develop a better understanding of the cognitive processes behind emotional categorization in children and adolescents with high-functioning autism spectrum disorder (ASD), in comparison with neurotypically developed peers. To this end, we combine novel real-time non-photorealistic rendering (NPR) algorithms, emotional facial animations, and eye-tracking technologies in a framework that serves as an interactive testbed for empirical research. In this paper, we focus on three experiments that: (1) validate real-time facial animations of virtual characters, (2) evaluate the NPR algorithms to create abstracted facial expressions, and (3) elucidate the relation between eye gaze behavior, ASD and alexithymia (i.e., difficulties in expressing ones emotions). The results show that our animations can be used in the proposed experiments; however, more evaluation is needed regarding the NPR abstractions, especially with individuals with ASD. Finally, even though no correlation was found between gaze behavior, ASD and alexithymia, the study opened several questions that will be addressed in future work.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Baio, J.: Prevalence of autism spectrum disorder among children aged 8 years—autism and developmental disabilities monitoring network, 11 sites, United States, 2010. Surveill. Summ. 63, 1–21 (2014) Baio, J.: Prevalence of autism spectrum disorder among children aged 8 years—autism and developmental disabilities monitoring network, 11 sites, United States, 2010. Surveill. Summ. 63, 1–21 (2014)
3.
Zurück zum Zitat Elsabbagh, M., Divan, G., Koh, Y., Kim, Y., Kauchali, S., Marcín, C., Montiel-Nava, C., Patel, V., Paula, C., Wang, C., Yasamy, M., Fombonne, E.: Global prevalence of autism and other pervasive developmental disorders. Autism Res. 5(3), 160–179 (2012)CrossRef Elsabbagh, M., Divan, G., Koh, Y., Kim, Y., Kauchali, S., Marcín, C., Montiel-Nava, C., Patel, V., Paula, C., Wang, C., Yasamy, M., Fombonne, E.: Global prevalence of autism and other pervasive developmental disorders. Autism Res. 5(3), 160–179 (2012)CrossRef
4.
Zurück zum Zitat Saemundsen, E., Magnússon, P., Georgsdóttir, I., Egilsson, E., Rafnsson, V.: Prevalence of autism spectrum disorders in an icelandic birth cohort. BMJ Open. 3(6), e002748 (2013)CrossRef Saemundsen, E., Magnússon, P., Georgsdóttir, I., Egilsson, E., Rafnsson, V.: Prevalence of autism spectrum disorders in an icelandic birth cohort. BMJ Open. 3(6), e002748 (2013)CrossRef
5.
Zurück zum Zitat Chita-Tegmark, M.: Attention allocation in ASD: a review and meta-analysis of eye-tracking studies. Rev. J. Autism Dev. Disord. 3(3), 209–223 (2016)CrossRef Chita-Tegmark, M.: Attention allocation in ASD: a review and meta-analysis of eye-tracking studies. Rev. J. Autism Dev. Disord. 3(3), 209–223 (2016)CrossRef
6.
Zurück zum Zitat Uljarevic, M., Hamilton, A.: Recognition of emotions in autism: a formal meta-analysis. J. Autism Dev. Disord. 43(7), 1517–1526 (2013)CrossRef Uljarevic, M., Hamilton, A.: Recognition of emotions in autism: a formal meta-analysis. J. Autism Dev. Disord. 43(7), 1517–1526 (2013)CrossRef
7.
Zurück zum Zitat Whyte, E., Smyth, J., Scherf, S.: Designing serious game interventions for individuals with autism. J. Autism Dev. Disord. 45(12), 3820–3831 (2014)CrossRef Whyte, E., Smyth, J., Scherf, S.: Designing serious game interventions for individuals with autism. J. Autism Dev. Disord. 45(12), 3820–3831 (2014)CrossRef
8.
Zurück zum Zitat Milne, M., Luerssen, M., Lewis, T., Leibbrandt, R., Powers, D.: Designing and evaluating interactive agents as social skills tutors for children with autism spectrum disorder. In: Perez-Marin, D., Pascual-Nieto, I., (eds.) Conversational Agents and Natural Language Interaction: Techniques and Effective Practices, pp. 23–48 (2011) Milne, M., Luerssen, M., Lewis, T., Leibbrandt, R., Powers, D.: Designing and evaluating interactive agents as social skills tutors for children with autism spectrum disorder. In: Perez-Marin, D., Pascual-Nieto, I., (eds.) Conversational Agents and Natural Language Interaction: Techniques and Effective Practices, pp. 23–48 (2011)
9.
Zurück zum Zitat Grawemeyer, B., Johnson, H., Brosnan, M., Ashwin, E., Benton, L.: Developing an embodied pedagogical agent with and for young people with autism spectrum disorder. In: ITS 2012. LNCS, vol. 7315, pp. 262–267. Springer, Heidelberg (2012) Grawemeyer, B., Johnson, H., Brosnan, M., Ashwin, E., Benton, L.: Developing an embodied pedagogical agent with and for young people with autism spectrum disorder. In: ITS 2012. LNCS, vol. 7315, pp. 262–267. Springer, Heidelberg (2012)
10.
Zurück zum Zitat Alcorn, A., Pain, H., Rajendran, G., Smith, T., Lemon, O., Porayska-Pomsta, K., Foster, M.E., Avramides, K., Frauenberger, C., Bernardini, S.: Social communication between virtual characters and children with autism. In: Artificial Intelligence in Education: 15th International Conference, pp. 7–14 (2011) Alcorn, A., Pain, H., Rajendran, G., Smith, T., Lemon, O., Porayska-Pomsta, K., Foster, M.E., Avramides, K., Frauenberger, C., Bernardini, S.: Social communication between virtual characters and children with autism. In: Artificial Intelligence in Education: 15th International Conference, pp. 7–14 (2011)
11.
Zurück zum Zitat Serret, S., Hun, S., Iakimova, G., Lozada, J., Anastassova, M., Santos, A., Vesperini, S., Askenazy, F.: Facing the challenge of teaching emotions to individuals with low- and high-functioning autism using a new serious game: a pilot study. Mol. Autism 5(37) (2014). http://www.jestimule.com Serret, S., Hun, S., Iakimova, G., Lozada, J., Anastassova, M., Santos, A., Vesperini, S., Askenazy, F.: Facing the challenge of teaching emotions to individuals with low- and high-functioning autism using a new serious game: a pilot study. Mol. Autism 5(37) (2014). http://​www.​jestimule.​com
12.
Zurück zum Zitat Alves, S., Marques, A., Queirós, C., Orvalho, V.: LIFEisGAME prototype: a serious game about emotions for children with autism spectrum disorders. PsychNol. J. 11(3), 191–211 (2013) Alves, S., Marques, A., Queirós, C., Orvalho, V.: LIFEisGAME prototype: a serious game about emotions for children with autism spectrum disorders. PsychNol. J. 11(3), 191–211 (2013)
13.
Zurück zum Zitat Rice, L., Wall, C., Fogel, A., Shic, F.: Computer-assisted face processing instruction improves emotion recognition, mentalizing, and social skills in students with ASD. J. Autism Dev. Disord. 45(7), 1–11 (2015)CrossRef Rice, L., Wall, C., Fogel, A., Shic, F.: Computer-assisted face processing instruction improves emotion recognition, mentalizing, and social skills in students with ASD. J. Autism Dev. Disord. 45(7), 1–11 (2015)CrossRef
14.
Zurück zum Zitat Tanaka, J.W., Wolf, J.M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown, C., Stahl, S., Kaiser, M.D., Schultz, R.T.: Using computerized games to teach face recognition skills to children with autism spectrum disorder: the let’s face it! program. J. Child Psychol. Psychiatry 51(8), 944–952 (2010)CrossRef Tanaka, J.W., Wolf, J.M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown, C., Stahl, S., Kaiser, M.D., Schultz, R.T.: Using computerized games to teach face recognition skills to children with autism spectrum disorder: the let’s face it! program. J. Child Psychol. Psychiatry 51(8), 944–952 (2010)CrossRef
15.
Zurück zum Zitat American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders: DSM-5, 5th edn. American Psychiatric Publishing, Arlington (2013) American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders: DSM-5, 5th edn. American Psychiatric Publishing, Arlington (2013)
16.
Zurück zum Zitat World Health Organization: The ICD-10 Classification of Mental and Behavioural Disorders: Diagnostic Criteria for Research, 10th edn. Geneva: World Health Organization, Switzerland (1993) World Health Organization: The ICD-10 Classification of Mental and Behavioural Disorders: Diagnostic Criteria for Research, 10th edn. Geneva: World Health Organization, Switzerland (1993)
17.
Zurück zum Zitat Krautheim, B.: The influence of alexithymia on gaze behavior patterns in male adolescents with autism spectrum disorder. Master’s thesis, Albert-Ludwigs-Universität Freiburg. Institut für Psychologie (2015) Krautheim, B.: The influence of alexithymia on gaze behavior patterns in male adolescents with autism spectrum disorder. Master’s thesis, Albert-Ludwigs-Universität Freiburg. Institut für Psychologie (2015)
18.
Zurück zum Zitat Kirchner, J.C., Hatri, A., Heekeren, H.R., Dziobek, I.: Autistic symptomatology, face processing abilities, and eye fixation patterns. J. Autism Dev. Disord. 41(2), 158–167 (2011)CrossRef Kirchner, J.C., Hatri, A., Heekeren, H.R., Dziobek, I.: Autistic symptomatology, face processing abilities, and eye fixation patterns. J. Autism Dev. Disord. 41(2), 158–167 (2011)CrossRef
19.
Zurück zum Zitat Klin, A., Jones, W., Schultz, R., Volkmar, F., Cohen, D.: Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch. Gen. Psychiatry 59(9), 809–816 (2002)CrossRef Klin, A., Jones, W., Schultz, R., Volkmar, F., Cohen, D.: Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch. Gen. Psychiatry 59(9), 809–816 (2002)CrossRef
20.
Zurück zum Zitat Senju, A., Johnson, M.H.: Atypical eye contact in autism: models, mechanisms and development. Neurosci. Biobehav. Rev. 33(8), 1204–1214 (2009)CrossRef Senju, A., Johnson, M.H.: Atypical eye contact in autism: models, mechanisms and development. Neurosci. Biobehav. Rev. 33(8), 1204–1214 (2009)CrossRef
21.
Zurück zum Zitat Sawyer, A.C.P., Williamson, P., Young, R.L.: Can gaze avoidance explain why individuals with asperger’s syndrome can’t recognise emotions from facial expressions? J. Autism Dev. Disord. 42(4), 606–618 (2012)CrossRef Sawyer, A.C.P., Williamson, P., Young, R.L.: Can gaze avoidance explain why individuals with asperger’s syndrome can’t recognise emotions from facial expressions? J. Autism Dev. Disord. 42(4), 606–618 (2012)CrossRef
22.
Zurück zum Zitat Bird, G., Press, C., Richardson, D.: The role of alexithymia in reduced eye-fixation in autism spectrum conditions. J. Autism Dev. disord. 41(11), 1556–1564 (2011)CrossRef Bird, G., Press, C., Richardson, D.: The role of alexithymia in reduced eye-fixation in autism spectrum conditions. J. Autism Dev. disord. 41(11), 1556–1564 (2011)CrossRef
23.
Zurück zum Zitat Bird, G., Cook, R.: Mixed emotions: the contribution of alexithymia to the emotional symptoms of autism. Transl. Psychiatry 3, e285 (2013)CrossRef Bird, G., Cook, R.: Mixed emotions: the contribution of alexithymia to the emotional symptoms of autism. Transl. Psychiatry 3, e285 (2013)CrossRef
24.
Zurück zum Zitat Rauh, R., Schaller, U.: Categorical perception of emotional facial expressions in video clips with natural and artificial actors: a pilot study. Tech. Rep. ALU-KJPP-2009-001, University of Freiburg (2009) Rauh, R., Schaller, U.: Categorical perception of emotional facial expressions in video clips with natural and artificial actors: a pilot study. Tech. Rep. ALU-KJPP-2009-001, University of Freiburg (2009)
25.
Zurück zum Zitat Arellano, D., Helzle, V., Schaller, U., Rauh, R.: Animated faces, abstractions and autism. In: Intelligent Virtual Agents 2014, Lecture Notes in Computer Science, vol. 8637, pp. 22–25 (2014) Arellano, D., Helzle, V., Schaller, U., Rauh, R.: Animated faces, abstractions and autism. In: Intelligent Virtual Agents 2014, Lecture Notes in Computer Science, vol. 8637, pp. 22–25 (2014)
26.
Zurück zum Zitat Helzle, V., Biehn, C., Schlömer, T., Linner, F.: Adaptable setup for performance driven facial animation. In: ACM SIGGRAPH 2004 Sketches, p. 54 (2004) Helzle, V., Biehn, C., Schlömer, T., Linner, F.: Adaptable setup for performance driven facial animation. In: ACM SIGGRAPH 2004 Sketches, p. 54 (2004)
27.
Zurück zum Zitat Ekman, P., Friesen, W., Hager, J.: The Facial Action Coding System. Weidenfeld & Nicolson, London (2002) Ekman, P., Friesen, W., Hager, J.: The Facial Action Coding System. Weidenfeld & Nicolson, London (2002)
28.
Zurück zum Zitat Peirce, J.W.: Generating stimuli for neuroscience using PsychoPy. Front. Neuroinform. 2(10) (2008) Peirce, J.W.: Generating stimuli for neuroscience using PsychoPy. Front. Neuroinform. 2(10) (2008)
29.
Zurück zum Zitat Arellano, D., Schaller, U.M., Rauh, R., Helzle, V., Spicker, M., Deussen, O.: Intelligent Virtual Agents: 15th International Conference, IVA 2015, Delft, The Netherlands, August 26–28, 2015, Proceedings, chap. On the Trail of Facial Processing in Autism Spectrum Disorders, pp. 432–441. Springer International Publishing, Cham (2015) Arellano, D., Schaller, U.M., Rauh, R., Helzle, V., Spicker, M., Deussen, O.: Intelligent Virtual Agents: 15th International Conference, IVA 2015, Delft, The Netherlands, August 26–28, 2015, Proceedings, chap. On the Trail of Facial Processing in Autism Spectrum Disorders, pp. 432–441. Springer International Publishing, Cham (2015)
30.
Zurück zum Zitat Law Smith, M.J., Montagne, B., Perrett, D.I., Gill, M., Gallagher, L.: Detecting subtle facial emotion recognition deficits in high-functioning autism using dynamic stimuli of varying intensities. Neuropsychologia 48(9), 2777–2781 (2010)CrossRef Law Smith, M.J., Montagne, B., Perrett, D.I., Gill, M., Gallagher, L.: Detecting subtle facial emotion recognition deficits in high-functioning autism using dynamic stimuli of varying intensities. Neuropsychologia 48(9), 2777–2781 (2010)CrossRef
31.
Zurück zum Zitat Lozier, L.M., Vanmeter, J.W., Marsh, A.: Impairments in facial affect recognition associated with autism spectrum disorders: A meta-analysis. Dev. Psychopathol. 26(4 Pt 1), 933–945 (2014)CrossRef Lozier, L.M., Vanmeter, J.W., Marsh, A.: Impairments in facial affect recognition associated with autism spectrum disorders: A meta-analysis. Dev. Psychopathol. 26(4 Pt 1), 933–945 (2014)CrossRef
32.
Zurück zum Zitat Gooch, B., Gooch, A.: Non-Photorealistic Rendering. A.K. Peters, Natick (2001)MATH Gooch, B., Gooch, A.: Non-Photorealistic Rendering. A.K. Peters, Natick (2001)MATH
33.
Zurück zum Zitat DeCarlo, D., Santella, A.: Stylization and abstraction of photographs. ACM Trans. Graph. 21(3), 769–776 (2002)CrossRef DeCarlo, D., Santella, A.: Stylization and abstraction of photographs. ACM Trans. Graph. 21(3), 769–776 (2002)CrossRef
34.
Zurück zum Zitat Gooch, B., Reinhard, E., Gooch, A.: Human facial illustrations: creation and psychophysical evaluation. ACM Trans. Graph. 23(1), 27–44 (2004)CrossRef Gooch, B., Reinhard, E., Gooch, A.: Human facial illustrations: creation and psychophysical evaluation. ACM Trans. Graph. 23(1), 27–44 (2004)CrossRef
35.
Zurück zum Zitat Spicker, M., Arellano, D., Schaller, U., Rauh, R., Helzle, V., Deussen, O.: Emotion recognition in autism spectrum disorder: Does stylization help? In: Proceedings of the ACM Symposium on Applied Perception, SAP ’16, pp. 97–104. ACM (2016) Spicker, M., Arellano, D., Schaller, U., Rauh, R., Helzle, V., Deussen, O.: Emotion recognition in autism spectrum disorder: Does stylization help? In: Proceedings of the ACM Symposium on Applied Perception, SAP ’16, pp. 97–104. ACM (2016)
36.
Zurück zum Zitat Sifneos, P.: The prevalence of alexithymic characteristics in psychosomatic patients. Psychother. Psychosom. 22, 255–262 (1973)CrossRef Sifneos, P.: The prevalence of alexithymic characteristics in psychosomatic patients. Psychother. Psychosom. 22, 255–262 (1973)CrossRef
37.
Zurück zum Zitat Weiß, R.H.: Grundintelligenztest Skala 2 - Revision - (CFT 20-R). Hogrefe, Göttingen (2006) Weiß, R.H.: Grundintelligenztest Skala 2 - Revision - (CFT 20-R). Hogrefe, Göttingen (2006)
38.
Zurück zum Zitat Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J. (eds.): Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, Oxford (2011) Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J. (eds.): Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, Oxford (2011)
39.
Zurück zum Zitat Kupfer, J., Brosig, B., Brähler, E.: TAS-26: Toronto-Alexithymie-Skala-26 (deutsche Version). Manual. Hogrefe Verlag GmbH & Co, Göttingen (2001) Kupfer, J., Brosig, B., Brähler, E.: TAS-26: Toronto-Alexithymie-Skala-26 (deutsche Version). Manual. Hogrefe Verlag GmbH & Co, Göttingen (2001)  
40.
Zurück zum Zitat Bermond, B., Vorst, H.C., Vingerhoets, A.J., Gerritsen, W.: The amsterdam alexithymia scale: its psychometric values and correlations with other personality traits. Psychother. Psychosom. 68(5), 241–251 (1999)CrossRef Bermond, B., Vorst, H.C., Vingerhoets, A.J., Gerritsen, W.: The amsterdam alexithymia scale: its psychometric values and correlations with other personality traits. Psychother. Psychosom. 68(5), 241–251 (1999)CrossRef
Metadaten
Titel
Interactive testbed for research in autism—the SARA project
verfasst von
Diana Arellano
Reinhold Rauh
Benjamin Krautheim
Marc Spicker
Ulrich Max Schaller
Volker Helzle
Oliver Deussen
Publikationsdatum
05.01.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Universal Access in the Information Society / Ausgabe 1/2018
Print ISSN: 1615-5289
Elektronische ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-016-0521-9

Weitere Artikel der Ausgabe 1/2018

Universal Access in the Information Society 1/2018 Zur Ausgabe

Premium Partner