Top

Autonomous Robots

Published in:

26-05-2016

Impact of sensory preferences of individuals with autism on the recognition of emotions expressed by two robots, an avatar, and a human

Authors: Pauline Chevalier, Jean-Claude Martin, Brice Isableu, Christophe Bazile, Adriana Tapus

Published in: Autonomous Robots | Issue 3/2017

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

We design a personalized human-robot environment for social learning for individuals with autism spectrum disorders (ASD). In order to define an individual’s profile, we posit that the individual’s reliance on proprioceptive and kinematic visual cues should affect the way the individual suffering from ASD interacts with a social agent (human/robot/virtual agent). In this paper, we assess the potential link between recognition performances of body/facial expressions of emotion of increasing complexity, emotion recognition on platforms with different visual features (two mini-humanoid robots, a virtual agent, and a human), and proprioceptive and visual cues integration of an individual. First, we describe the design of the EMBODI-EMO database containing videos of controlled body/facial expressions of emotions from various platforms. We explain how we validated this database with typically developed (TD) individuals. Then, we investigate the relationship between emotion recognition and proprioceptive and visual profiles of TD individuals and individuals with ASD. For TD individuals, our results indicate a relationship between profiles and emotion recognition. As expected, we show that TD individuals that rely more heavily on visual cues yield better recognition scores. However, we found that TD individuals relying on proprioception have better recognition scores, going against our hypothesis. Finally, participants with ASD relying more heavily on proprioceptive cues have lower emotion recognition scores on all conditions than participants relying on visual cues.

previous article Probabilistic movement primitives for coordination of multiple human–robot collaborative tasks

next article A low-cost socially assistive robot and robot-assisted intervention for children with autism spectrum disorder: field trials and lessons learned

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Database link: http://perso.ensta-paristech.fr/~tapus/eng/media/EMBODI-EMO.zip.

Link to the database: http://perso.ensta-paristech.fr/~tapus/eng/media/EMBODI-EMO.zip.

Bar-Haim, Y., & Bart, O. (2006). Motor function and social participation in kindergarten children. Social Development, 15(2), 296–310.CrossRef

Baron-Cohen, S., Wheelwright, S., & Jolliffe, T. (1997). Is there a” language of the eyes”? evidence from normal adults, and adults with autism or asperger syndrome. Visual Cognition, 4(3), 311–331.CrossRef

Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001). The “reading the mind in the eyes” test revised version: A study with normal adults, and adults with asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry, 42(2), 241–251.CrossRef

Begeer, S., Rieffe, C., Terwogt, M. M., & Stockmann, L. (2006). Attention to facial emotion expressions in children with autism. Autism, 10(1), 37–51.CrossRef

Bondy, A. S., & Frost, L. A. (1994). The picture exchange communication system. Focus on Autism and Other Developmental Disabilities, 9(3), 1–19.CrossRef

Bray, A., Subanandan, A., Isableu, B., Ohlmann, T., Golding, J. F., & Gresty, M. A. (2004). We are most aware of our place in the world when about to fall. Current Biology, 14(15), R609–R610.CrossRef

Brown, C., & Dunn, W. (2002). Adolescent-adult sensory profile: User’s manual. San Antonio: Therapy Skill Builders.

Buisine, S., Courgeon, M., Charles, A., Clavel, C., Martin, J. C., Tan, N., et al. (2014). The role of body postures in the recognition of emotions in contextually rich scenarios. International Journal of Human-Computer Interaction, 30(1), 52–62.CrossRef

Burke, D., Hagbarth, K. E., Löfstedt, L., & Wallin, B. G. (1976). The responses of human muscle spindle endings to vibration of non-contracting muscles. The Journal of physiology, 261(3), 673–693.CrossRef

Celani, G., Battacchi, M. W., & Arcidiacono, L. (1999). The understanding of the emotional meaning of facial expressions in people with autism. Journal of autism and developmental disorders, 29(1), 57–66.CrossRef

Charman, T., Swettenham, J., Baron-Cohen, S., Cox, A., Baird, G., & Drew, A. (1997). Infants with autism: An investigation of empathy, pretend play, joint attention, and imitation. Developmental Psychology, 33(5), 781.CrossRef

Chevalier, P., Isableu, B., Martin, J. C., & Tapus, A. (2016). Individuals with autism: Analysis of the first interaction with nao robot based on their proprioceptive and kinematic profiles. In T. Borangiu (Ed.), Advances in robot design and intelligent control (pp. 225–233). Berlin: Springer.CrossRef

Chiari, L., Rocchi, L., & Cappello, A. (2002). Stabilometric parameters are affected by anthropometry and foot placement. Clinical Biomechanics, 17(9), 666–677.CrossRef

Coates, S., Lord, M., & Jakabovics, E. (1975). Field dependence-independence, social-non-social play and sex differences in preschool children. Perceptual and Motor Skills, 40(1), 195–202.CrossRef

Costa, S., Soares, F., Pereira, A. P., Santos, C., Hiolle, A. (2014). Building a game scenario to encourage children with autism to recognize and label emotions using a humanoid robot. In Robot and human interactive communication, 2014 RO-MAN: The 23rd IEEE international symposium on, IEEE, pp 820–825

Coulson, M. (2004). Attributing emotion to static body postures: Recognition accuracy, confusions, and viewpoint dependence. Journal of Nonverbal Behavior, 28(2), 117–139.MathSciNetCrossRef

Courgeon, M., & Clavel, C. (2013). Marc: A framework that features emotion models for facial animation during human-computer interaction. Journal on Multimodal User Interfaces, 7(4), 311–319.CrossRef

Courgeon, M., Grynszpan, O., Buisine, S., Martin, J. (2012). Interactive expressive virtual characters: Challenges for conducting experimental studies about multimodal social interaction. In Proceedings of the 9th International Conference on Disability, Virtual Reality & Associated Technologies Laval, France, 10–12 Sept.

Dael, N., Mortillaro, M., & Scherer, K. R. (2012). Emotion expression in body action and posture. Emotion, 12(5), 1085.CrossRef

Dautenhahn, K., Nehaniv, C. L., Walters, M. L., Robins, B., Kose-Bagci, H., Mirza, N. A., et al. (2009). Kaspar—A minimally expressive humanoid robot for human-robot interaction research. Applied Bionics and Biomechanics, 6(3–4), 369–397.CrossRef

De Gelder, B., & Van den Stock, J. (2011). The bodily expressive action stimulus test (beast). construction and validation of a stimulus basis for measuring perception of whole body expression of emotions. Frontiers in Psychology, 2, 419.CrossRef

Dunn W (1999) The sensory profile: Users manual (psychological corporation, San Antonio, TX)

Edin, B. B. (2001). Cutaneous afferents provide information about knee joint movements in humans. The Journal of Physiology, 531(1), 289–297.CrossRef

Ekman, P., & Friesen, W. (1984). Emotion facial action coding system (em-facs). San Francisco: University of California.

Erden, M. S. (2013). Emotional postures for the humanoid-robot nao. International Journal of Social Robotics, 5(4), 441–456.CrossRef

Feil-Seifer, D., Mataric, M. J. (2005) Defining socially assistive robotics. In Rehabilitation robotics, 2005. ICORR 2005. 9th International conference on, IEEE, pp 465–468

Ferrell, W., Gandevia, S., & McCloskey, D. (1987). The role of joint receptors in human kinaesthesia when intramuscular receptors cannot contribute. The Journal of physiology, 386(1), 63–71.CrossRef

Gepner, B., & Mestre, D. R. (2002). Brief report: Postural reactivity to fast visual motion differentiates autistic from children with asperger syndrome. Journal of Autism and Developmental disorders, 32(3), 231–238.CrossRef

Gepner, B., Mestre, D., Masson, G., & de Schonen, S. (1995). Postural effects of motion vision in young autistic children. NeuroReport, 6(8), 1211–1214.CrossRef

Golan, O., Ashwin, E., Granader, Y., McClintock, S., Day, K., Leggett, V., et al. (2010). Enhancing emotion recognition in children with autism spectrum conditions: An intervention using animated vehicles with real emotional faces. Journal of Autism and Developmental Disorders, 40(3), 269–279.CrossRef

Goodwin, G. M., McCloskey, D. I., & Matthews, P. B. (1972). Proprioceptive illusions induced by muscle vibration: Contribution by muscle spindles to perception? Science, 175(4028), 1382–1384.CrossRef

Gowen, E., & Hamilton, A. (2013). Motor abilities in autism: A review using a computational context. Journal of Autism and Developmental Disorders, 43(2), 323–344.CrossRef

Greffou, S., Bertone, A., Hahler, E. M., Hanssens, J. M., Mottron, L., & Faubert, J. (2012). Postural hypo-reactivity in autism is contingent on development and visual environment: A fully immersive virtual reality study. Journal of Autism and Developmental Disorders, 42(6), 961–970.CrossRef

Hart, M. (2005). Autism/excel study. In Proceedings of the 7th international ACM SIGACCESS conference on computers and accessibility, ACM, pp 136–141

Haswell, C. C., Izawa, J., Dowell, L. R., Mostofsky, S. H., & Shadmehr, R. (2009). Representation of internal models of action in the autistic brain. Nature Neuroscience, 12(8), 970–972.CrossRef

Herbert, M. R., Ziegler, D. A., Makris, N., Filipek, P. A., Kemper, T. L., Normandin, J. J., et al. (2004). Localization of white matter volume increase in autism and developmental language disorder. Annals of Neurology, 55(4), 530–540.CrossRef

Isableu, B., Fourre, B., Vuillerme, N., Giraudet, G., & Amorim, M. A. (2011). Differential integration of visual and kinaesthetic signals to upright stance. Experimental Brain Research, 212(1), 33–46.CrossRef

Kim, E. S., Berkovits, L. D., Bernier, E. P., Leyzberg, D., Shic, F., Paul, R., et al. (2013). Social robots as embedded reinforcers of social behavior in children with autism. Journal of Autism and Developmental Disorders, 43(5), 1038–1049.CrossRef

Kohen-Raz, R., Volkman, F. R., & Cohen, D. J. (1992). Postural control in children with autism. Journal of Autism and Developmental Disorders, 22(3), 419–432.CrossRef

Kozima, H., Nakagawa, C., Yasuda, Y. (2005) Interactive robots for communication-care: A case-study in autism therapy. In Robot and human interactive communication, 2005. ROMAN 2005. IEEE International Workshop on, IEEE, pp. 341–346

Liu, W., & Chepyator-Thomson, J. R. (2009). Field dependence-independence and physical activity engagement among middle school students. Physical Education and Sport Pedagogy, 14(2), 125–136.CrossRef

Meeren, H. K., van Heijnsbergen, C. C., & de Gelder, B. (2005). Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences of the United States of America, 102(45), 16,518–16,523.CrossRef

Mehrabian, A. (1972). Nonverbal communication. Transaction Publishers.

Meltzoff, A. N., Brooks, R., Shon, A. P., & Rao, R. P. (2010). Social robots are psychological agents for infants: A test of gaze following. Neural Networks, 23(8), 966–972.CrossRef

Qin, S., Nagai, Y., Kumagaya, S., Ayaya, S., Asada, M. (2014). Autism simulator employing augmented reality: A prototype. In Development and Learning and Epigenetic Robotics (ICDL-Epirob), 2014 Joint IEEE international conferences on, IEEE, pp 155–156

Roll, J., & Vedel, J. (1982). Kinaesthetic role of muscle afferents in man, studied by tendon vibration and microneurography. Experimental Brain Research, 47(2), 177–190.CrossRef

Salter, T., Michaud, F., & Larouche, H. (2010). How wild is wild? a taxonomy to characterize the wildness of child-robot interaction. International Journal of Social Robotics, 2(4), 405–415.CrossRef

Saracho, O. (2003). Matching teachers’ and students’ cognitive styles. Early Child Development and Care, 173(2–3), 161–173.CrossRef

Scassellati, B., Admoni, H., & Mataric, M. (2012). Robots for use in autism research. Annual Review of Biomedical Engineering, 14, 275–294.CrossRef

Scherer, K. R. (1995). Expression of emotion in voice and music. Journal of Voice, 9(3), 235–248.CrossRef

Silver, M., & Oakes, P. (2001). Evaluation of a new computer intervention to teach people with autism or asperger syndrome to recognize and predict emotions in others. Autism, 5(3), 299–316.CrossRef

Simmons, D. R., Robertson, A. E., McKay, L. S., Toal, E., McAleer, P., & Pollick, F. E. (2009). Vision in autism spectrum disorders. Vision Research, 49(22), 2705–2739.CrossRef

Tapus, A., Mataric, M., Scassellati, B. (2007). Attention to facial emotion expressions in children with autism. In IEEE robotics and automation magazine (RAM), Special issue on Grand Challenges in Robotics, Vol. 14, No. 1

Tapus, A., Peca, A., Aly, A., Pop, C., Jisa, L., Pintea, S., et al. (2012). Children with autism social engagement in interaction with nao, an imitative robot-a series of single case experiments. Interaction Studies, 13(3), 315–347.CrossRef

Thill, S., Pop, C. A., Belpaeme, T., Ziemke, T., & Vanderborght, B. (2012). Robot-assisted therapy for autism spectrum disorders with (partially) autonomous control: Challenges and outlook. Paladyn, Journal of Behavioral Robotics, 3(4), 209–217.CrossRef

Wainer, J., Dautenhahn, K., Robins, B., Amirabdollahian, F. (2010). Collaborating with kaspar: Using an autonomous humanoid robot to foster cooperative dyadic play among children with autism (pp 631–638)

Wallbott, H. G. (1998). Bodily expression of emotion. European Journal of Social Psychology, 28(6), 879–896.CrossRef

Title: Impact of sensory preferences of individuals with autism on the recognition of emotions expressed by two robots, an avatar, and a human
Authors: Pauline Chevalier
Jean-Claude Martin
Brice Isableu
Christophe Bazile
Adriana Tapus
Publication date: 26-05-2016
Publisher: Springer US
Published in: Autonomous Robots / Issue 3/2017
Print ISSN: 0929-5593
Electronic ISSN: 1573-7527
DOI: https://doi.org/10.1007/s10514-016-9575-z

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 3/2017

Special Issue on Assistive and Rehabilitation Robotics

An oscillator-based smooth real-time estimate of gait phase for wearable robotics

Assist On-Ankle: a reconfigurable ankle exoskeleton with series-elastic actuation

Probabilistic movement primitives for coordination of multiple human–robot collaborative tasks

SCRIPT passive orthosis: design of interactive hand and wrist exoskeleton for rehabilitation at home after stroke

A low-cost socially assistive robot and robot-assisted intervention for children with autism spectrum disorder: field trials and lessons learned