Skip to main content
Top
Published in: International Journal of Social Robotics 5/2016

01-11-2016

Human–Robot Gesture Analysis for Objective Assessment of Autism Spectrum Disorder

Authors: Indika B. Wijayasinghe, Isura Ranatunga, Namrata Balakrishnan, Nicoleta Bugnariu, Dan O. Popa

Published in: International Journal of Social Robotics | Issue 5/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper we study the use of human robot interaction as a mean to objectively evaluate imitation deficits in children with autism. Robot control and data analysis methods were combined to assess the quality of interaction between the robot and the subjects. Humanoid robot Zeno was used to execute upper body gestures which the subjects were asked to imitate. The resulting motion of the subject was acquired through a motion capture system and compared with the intended motion performed by Zeno using the dynamic time warping (DTW) algorithm. During this study, the clinical hypothesis was that the resulting DTW cost can serve as a quantitative measure for the similarity between the motions, and thus can be used to objectively assess the severity of imitation deficits exhibited by the child. To validate this hypothesis, we present two sets of experiments, one with a set of healthy adults and the other with a group of children, some with autism spectrum disorder. The experiment with adult subjects serves as a statistically significant test to demonstrate the viability of the DTW cost as a similarity measure for the gesture analysis, whereas the experiment with child subjects is a pilot study to differentiate imitation performance for children with autism.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Kanner L (1943) Autistic disturbances of affective contact. Nerv Child 2:217–250 Kanner L (1943) Autistic disturbances of affective contact. Nerv Child 2:217–250
2.
4.
go back to reference Steffenburg S, Gillberg C, Hellgren L, Andersson L, Gillberg IC, Jakobsson G, Bohman M (1989) A twin study of autism in denmark, finland, iceland, norway and sweden. J Child Psychol Psychiatry 30(3):405–416CrossRef Steffenburg S, Gillberg C, Hellgren L, Andersson L, Gillberg IC, Jakobsson G, Bohman M (1989) A twin study of autism in denmark, finland, iceland, norway and sweden. J Child Psychol Psychiatry 30(3):405–416CrossRef
5.
go back to reference Whyatt C, Craig C (2013) Sensory-motor problems in autism. Front Integr Neurosci 7:51CrossRef Whyatt C, Craig C (2013) Sensory-motor problems in autism. Front Integr Neurosci 7:51CrossRef
6.
go back to reference Scassellati B, Admoni H, Mataric M (2012) Robots for use in autism research. Annu Rev Biomed Eng 14(1):275–294CrossRef Scassellati B, Admoni H, Mataric M (2012) Robots for use in autism research. Annu Rev Biomed Eng 14(1):275–294CrossRef
7.
go back to reference Shamsuddin S, Yussof H, Ismail LI, Mohamed S, Hanapiah FA, Zahari NI (2012) Initial response in hri—a case study on evaluation of child with autism spectrum disorders interacting with a humanoid robot nao. In: International symposium on robotics and intelligent sensors 2012 Shamsuddin S, Yussof H, Ismail LI, Mohamed S, Hanapiah FA, Zahari NI (2012) Initial response in hri—a case study on evaluation of child with autism spectrum disorders interacting with a humanoid robot nao. In: International symposium on robotics and intelligent sensors 2012
8.
go back to reference Robins B, Dautenhahn K (2014) Tactile interactions with a humanoid robot: novel play scenario implementations with children with autism. Int J Soc Robot 6(3):397–415CrossRef Robins B, Dautenhahn K (2014) Tactile interactions with a humanoid robot: novel play scenario implementations with children with autism. Int J Soc Robot 6(3):397–415CrossRef
9.
go back to reference Robins B, Dautenhahn K, Dubowski J (2006) Does appearance matter in the interaction of children with autism with a humanoid robot? Interact Stud 7(3):509–542CrossRef Robins B, Dautenhahn K, Dubowski J (2006) Does appearance matter in the interaction of children with autism with a humanoid robot? Interact Stud 7(3):509–542CrossRef
10.
go back to reference Tapus A, Peca A, Aly A, Pop C, Jisa L, Pintea S, Rusu AS, David DO (2012) Children with autism social engagement in interaction with nao, an imitative robot. Interact Stud 13(3):315–347CrossRef Tapus A, Peca A, Aly A, Pop C, Jisa L, Pintea S, Rusu AS, David DO (2012) Children with autism social engagement in interaction with nao, an imitative robot. Interact Stud 13(3):315–347CrossRef
11.
go back to reference Kozima H, Michalowski M, Nakagawa C (2009) Keepon: a playful robot for research, therapy, and entertainment. Int J Soc Robot 1(1):3–18CrossRef Kozima H, Michalowski M, Nakagawa C (2009) Keepon: a playful robot for research, therapy, and entertainment. Int J Soc Robot 1(1):3–18CrossRef
12.
go back to reference Huskens B, Verschuur R, Gillesen J, Didden R, Barakova E (2013) Promoting question-asking in school-aged children with autism spectrum disorders: effectiveness of a robot intervention compared to a human-trainer intervention. Dev Neurorehabil 16(5):345–356CrossRef Huskens B, Verschuur R, Gillesen J, Didden R, Barakova E (2013) Promoting question-asking in school-aged children with autism spectrum disorders: effectiveness of a robot intervention compared to a human-trainer intervention. Dev Neurorehabil 16(5):345–356CrossRef
13.
go back to reference Costa S, Lehmann H, Dautenhahn K, Robins B, Soares F (2014) Using a humanoid robot to elicit body awareness and appropriate physical interaction in children with autism. Int J Soc Robot 7(2):265–278CrossRef Costa S, Lehmann H, Dautenhahn K, Robins B, Soares F (2014) Using a humanoid robot to elicit body awareness and appropriate physical interaction in children with autism. Int J Soc Robot 7(2):265–278CrossRef
14.
go back to reference Boccanfuso L, O’Kane JM (2011) CHARLIE: an adaptive robot design with hand and face tracking for use in autism therapy. Int J Soc Robot 3(4):337–347CrossRef Boccanfuso L, O’Kane JM (2011) CHARLIE: an adaptive robot design with hand and face tracking for use in autism therapy. Int J Soc Robot 3(4):337–347CrossRef
15.
go back to reference Wainer J, Dautenhahn K, Robins B, Amirabdollahian F (2013) A pilot study with a novel setup for collaborative play of the humanoid robot kaspar with children with autism. Int J Soc Robot 6(1):45–65CrossRef Wainer J, Dautenhahn K, Robins B, Amirabdollahian F (2013) A pilot study with a novel setup for collaborative play of the humanoid robot kaspar with children with autism. Int J Soc Robot 6(1):45–65CrossRef
16.
go back to reference Cabibihan JJ, Javed H, Ang M Jr, Aljunied SM (2013) Why robots? A survey on the roles and benefits of social robots in the therapy of children with autism. Int J Soc Robot 5(4):593–618CrossRef Cabibihan JJ, Javed H, Ang M Jr, Aljunied SM (2013) Why robots? A survey on the roles and benefits of social robots in the therapy of children with autism. Int J Soc Robot 5(4):593–618CrossRef
17.
go back to reference Rinehart N, Bradshaw J, Brereton A, Tonge B (2001) Movement preparation in high-functioning autism and asperger disorder: a serial choice reaction time task involving motor reprogramming. J Autism Dev Disord 31(1):79–88CrossRef Rinehart N, Bradshaw J, Brereton A, Tonge B (2001) Movement preparation in high-functioning autism and asperger disorder: a serial choice reaction time task involving motor reprogramming. J Autism Dev Disord 31(1):79–88CrossRef
18.
go back to reference Ricks DJ, Colton MB (2010) Trends and considerations in robot-assisted autism therapy. In: 2010 IEEE international conference on robotics and automation (ICRA), pp. 4354–4359, iD: 1 Ricks DJ, Colton MB (2010) Trends and considerations in robot-assisted autism therapy. In: 2010 IEEE international conference on robotics and automation (ICRA), pp. 4354–4359, iD: 1
19.
go back to reference Fasola J, Mataric M (2012) Using socially assistive human–robot interaction to motivate physical exercise for older adults. Proc IEEE 100(8):2512–2526CrossRef Fasola J, Mataric M (2012) Using socially assistive human–robot interaction to motivate physical exercise for older adults. Proc IEEE 100(8):2512–2526CrossRef
20.
go back to reference Fujimoto I, Matsumoto T, Silva PRSD, Kobayashi M, Higashi M (2011) Mimicking and evaluating human motion to improve the imitation skill of children with autism through a robot. Int J Soc Robot 3(4):349–357CrossRef Fujimoto I, Matsumoto T, Silva PRSD, Kobayashi M, Higashi M (2011) Mimicking and evaluating human motion to improve the imitation skill of children with autism through a robot. Int J Soc Robot 3(4):349–357CrossRef
21.
go back to reference Goncalves N, Costa S, Rodrigues J, Soares F (2014) Detection of stereotyped hand flapping movements in autistic children using the kinect sensor: a case study. In: 2014 IEEE international conference on autonomous robot systems and competitions (ICARSC), pp 212–216 Goncalves N, Costa S, Rodrigues J, Soares F (2014) Detection of stereotyped hand flapping movements in autistic children using the kinect sensor: a case study. In: 2014 IEEE international conference on autonomous robot systems and competitions (ICARSC), pp 212–216
22.
go back to reference Ranatunga I, Rajruangrabin J, Popa DO, Makedon F (2011) Enhanced therapeutic interactivity using social robot zeno. In: Proceedings of the 4th international conference on PErvasive Technologies related to assistive environments, ser. PETRA ’11. ACM, New York, pp 57:1–57:6 Ranatunga I, Rajruangrabin J, Popa DO, Makedon F (2011) Enhanced therapeutic interactivity using social robot zeno. In: Proceedings of the 4th international conference on PErvasive Technologies related to assistive environments, ser. PETRA ’11. ACM, New York, pp 57:1–57:6
23.
go back to reference Ranatunga I, Torres NA, Patterson R, Bugnariu N, Stevenson M, Popa D (2012) Rodica: a human–robot interaction system for treatment of childhood autism spectrum disorders. In: Proceedings of the 5th international conference on PErvasive Technologies related to assistive environments, ser. PETRA ’12. ACM, New York Ranatunga I, Torres NA, Patterson R, Bugnariu N, Stevenson M, Popa D (2012) Rodica: a human–robot interaction system for treatment of childhood autism spectrum disorders. In: Proceedings of the 5th international conference on PErvasive Technologies related to assistive environments, ser. PETRA ’12. ACM, New York
24.
go back to reference Torres NA, Clark N, Ranatunga I, Popa D (2012) Implementation of interactive armplayback behaviors of social robot zeno for autism spectrum disorder therapy. In: Proceedings of the 5th international conference on PErvasive technologies related to assistive environments, ser. PETRA ’12. ACM, New York Torres NA, Clark N, Ranatunga I, Popa D (2012) Implementation of interactive armplayback behaviors of social robot zeno for autism spectrum disorder therapy. In: Proceedings of the 5th international conference on PErvasive technologies related to assistive environments, ser. PETRA ’12. ACM, New York
25.
go back to reference Baer D, Peterson R, Sherman J (1967) The development of imitation by reinforcing behavioral similarity to a model. J Exp Anal Behav 10(5):405CrossRef Baer D, Peterson R, Sherman J (1967) The development of imitation by reinforcing behavioral similarity to a model. J Exp Anal Behav 10(5):405CrossRef
27.
go back to reference Itakura F (1975) Minimum prediction residual principle applied to speech recognition. IEEE Trans Acoust Speech Sig Process 23(1):67–72CrossRef Itakura F (1975) Minimum prediction residual principle applied to speech recognition. IEEE Trans Acoust Speech Sig Process 23(1):67–72CrossRef
28.
go back to reference Sakoe H, Chiba S (1978) Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoust Speech Sig Process 26(1):43–49CrossRefMATH Sakoe H, Chiba S (1978) Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoust Speech Sig Process 26(1):43–49CrossRefMATH
29.
go back to reference Christiansen R, Rushforth CK (1997) Detecting and locating key words in continuous speech using linear predictive coding. IEEE Trans Acoust Speech Sig Process 25(5):361–367CrossRef Christiansen R, Rushforth CK (1997) Detecting and locating key words in continuous speech using linear predictive coding. IEEE Trans Acoust Speech Sig Process 25(5):361–367CrossRef
30.
go back to reference Ferre F, Clote P (2006) Btw: a web server for boltzmann time warping of gene expression time series. Nucleic Acids Res 34:482–485CrossRef Ferre F, Clote P (2006) Btw: a web server for boltzmann time warping of gene expression time series. Nucleic Acids Res 34:482–485CrossRef
31.
go back to reference Lijffijt J, Papapetrou P, Hollmen J, Athitsos V (2010) Benchmarking dynamic time warping for music retrieval. In: 3rd international conference on pervasive technologies related to assistive environments Lijffijt J, Papapetrou P, Hollmen J, Athitsos V (2010) Benchmarking dynamic time warping for music retrieval. In: 3rd international conference on pervasive technologies related to assistive environments
33.
go back to reference Jangyodsuk P, Conly C, Athitsos V (2014) Sign language recognition using dynamic time warping and hand shape distance based on histogram of oriented gradient features. In: 7th international conference on pervasive technologies related to assistive environments Jangyodsuk P, Conly C, Athitsos V (2014) Sign language recognition using dynamic time warping and hand shape distance based on histogram of oriented gradient features. In: 7th international conference on pervasive technologies related to assistive environments
34.
go back to reference Wang H, Stefan A, Moradi S, Athitsos V, Neidle C, Kamangar F (2012) A system for large vocabulary sign search. Lect Notes Comput Sci 6553:342–353CrossRef Wang H, Stefan A, Moradi S, Athitsos V, Neidle C, Kamangar F (2012) A system for large vocabulary sign search. Lect Notes Comput Sci 6553:342–353CrossRef
35.
go back to reference Ferguson S, Schubert E, Stevens CJ (2014) Dynamic dance warping: using dynamic time warping to compare dance movement performed under different conditions. In: Proceedings of the 2014 international workshop on movement and computing, p 94 Ferguson S, Schubert E, Stevens CJ (2014) Dynamic dance warping: using dynamic time warping to compare dance movement performed under different conditions. In: Proceedings of the 2014 international workshop on movement and computing, p 94
36.
go back to reference Brooks DA, Howard AM (2012) Quantifying upper-arm rehabilitation metrics for children through interaction with a humanoid robot. Appl Bion Biomech 9:157–172CrossRef Brooks DA, Howard AM (2012) Quantifying upper-arm rehabilitation metrics for children through interaction with a humanoid robot. Appl Bion Biomech 9:157–172CrossRef
37.
go back to reference Zheng Z, Das S, Young EM, Swanson A, Warren Z, Sarkar N (2014) Autonomous robot-mediated imitation learning for children with autism. In: IEEE international conference on robotics and automation (ICRA) 2014, pp 2707–2712 Zheng Z, Das S, Young EM, Swanson A, Warren Z, Sarkar N (2014) Autonomous robot-mediated imitation learning for children with autism. In: IEEE international conference on robotics and automation (ICRA) 2014, pp 2707–2712
39.
go back to reference Ranatunga I, Beltran M, Torres NA, Bugnariu N, Patterson RM, Garver C, Popa DO (2013) Human–robot upper body gesture imitation analysis for autism spectrum disorders. In: Proceedings of the 5th international conference on social robotics Ranatunga I, Beltran M, Torres NA, Bugnariu N, Patterson RM, Garver C, Popa DO (2013) Human–robot upper body gesture imitation analysis for autism spectrum disorders. In: Proceedings of the 5th international conference on social robotics
Metadata
Title
Human–Robot Gesture Analysis for Objective Assessment of Autism Spectrum Disorder
Authors
Indika B. Wijayasinghe
Isura Ranatunga
Namrata Balakrishnan
Nicoleta Bugnariu
Dan O. Popa
Publication date
01-11-2016
Publisher
Springer Netherlands
Published in
International Journal of Social Robotics / Issue 5/2016
Print ISSN: 1875-4791
Electronic ISSN: 1875-4805
DOI
https://doi.org/10.1007/s12369-016-0379-2

Other articles of this Issue 5/2016

International Journal of Social Robotics 5/2016 Go to the issue

Premium Partners