David Feil-Seifer
Maja Mataric
ABSTRACT
Recent feasibility studies involving children with autism spectrum disorders (ASD) interacting with socially assistive robots have shown that some children have positive reactions to robots, while others may have negative reactions. It is unlikely that children with ASD will enjoy any robot 100% of the time. It is therefore important to develop methods for detecting negative child behaviors in order to minimize distress and facilitate effective human-robot interaction. Our past work has shown that negative reactions can be readily identified and classified by a human observer from overhead video data alone, and that an automated position tracker combined with human-determined heuristics can differentiate between the two classes of reactions. This paper describes and validates an improved, non-heuristic method for determining if a child is interacting positively or negatively with a robot, based on Gaussian mixture models (GMM) and a naive-Bayes classifier of overhead camera observations. The approach achieves a 91.4% accuracy rate in classifying robot interaction, parent interaction, avoidance, and hiding against the wall behaviors and demonstrates that these classes are sufficient for distinguishing between positive and negative reactions of the child to the robot.
- Robotic tools for prosodic training for children with asd: A case study. In International Meeting for Autism Research (IMFAR), London, UK, 2008.Google Scholar
- O. Boiman and M. Irani. Detecting irregularities in images and in video. International Journal of Computer Vision, 74(1):17--31, 2007. Google ScholarDigital Library
- M. Chan, A. Hoogs, J. Schmiederer, and M. Petersen. Detecting rare events in video using semantic primitives with HMM. In Proceedings of the 17th International Conference on Pattern Recognition (ICPR), volume 4, pages 150--154, Cambridge, England, UK, 2004. Google ScholarDigital Library
- K. Dautenhahn, I. Werry, J. Rae, P. Dickerson, P. Stribling, and B. Ogden. Robotic playmates: Analysing interactive competencies of children with autism playing with a mobile robot. In K. Dautenhahn, A. Bond, L. Canamero, and B. Edmonds, editors, Socially Intelligent Agents: Creating Relationships with Computers and Robots, pages 117--124. Kluwer Academic Publishers, 2002.Google ScholarCross Ref
- A. Efros, A. Berg, G. Mori, and J. Malik. Recognizing action at a distance. In Proceedings of the International Conference on Computer Vision, pages 726--733, Nice, France, 2003. Google ScholarDigital Library
- H. Eng, K. Toh, A. Kam, J. Wang, and W. Yau. An automatic drowning detection surveillance system for challenging outdoor pool environments. In Proceedings of the International Conference on Computer Vision, pages 532--539, Nice, France, 2003. Google ScholarDigital Library
- D. J. Feil-Seifer and M. J. Matarić. Toward socially assistive robotics for augmenting interventions for children with autism spectrum disorders. In 11th International Symposium on Experimental Robotics 2008, volume 54, pages 201--210, Athens, Greece, Jul 2008. Springer.Google Scholar
- D. J. Feil-Seifer and M. J. Matarić. Using proxemics to evaluate human-robot interaction. In Proceedings of the International Conference on Human-Robot Interaction, pages 143--144, Osaka, Japan, Mar 2010. Google ScholarDigital Library
- D. Geschwind, J. Sowinski, C. Lord, P. Iverson, L. Ducat, and S. Spence. The autism genetic resource exchange: A resource for the study of autism and related neuropsychiatric conditions. American Journal of Human Genetics, 69:461--463, 2001.Google ScholarCross Ref
- R. Kelley, A. Tavakkoli, C. King, M. Nicolescu, M. Nicolescu, and G. Bebis. Understanding human intentions via hidden markov models in autonomous mobile robots. In Proceedings of the Conference on Human Robot Interaction, pages 367--374, Amsterdam, Netherlands, March 2008. Google ScholarDigital Library
- H. Kozima, C. Nakagawa, and Y. Yasuda. Children-robot interaction: a pilot study in autism therapy. Prog Brain Res, 164:385--400, 2007.Google ScholarCross Ref
- H. Kozima, Y. Yasuda, and C. Nakagawa. Social interaction facilitated by a minimally-designed robot: Finding from longitudinal therapeutic practices for autistic children. In Proceedings of the International Conference on Robot and Human Interactive Communication, pages 599--604, August 2007.Google ScholarCross Ref
- C. Lord, S. Risi, L. Lambrecht, E. H. C. Jr., B. L. Leventhal, P. C. DiLavore, A. Pickles, and M. Rutter. The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30(3):205--223, Jun 2000.Google ScholarCross Ref
- C. Lord, M. Rutter, and A. L. Couteur. Autism diagnostic interview-revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders, 24(5):659--685, Oct 1994.Google ScholarCross Ref
- S. Park and J. Aggarwal. Semantic-level understanding of human actions and interactions using event hierarchy. In Conference on Computer Vision and Pattern Recognition, pages 12--12, 2004. Google ScholarDigital Library
- D. Ramanan and D. Forsyth. Automatic annotation of everyday movements. In S. Thrun, L. Saul, and B. Schölkopf, editors, Advances in Neural Information Processing Systems 16, Cambridge, MA, 2004. MIT Press.Google Scholar
- B. Robins, K. Dautenhahn, R. Boekhorst, and A. Billard. Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? Universal Access in the Information Society, 4(2):105--120, 2005. Google ScholarDigital Library
- B. Robins, K. Dautenhahn, R. te Boekhorst, and C. Nehaniv. Behaviour delay and robot expressiveness in child-robot interactions: a user study on interaction kinesics. In Proceedings of the International Conference on Human-Robot Interaction (HRI), pages 17--24, Amsterdam, The Netherlands, March 2008. ACM New York, NY, USA. Google ScholarDigital Library
- B. Scassellati. Quantitative metrics of social response for autism diagnosis. In IEEE International Workshop on Robots and Human Interactive Communication (ROMAN), pages 585--590, Nashville, TN, Aug 2005.Google ScholarCross Ref
- G. Schwarz. Estimating the dimension of a model. The annals of statistics, 6(2):461--464, 1978.Google Scholar
- S. Sparrow, D. Balla, and D. Cicchetti. Vineland adaptive behavior scales. Test Corp of Amer, 1984.Google Scholar
- T. Xiang and S. Gong. Beyond tracking: Modelling activity and understanding behaviour. International Journal of Computer Vision, 67(1):21--51, 2006. Google ScholarDigital Library
- H. Zhong, J. Shi, and M. Visontai. Detecting Unusual Activity in Video. In Proceedings of the Conference on Computer Vision and Pattern Recognition, volume 2, pages 819--826, Washington, DC, USA, 2004. IEEE Computer Society. Google ScholarDigital Library
Index Terms
- Automated detection and classification of positive vs. negative robot interactions with children with autism using distance-based features
Recommendations
Emotional Robot to Examine Differences in Play Patterns and Affective Response of Children with and Without ASD
HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot InteractionRobots are often employed to proactively engage children with Autism Spectrum Disorder (ASD) in well-defined physical or social activities to promote specific educational or therapeutic outcomes. However, much can also be learned by leveraging a robot's ...
Individual Differences of Children with Autism in Robot-assisted Autism Therapy
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot InteractionResearch has recognized the importance of individual differences of children with Autism Spectrum Disorder (ASD) that require interventions to meet their heterogeneous needs. This relatively large-scale study investigates a robot-assisted autism therapy ...
A robot-assisted behavioral intervention system for children with autism spectrum disorders
The purpose of this paper is to propose and examine the feasibility of a robot-assisted intervention system capable of facilitating social training for children with autism spectrum disorder (ASD) via human-robot interaction (HRI) architecture. Based on ...
Comments