nach oben

International Journal of Social Robotics

Erschienen in:

01.08.2012

Evaluation of the Robot Assisted Sign Language Tutoring Using Video-Based Studies

verfasst von: Hatice Kose, Rabia Yorganci, Esra H. Algan, Dag S. Syrdal

Erschienen in: International Journal of Social Robotics | Ausgabe 3/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

The results are from an on-going study which aims to assist in the teaching of Sign Language (SL) to hearing impaired children by means of non-verbal communication and imitation based interaction games between a humanoid robot and the child. In this study, the robot will be able to express a word in the SL among a set of chosen words using hand movements, body and face gestures and having comprehended the word, the child will give relevant feedback to the robot.

This paper reports the findings of such an evaluation on a subset of sample words chosen from Turkish Sign Language (TSL) via the comparison of their video representations carried out by human teachers and the Nao H25 robot. Within this study, several surveys and user studies have been realized to reveal the resemblance between the two types of videos involving the performance of the robot simulator and the human teacher for each chosen word. In order to investigate the perceived level of similarity between human and robot behavior, participants with different sign language acquaintance levels and age groups have been asked to evaluate the videos using paper based and online questionnaires. The results of these surveys have been summarized and the most significant factors affecting the comprehension of TSL words have been discussed.

Vorheriger Artikel Telerobotic Pointing Gestures Shape Human Spatial Cognition

Nächster Artikel Measuring the Improvement of the Interaction Comfort of a Wearable Exoskeleton

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Aran O, Keskin C, Akarun L (2005) Sign language tutoring tool. In: European signal processing conference (EUSIPCO’05), Antalya, Turkey

Gürel TC (2010) Turkish sign language animation with articulated body model. MSc thesis, Boğazici University

Turkish sign language dictionary v1.0. [online]. Available: http://www.cmpe.boun.edu.tr/pilab/tidsozlugu

Jaffe D (1994) Evolution of mechanical fingerspelling hands, for people who are deaf-blind. J Rehabil Res Dev 31:236–244

Hersh MA, Johnson MA (eds) (2003) Assistive technology for the hearing-impaired, deaf and deaf blind. Springer, Berlin. ISBN:978-1-85233-382-9

Staner AT, Pentland A (2002) Real-time American sign language recognition from video using hidden Markov models. Technical report TR-306, Media Lab, MIT

Kadous W (1995) GRASP: recognition of Australian sign language using instrumented gloves. MSc thesis, University of New South Wales

Murakami K, Taguchi H. (1991) Gesture recognition using recurrent neural networks. In: Proceedings of CHI’91: human factors in computing systems, pp 237–242

Aran O, Akarun L (2010) A multi-class classification strategy for fisher scores: application to signer independent sign language recognition. Pattern Recognit 43(5):1717–1992 CrossRef

10.

Keskin C, Akarun L (2009) Input-output HMM based 3D hand gesture recognition and spotting for generic applications (accepted for publication). Pattern Recognit Lett 30(12):1086–1095 CrossRef

11.

Aran O, Burger MST, Caplier A, Akarun L (2009) A belief-based sequential fusion approach for fusing manual and non-manual signs. Pattern Recognit 42(5):812–822 MATHCrossRef

12.

Aran O, Ari I, Benoit A, Campr P, Carrillo AH, Fanard F, Akarun L, Caplier A, Rombaut M, Sankur B (2009) Signtutor: an interactive system for sign language tutoring. IEEE Multimed 16(1):81–93 CrossRef

13.

Aran O, Ari I, Campr P, Dikici E, Hruz M, Parlak S, Akarun L, Saraclar M (2008) Speech and sliding text aided sign retrieval from hearing impaired sign news videos. J Multimodal User Interfaces 2(1):117–131 CrossRef

14.

Caplier A, Stillittano S, Aran O, Akarun L, Bailly G, Beautemps D, Aboutabit N, Burger T (2007) Image and video for hearing impaired people. J Image Video Process (Special issue on image and video processing for disability). doi:10.1155/2007/45641

15.

Shen Q, Kose-Bagci H, Saunders J, Dautenhahn K (2009) An experimental investigation of interference effects in human-humanoid interaction games. In: The 18th IEEE international symposium on robot and human interactive communication (ROMAN 2009), pp 291–298. doi:10.1109/ROMAN.2009.5326342 CrossRef

16.

Kose-Bagci H, Dautenhahn K, Nehaniv CL (2008) Emergent dynamics of turn-taking interaction in drumming games with a humanoid Robot. In: Proc IEEE RO-MAN 2008, Technische Universitat Munchen, Munich, Germany, 1–3 August 2008

17.

Kose-Bagci H, Ferrari E, Dautenhahn K, Syrdal DS, Nehaniv CL (2009) Effects of embodiment and gestures on social interaction in drumming games with a humanoid robot. Adv Robot (Special issue on robot and human interactive communication) 24(14):1951–1996 CrossRef

18.

Kose-Bagci H, Dautenhahn K, Syrdal DS, Nehaniv CL (2010) Drum-mate: interaction dynamics and gestures in human-humanoid drumming experiments. Connect Sci 22(2):103–134. doi:10.1080/09540090903383189 CrossRef

19.

Dautenhahn K, Nehaniv CL, Walters ML, Robins B, Kose-Bagci H, Mirza NA, Blow M (2009) KASPAR—a minimally expressive humanoid robot for human-robot interaction research. Special issue on “humanoid robots”. Appl Bionics Biomech 6(3):369–397 CrossRef

20.

Adamo-Villani N (2006) A virtual learning environment for deaf children: design and evaluation. Int. J. Appl. Sci. Eng. Technol. 16:18–23

21.

Lee S, Henderson V, Hamilton H, Starner T, Brashear H, Hamilton S (2005) A gesture-based American sign language (ASL) tutor for deaf children. In: Proceedings of CHI (computer-human interaction), Portland, OR, April 2005

22.

Greenbacker C, McCoy K (2008) The ICICLE project: an overiew. In: First annual computer science research day. Department of Computer & Information Sciences, University of Delaware

23.

Graf C, Härtl A, Röfer T, Laue T (2009) A robust closed-loop gait for the standard platform league humanoid. In: Zhou C, Pagello E, Menegatti E, Behnke S, Röfer T (eds) Proceedings of the fourth workshop on humanoid soccer robots in conjunction with the 2009 IEEE-RAS international conference on humanoid robots, Paris, France, 2009, pp 30–37

24.

Aldebaran robotics choregraphe. Available: http://www.aldebaran-robotics.com/en/programmable

25.

Kose H, Yorganci R http://humanoid.ce.itu.edu.tr

26.

Kose H, Yorganci R, Algan HE (2011) Evaluation of the robot sign language tutor using video-based studies. In: 5th European conference on mobile robots (ECMR11), pp 109–115

27.

Kose H, Yorganci R, Itauma II (2011) Robot assisted interactive sign language tutoring game. In: IEEE ROBIO conference 2011, pp 2247–2249

28.

Kose H, Yorganci R (2011) Tale of a robot: humanoid robot assisted sign language tutoring. In: 11th IEEERAS international conference on humanoid robots (HUMANOIDS 2011). pp 105–111. doi:10.1109/Humanoids.2011.6100846 CrossRef

Titel: Evaluation of the Robot Assisted Sign Language Tutoring Using Video-Based Studies
verfasst von: Hatice Kose
Rabia Yorganci
Esra H. Algan
Dag S. Syrdal
Publikationsdatum: 01.08.2012
Verlag: Springer Netherlands
Erschienen in: International Journal of Social Robotics / Ausgabe 3/2012
Print ISSN: 1875-4791
Elektronische ISSN: 1875-4805
DOI: https://doi.org/10.1007/s12369-012-0142-2

Premium Partner

Marktübersichten

Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.

Zur Marktübersicht

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 3/2012

You Want Me to Trust a ROBOT? The Development of a Human–Robot Interaction Trust Scale

Measuring Human-Robots Interactions

Facial Communicative Signals

A Methodological Outline and Utility Assessment of Sensor-based Biosignal Measurement in Human-Robot Interaction

Measuring Human-Robot Interaction Through Motor Resonance

Measuring the Improvement of the Interaction Comfort of a Wearable Exoskeleton

Premium Partner

Marktübersichten