Skip to main content

2016 | OriginalPaper | Buchkapitel

Don’t Read My Lips: Assessing Listening and Speaking Skills Through Play with a Humanoid Robot

verfasst von : Panayiota Polycarpou, Anna Andreeva, Andri Ioannou, Panayiotis Zaphiris

Erschienen in: HCI International 2016 – Posters' Extended Abstracts

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This study investigates the potential of using the humanoid robot, NAO, as a playful tool for assessing the listening and speaking skills of seven hearing-impaired students who use cochlear implant(s) and sign language as their main communication modality. NAO does not have a human mouth and therefore, students cannot do lip-reading; we considered this to be a unique characteristic of the technology that can help make the assessment of listening and speaking skills efficient and accurate. Three game-like applications were designed and deployed on NAO for the purpose of this study. Results demonstrated how NAO was successfully used in this context. Our results, although preliminary, should encourage future research in the area of listening and speaking assessment for hearing impaired children, as well as speech enhancement via play with social robots.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Welling, D.R., Ukstins, C.A.: Fundamentals of Audiology For The Speech-Language Pathologist. Jones & Bartlett Learning, Burlington (2015) Welling, D.R., Ukstins, C.A.: Fundamentals of Audiology For The Speech-Language Pathologist. Jones & Bartlett Learning, Burlington (2015)
2.
Zurück zum Zitat Barnett, S.: Communication with deaf and hard-of-hearing people: a guide for medical education. J. Assoc. Am. Med. Coll. 77, 694–700 (2002). Lippincott Williams & Wilkins, PhiladelphiaCrossRef Barnett, S.: Communication with deaf and hard-of-hearing people: a guide for medical education. J. Assoc. Am. Med. Coll. 77, 694–700 (2002). Lippincott Williams & Wilkins, PhiladelphiaCrossRef
3.
Zurück zum Zitat Ioannou, A., Andreou, E., Christofi, M.: Preschoolers’ interest and caring behaviour around a humanoid robot. TechTrends 59, 23–26 (2015). Springer, USCrossRef Ioannou, A., Andreou, E., Christofi, M.: Preschoolers’ interest and caring behaviour around a humanoid robot. TechTrends 59, 23–26 (2015). Springer, USCrossRef
4.
Zurück zum Zitat Ioannou, A., Kartapanis, I., Zaphiris, P.: Social robots as co-therapists in autism therapy sessions: a single-case study. In: Tapus, A., et al. (eds.) ICSR 2015. LNCS, vol. 9388, pp. 255–263. Springer, Heidelberg (2015). doi:10.1007/978-3-319-25554-5_26 CrossRef Ioannou, A., Kartapanis, I., Zaphiris, P.: Social robots as co-therapists in autism therapy sessions: a single-case study. In: Tapus, A., et al. (eds.) ICSR 2015. LNCS, vol. 9388, pp. 255–263. Springer, Heidelberg (2015). doi:10.​1007/​978-3-319-25554-5_​26 CrossRef
5.
Zurück zum Zitat Robins, B., Dautenhahn, K., Boekhorst, R., Billard, A.: Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? Univ. Access Inf. Soc. 4, 105–120 (2005). Springer, HeidelbergCrossRef Robins, B., Dautenhahn, K., Boekhorst, R., Billard, A.: Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? Univ. Access Inf. Soc. 4, 105–120 (2005). Springer, HeidelbergCrossRef
6.
Zurück zum Zitat Arendsen, J., Janssen, J.B., Begeer, S., Stekelenburg, F.C.: The use of robots in social behavior tutoring for children with ASD. In: Proceedings of the 28th Annual European Conference on Cognitive Ergonomics, pp. 371–372. ACM, New York (2010) Arendsen, J., Janssen, J.B., Begeer, S., Stekelenburg, F.C.: The use of robots in social behavior tutoring for children with ASD. In: Proceedings of the 28th Annual European Conference on Cognitive Ergonomics, pp. 371–372. ACM, New York (2010)
7.
Zurück zum Zitat Sawada, H., Kitani, M., Hayashi, Y.: A robotic voice simulator and the interactive training for hearing-impaired people. J. Biomed. Biotechnol. 28, 7 (2008). Hindawi Publishing Corporation, New York Sawada, H., Kitani, M., Hayashi, Y.: A robotic voice simulator and the interactive training for hearing-impaired people. J. Biomed. Biotechnol. 28, 7 (2008). Hindawi Publishing Corporation, New York
8.
Zurück zum Zitat Kose-Bagci, H., Yorganci, R.: Tale of a robot: humanoid robot assisted sign language tutoring. In: 11th IEEE-RAS International Conference on Humanoid Robots, pp. 105–111. IEEE, Bled Slovenia (2011) Kose-Bagci, H., Yorganci, R.: Tale of a robot: humanoid robot assisted sign language tutoring. In: 11th IEEE-RAS International Conference on Humanoid Robots, pp. 105–111. IEEE, Bled Slovenia (2011)
9.
Zurück zum Zitat Uluer, P., Akalin, N., Kose, H.: A new robotic platform for sign language tutoring humanoid robots as assistive game companions for teaching sign language. Int. J. Soc. Robot. 7, 571–585 (2015). Springer, NetherlandsCrossRef Uluer, P., Akalin, N., Kose, H.: A new robotic platform for sign language tutoring humanoid robots as assistive game companions for teaching sign language. Int. J. Soc. Robot. 7, 571–585 (2015). Springer, NetherlandsCrossRef
Metadaten
Titel
Don’t Read My Lips: Assessing Listening and Speaking Skills Through Play with a Humanoid Robot
verfasst von
Panayiota Polycarpou
Anna Andreeva
Andri Ioannou
Panayiotis Zaphiris
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-40542-1_41

Neuer Inhalt