Skip to main content

2019 | OriginalPaper | Buchkapitel

Automatic Evaluation of Speech Therapy Exercises Based on Image Data

verfasst von : Zuzana Bílková, Adam Novozámský, Adam Domínec, Šimon Greško, Barbara Zitová, Markéta Paroubková

Erschienen in: Image Analysis and Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The presented paper proposes a new method for unique automatic evaluation of speech therapy exercises, one part of the future software system for speech therapy support. The method is based on the detection of the lips and tongue movements, which will help to evaluate the quality of the exercise implementation. Four different types of exercises are introduced and the corresponding features, capturing the quality of the movements, are shown. The method was tested using manually annotated data and the proposed features were evaluated and analyzed. At the second part, the tongue detection is proposed based on the convolutional neural network approach and preliminary results were shown.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chen, Y.P.P., et al.: Systematic review of virtual speech therapists for speech disorders. Comput. Speech Lang. 37, 98–128 (2016)CrossRef Chen, Y.P.P., et al.: Systematic review of virtual speech therapists for speech disorders. Comput. Speech Lang. 37, 98–128 (2016)CrossRef
2.
Zurück zum Zitat Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: International Conference on Computer Vision & Pattern Recognition (CVPR 2005), vol. 1, pp. 886–893. IEEE Computer Society (2005) Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: International Conference on Computer Vision & Pattern Recognition (CVPR 2005), vol. 1, pp. 886–893. IEEE Computer Society (2005)
3.
Zurück zum Zitat Du, J.q., Lu, Y.s., Zhu, M.f., Zhang, K., Ding, C.h.: A novel algorithm of color tongue image segmentation based on HSI. In: 2008 International Conference on BioMedical Engineering and Informatics, vol. 1, pp. 733–737. IEEE (2008) Du, J.q., Lu, Y.s., Zhu, M.f., Zhang, K., Ding, C.h.: A novel algorithm of color tongue image segmentation based on HSI. In: 2008 International Conference on BioMedical Engineering and Informatics, vol. 1, pp. 733–737. IEEE (2008)
4.
Zurück zum Zitat Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1867–1874 (2014) Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1867–1874 (2014)
5.
Zurück zum Zitat Lopes, C.B., Gonçalves, A.L., Scharcanski, J., Jung, C.R.: Color-based lips extraction applied to voice activity detection. In: 2011 18th IEEE International Conference on Image Processing, pp. 1057–1060. IEEE (2011) Lopes, C.B., Gonçalves, A.L., Scharcanski, J., Jung, C.R.: Color-based lips extraction applied to voice activity detection. In: 2011 18th IEEE International Conference on Image Processing, pp. 1057–1060. IEEE (2011)
6.
Zurück zum Zitat Pang, B., Zhang, D., Wang, K.: The bi-elliptical deformable contour and its application to automated tongue segmentation in Chinese medicine. IEEE Trans. Med. Imaging 24(8), 946–956 (2005)CrossRef Pang, B., Zhang, D., Wang, K.: The bi-elliptical deformable contour and its application to automated tongue segmentation in Chinese medicine. IEEE Trans. Med. Imaging 24(8), 946–956 (2005)CrossRef
8.
Zurück zum Zitat Viola, P., Jones, M., et al.: Rapid object detection using a boosted cascade of simple features. In: CVPR (1), vol. 1, pp. 511–518 (2001) Viola, P., Jones, M., et al.: Rapid object detection using a boosted cascade of simple features. In: CVPR (1), vol. 1, pp. 511–518 (2001)
9.
Zurück zum Zitat Zhang, B., Kumar, B.V., Zhang, D.: Detecting diabetes mellitus and nonproliferative diabetic retinopathy using tongue color, texture, and geometry features. IEEE Trans. Biomed. Eng. 61(2), 491–501 (2014)CrossRef Zhang, B., Kumar, B.V., Zhang, D.: Detecting diabetes mellitus and nonproliferative diabetic retinopathy using tongue color, texture, and geometry features. IEEE Trans. Biomed. Eng. 61(2), 491–501 (2014)CrossRef
10.
Zurück zum Zitat Zhang, H., Zuo, W., Wang, K., Zhang, D.: A snake-based approach to automated segmentation of tongue image using polar edge detector. Int. J. Imaging Syst. Technol. 16(4), 103–112 (2006)CrossRef Zhang, H., Zuo, W., Wang, K., Zhang, D.: A snake-based approach to automated segmentation of tongue image using polar edge detector. Int. J. Imaging Syst. Technol. 16(4), 103–112 (2006)CrossRef
11.
Zurück zum Zitat Zhongxu, Z., Aimin, W., Lansun, S.: The color tongue image segmentation based on mathematical morphology and his model. J. Beijing Polytech. Univ. 2 (1999) Zhongxu, Z., Aimin, W., Lansun, S.: The color tongue image segmentation based on mathematical morphology and his model. J. Beijing Polytech. Univ. 2 (1999)
Metadaten
Titel
Automatic Evaluation of Speech Therapy Exercises Based on Image Data
verfasst von
Zuzana Bílková
Adam Novozámský
Adam Domínec
Šimon Greško
Barbara Zitová
Markéta Paroubková
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-27202-9_36