Skip to main content
Top

2022 | OriginalPaper | Chapter

An Advanced Tool for Semi-automatic Annotation for Early Screening of Neurodevelopmental Disorders

Authors : Giuseppe Massimo Bernava, Marco Leo, Pierluigi Carcagnì, Cosimo Distante

Published in: Image Analysis and Processing. ICIAP 2022 Workshops

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Non-invasive solutions (no sensors nor markers) appear the most appealing for assessment of body movements and facial dynamics in order to predict Neurodevelopmental disorders (NDD) even in the first days of life. To this aim, recent advances in machine learning applied could be effectively exploited on visual data framing the children, but they suffer from the scarcity of annotated data for training the algorithms. In order to fill this gap, in this paper, a semi-automatic tool specifically designed for labelling videos of children in cribs is introduced. It consists of a Graphical User Interface allowing to select: 1) videos, or static images, to be processed and 2) the desired annotation goal achieved by state-of-the-art deep learning based neural architectures.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Akter, T., et al.: Improved transfer-learning-based facial recognition framework to detect autistic children at an early stage. Brain Sci. 11(6), 734 (2021)CrossRef Akter, T., et al.: Improved transfer-learning-based facial recognition framework to detect autistic children at an early stage. Brain Sci. 11(6), 734 (2021)CrossRef
2.
go back to reference Baccinelli, W., et al.: Movidea: a software package for automatic video analysis of movements in infants at risk for neurodevelopmental disorders. Brain Sci. 10(4), 203 (2020)CrossRef Baccinelli, W., et al.: Movidea: a software package for automatic video analysis of movements in infants at risk for neurodevelopmental disorders. Brain Sci. 10(4), 203 (2020)CrossRef
3.
go back to reference Bazarevsky, V., Grishchenko, I., Raveendran, K., Zhu, T., Zhang, F., Grundmann, M.: BlazePose: on-device real-time body pose tracking. arXiv preprint arXiv:2006.10204 (2020) Bazarevsky, V., Grishchenko, I., Raveendran, K., Zhu, T., Zhang, F., Grundmann, M.: BlazePose: on-device real-time body pose tracking. arXiv preprint arXiv:​2006.​10204 (2020)
4.
go back to reference Bernava, G., Nucita, A., Iannizzotto, G., Caprì, T., Fabio, R.A.: Proteo: a framework for serious games in telerehabilitation. Appl. Sci. 11(13), 5935 (2021)CrossRef Bernava, G., Nucita, A., Iannizzotto, G., Caprì, T., Fabio, R.A.: Proteo: a framework for serious games in telerehabilitation. Appl. Sci. 11(13), 5935 (2021)CrossRef
5.
go back to reference Caruso, A., et al.: Early motor development predicts clinical outcomes of siblings at high-risk for autism: insight from an innovative motion-tracking technology. Brain Sci. 10(6), 379 (2020)CrossRef Caruso, A., et al.: Early motor development predicts clinical outcomes of siblings at high-risk for autism: insight from an innovative motion-tracking technology. Brain Sci. 10(6), 379 (2020)CrossRef
6.
go back to reference Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)CrossRef Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)CrossRef
7.
go back to reference Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: CVPR09 (2009) Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: CVPR09 (2009)
8.
go back to reference Duan, H., Min, X., Fang, Y., Fan, L., Yang, X., Zhai, G.: Visual attention analysis and prediction on human faces for children with autism spectrum disorder. ACM Trans. Multimedia Comput. Commun. Appl. (TOMM) 15(3s), 1–23 (2019) Duan, H., Min, X., Fang, Y., Fan, L., Yang, X., Zhai, G.: Visual attention analysis and prediction on human faces for children with autism spectrum disorder. ACM Trans. Multimedia Comput. Commun. Appl. (TOMM) 15(3s), 1–23 (2019)
9.
go back to reference Ghazi, M.A., Ding, L., Fagg, A.H., Kolobe, T.H., Miller, D.P.: Vision-based motion capture system for tracking crawling motions of infants. In: 2017 IEEE International Conference on Mechatronics and Automation (ICMA), pp. 1549–1555. IEEE (2017) Ghazi, M.A., Ding, L., Fagg, A.H., Kolobe, T.H., Miller, D.P.: Vision-based motion capture system for tracking crawling motions of infants. In: 2017 IEEE International Conference on Mechatronics and Automation (ICMA), pp. 1549–1555. IEEE (2017)
10.
go back to reference Hadders-Algra, M.: Early diagnostics and early intervention in neurodevelopmental disorders-age-dependent challenges and opportunities. J. Clin. Med. 10(4), 861 (2021)CrossRef Hadders-Algra, M.: Early diagnostics and early intervention in neurodevelopmental disorders-age-dependent challenges and opportunities. J. Clin. Med. 10(4), 861 (2021)CrossRef
11.
go back to reference He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
12.
go back to reference Hosseini, M.P., Beary, M., Hadsell, A., Messersmith, R., Soltanian-Zadeh, H.: Deep learning for autism diagnosis and facial analysis in children. Front. Comput. Neurosci. 15 (2021) Hosseini, M.P., Beary, M., Hadsell, A., Messersmith, R., Soltanian-Zadeh, H.: Deep learning for autism diagnosis and facial analysis in children. Front. Comput. Neurosci. 15 (2021)
13.
go back to reference Kanemaru, N., et al.: Specific characteristics of spontaneous movements in preterm infants at term age are associated with developmental delays at age 3 years. Dev. Med. Child Neurol. 55(8), 713–721 (2013) Kanemaru, N., et al.: Specific characteristics of spontaneous movements in preterm infants at term age are associated with developmental delays at age 3 years. Dev. Med. Child Neurol. 55(8), 713–721 (2013)
14.
go back to reference Leo, M., Bernava, G.M., Carcagnì, P., Distante, C.: Video-based automatic baby motion analysis for early neurological disorder diagnosis: state of the art and future directions. Sensors 22(3), 866 (2022)CrossRef Leo, M., Bernava, G.M., Carcagnì, P., Distante, C.: Video-based automatic baby motion analysis for early neurological disorder diagnosis: state of the art and future directions. Sensors 22(3), 866 (2022)CrossRef
15.
go back to reference Leo, M., et al.: Computational analysis of deep visual data for quantifying facial expression production. Appl. Sci. 9(21), 4542 (2019)CrossRef Leo, M., et al.: Computational analysis of deep visual data for quantifying facial expression production. Appl. Sci. 9(21), 4542 (2019)CrossRef
16.
go back to reference Leo, M., et al.: Computational assessment of facial expression production in ASD children. Sensors 18(11), 3993 (2018)CrossRef Leo, M., et al.: Computational assessment of facial expression production in ASD children. Sensors 18(11), 3993 (2018)CrossRef
18.
go back to reference Micai, M., Fulceri, F., Caruso, A., Guzzetta, A., Gila, L., Scattoni, M.L.: Early behavioral markers for neurodevelopmental disorders in the first 3 years of life: an overview of systematic reviews. Neurosci. Biobehav. Rev. 116, 183–201 (2020)CrossRef Micai, M., Fulceri, F., Caruso, A., Guzzetta, A., Gila, L., Scattoni, M.L.: Early behavioral markers for neurodevelopmental disorders in the first 3 years of life: an overview of systematic reviews. Neurosci. Biobehav. Rev. 116, 183–201 (2020)CrossRef
19.
go back to reference Moccia, S., Migliorelli, L., Carnielli, V., Frontoni, E.: Preterm infant’s pose estimation with spatio-temporal features. IEEE Trans. Biomed. Eng. 67(8), 2370–2380 (2019)CrossRef Moccia, S., Migliorelli, L., Carnielli, V., Frontoni, E.: Preterm infant’s pose estimation with spatio-temporal features. IEEE Trans. Biomed. Eng. 67(8), 2370–2380 (2019)CrossRef
20.
go back to reference Morris-Rosendahl, D.J., Crocq, M.A.: Neurodevelopmental disorders-the history and future of a diagnostic concept. Dialogues Clin. Neurosci. 22(1), 65 (2020)CrossRef Morris-Rosendahl, D.J., Crocq, M.A.: Neurodevelopmental disorders-the history and future of a diagnostic concept. Dialogues Clin. Neurosci. 22(1), 65 (2020)CrossRef
21.
go back to reference Orlandi, S., et al.: AVIM-a contactless system for infant data acquisition and analysis: software architecture and first results. Biomed. Signal Process. Control 20, 85–99 (2015)CrossRef Orlandi, S., et al.: AVIM-a contactless system for infant data acquisition and analysis: software architecture and first results. Biomed. Signal Process. Control 20, 85–99 (2015)CrossRef
22.
go back to reference Peyton, C., et al.: Inter-observer reliability using the general movement assessment is influenced by rater experience. Early Human Dev. 161, 105436 (2021)CrossRef Peyton, C., et al.: Inter-observer reliability using the general movement assessment is influenced by rater experience. Early Human Dev. 161, 105436 (2021)CrossRef
24.
go back to reference Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: A semi-automatic methodology for facial landmark annotation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2013 Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: A semi-automatic methodology for facial landmark annotation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2013
25.
go back to reference Shephard, E., et al.: Early developmental pathways to childhood symptoms of attention-deficit hyperactivity disorder, anxiety and autism spectrum disorder. J. Child Psychol. Psychiatry 60(9), 963–974 (2019)CrossRef Shephard, E., et al.: Early developmental pathways to childhood symptoms of attention-deficit hyperactivity disorder, anxiety and autism spectrum disorder. J. Child Psychol. Psychiatry 60(9), 963–974 (2019)CrossRef
26.
go back to reference Tomasi, C., Detection, T.K.: Tracking of point features. Int. J. Comput. Vis. 9, 137–154 (1991)CrossRef Tomasi, C., Detection, T.K.: Tracking of point features. Int. J. Comput. Vis. 9, 137–154 (1991)CrossRef
Metadata
Title
An Advanced Tool for Semi-automatic Annotation for Early Screening of Neurodevelopmental Disorders
Authors
Giuseppe Massimo Bernava
Marco Leo
Pierluigi Carcagnì
Cosimo Distante
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-031-13324-4_14

Premium Partner