Skip to main content

2022 | OriginalPaper | Buchkapitel

Attributed Graphettes-Based Preterm Infants Motion Analysis

verfasst von : Davide Garbarino, Matteo Moro, Chiara Tacchino, Paolo Moretti, Maura Casadio, Francesca Odone, Annalisa Barla

Erschienen in: Complex Networks & Their Applications X

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The study of preterm infants neuro-motor status can be performed by analyzing infants spontaneous movements. Nowadays, available automatic methods for assessing infants motion patterns are still limited. We present a novel pipeline for the characterization of infants spontaneous movements, which given RGB videos leverages on network analysis and NLP. First, we describe a body configuration for each frame considering landmark points on infants bodies as nodes of a network and connecting them depending on their proximity. Each configuration can be described by means of attributed graphettes. We identify each attributed graphette by a string, thus allowing to study videos as texts, i.e. sequences of strings. This allows us exploiting NLP methods as topic modelling to obtain interpretable representations. We analyze topics to describe both global and local differences in infants with normal and abnormal motion patters. We find encouraging correspondences between our results and evaluations performed by expert physicians.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Adde, L., Helbostad, J.L., Jensenius, A.R., Taraldsen, G., Grunewaldt, K.H., Støen, R.: Early prediction of cerebral palsy by computer-based video analysis of general movements: a feasibility study. Dev. Med. Child Neurol. 52(8), 773–778 (2010)CrossRef Adde, L., Helbostad, J.L., Jensenius, A.R., Taraldsen, G., Grunewaldt, K.H., Støen, R.: Early prediction of cerebral palsy by computer-based video analysis of general movements: a feasibility study. Dev. Med. Child Neurol. 52(8), 773–778 (2010)CrossRef
2.
Zurück zum Zitat Ahmedt-Aristizabal, D., Denman, S., Nguyen, K., Sridharan, S., Dionisio, S., Fookes, C.: Understanding patients’ behavior: vision-based analysis of seizure disorders. IEEE J. Biomed. Health Inform. 23(6), 2583–2591 (2019)CrossRef Ahmedt-Aristizabal, D., Denman, S., Nguyen, K., Sridharan, S., Dionisio, S., Fookes, C.: Understanding patients’ behavior: vision-based analysis of seizure disorders. IEEE J. Biomed. Health Inform. 23(6), 2583–2591 (2019)CrossRef
3.
Zurück zum Zitat Alghamdi, R., Alfalqi, K.: A survey of topic modeling in text mining. International Journal of Advanced Computer Science and Applications (IJACSA), vol. 6, no. 1 (2015) Alghamdi, R., Alfalqi, K.: A survey of topic modeling in text mining. International Journal of Advanced Computer Science and Applications (IJACSA), vol. 6, no. 1 (2015)
4.
Zurück zum Zitat Allen, M.C.: Neurodevelopmental outcomes of preterm infants. Current Opinion Neurol. 21(2), 123–128 (2008)CrossRef Allen, M.C.: Neurodevelopmental outcomes of preterm infants. Current Opinion Neurol. 21(2), 123–128 (2008)CrossRef
5.
Zurück zum Zitat Bax, M., et al.: Proposed definition and classification of cerebral palsy, April 2005. Dev. Med. Child Neurol. 47(8), 571–576 (2005) Bax, M., et al.: Proposed definition and classification of cerebral palsy, April 2005. Dev. Med. Child Neurol. 47(8), 571–576 (2005)
6.
Zurück zum Zitat Bayley, N.: Bayley scales of infant and toddler development: administration manual. Harcourt assessment (2006) Bayley, N.: Bayley scales of infant and toddler development: administration manual. Harcourt assessment (2006)
7.
Zurück zum Zitat Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003) Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)
8.
Zurück zum Zitat Carse, B., Meadows, B., Bowers, R., Rowe, P.: Affordable clinical gait analysis: an assessment of the marker tracking accuracy of a new low-cost optical 3d motion analysis system. Physiotherapy 99(4), 347–351 (2013)CrossRef Carse, B., Meadows, B., Bowers, R., Rowe, P.: Affordable clinical gait analysis: an assessment of the marker tracking accuracy of a new low-cost optical 3d motion analysis system. Physiotherapy 99(4), 347–351 (2013)CrossRef
9.
Zurück zum Zitat Chambers, C., et al.: Computer vision to automatically assess infant neuromotor risk. IEEE Trans. Neural Syst. Rehabil. Eng. 28(11), 2431–2442 (2020) Chambers, C., et al.: Computer vision to automatically assess infant neuromotor risk. IEEE Trans. Neural Syst. Rehabil. Eng. 28(11), 2431–2442 (2020)
10.
Zurück zum Zitat Colyer, S.L., Evans, M., Cosker, D.P., Salo, A.I.: A review of the evolution of vision-based motion analysis and the integration of advanced computer vision methods towards developing a markerless system. Sports Med.-open 4(1), 1–15 (2018)CrossRef Colyer, S.L., Evans, M., Cosker, D.P., Salo, A.I.: A review of the evolution of vision-based motion analysis and the integration of advanced computer vision methods towards developing a markerless system. Sports Med.-open 4(1), 1–15 (2018)CrossRef
11.
Zurück zum Zitat Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009) Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
12.
Zurück zum Zitat Desmarais, Y., Mottet, D., Slangen, P., Montesinos, P.: A review of 3d human pose estimation algorithms for markerless motion capture. arXiv preprint arXiv:2010.06449 (2020) Desmarais, Y., Mottet, D., Slangen, P., Montesinos, P.: A review of 3d human pose estimation algorithms for markerless motion capture. arXiv preprint arXiv:​2010.​06449 (2020)
13.
Zurück zum Zitat Dimitrova, T., Petrovski, K., Kocarev, L.: Graphlets in multiplex networks. Sci. Rep. 10(1), 1–13 (2020) Dimitrova, T., Petrovski, K., Kocarev, L.: Graphlets in multiplex networks. Sci. Rep. 10(1), 1–13 (2020)
14.
Zurück zum Zitat Garello, L., et al.: A study of at-term and preterm infants’ motion based on markerless video analysis (2021) Garello, L., et al.: A study of at-term and preterm infants’ motion based on markerless video analysis (2021)
15.
Zurück zum Zitat Goldberg, Y.: Neural network methods for natural language processing. Synthesis Lect. Hum. Lang. Technol. 10(1), 1–309 (2017)CrossRef Goldberg, Y.: Neural network methods for natural language processing. Synthesis Lect. Hum. Lang. Technol. 10(1), 1–309 (2017)CrossRef
16.
Zurück zum Zitat Hasan, A., Chung, P.C., Hayes, W.: Graphettes: constant-time determination of graphlet and orbit identity including (possibly disconnected) graphlets up to size 8. PloS One 12(8), e0181570 (2017) Hasan, A., Chung, P.C., Hayes, W.: Graphettes: constant-time determination of graphlet and orbit identity including (possibly disconnected) graphlets up to size 8. PloS One 12(8), e0181570 (2017)
17.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
18.
Zurück zum Zitat Hesse, N., Bodensteiner, C., Arens, M., Hofmann, U.G., Weinberger, R., Sebastian Schroeder, A.: Computer vision for medical infant motion analysis: State of the art and rgb-d data set. In: Proceedings of the ECCV (2018) Hesse, N., Bodensteiner, C., Arens, M., Hofmann, U.G., Weinberger, R., Sebastian Schroeder, A.: Computer vision for medical infant motion analysis: State of the art and rgb-d data set. In: Proceedings of the ECCV (2018)
19.
Zurück zum Zitat Long, Q., Jin, Y., Song, G., Li, Y., Lin, W.: Graph structural-topic neural network. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1065–1073 (2020) Long, Q., Jin, Y., Song, G., Li, Y., Lin, W.: Graph structural-topic neural network. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1065–1073 (2020)
20.
Zurück zum Zitat Mathis, A., et al.: Deeplabcut: markerless pose estimation of user-defined body parts with deep learning. Nat. Neurosci. 21(9), 1281 (2018) Mathis, A., et al.: Deeplabcut: markerless pose estimation of user-defined body parts with deep learning. Nat. Neurosci. 21(9), 1281 (2018)
21.
Zurück zum Zitat Meinecke, L., Breitbach-Faller, N., Bartz, C., Damen, R., Rau, G., Disselhorst-Klug, C.: Movement analysis in the early detection of newborns at risk for developing spasticity due to infantile cerebral palsy. Hum. Mov. Sci. 25(2), 125–144 (2006)CrossRef Meinecke, L., Breitbach-Faller, N., Bartz, C., Damen, R., Rau, G., Disselhorst-Klug, C.: Movement analysis in the early detection of newborns at risk for developing spasticity due to infantile cerebral palsy. Hum. Mov. Sci. 25(2), 125–144 (2006)CrossRef
22.
Zurück zum Zitat Milo, R., Shen-Orr, S., Itzkovitz, S., Kashtan, N., Chklovskii, D., Alon, U.: Network motifs: simple building blocks of complex networks. Science 298(5594), 824–827 (2002)CrossRef Milo, R., Shen-Orr, S., Itzkovitz, S., Kashtan, N., Chklovskii, D., Alon, U.: Network motifs: simple building blocks of complex networks. Science 298(5594), 824–827 (2002)CrossRef
23.
Zurück zum Zitat Mimno, D., Wallach, H., Talley, E., Leenders, M., McCallum, A.: Optimizing semantic coherence in topic models. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pp. 262–272 (2011) Mimno, D., Wallach, H., Talley, E., Leenders, M., McCallum, A.: Optimizing semantic coherence in topic models. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pp. 262–272 (2011)
24.
Zurück zum Zitat Pržulj, N., Corneil, D.G., Jurisica, I.: Modeling interactome: scale-free or geometric? Bioinformatics 20(18), 3508–3515 (2004)CrossRef Pržulj, N., Corneil, D.G., Jurisica, I.: Modeling interactome: scale-free or geometric? Bioinformatics 20(18), 3508–3515 (2004)CrossRef
25.
Zurück zum Zitat Röder, M., Both, A., Hinneburg, A.: Exploring the space of topic coherence measures. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp. 399–408 (2015) Röder, M., Both, A., Hinneburg, A.: Exploring the space of topic coherence measures. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp. 399–408 (2015)
26.
Zurück zum Zitat Salton, G., Harman, D.: Information retrieval. In: Encyclopedia of Computer Science, pp. 858–863 (2003) Salton, G., Harman, D.: Information retrieval. In: Encyclopedia of Computer Science, pp. 858–863 (2003)
27.
Zurück zum Zitat Tu, K., Li, J., Towsley, D., Braines, D., Turner, L.D.: gl2vec: Learning feature representation using graphlets for directed networks. In: Proceedings of the 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, pp. 216–221 (2019) Tu, K., Li, J., Towsley, D., Braines, D., Turner, L.D.: gl2vec: Learning feature representation using graphlets for directed networks. In: Proceedings of the 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, pp. 216–221 (2019)
Metadaten
Titel
Attributed Graphettes-Based Preterm Infants Motion Analysis
verfasst von
Davide Garbarino
Matteo Moro
Chiara Tacchino
Paolo Moretti
Maura Casadio
Francesca Odone
Annalisa Barla
Copyright-Jahr
2022
DOI
https://doi.org/10.1007/978-3-030-93409-5_8

Premium Partner