Skip to main content

2021 | OriginalPaper | Buchkapitel

A Few-Shot Learning Graph Multi-trajectory Evolution Network for Forecasting Multimodal Baby Connectivity Development from a Baseline Timepoint

verfasst von : Alaa Bessadok, Ahmed Nebli, Mohamed Ali Mahjoub, Gang Li, Weili Lin, Dinggang Shen, Islem Rekik

Erschienen in: Predictive Intelligence in Medicine

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Charting the baby connectome evolution trajectory during the first year after birth plays a vital role in understanding dynamic connectivity development of baby brains. Such analysis requires acquisition of longitudinal connectomic datasets. However, both neonatal and postnatal scans are rarely acquired due to various difficulties. A small body of works has focused on predicting baby brain evolution trajectory from a neonatal brain connectome derived from a single modality. Although promising, large training datasets are essential to boost model learning and to generalize to a multi-trajectory prediction from different modalities (i.e., functional and morphological connectomes). Here, we unprecedentedly explore the question: “Can we design a few-shot learning-based framework for predicting brain graph trajectories across different modalities?” To this aim, we propose a Graph Multi-Trajectory Evolution Network (GmTE-Net), which adopts a teacher-student paradigm where the teacher network learns on pure neonatal brain graphs and the student network learns on simulated brain graphs given a set of different timepoints. To the best of our knowledge, this is the first teacher-student architecture tailored for brain graph multi-trajectory growth prediction that is based on few-shot learning and generalized to graph neural networks (GNNs). To boost the performance of the student network, we introduce a local topology-aware distillation loss that forces the predicted graph topology of the student network to be consistent with the teacher network. Experimental results demonstrate substantial performance gains over benchmark methods. Hence, our GmTE-Net can be leveraged to predict atypical brain connectivity trajectory evolution across various modalities. Our code is available at https://​github.​com/​basiralab/​GmTE-Net.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zhang, H., Shen, D., Lin, W.: Resting-state functional MRI studies on infant brains: a decade of gap-filling efforts. Neuroimage 185, 664–684 (2019)CrossRef Zhang, H., Shen, D., Lin, W.: Resting-state functional MRI studies on infant brains: a decade of gap-filling efforts. Neuroimage 185, 664–684 (2019)CrossRef
2.
Zurück zum Zitat Rekik, I., Li, G., Lin, W., Shen, D.: Predicting infant cortical surface development using a 4d varifold-based learning framework and local topography-based shape morphing. Med. Image Anal. 28, 1–12 (2016)CrossRef Rekik, I., Li, G., Lin, W., Shen, D.: Predicting infant cortical surface development using a 4d varifold-based learning framework and local topography-based shape morphing. Med. Image Anal. 28, 1–12 (2016)CrossRef
3.
Zurück zum Zitat Rekik, I., Li, G., Yap, P.T., Chen, G., Lin, W., Shen, D.: Joint prediction of longitudinal development of cortical surfaces and white matter fibers from neonatal mri. Neuroimage 152, 411–424 (2017)CrossRef Rekik, I., Li, G., Yap, P.T., Chen, G., Lin, W., Shen, D.: Joint prediction of longitudinal development of cortical surfaces and white matter fibers from neonatal mri. Neuroimage 152, 411–424 (2017)CrossRef
4.
5.
Zurück zum Zitat Fornito, A., Zalesky, A., Breakspear, M.: The connectomics of brain disorders. Nat. Rev. Neurosci. 16, 159–172 (2015)CrossRef Fornito, A., Zalesky, A., Breakspear, M.: The connectomics of brain disorders. Nat. Rev. Neurosci. 16, 159–172 (2015)CrossRef
6.
Zurück zum Zitat Ghribi, O., Li, G., Lin, W., Shen, D., Rekik, I.: Multi-regression based supervised sample selection for predicting baby connectome evolution trajectory from neonatal timepoint. Med. Image Anal. 68, 101853 (2021) Ghribi, O., Li, G., Lin, W., Shen, D., Rekik, I.: Multi-regression based supervised sample selection for predicting baby connectome evolution trajectory from neonatal timepoint. Med. Image Anal. 68, 101853 (2021)
7.
Zurück zum Zitat Goktas, A.S., Bessadok, A., Rekik, I.: Residual embedding similarity-based network selection for predicting brain network evolution trajectory from a single observation. arXiv preprint arXiv:2009.11110 (2020) Goktas, A.S., Bessadok, A., Rekik, I.: Residual embedding similarity-based network selection for predicting brain network evolution trajectory from a single observation. arXiv preprint arXiv:​2009.​11110 (2020)
8.
Zurück zum Zitat Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016) Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:​1609.​02907 (2016)
10.
12.
Zurück zum Zitat Li, A., Luo, T., Lu, Z., Xiang, T., Wang, L.: Large-scale few-shot learning: knowledge transfer with class hierarchy. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7212–7220 (2019) Li, A., Luo, T., Lu, Z., Xiang, T., Wang, L.: Large-scale few-shot learning: knowledge transfer with class hierarchy. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7212–7220 (2019)
15.
16.
Zurück zum Zitat Rajasegaran, J., Khan, S., Hayat, M., Khan, F.S., Shah, M.: Self-supervised knowledge distillation for few-shot learning. arXiv preprint arXiv:2006.09785 (2020) Rajasegaran, J., Khan, S., Hayat, M., Khan, F.S., Shah, M.: Self-supervised knowledge distillation for few-shot learning. arXiv preprint arXiv:​2006.​09785 (2020)
19.
Zurück zum Zitat Bassett, D.S., Sporns, O.: Network neuroscience. Nat. Neurosci. 20, 353–364 (2017)CrossRef Bassett, D.S., Sporns, O.: Network neuroscience. Nat. Neurosci. 20, 353–364 (2017)CrossRef
20.
Zurück zum Zitat Liu, J., et al.: Complex brain network analysis and its applications to brain disorders: a survey. Complexity 2017 (2017) Liu, J., et al.: Complex brain network analysis and its applications to brain disorders: a survey. Complexity 2017 (2017)
21.
Zurück zum Zitat Joyce, K.E., Laurienti, P.J., Burdette, J.H., Hayasaka, S.: A new measure of centrality for brain networks. PloS one 5, e12200 (2010) Joyce, K.E., Laurienti, P.J., Burdette, J.H., Hayasaka, S.: A new measure of centrality for brain networks. PloS one 5, e12200 (2010)
22.
Zurück zum Zitat Fornito, A., Zalesky, A., Bullmore, E.: Fundamentals of Brain Network Analysis. Academic Press, Cambridge (2016) Fornito, A., Zalesky, A., Bullmore, E.: Fundamentals of Brain Network Analysis. Academic Press, Cambridge (2016)
23.
Zurück zum Zitat Freeman, L.C.: A set of measures of centrality based on betweenness. Sociometry, pp. 35–41 (1977) Freeman, L.C.: A set of measures of centrality based on betweenness. Sociometry, pp. 35–41 (1977)
24.
Zurück zum Zitat Tzourio-Mazoyer, N., et al.: Automated anatomical labeling of activations in spm using a macroscopic anatomical parcellation of the mni mri single-subject brain. Neuroimage 15, 273–289 (2002)CrossRef Tzourio-Mazoyer, N., et al.: Automated anatomical labeling of activations in spm using a macroscopic anatomical parcellation of the mni mri single-subject brain. Neuroimage 15, 273–289 (2002)CrossRef
25.
Zurück zum Zitat Fischl, B., et al.: Sequence-independent segmentation of magnetic resonance images. Neuroimage 23, S69–S84 (2004)CrossRef Fischl, B., et al.: Sequence-independent segmentation of magnetic resonance images. Neuroimage 23, S69–S84 (2004)CrossRef
26.
Zurück zum Zitat Pilanci, M., Vural, E.: Domain adaptation on graphs by learning aligned graph bases. IEEE Trans. Knowl. Data Eng. (2020). IEEE Pilanci, M., Vural, E.: Domain adaptation on graphs by learning aligned graph bases. IEEE Trans. Knowl. Data Eng. (2020). IEEE
27.
Zurück zum Zitat Redko, I., Morvant, E., Habrard, A., Sebban, M., Bennani, Y.: A survey on domain adaptation theory. arXiv preprint arXiv:2004.11829 (2020) Redko, I., Morvant, E., Habrard, A., Sebban, M., Bennani, Y.: A survey on domain adaptation theory. arXiv preprint arXiv:​2004.​11829 (2020)
Metadaten
Titel
A Few-Shot Learning Graph Multi-trajectory Evolution Network for Forecasting Multimodal Baby Connectivity Development from a Baseline Timepoint
verfasst von
Alaa Bessadok
Ahmed Nebli
Mohamed Ali Mahjoub
Gang Li
Weili Lin
Dinggang Shen
Islem Rekik
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-87602-9_2