Skip to main content
Top
Published in: World Wide Web 5/2023

27-07-2023

Structure-adaptive graph neural network with temporal representation and residual connections

Authors: Xin Bi, Qingling Jiang, Zhixun Liu, Xin Yao, Haojie Nie, George Y. Yuan, Xiangguo Zhao, Yongjiao Sun

Published in: World Wide Web | Issue 5/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Graph learning methods have boosted brain analysis for user healthcare, disease detection, and behavioral modeling. Spatially separated brain regions are functionally connected with different weights, enabling the classification of brain networks from the perspective of graph learning. However, existing methods based on graph neural networks mainly rely on the calculation of node feature correlation and manual threshold selection to obtain the graph structure, which disregards the temporal features of nodes and the latent information in the implicit graph structure. To address this problem, we propose a structure adaptive graph neural network with temporal representation and residual connections (TR-SAGNN) for brain network classification. First, we design a temporal attention learning module to learn the temporal features of the node itself. We design an end-to-end adaptive graph structure learning module based on the product-moment self-attention mechanism, which avoids manual threshold selection and obtains a more accurate graph structure. Second, we design a graph representation learning module based on a residual connection strategy to avoid the problem of insufficient propagation of node features. Last, we design a loss function to consider both the graph classification task and node classification task, which makes the model obtain better graph representation learning ability under the supervision of the node classification label. We conduct extensive experiments on the ANDI dataset. The results show that our model has better end-to-end adaptive graph construction capability as well as feature learning and classification performance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Shi, F., Dey, N., Ashour, A.S., Sifaki-Pistolla, D., Sherratt, R.S.: Metakansei modeling with valence-arousal fmri dataset of brain. Cogn. Comput. 11(2), 227–240 (2019)CrossRef Shi, F., Dey, N., Ashour, A.S., Sifaki-Pistolla, D., Sherratt, R.S.: Metakansei modeling with valence-arousal fmri dataset of brain. Cogn. Comput. 11(2), 227–240 (2019)CrossRef
2.
go back to reference Le Bihan, D.: Looking into the functional architecture of the brain with diffusion mri. Nat. Rev. Neurosci. 4(6), 469–480 (2003)CrossRef Le Bihan, D.: Looking into the functional architecture of the brain with diffusion mri. Nat. Rev. Neurosci. 4(6), 469–480 (2003)CrossRef
3.
go back to reference Friston, K.J.: Functional and effective connectivity in neuroimaging: a synthesis. Hum. Brain. Map. 2(1–2), 56–78 (1994)CrossRef Friston, K.J.: Functional and effective connectivity in neuroimaging: a synthesis. Hum. Brain. Map. 2(1–2), 56–78 (1994)CrossRef
4.
go back to reference Song, X., Li, J., Cai, T., Yang, S., Yang, T., Liu, C.: A survey on deep learning based knowledge tracing. Knowledge-Based Systems 258, 110036 (2022)CrossRef Song, X., Li, J., Cai, T., Yang, S., Yang, T., Liu, C.: A survey on deep learning based knowledge tracing. Knowledge-Based Systems 258, 110036 (2022)CrossRef
5.
go back to reference Liu, J., Chen, Y., Huang, X., Li, J., Min, G.: Gnn-based long and short term preference modeling for next-location prediction. Inform Sci 629, 1–14 (2023)CrossRef Liu, J., Chen, Y., Huang, X., Li, J., Min, G.: Gnn-based long and short term preference modeling for next-location prediction. Inform Sci 629, 1–14 (2023)CrossRef
6.
go back to reference Xu, C., Zhao, W., Zhao, J., Guan, Z., Song, X., Li, J.: Uncertaintyaware multiview deep learning for internet of things applications. IEEE Trans. Indust. Inform. 19, 1456–1466 (2022)CrossRef Xu, C., Zhao, W., Zhao, J., Guan, Z., Song, X., Li, J.: Uncertaintyaware multiview deep learning for internet of things applications. IEEE Trans. Indust. Inform. 19, 1456–1466 (2022)CrossRef
7.
go back to reference Rubinov, M., Sporns, O.: Complex network measures of brain connectivity: uses and interpretations. Neuroimage 52(3), 1059–1069 (2010)CrossRef Rubinov, M., Sporns, O.: Complex network measures of brain connectivity: uses and interpretations. Neuroimage 52(3), 1059–1069 (2010)CrossRef
8.
go back to reference Ji, J., Yao, Y.: A novel cnn framework to extract multi-level modular features for the classification of brain networks. Appl. Intell. 52(6), 6835–6852 (2022)CrossRef Ji, J., Yao, Y.: A novel cnn framework to extract multi-level modular features for the classification of brain networks. Appl. Intell. 52(6), 6835–6852 (2022)CrossRef
9.
go back to reference Parisot, S., Ktena, S.I., Ferrante, E., Lee, M., Guerrero, R., Glocker, B., Rueckert, D.: Disease prediction using graph convolutional networks: application to autism spectrum disorder and alzheimer’s disease. Med. Image Anal. 48, 117–130 (2018)CrossRef Parisot, S., Ktena, S.I., Ferrante, E., Lee, M., Guerrero, R., Glocker, B., Rueckert, D.: Disease prediction using graph convolutional networks: application to autism spectrum disorder and alzheimer’s disease. Med. Image Anal. 48, 117–130 (2018)CrossRef
10.
go back to reference Yuan, Y., Wang, G., Wang, H., Chen, L.: Efficient subgraph search over large uncertain graphs. Proc VLDB Endow 4(11), 876–886 (2011)CrossRef Yuan, Y., Wang, G., Wang, H., Chen, L.: Efficient subgraph search over large uncertain graphs. Proc VLDB Endow 4(11), 876–886 (2011)CrossRef
11.
go back to reference Parisot, S., Ktena, S.I., Ferrante, E., Lee, M., Guerrero, R., Glocker, B., Rueckert, D.: Disease prediction using graph convolutional networks: application to autism spectrum disorder and alzheimer’s disease. Med Image Anal 48, 117–130 (2018)CrossRef Parisot, S., Ktena, S.I., Ferrante, E., Lee, M., Guerrero, R., Glocker, B., Rueckert, D.: Disease prediction using graph convolutional networks: application to autism spectrum disorder and alzheimer’s disease. Med Image Anal 48, 117–130 (2018)CrossRef
12.
go back to reference Yuan, Y., Chen, L.,Wang, G.: Efficiently answering probability thresholdbased shortest path queries over uncertain graphs. In: Database Systems for Advanced Applications: 15th International Conference, DASFAA 2010, Tsukuba, Japan, April 1-4, 2010, Proceedings, Part I 15, 155–170. Springer (2010) Yuan, Y., Chen, L.,Wang, G.: Efficiently answering probability thresholdbased shortest path queries over uncertain graphs. In: Database Systems for Advanced Applications: 15th International Conference, DASFAA 2010, Tsukuba, Japan, April 1-4, 2010, Proceedings, Part I 15, 155–170. Springer (2010)
13.
go back to reference Yuan, Y., Wang, G., Chen, L., Wang, H.: Efficient subgraph similarity search on large probabilistic graph databases. arXiv:1205.6692 (2012) Yuan, Y., Wang, G., Chen, L., Wang, H.: Efficient subgraph similarity search on large probabilistic graph databases. arXiv:​1205.​6692 (2012)
14.
go back to reference Zhang, Y., Huang, H.: New graph-blind convolutional network for brain connectome data analysis. In: International Conference on Information Processing in Medical Imaging, 669–681. Springer (2019) Zhang, Y., Huang, H.: New graph-blind convolutional network for brain connectome data analysis. In: International Conference on Information Processing in Medical Imaging, 669–681. Springer (2019)
15.
go back to reference Brakowski, J., Spinelli, S., Dörig, N., Bosch, O.G., Manoliu, A., Holtforth, M.G., Seifritz, E.: Resting state brain network function in major depression-depression symptomatology, antidepressant treatment effects, future research. J. Psychiatric Res. 92, 147–159 (2017)CrossRef Brakowski, J., Spinelli, S., Dörig, N., Bosch, O.G., Manoliu, A., Holtforth, M.G., Seifritz, E.: Resting state brain network function in major depression-depression symptomatology, antidepressant treatment effects, future research. J. Psychiatric Res. 92, 147–159 (2017)CrossRef
16.
go back to reference Sporns, O., Tononi, G., Kötter, R.: The human connectome: a structural description of the human brain. PLoS Comput. Biol. 1(4), 42 (2005)CrossRef Sporns, O., Tononi, G., Kötter, R.: The human connectome: a structural description of the human brain. PLoS Comput. Biol. 1(4), 42 (2005)CrossRef
17.
go back to reference Zhang, H.-Y., Wang, S.-J., Xing, J., Liu, B., Ma, Z.-L., Yang, M., Zhang, Z.-J., Teng, G.-J.: Detection of pcc functional connectivity characteristics in resting-state fmri in mild alzheimer’s disease. Behav. Brain Res. 197(1), 103–108 (2009)CrossRef Zhang, H.-Y., Wang, S.-J., Xing, J., Liu, B., Ma, Z.-L., Yang, M., Zhang, Z.-J., Teng, G.-J.: Detection of pcc functional connectivity characteristics in resting-state fmri in mild alzheimer’s disease. Behav. Brain Res. 197(1), 103–108 (2009)CrossRef
18.
go back to reference Sorg, C., Riedl, V., Perneczky, R., Kurz, A., Wohlschlager, A.M.: Impact of alzheimer’s disease on the functional connectivity of spontaneous brain activity. Curr. Alzheimer Res. 6(6), 541–553 (2009)CrossRef Sorg, C., Riedl, V., Perneczky, R., Kurz, A., Wohlschlager, A.M.: Impact of alzheimer’s disease on the functional connectivity of spontaneous brain activity. Curr. Alzheimer Res. 6(6), 541–553 (2009)CrossRef
19.
go back to reference Beckmann, C.F., DeLuca, M., Devlin, J.T., Smith, S.M.: Investigations into resting-state connectivity using independent component analysis. Phil. Transac. Royal Soc. B Biol. Sci. 360(1457), 1001–1013 (2005)CrossRef Beckmann, C.F., DeLuca, M., Devlin, J.T., Smith, S.M.: Investigations into resting-state connectivity using independent component analysis. Phil. Transac. Royal Soc. B Biol. Sci. 360(1457), 1001–1013 (2005)CrossRef
20.
go back to reference Min, S., Gao, Z., Peng, J., Wang, L., Qin, K., Fang, B.: Stgsn - spatial-temporal graph neural network framework for time-evolving social networks. Knowledge-Based Systems 214, 106746 (2021)CrossRef Min, S., Gao, Z., Peng, J., Wang, L., Qin, K., Fang, B.: Stgsn - spatial-temporal graph neural network framework for time-evolving social networks. Knowledge-Based Systems 214, 106746 (2021)CrossRef
21.
go back to reference You, R., Yao, S., Mamitsuka, H., Zhu, S.: Deepgraphgo: graph neural network for large-scale, multispecies protein function prediction. Bioinformatics 37(Supplement 1), 262–271 (2021)CrossRef You, R., Yao, S., Mamitsuka, H., Zhu, S.: Deepgraphgo: graph neural network for large-scale, multispecies protein function prediction. Bioinformatics 37(Supplement 1), 262–271 (2021)CrossRef
22.
go back to reference Bi, X., Nie, H., Zhang, G., Hu, L., Ma, Y., Zhao, X., Yuan, Y., Wang, G.: Boosting question answering over knowledge graph with reward integration and policy evaluation under weak supervision. Inform. Proc. Manag. 60(2), 103242 (2023)CrossRef Bi, X., Nie, H., Zhang, G., Hu, L., Ma, Y., Zhao, X., Yuan, Y., Wang, G.: Boosting question answering over knowledge graph with reward integration and policy evaluation under weak supervision. Inform. Proc. Manag. 60(2), 103242 (2023)CrossRef
23.
go back to reference Qi, Y., Gu, Z., Li, A., Zhang, X., Shafiq, M., Mei, Y., Lin, K.: Cybersecurity knowledge graph enabled attack chain detection for cyber-physical systems. Computers and Electrical Engineering 108, 108660 (2023)CrossRef Qi, Y., Gu, Z., Li, A., Zhang, X., Shafiq, M., Mei, Y., Lin, K.: Cybersecurity knowledge graph enabled attack chain detection for cyber-physical systems. Computers and Electrical Engineering 108, 108660 (2023)CrossRef
24.
go back to reference Bi, X., Nie, H., Zhang, G., Hu, L., Ma, Y., Zhao, X., Yuan, Y., Wang, G.: Boosting question answering over knowledge graph with reward integration and policy evaluation under weak supervision. Inform. Proc. Manag. 60, 103242 (2023)CrossRef Bi, X., Nie, H., Zhang, G., Hu, L., Ma, Y., Zhao, X., Yuan, Y., Wang, G.: Boosting question answering over knowledge graph with reward integration and policy evaluation under weak supervision. Inform. Proc. Manag. 60, 103242 (2023)CrossRef
25.
go back to reference Song, X., Li, J., Cai, T., Yang, S., Yang, T., Liu, C.: A survey on deep learning based knowledge tracing. Knowledge-Based Systems 258, 110036 (2022)CrossRef Song, X., Li, J., Cai, T., Yang, S., Yang, T., Liu, C.: A survey on deep learning based knowledge tracing. Knowledge-Based Systems 258, 110036 (2022)CrossRef
26.
go back to reference Jia, Y., Lin, M., Wang, Y., Li, J., Chen, K., Siebert, J., Zhang, G.Z., Liao, Q.: Extrapolation over temporal knowledge graph via hyperbolic embedding. CAAI Transactions on Intelligence Technology (2023) Jia, Y., Lin, M., Wang, Y., Li, J., Chen, K., Siebert, J., Zhang, G.Z., Liao, Q.: Extrapolation over temporal knowledge graph via hyperbolic embedding. CAAI Transactions on Intelligence Technology (2023)
27.
go back to reference He, D., Zheng, Z., Stone, L.: Detecting generalized synchrony: An improved approach. Physical Review E 67(2), 026223 (2003)CrossRef He, D., Zheng, Z., Stone, L.: Detecting generalized synchrony: An improved approach. Physical Review E 67(2), 026223 (2003)CrossRef
28.
go back to reference Yang, S., Cai, B., Cai, T., Song, X., Jiang, J., Li, B., Li, J.: Robust crossnetwork node classification via constrained graph mutual information. Knowledge-Based Systems 257, 109852 (2022)CrossRef Yang, S., Cai, B., Cai, T., Song, X., Jiang, J., Li, B., Li, J.: Robust crossnetwork node classification via constrained graph mutual information. Knowledge-Based Systems 257, 109852 (2022)CrossRef
29.
go back to reference Fang, U., Li, J., Lu, X., Mian, A., Gu, Z.: Robust image clustering via context-aware contrastive graph learning. Pattern Recog. 109340 (2023) Fang, U., Li, J., Lu, X., Mian, A., Gu, Z.: Robust image clustering via context-aware contrastive graph learning. Pattern Recog. 109340 (2023)
30.
go back to reference Yuan, Y., Wang, G., Chen, L., Wang, H.: Efficient keyword search on uncertain graph data. IEEE Transactions on Knowledge and Data Engineering 25(12), 2767–2779 (2013)CrossRef Yuan, Y., Wang, G., Chen, L., Wang, H.: Efficient keyword search on uncertain graph data. IEEE Transactions on Knowledge and Data Engineering 25(12), 2767–2779 (2013)CrossRef
31.
go back to reference Fang, U., Li, J., Akhtar, N., Li, M., Jia, Y.: Gomic: Multi-view image clustering via self-supervised contrastive heterogeneous graph co-learning. World Wide Web, 1–17 (2022) Fang, U., Li, J., Akhtar, N., Li, M., Jia, Y.: Gomic: Multi-view image clustering via self-supervised contrastive heterogeneous graph co-learning. World Wide Web, 1–17 (2022)
32.
go back to reference Li, R., Wang, S., Zhu, F., Huang, J.: Adaptive graph convolutional neural networks. AAAI Conference on Artificial Intelligence. 3546–3553 (2018) Li, R., Wang, S., Zhu, F., Huang, J.: Adaptive graph convolutional neural networks. AAAI Conference on Artificial Intelligence. 3546–3553 (2018)
33.
go back to reference Hamilton, W.L., Ying, Z., Leskovec, J.: Inductive representation learning on large graphs. In: Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA. 1024–1034 (2017) Hamilton, W.L., Ying, Z., Leskovec, J.: Inductive representation learning on large graphs. In: Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA. 1024–1034 (2017)
34.
go back to reference Xing, X., Li, Q., Wei, H., Zhang, M., Zhan, Y., Zhou, X.S., Xue, Z., Shi, F.: Dynamic spectral graph convolution networks with assistant task training for early mci diagnosis. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part IV, 639–646 Springer. (2019) Xing, X., Li, Q., Wei, H., Zhang, M., Zhan, Y., Zhou, X.S., Xue, Z., Shi, F.: Dynamic spectral graph convolution networks with assistant task training for early mci diagnosis. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part IV, 639–646 Springer. (2019)
35.
go back to reference Zhang, H., Song, R., Wang, L., Zhang, L., Wang, D., Wang, C., Zhang, W.: Classification of brain disorders in rs-fmri via local-to-global graph neural networks. IEEE Transactions on Medical Imaging (2022) Zhang, H., Song, R., Wang, L., Zhang, L., Wang, D., Wang, C., Zhang, W.: Classification of brain disorders in rs-fmri via local-to-global graph neural networks. IEEE Transactions on Medical Imaging (2022)
36.
go back to reference Zhu, Y., Cui, H., He, L., Sun, L., Yang, C.: Joint embedding of structural and functional brain networks with graph neural networks for mental illness diagnosis. In: 2022 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 272–276 IEEE. (2022) Zhu, Y., Cui, H., He, L., Sun, L., Yang, C.: Joint embedding of structural and functional brain networks with graph neural networks for mental illness diagnosis. In: 2022 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 272–276 IEEE. (2022)
37.
go back to reference He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
38.
go back to reference Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4700–4708 (2017) Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4700–4708 (2017)
39.
go back to reference Li, R., Wang, S., Zhu, F., Huang, J.: Adaptive graph convolutional neural networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018) Li, R., Wang, S., Zhu, F., Huang, J.: Adaptive graph convolutional neural networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018)
40.
go back to reference Zhuang, C., Ma, Q.: Dual graph convolutional networks for graph-based semi-supervised classification. In: Proceedings of the 2018 World Wide Web Conference, 499–508 (2018) Zhuang, C., Ma, Q.: Dual graph convolutional networks for graph-based semi-supervised classification. In: Proceedings of the 2018 World Wide Web Conference, 499–508 (2018)
41.
go back to reference Yun, S., Jeong, M., Kim, R., Kang, J., Kim, H.J.: Graph transformer networks. Advances in neural information processing systems 32, 11983–11993 (2019) Yun, S., Jeong, M., Kim, R., Kang, J., Kim, H.J.: Graph transformer networks. Advances in neural information processing systems 32, 11983–11993 (2019)
Metadata
Title
Structure-adaptive graph neural network with temporal representation and residual connections
Authors
Xin Bi
Qingling Jiang
Zhixun Liu
Xin Yao
Haojie Nie
George Y. Yuan
Xiangguo Zhao
Yongjiao Sun
Publication date
27-07-2023
Publisher
Springer US
Published in
World Wide Web / Issue 5/2023
Print ISSN: 1386-145X
Electronic ISSN: 1573-1413
DOI
https://doi.org/10.1007/s11280-023-01179-7

Other articles of this Issue 5/2023

World Wide Web 5/2023 Go to the issue

Premium Partner