Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 3/2022

04-05-2021 | Original Article

MGPOOL: multi-granular graph pooling convolutional networks representation learning

Authors: Zhenghua Xin, Guolong Chen, Jie Chen, Shu Zhao, Zongchao Wang, Aidong Fang, Zhenggao Pan, Lin Cui

Published in: International Journal of Machine Learning and Cybernetics | Issue 3/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Graph convolutional network (GCN) nowadays become new state-of-the-art for networks representation learning. Most of the existing methods are single-granular methods that failed to analyze the graph at multi-granular views so as to lose abundant information. Advanced graph pooling techniques can be successfully benefiting from semi-supervised networks representation learning. How to capture multi-granular information through the graph pooling techniques on graphs without additional input features is a great challenge. Technically speaking, we propose our graph node embeddings framework, MGPOOL. First, inspired by the triadic influence learning, we use the 3-clique algorithm to coarsen the graph repeatedly. Three nodes of a triangle form a supernode. We treat the supernodes as key nodes for our graph pooling operations. That keeps the local relationship. These graphs capture consecutive 3-cliques from the finest to the coarsest to preserve global structural relationships. Second, we use the unsupervised single-granular algorithms on the coarsest graph to acquire its node embeddings. Based on that, our graph pooling operations combining with that node embeddings to generate another same size of the coarsest graph. This makes up for the uniqueness of the coarsening result at a time and expands the receptive field for each node to avoid high-proximity information lost. Third, we take the embeddings, the coarsest graph and new coarsest graph as uniform input of MGPOOL. We restore the coarsest graph to the original graph to get the original graph node embeddings. The experimental results on four public datasets, Wiki, Cora, CiteSeer, and DBLP, demonstrate that our method has a better Macro F1 value for node classification tasks and AUC and Ap value for link prediction than the baseline methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Appendix
Available only for authorised users
Footnotes
1
https://github.com/GTmac/HARP/tree/master/
example_networks/DBLP.
 
2
https://github.com/GTmac/HARP/tree/master/
example_networks/citeseer.
 
Literature
1.
go back to reference Chen J, Liu Y, Zhao S, Zhang YP (2019) Citation recommendation based on weighted heterogeneous information network containing semantic linking. In: International conference on multimedia and expo, pp 31–36 Chen J, Liu Y, Zhao S, Zhang YP (2019) Citation recommendation based on weighted heterogeneous information network containing semantic linking. In: International conference on multimedia and expo, pp 31–36
2.
go back to reference Hamilton WL, Ying R, Leskovec J (2017) Inductive representation learning on large graphs. In: Conference and workshop on neural information processing systems Hamilton WL, Ying R, Leskovec J (2017) Inductive representation learning on large graphs. In: Conference and workshop on neural information processing systems
3.
go back to reference Perozzi B, Al-Rfou R, Skiena S (2014) DeepWalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, New York, USA, August, pp 701–710 Perozzi B, Al-Rfou R, Skiena S (2014) DeepWalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, New York, USA, August, pp 701–710
4.
go back to reference Grover A, Leskovec J (2016) Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, San Francisco, USA, pp 855–864 Grover A, Leskovec J (2016) Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, San Francisco, USA, pp 855–864
5.
go back to reference Tang J, Qu M, Wang M et al (2015) Line: large-scale information network embedding. In: Proceedings of the 24th international conference on World Wide Web, Florence, pp 1067–1077 Tang J, Qu M, Wang M et al (2015) Line: large-scale information network embedding. In: Proceedings of the 24th international conference on World Wide Web, Florence, pp 1067–1077
6.
go back to reference Bruna J, Zaremba W, Szlam A, Lecun Y (2014) Spectral networks and locally connected networks on graphs. In: International conference on learning representations Bruna J, Zaremba W, Szlam A, Lecun Y (2014) Spectral networks and locally connected networks on graphs. In: International conference on learning representations
7.
go back to reference Boscaini D, Masci J, Melzi S, Bronstein MM, Castellani U, Vandergheynst P (2015) Learning class-specific descriptors for deformable shapes using localized spectral convolutional networks. Comput Graph Forum 34:13–23CrossRef Boscaini D, Masci J, Melzi S, Bronstein MM, Castellani U, Vandergheynst P (2015) Learning class-specific descriptors for deformable shapes using localized spectral convolutional networks. Comput Graph Forum 34:13–23CrossRef
8.
go back to reference Defferrard M, Bresson X, Vandergheynst P (2016) Convolutional neural networks on graphs with fast localized spectral filtering. In: Advances in neural information processing systems, pp 3844–3852 Defferrard M, Bresson X, Vandergheynst P (2016) Convolutional neural networks on graphs with fast localized spectral filtering. In: Advances in neural information processing systems, pp 3844–3852
9.
go back to reference Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In International conference on learning representations Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In International conference on learning representations
10.
go back to reference Khasanova R, Frossard P (2017) Graph-based isometry invariant representation learning. In: International conference on machine learning, pp 1847–1856 Khasanova R, Frossard P (2017) Graph-based isometry invariant representation learning. In: International conference on machine learning, pp 1847–1856
11.
go back to reference Levie R, Monti F, Bresson X, Bronstein MM (2017) Cayleynets: graph convolutional neural networks with complex rational spectral fifilters. arXiv preprint. arXiv:1705.07664 Levie R, Monti F, Bresson X, Bronstein MM (2017) Cayleynets: graph convolutional neural networks with complex rational spectral fifilters. arXiv preprint. arXiv:​1705.​07664
12.
go back to reference Gao HY, Ji SW (2019) Graph u-nets. In: International conference on machine learning, pp 2083–2092 Gao HY, Ji SW (2019) Graph u-nets. In: International conference on machine learning, pp 2083–2092
13.
go back to reference Gao HY, Ji SW (2019) Graph representation learning via hard and channel-wise attention networks. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge, discovery and data mining, pp 741–749 Gao HY, Ji SW (2019) Graph representation learning via hard and channel-wise attention networks. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge, discovery and data mining, pp 741–749
14.
go back to reference Yuan H, Ji SW (2020) Structpool: structured graph pooling via conditional random fields. In: International Conference on Learning Representations, Addis Ababa, Ethiopia, April 26-30, 2020. Yuan H, Ji SW (2020) Structpool: structured graph pooling via conditional random fields. In: International Conference on Learning Representations, Addis Ababa, Ethiopia, April 26-30, 2020.
15.
go back to reference Zhang MH, Chen YX (2018) Link prediction based on graph neural networks. In: Advances in neural information processing systems, pp 5165–5175 Zhang MH, Chen YX (2018) Link prediction based on graph neural networks. In: Advances in neural information processing systems, pp 5165–5175
16.
go back to reference Zhang MH, Cui ZC, Neumann M, Chen YX (2018) An end-to-end deep learning architecture for graph classification. In: AAAI conference on artificial intelligence, pp 4438–4445 Zhang MH, Cui ZC, Neumann M, Chen YX (2018) An end-to-end deep learning architecture for graph classification. In: AAAI conference on artificial intelligence, pp 4438–4445
17.
go back to reference Ying ZT, You JX, Morris Christopher, Ren X, Hamilton W, Leskovec J (2018) Hierarchical graph representation learning with differentiable pooling. In: Advances in neural information processing systems, pp 4800–4810 Ying ZT, You JX, Morris Christopher, Ren X, Hamilton W, Leskovec J (2018) Hierarchical graph representation learning with differentiable pooling. In: Advances in neural information processing systems, pp 4800–4810
18.
go back to reference Gao HY, Wang ZY, Ji SW (2018) Large-scale learnable graph convolutional networks. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge, discovery and data mining, pp 1416–1424 Gao HY, Wang ZY, Ji SW (2018) Large-scale learnable graph convolutional networks. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge, discovery and data mining, pp 1416–1424
19.
go back to reference Lee J, Lee I, Kang J (2019) Self-attention graph pooling. In: International conference on machine learning, pp 3734–3743 Lee J, Lee I, Kang J (2019) Self-attention graph pooling. In: International conference on machine learning, pp 3734–3743
20.
go back to reference Xu BB, Shen HW, Cao Q, Qiu YQ, Cheng XQ (2019) Graph wavelet neural network. In: International conference on learning representations Xu BB, Shen HW, Cao Q, Qiu YQ, Cheng XQ (2019) Graph wavelet neural network. In: International conference on learning representations
21.
go back to reference Liang JQ, Gurukar S, Parthasarathy S. MILE: a multi-level framework for scalable graph embeddings refinement Liang JQ, Gurukar S, Parthasarathy S. MILE: a multi-level framework for scalable graph embeddings refinement
22.
go back to reference Hu FY, Zhu YQ, Wu S, Wang L, Tan TN (2019) Hierarchical graph convolutional networks for semi-supervised node classification. In: International joint conference on artificial intelligence, pp 4532–4539 Hu FY, Zhu YQ, Wu S, Wang L, Tan TN (2019) Hierarchical graph convolutional networks for semi-supervised node classification. In: International joint conference on artificial intelligence, pp 4532–4539
23.
go back to reference Wang X, Cui P, Wang J, Pei J, Zhu WW, and Yang SQ (2017) Community preserving network embedding. In: Association for the advancement of artificial intelligence conference Wang X, Cui P, Wang J, Pei J, Zhu WW, and Yang SQ (2017) Community preserving network embedding. In: Association for the advancement of artificial intelligence conference
24.
go back to reference Hu X (2017) Label informed attributed network embedding. In: Tenth ACM international conference on web search and data mining, pp 731–739 Hu X (2017) Label informed attributed network embedding. In: Tenth ACM international conference on web search and data mining, pp 731–739
25.
go back to reference Du L, Lu ZC, Wang Y, Song GJ, Wang YM, Chen W (2018) Galaxy network embedding: a hierarchical community structure preserving approach. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp 2079–2085 Du L, Lu ZC, Wang Y, Song GJ, Wang YM, Chen W (2018) Galaxy network embedding: a hierarchical community structure preserving approach. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp 2079–2085
26.
go back to reference Yu F, Koltun V (2016) Multi-scale context aggregation by dilation convolutions. In: International conference on learning representations Yu F, Koltun V (2016) Multi-scale context aggregation by dilation convolutions. In: International conference on learning representations
27.
go back to reference Zhang MH, Hu BB, Shi C, Wu B, Wang B (2018) Matrix factorization meets social network embedding for rating prediction. In: Proceedings of APWeb/WAIM, Macau, China, pp 121–129 Zhang MH, Hu BB, Shi C, Wu B, Wang B (2018) Matrix factorization meets social network embedding for rating prediction. In: Proceedings of APWeb/WAIM, Macau, China, pp 121–129
28.
go back to reference Qiu JZ, Dong YX, Ma H, Li J, Wang KS, Tang J (2018) Network embedding as matrix factorization: unifying DeepWalk, LINE, PTE, and node2vec. In: Proceedings of WSDM, Feb., Marina Del Rey, CA, USA, pp 459–467 Qiu JZ, Dong YX, Ma H, Li J, Wang KS, Tang J (2018) Network embedding as matrix factorization: unifying DeepWalk, LINE, PTE, and node2vec. In: Proceedings of WSDM, Feb., Marina Del Rey, CA, USA, pp 459–467
29.
go back to reference Tenenbaum JB, De Silva V, Langford CJ (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef Tenenbaum JB, De Silva V, Langford CJ (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef
30.
go back to reference Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
31.
go back to reference Song DJ, Meyer David A, Tao DC (2015) Top-k link recommendation in social networks. In: Proceedings of the 2015 IEEE international conference on data mining. IEEE Computer Society Washington, DC, USA, November 14–17, pp 389–398 Song DJ, Meyer David A, Tao DC (2015) Top-k link recommendation in social networks. In: Proceedings of the 2015 IEEE international conference on data mining. IEEE Computer Society Washington, DC, USA, November 14–17, pp 389–398
32.
go back to reference Zhang J, Dong YX, Wang Y, Tang J, Ding M (2019) ProNE: fast and scalable network representation, learning. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence Zhang J, Dong YX, Wang Y, Tang J, Ding M (2019) ProNE: fast and scalable network representation, learning. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence
33.
go back to reference Monti F, Boscaini D, Masci J, Rodola E, Svoboda J, Bronstein MM (2017) Geometric deep learning on graphs and manifolds using mixture model cnns. In: Proceedings of international conference on computer vision and pattern recognition, vol 1, p 3 Monti F, Boscaini D, Masci J, Rodola E, Svoboda J, Bronstein MM (2017) Geometric deep learning on graphs and manifolds using mixture model cnns. In: Proceedings of international conference on computer vision and pattern recognition, vol 1, p 3
34.
go back to reference Hamilton W, Ying ZT, Leskovec J (2017) Inductive representation learning on large graphs. In: Advances in neural information processing systems, pp 1024–1034 Hamilton W, Ying ZT, Leskovec J (2017) Inductive representation learning on large graphs. In: Advances in neural information processing systems, pp 1024–1034
35.
go back to reference Velickovic P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y (2018) Graph attention networks. In: International conference on machine learning Velickovic P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y (2018) Graph attention networks. In: International conference on machine learning
36.
37.
go back to reference Ding M, Tang J, Zhang J (2018) Semi-supervised learning on graphs with generative adversarial nets. In: Proceedings of the 27th ACM international conference on information and knowledge management. ACM, pp 913–922 Ding M, Tang J, Zhang J (2018) Semi-supervised learning on graphs with generative adversarial nets. In: Proceedings of the 27th ACM international conference on information and knowledge management. ACM, pp 913–922
38.
go back to reference Wu S, Tang YY, Zhu Y. Q, Wang L, Xie X, Tan TN (2019) Session-based recommendation with graph neural networks. In: AAAI conference on artificial intelligence Wu S, Tang YY, Zhu Y. Q, Wang L, Xie X, Tan TN (2019) Session-based recommendation with graph neural networks. In: AAAI conference on artificial intelligence
39.
go back to reference Yang Z, Cohen W, Salakhutdinov R (2016) Revisiting semi-supervised learning with graph embeddings. In: International conference on machine learning, New York, pp 40–48 Yang Z, Cohen W, Salakhutdinov R (2016) Revisiting semi-supervised learning with graph embeddings. In: International conference on machine learning, New York, pp 40–48
40.
go back to reference Zhuang CY, Ma Q (2018) Dual graph convolutional networks for graph-based semi-supervised classification. In: International World Wide Web conference Zhuang CY, Ma Q (2018) Dual graph convolutional networks for graph-based semi-supervised classification. In: International World Wide Web conference
41.
go back to reference Chen HC, Perozzi B, Hu YF, Skiena S (2018) HARP: hierarchical representation learning for networks. In: AAAI conference on artificial intelligence, New Orleans, Riverside, USA, Feb, pp 2127–2134 Chen HC, Perozzi B, Hu YF, Skiena S (2018) HARP: hierarchical representation learning for networks. In: AAAI conference on artificial intelligence, New Orleans, Riverside, USA, Feb, pp 2127–2134
42.
go back to reference Fu GJ, Hou CB, Yao X (2019) Learning Topologiacal representation for networks via hierarchical sampling. arXiv:1902.06684 [cs.SI], originally announced Feb., to be published Fu GJ, Hou CB, Yao X (2019) Learning Topologiacal representation for networks via hierarchical sampling. arXiv:​1902.​06684 [cs.SI], originally announced Feb., to be published
43.
go back to reference Xin ZH, Chen J, Cheng GL, Zhao S (2019) Marc: multi-granular representation learning for networks based on the 3-clique. IEEE Access 7(1):141715–141727CrossRef Xin ZH, Chen J, Cheng GL, Zhao S (2019) Marc: multi-granular representation learning for networks based on the 3-clique. IEEE Access 7(1):141715–141727CrossRef
44.
go back to reference Deng C, Zhao Z, Wang Y, Zhang Z, Feng Z (2020) GraphZoom: a multi-level spectral approach for accurate and scalable graph embedding. In: International conference on learning representations Deng C, Zhao Z, Wang Y, Zhang Z, Feng Z (2020) GraphZoom: a multi-level spectral approach for accurate and scalable graph embedding. In: International conference on learning representations
46.
go back to reference Tang J, Zhang J, Yao L, Li J, Su Z (2008) ArnetMiner: extraction and mining of academic social networks. In: Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining, August 24, pp 990–999 Tang J, Zhang J, Yao L, Li J, Su Z (2008) ArnetMiner: extraction and mining of academic social networks. In: Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining, August 24, pp 990–999
47.
go back to reference He XN, Deng K, Wang X, Li Y, Zhang YD, Wang M (2020) LightGCN: simplifying and powering graph convolution network for recommendation. In: International conference on research and development in information retrieval He XN, Deng K, Wang X, Li Y, Zhang YD, Wang M (2020) LightGCN: simplifying and powering graph convolution network for recommendation. In: International conference on research and development in information retrieval
48.
go back to reference McCallum A, Freitag D, Pereira FCN (2000) Maximum entropy markov models for information extraction and segmentation, In: International conference on machine learning, vol. 17 McCallum A, Freitag D, Pereira FCN (2000) Maximum entropy markov models for information extraction and segmentation, In: International conference on machine learning, vol. 17
49.
go back to reference Li QM, Han ZC, Wu XM (2018) Deeper insights into graph convolutional networks for semisupervised learning. In: AAAI conference on artificial intelligence, pp 3538–3545 Li QM, Han ZC, Wu XM (2018) Deeper insights into graph convolutional networks for semisupervised learning. In: AAAI conference on artificial intelligence, pp 3538–3545
50.
go back to reference Li YX, Chai Y, Yin HP, Chen B (2020) A novel feature learning framework for high-dimensional data classification. Int J Mach Learn Cybern 2020(7):1–15 Li YX, Chai Y, Yin HP, Chen B (2020) A novel feature learning framework for high-dimensional data classification. Int J Mach Learn Cybern 2020(7):1–15
Metadata
Title
MGPOOL: multi-granular graph pooling convolutional networks representation learning
Authors
Zhenghua Xin
Guolong Chen
Jie Chen
Shu Zhao
Zongchao Wang
Aidong Fang
Zhenggao Pan
Lin Cui
Publication date
04-05-2021
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 3/2022
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-021-01328-2

Other articles of this Issue 3/2022

International Journal of Machine Learning and Cybernetics 3/2022 Go to the issue