Skip to main content
Erschienen in: Neural Processing Letters 4/2022

13.03.2021

Semi-supervised Learning with Graph Convolutional Networks Based on Hypergraph

verfasst von: Yangding Li, Yingying Wan, Xingyi Liu

Erschienen in: Neural Processing Letters | Ausgabe 4/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Graph convolutional networks (GCNs), which rely on graph structures to aggregate information of neighbors to output robust node embeddings, have been becoming a popular model for semi-supervised classification tasks. However, most existing GCNs ignore the importance of the quality of graph structures, therefore output suboptimal classification performance. In this paper, we propose a new graph learning method to output a high-quality graph structure, aiming at eventually improving classification performance for the downstream GCN model (HS-GCN). Specifically, the proposed graph learning method employs an adaptive graph learning to capture the intrinsic low-level correlation of data, and learns the more useful high-level correlation from a hypergraph. Besides, sparse learning and a low-rank constraint are integrated with graph learning respectively to remove redundant information, and to obtain a compact graph structure for promoting information aggregation of GCNs. The experimental results show that the graph structure of our proposed graph learning method can significantly improve the classification performance of GCNs.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Atwood J, Towsley D (2016) Diffusion-convolutional neural networks. In: Advances in neural information processing systems, pp 1993–2001 Atwood J, Towsley D (2016) Diffusion-convolutional neural networks. In: Advances in neural information processing systems, pp 1993–2001
2.
Zurück zum Zitat Belkin M, Niyogi P (2003) Laplacian Eigenmaps for dimensionality reduction and data representation. Neural Comput 15:1373–1396CrossRef Belkin M, Niyogi P (2003) Laplacian Eigenmaps for dimensionality reduction and data representation. Neural Comput 15:1373–1396CrossRef
3.
Zurück zum Zitat Cheng X, Zhu Y, Song J, Wen G, He W (2017) A novel low-rank hypergraph feature selection for multi-view classification. Neurocomputing 253:115–121CrossRef Cheng X, Zhu Y, Song J, Wen G, He W (2017) A novel low-rank hypergraph feature selection for multi-view classification. Neurocomputing 253:115–121CrossRef
4.
Zurück zum Zitat Fan K (1949) On a theorem of Weyl concerning Eigenvalues of linear transformations I. Proc Natl Acad Sci U S Am 35(11):652MathSciNetCrossRef Fan K (1949) On a theorem of Weyl concerning Eigenvalues of linear transformations I. Proc Natl Acad Sci U S Am 35(11):652MathSciNetCrossRef
5.
Zurück zum Zitat Fu S, Weifeng L, Yicong Z, Liqiang N (2019) HpLapGCN: hypergraph p-Laplacian graph convolutional networks. Neurocomputing 362:166–174CrossRef Fu S, Weifeng L, Yicong Z, Liqiang N (2019) HpLapGCN: hypergraph p-Laplacian graph convolutional networks. Neurocomputing 362:166–174CrossRef
6.
Zurück zum Zitat Gao X, Hu W, Guo Z (2020) Exploring structure-adaptive graph learning for robust semi-supervised classification. In: 2020 IEEE international conference on multimedia and expo. IEEE, pp 1–6 Gao X, Hu W, Guo Z (2020) Exploring structure-adaptive graph learning for robust semi-supervised classification. In: 2020 IEEE international conference on multimedia and expo. IEEE, pp 1–6
7.
Zurück zum Zitat Grover A, Leskovec J (2016) node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 855–864 Grover A, Leskovec J (2016) node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 855–864
8.
Zurück zum Zitat Guo Y, Zhengwang W, Shen D (2020) Learning longitudinal classification-regression model for infant hippocampus segmentation. Neurocomputing 391:191–198CrossRef Guo Y, Zhengwang W, Shen D (2020) Learning longitudinal classification-regression model for infant hippocampus segmentation. Neurocomputing 391:191–198CrossRef
9.
Zurück zum Zitat Hao S, Zhou Y, Guo Y (2020) A brief survey on semantic segmentation with deep learning. Neurocomputing 406:302–321CrossRef Hao S, Zhou Y, Guo Y (2020) A brief survey on semantic segmentation with deep learning. Neurocomputing 406:302–321CrossRef
10.
Zurück zum Zitat Hu R, Xiaofeng Z, Yonghua Z, Jiangzhang G (2020) Robust SVM with adaptive graph learning. World Wide Web 23(3):1945–1968CrossRef Hu R, Xiaofeng Z, Yonghua Z, Jiangzhang G (2020) Robust SVM with adaptive graph learning. World Wide Web 23(3):1945–1968CrossRef
11.
Zurück zum Zitat Hu Z, Feiping N, Wei C, Shuzheng H, Rong W, Xuelong L (2020) Multi-view spectral clustering via sparse graph learning. Neurocomputing 384:1–10CrossRef Hu Z, Feiping N, Wei C, Shuzheng H, Rong W, Xuelong L (2020) Multi-view spectral clustering via sparse graph learning. Neurocomputing 384:1–10CrossRef
12.
Zurück zum Zitat Jiang B, Zhang Z, Lin D, Tang J, Luo B (2019) Semi-supervised learning with graph learning-convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 11313–11320 Jiang B, Zhang Z, Lin D, Tang J, Luo B (2019) Semi-supervised learning with graph learning-convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 11313–11320
13.
Zurück zum Zitat Kang Z, Pan H, Hoi SCH, Xu Z (2019) Robust graph learning from noisy data. IEEE Trans Cybern 50(5):1833–1843CrossRef Kang Z, Pan H, Hoi SCH, Xu Z (2019) Robust graph learning from noisy data. IEEE Trans Cybern 50(5):1833–1843CrossRef
14.
Zurück zum Zitat Kingma DP, Adam JB (2015) A method for stochastic optimization. In: International conference on learning representations Kingma DP, Adam JB (2015) A method for stochastic optimization. In: International conference on learning representations
15.
Zurück zum Zitat Kipf T, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: International conference on learning representations Kipf T, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: International conference on learning representations
16.
Zurück zum Zitat Li Y, Zhang S, Cheng D, He W, Wen G, Xie Q (2017) Spectral clustering based on hypergraph and self-re-presentation. Multimed Tools Appl 76(16):17559–17576CrossRef Li Y, Zhang S, Cheng D, He W, Wen G, Xie Q (2017) Spectral clustering based on hypergraph and self-re-presentation. Multimed Tools Appl 76(16):17559–17576CrossRef
17.
Zurück zum Zitat Nie F, Wang X, Jordan MI, Huang H (2016) The constrained Laplacian rank algorithm for graph-based clustering. In: Thirtieth AAAI conference on artificial intelligence Nie F, Wang X, Jordan MI, Huang H (2016) The constrained Laplacian rank algorithm for graph-based clustering. In: Thirtieth AAAI conference on artificial intelligence
18.
Zurück zum Zitat Nie F, Wei Z, Li X (2016) Unsupervised feature selection with structured graph optimization. In: Thirtieth AAAI conference on artificial intelligence Nie F, Wei Z, Li X (2016) Unsupervised feature selection with structured graph optimization. In: Thirtieth AAAI conference on artificial intelligence
19.
Zurück zum Zitat Niepert M, Ahmed M, Kutzkov K (2016) Learning convolutional neural networks for graphs. In: International conference on machine learning, pp 2014–2023 Niepert M, Ahmed M, Kutzkov K (2016) Learning convolutional neural networks for graphs. In: International conference on machine learning, pp 2014–2023
20.
21.
Zurück zum Zitat Qian X, Huang H, Chen X, Huang T (2017) Efficient construction of sparse radial basis function neural networks using l1-regularization. Neural Netw 94:239–254CrossRef Qian X, Huang H, Chen X, Huang T (2017) Efficient construction of sparse radial basis function neural networks using l1-regularization. Neural Netw 94:239–254CrossRef
23.
Zurück zum Zitat Shen HT, Zhu X, Zhang Z, Wang SH, Chen Y, Xu X, Shao J (2021) Heterogeneous data fusion for predicting mild cognitive impairment conversion. Inf Fusion 66:54–63CrossRef Shen HT, Zhu X, Zhang Z, Wang SH, Chen Y, Xu X, Shao J (2021) Heterogeneous data fusion for predicting mild cognitive impairment conversion. Inf Fusion 66:54–63CrossRef
25.
Zurück zum Zitat van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9:2579–2605MATH van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9:2579–2605MATH
27.
Zurück zum Zitat Wan Y, Zhan M, Li Y (2021) Adaptive graph learning for semi-supervised classification of GCNS. In: Australasian database conference Wan Y, Zhan M, Li Y (2021) Adaptive graph learning for semi-supervised classification of GCNS. In: Australasian database conference
28.
Zurück zum Zitat Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 1225–1234 Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 1225–1234
29.
Zurück zum Zitat Yadati N, Nimishakavi M, Yadav P, Louis A, Talukdar P (2018) Hypergcn: Hypergraph convolutional networks for semi-supervised classification. arXiv:1809.02589 Yadati N, Nimishakavi M, Yadav P, Louis A, Talukdar P (2018) Hypergcn: Hypergraph convolutional networks for semi-supervised classification. arXiv:​1809.​02589
30.
Zurück zum Zitat Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: 13th European conference on computer vision. Springer, pp 818–833 Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: 13th European conference on computer vision. Springer, pp 818–833
31.
Zurück zum Zitat Zhang S, Li X, Zong M, Zhu X, Cheng D (2017) Learning k for kNN classification. ACM Trans Intell Syst Technol 8(3):1–19 Zhang S, Li X, Zong M, Zhu X, Cheng D (2017) Learning k for kNN classification. ACM Trans Intell Syst Technol 8(3):1–19
32.
Zurück zum Zitat Zhao Z, Liu H (2007) Spectral feature selection for supervised and unsupervised learning. In: Proceedings of the 24th international conference on machine learning, pp 1151–1157 Zhao Z, Liu H (2007) Spectral feature selection for supervised and unsupervised learning. In: Proceedings of the 24th international conference on machine learning, pp 1151–1157
33.
Zurück zum Zitat Zhou D, Huang J, Schölkopf B (2007) Learning with hypergraphs: clustering, classification, and embedding. In: Advances in neural information processing systems, pp 1601–1608 Zhou D, Huang J, Schölkopf B (2007) Learning with hypergraphs: clustering, classification, and embedding. In: Advances in neural information processing systems, pp 1601–1608
34.
Zurück zum Zitat Zhou Y, Tian L, Zhu C, Jin X, Sun Y (2019) Video coding optimization for virtual reality 360-degree source. IEEE J Sel Top Signal Process 14(1):118–129CrossRef Zhou Y, Tian L, Zhu C, Jin X, Sun Y (2019) Video coding optimization for virtual reality 360-degree source. IEEE J Sel Top Signal Process 14(1):118–129CrossRef
35.
Zurück zum Zitat Zhu X, Gan J, Guangquan L, Li J, Zhang S (2020) Spectral clustering via half-quadratic optimization. World Wide Web 23(3):1969–1988CrossRef Zhu X, Gan J, Guangquan L, Li J, Zhang S (2020) Spectral clustering via half-quadratic optimization. World Wide Web 23(3):1969–1988CrossRef
Metadaten
Titel
Semi-supervised Learning with Graph Convolutional Networks Based on Hypergraph
verfasst von
Yangding Li
Yingying Wan
Xingyi Liu
Publikationsdatum
13.03.2021
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 4/2022
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10487-w

Weitere Artikel der Ausgabe 4/2022

Neural Processing Letters 4/2022 Zur Ausgabe

Neuer Inhalt