Skip to main content

2021 | OriginalPaper | Buchkapitel

Boosted Personalized Page Rank Propagation for Graph Neural Prediction

verfasst von : Wenwen Xia, Fucai Luo

Erschienen in: Communications, Signal Processing, and Systems

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Graph neural networks have recently achieved impressive success on many graph learning problems, including semi-supervised graph node classification. Previous message-passing algorithms are confronted with the dilemma of aggregating more neighbor’s information and avoiding over-smoothed node representations. The recently proposed personalized page rank propagation scheme separates the node prediction and information propagation into independent stages and achieves state-of-the-art performance on public datasets. However, the personalized page rank propagation scheme results in a computationally effective computation graph in model training. In this paper, we propose a boosted personalized page rank propagation scheme to reduce the model complexity and computational cost. The proposed algorithm is based on the principle of compressing multiple iterations in personalized page rank propagation into a one-step operation to simplifying the computation graph. Experiments on three public datasets reveal that the proposed algorithm reduces more than 50% training time, especially when the iteration number increases, without sacrificing the model’s prediction accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Mislove A, Koppula HS, Gummadi KP, Druschel P, Bhattacharjee B (2008) Growth of the Flickr social network. In: Proceedings of the first workshop on online social networks, pp 25–30 Mislove A, Koppula HS, Gummadi KP, Druschel P, Bhattacharjee B (2008) Growth of the Flickr social network. In: Proceedings of the first workshop on online social networks, pp 25–30
2.
Zurück zum Zitat Tang J, Zhang J, Yao L, Li J, Zhang L, Su Z (2008) Arnetminer: extraction and mining of academic social networks. In: Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 990–998 Tang J, Zhang J, Yao L, Li J, Zhang L, Su Z (2008) Arnetminer: extraction and mining of academic social networks. In: Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 990–998
3.
Zurück zum Zitat Duvenaud DK, Maclaurin D, Iparraguirre J, Bombarell R, Hirzel T, Aspuru-Guzik A, Adams RP (2015) Convolutional networks on graphs for learning molecular fingerprints. In: Advances in neural information processing systems, pp 2224–2232 Duvenaud DK, Maclaurin D, Iparraguirre J, Bombarell R, Hirzel T, Aspuru-Guzik A, Adams RP (2015) Convolutional networks on graphs for learning molecular fingerprints. In: Advances in neural information processing systems, pp 2224–2232
4.
Zurück zum Zitat Grover A, Leskovec J (2016) Node2vec: Scalable feature learning for networks. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining, vol 13–17-Aug, pp 855–864 Grover A, Leskovec J (2016) Node2vec: Scalable feature learning for networks. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining, vol 13–17-Aug, pp 855–864
5.
Zurück zum Zitat Zhang M, Chen Y (2018) Link prediction based on graph neural networks. In: Advances in neural information processing systems, vol 31, pp 5165–5175 Zhang M, Chen Y (2018) Link prediction based on graph neural networks. In: Advances in neural information processing systems, vol 31, pp 5165–5175
6.
Zurück zum Zitat Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutionalnetworks. In: 5th international conference on learning representations, pp 1–14 Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutionalnetworks. In: 5th international conference on learning representations, pp 1–14
7.
Zurück zum Zitat Johnson DK, Karanicolas J (2016) Ultra-high-throughput structure-based virtual screening for small-molecule inhibitors of protein–protein interactions. J Chem Inf Model 56(2):399–411 Johnson DK, Karanicolas J (2016) Ultra-high-throughput structure-based virtual screening for small-molecule inhibitors of protein–protein interactions. J Chem Inf Model 56(2):399–411
8.
Zurück zum Zitat Veličković P, Casanova A, Liò P, Cucurull G, Romero A, Bengio Y (2018) Graph attention networks. In: 6th International Conference on Learning Representations, pp 1–12 Veličković P, Casanova A, Liò P, Cucurull G, Romero A, Bengio Y (2018) Graph attention networks. In: 6th International Conference on Learning Representations, pp 1–12
9.
Zurück zum Zitat Hamilton W, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. In: Advances in neural information processing systems, pp 1024–1034 Hamilton W, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. In: Advances in neural information processing systems, pp 1024–1034
10.
Zurück zum Zitat Li Q, Han Z, Wu X-M (2018) Deeper insights into graph convolutional networks for semi-supervised learning. In: Thirty-Second AAAI conference on artificial intelligence Li Q, Han Z, Wu X-M (2018) Deeper insights into graph convolutional networks for semi-supervised learning. In: Thirty-Second AAAI conference on artificial intelligence
11.
Zurück zum Zitat Xu K, Li C, Tian Y, Sonobe T, Kawarabayashi K, Jegelka S (2018) Representation learning on graphs with jumping knowledge networks. arXiv preprint arXiv:1806.03536 Xu K, Li C, Tian Y, Sonobe T, Kawarabayashi K, Jegelka S (2018) Representation learning on graphs with jumping knowledge networks. arXiv preprint arXiv:​1806.​03536
12.
Zurück zum Zitat Klicpera J, Bojchevski A, Günnemann S (2018) Predict then propagate: graph neural networks meet personalized pagerank. arXiv preprint arXiv:1810.05997 Klicpera J, Bojchevski A, Günnemann S (2018) Predict then propagate: graph neural networks meet personalized pagerank. arXiv preprint arXiv:​1810.​05997
13.
Zurück zum Zitat Page L, Brin S, Motwani R, Winograd T (1999) The pagerank citation ranking: bringing order to the web. Tech, Rep, Stanford InfoLab Page L, Brin S, Motwani R, Winograd T (1999) The pagerank citation ranking: bringing order to the web. Tech, Rep, Stanford InfoLab
14.
Zurück zum Zitat McCallum AK, Nigam K, Rennie J, Seymore K (2000) Automating the construction of internet portals with machine learning. Inf Retrieval 3(2):127–163CrossRef McCallum AK, Nigam K, Rennie J, Seymore K (2000) Automating the construction of internet portals with machine learning. Inf Retrieval 3(2):127–163CrossRef
15.
Zurück zum Zitat Sen P, Namata G, Bilgic M, Getoor L, Galligher B, Eliassi-Rad T (2008) Collective classification in network data. AI Magazine 29(3):93CrossRef Sen P, Namata G, Bilgic M, Getoor L, Galligher B, Eliassi-Rad T (2008) Collective classification in network data. AI Magazine 29(3):93CrossRef
16.
Zurück zum Zitat Namata G, London B, Getoor L, Huang B, Edu (UMD) Query-driven active surveying for collective classification. In: 10th international workshop on mining and learning with graphs, vol 8 Namata G, London B, Getoor L, Huang B, Edu (UMD) Query-driven active surveying for collective classification. In: 10th international workshop on mining and learning with graphs, vol 8
Metadaten
Titel
Boosted Personalized Page Rank Propagation for Graph Neural Prediction
verfasst von
Wenwen Xia
Fucai Luo
Copyright-Jahr
2021
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-8411-4_148

Neuer Inhalt