Skip to main content
Top

2023 | OriginalPaper | Chapter

A Graph Contrastive Learning Framework with Adaptive Augmentation and Encoding for Unaligned Views

Authors : Yifu Guo, Yong Liu

Published in: Advances in Knowledge Discovery and Data Mining

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recently, graph contrastive learning has emerged as a successful method for graph representation learning, but it still faces three challenging problems. First, existing contrastive methods cannot preserve the semantics of the graph well after view augmentation. Second, most models use the same encoding method to encode homophilic and heterophilic graphs, failing to obtain better-quality representations. Finally, most models require that the two augmented views have the same set of nodes, which limits flexible augmentation methods. To address the above problems, we propose a novel graph contrastive learning framework with adaptive augmentation and encoding for unaligned views, called GCAUV in this paper. First, we propose multiple node centrality metrics to compute edge centrality for view augmentation, adaptively removing edges with low centrality to preserve the semantics of the graph well. Second, we use a multi-headed graph attention network to encode homophilic graphs, and use MLP to encode heterophilic graphs. Finally, we propose g-EMD distance instead of cosine similarity to measure the distance between positive and negative samples. We also perform adversarial training by adding perturbation to node features to improve the accuracy of GCAUV. Experimental results show that our method outperforms the state-of-the-art graph contrastive methods on node classification tasks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bryan Perozzi, R.A.R., Skiena, S.: DeepWalk: Online learning of social representations. In: Proceedings of KDD, pp. 701–710 (2014) Bryan Perozzi, R.A.R., Skiena, S.: DeepWalk: Online learning of social representations. In: Proceedings of KDD, pp. 701–710 (2014)
3.
go back to reference Grover, A., Leskovec, J.: node2vec: Scalable feature learning for networks. In: Proceedings of KDD, pp. 855–864 (2016) Grover, A., Leskovec, J.: node2vec: Scalable feature learning for networks. In: Proceedings of KDD, pp. 855–864 (2016)
4.
go back to reference Hassani, K., Ahmadi, A.H.K.: Contrastive multi-view representation learning on graphs. In: Proceedings of ICML, pp. 4116–4126 (2020) Hassani, K., Ahmadi, A.H.K.: Contrastive multi-view representation learning on graphs. In: Proceedings of ICML, pp. 4116–4126 (2020)
5.
go back to reference Jiao, Y., Xiong, Y., Zhang, J., Zhang, Y., Zhang, T.: Sub-graph contrast for scalable self-supervised graph representation learning. In: Proceedings of ICDM (2020) Jiao, Y., Xiong, Y., Zhang, J., Zhang, Y., Zhang, T.: Sub-graph contrast for scalable self-supervised graph representation learning. In: Proceedings of ICDM (2020)
7.
go back to reference Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: Proceedings of ICLR (2017) Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: Proceedings of ICLR (2017)
8.
go back to reference Kong, K., Li, G., Ding, M., Wu, Z., Zhu, C.: Robust optimization as data augmentation for large-scale graphs. arXiv e-prints arXiv:2010.09891 (2020) Kong, K., Li, G., Ding, M., Wu, Z., Zhu, C.: Robust optimization as data augmentation for large-scale graphs. arXiv e-prints arXiv:​2010.​09891 (2020)
9.
go back to reference Liu, M., Liu, Y.: Inductive representation learning in temporal networks via mining neighborhood and community influences. In: Proceedings of SIGIR (2022) Liu, M., Liu, Y.: Inductive representation learning in temporal networks via mining neighborhood and community influences. In: Proceedings of SIGIR (2022)
10.
go back to reference Liu, M., Quan, Z.W., Wu, J.M., Liu, Y., Han, M.: Embedding temporal networks inductively via mining neighborhood and community influences. In: Applied Intelligence 52 (2022) Liu, M., Quan, Z.W., Wu, J.M., Liu, Y., Han, M.: Embedding temporal networks inductively via mining neighborhood and community influences. In: Applied Intelligence 52 (2022)
11.
go back to reference Pei, H., Wei, B., Chang, K.C.-C., Lei, Y., Yang, B.: Geom-GCN: geometric graph convolutional networks. arXiv e-prints arXiv:2002.05287 (2020) Pei, H., Wei, B., Chang, K.C.-C., Lei, Y., Yang, B.: Geom-GCN: geometric graph convolutional networks. arXiv e-prints arXiv:​2002.​05287 (2020)
12.
go back to reference Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., Bengio, Y.: Graph attention networks. In: Proceedings of ICLR (2018) Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., Bengio, Y.: Graph attention networks. In: Proceedings of ICLR (2018)
13.
go back to reference Thakoor, S., Tallec, C., Azar, M.G., Munos, R., Veličković, P., Valko, M.: Bootstrapped representation learning on graphs. In: Proceedings of ICLR (2021) Thakoor, S., Tallec, C., Azar, M.G., Munos, R., Veličković, P., Valko, M.: Bootstrapped representation learning on graphs. In: Proceedings of ICLR (2021)
14.
go back to reference Velickovic, P., Fedus, W., Hamilton, W.L., Liò, P., Bengio, Y., Hjelm, R.D.: Deep graph infomax. In: Proceedings of ICLR (2019) Velickovic, P., Fedus, W., Hamilton, W.L., Liò, P., Bengio, Y., Hjelm, R.D.: Deep graph infomax. In: Proceedings of ICLR (2019)
15.
go back to reference Wang, H., Zhang, J., Zhu, Q., Huang, W.: Augmentation-free graph contrastive learning with performance guarantee. arXiv e-prints arXiv:2204.04874 (2022) Wang, H., Zhang, J., Zhu, Q., Huang, W.: Augmentation-free graph contrastive learning with performance guarantee. arXiv e-prints arXiv:​2204.​04874 (2022)
16.
go back to reference Xia, J., Wu, L., Chen, J., Hu, B., Li, S.Z.: SimGRACE: a simple framework for graph contrastive learning without data augmentation. In: Proceedings of WWW (2022) Xia, J., Wu, L., Chen, J., Hu, B., Li, S.Z.: SimGRACE: a simple framework for graph contrastive learning without data augmentation. In: Proceedings of WWW (2022)
17.
go back to reference You, Y., Chen, T., Wang, Z., Shen, Y.: Graph contrastive learning with augmentations. In: Proceedings of NIPS, pp. 5812–5823 (2020) You, Y., Chen, T., Wang, Z., Shen, Y.: Graph contrastive learning with augmentations. In: Proceedings of NIPS, pp. 5812–5823 (2020)
18.
go back to reference Zhu, Y., Xu, Y., Yu, F., Liu, Q., Wu, S., Wang, L.: Deep graph contrastive representation learning. In: Proceedings of ICML (2020) Zhu, Y., Xu, Y., Yu, F., Liu, Q., Wu, S., Wang, L.: Deep graph contrastive representation learning. In: Proceedings of ICML (2020)
19.
go back to reference Zhu, Y., Xu, Y., Yu, F., Liu, Q., Wu, S., Wang, L.: Graph contrastive learning with adaptive augmentation. In: Proceedings of WWW, pp. 2069–2080 (2021) Zhu, Y., Xu, Y., Yu, F., Liu, Q., Wu, S., Wang, L.: Graph contrastive learning with adaptive augmentation. In: Proceedings of WWW, pp. 2069–2080 (2021)
20.
go back to reference Zhu, Y., Guo, J., Wu, F.: Rosa: a robust self-aligned framework for node-node graph contrastive learning. In: Proceedings of IJCAI, pp. 3795–3801 (2022) Zhu, Y., Guo, J., Wu, F.: Rosa: a robust self-aligned framework for node-node graph contrastive learning. In: Proceedings of IJCAI, pp. 3795–3801 (2022)
Metadata
Title
A Graph Contrastive Learning Framework with Adaptive Augmentation and Encoding for Unaligned Views
Authors
Yifu Guo
Yong Liu
Copyright Year
2023
DOI
https://doi.org/10.1007/978-3-031-33377-4_8

Premium Partner