Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 6/2023

05.01.2023 | Original Article

Context-sensitive graph representation learning

verfasst von: Jisheng Qin, Xiaoqin Zeng, Shengli Wu, Yang Zou

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 6/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Graph representation learning, which maps high-dimensional graphs or sparse graphs into a low-dimensional vector space, has shown its superiority in numerous learning tasks. Recently, researchers have identified some advantages of context-sensitive graph representation learning methods in functions such as link predictions and ranking recommendations. However, most existing methods depend on convolutional neural networks or recursive neural networks to obtain additional information outside a node, or require community algorithms to extract multiple contexts of a node, or focus only on the local neighboring nodes without their structural information. In this paper, we propose a novel context-sensitive representation method, Context-Sensitive Graph Representation Learning (CSGRL), which simultaneously combines attention networks and a variant of graph auto-encoder to learn weighty information about various aspects of participating neighboring nodes. The core of CSGRL is to utilize an asymmetric graph encoder to aggregate information about neighboring nodes and local structures to optimize the learning goal. The main benefit of CSGRL is that it does not need additional features and multiple contexts for the node. The message of neighboring nodes and their structures spread through the encoder. Experiments are conducted on three real datasets for both tasks of link prediction and node clustering, and the results demonstrate that CSGRL can significantly improve the effectiveness of all challenging learning tasks compared with 14 state-of-the-art baselines.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Abu-El-Haija S, Perozzi B, Al-Rfou R et al. (2017) Watch your step: learning graph embeddings through attention. arXiv preprint arXiv: 1710.09599 Abu-El-Haija S, Perozzi B, Al-Rfou R et al. (2017) Watch your step: learning graph embeddings through attention. arXiv preprint arXiv:​ 1710.​09599
2.
Zurück zum Zitat Caron M, Bojanowski P, Joulin A et al (2018) Deep clustering for unsupervised learning of visual features. In: Proceedings of the European Conference on Computer Vision (ECCV). pp: 132–149 Caron M, Bojanowski P, Joulin A et al (2018) Deep clustering for unsupervised learning of visual features. In: Proceedings of the European Conference on Computer Vision (ECCV). pp: 132–149
3.
Zurück zum Zitat Chen L, Guan Z, Xu Q et al (2020) Question-driven purchasing propensity analysis for recommendation. Proc AAAI Conf Artif Intell 34(01): 35–42 Chen L, Guan Z, Xu Q et al (2020) Question-driven purchasing propensity analysis for recommendation. Proc AAAI Conf Artif Intell 34(01): 35–42
4.
Zurück zum Zitat Epasto A, Perozzi B (2019) Is a single embedding enough? Learning node representations that capture multiple social contexts. In: The World Wide Web Conference, pp 394–404 Epasto A, Perozzi B (2019) Is a single embedding enough? Learning node representations that capture multiple social contexts. In: The World Wide Web Conference, pp 394–404
5.
Zurück zum Zitat Gracious T, Dukkipati A (2020) Adversarial context aware network embeddings for textual networks. arXiv preprint arXiv:2011.02665 Gracious T, Dukkipati A (2020) Adversarial context aware network embeddings for textual networks. arXiv preprint arXiv:​2011.​02665
6.
Zurück zum Zitat Grover A, Leskovec J (2016) node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pp 855–864 Grover A, Leskovec J (2016) node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pp 855–864
7.
Zurück zum Zitat Grover A, Zweig A, Ermon S (2019) Graphite: iterative generative modeling of graphs. In: International conference on machine learning. PMLR, 2434–2444 Grover A, Zweig A, Ermon S (2019) Graphite: iterative generative modeling of graphs. In: International conference on machine learning. PMLR, 2434–2444
8.
Zurück zum Zitat Haghani S, Keyvanpour MR (2019) A systemic analysis of link prediction in social network. Artif Intell Rev 52(3):1961–1995CrossRef Haghani S, Keyvanpour MR (2019) A systemic analysis of link prediction in social network. Artif Intell Rev 52(3):1961–1995CrossRef
9.
Zurück zum Zitat Hasanzadeh A, Hajiramezanali E, Duffield N et al. (2019) Semi-implicit graph variational auto-encoders. arXiv preprint arXiv:1908.07078 Hasanzadeh A, Hajiramezanali E, Duffield N et al. (2019) Semi-implicit graph variational auto-encoders. arXiv preprint arXiv:​1908.​07078
10.
12.
Zurück zum Zitat Kefato Z, Girdzijauskas S (2020) Gossip and attend: context-sensitive graph representation learning. In: Proceedings of the International AAAI Conference on Web and Social Media, pp: 351–359 Kefato Z, Girdzijauskas S (2020) Gossip and attend: context-sensitive graph representation learning. In: Proceedings of the International AAAI Conference on Web and Social Media, pp: 351–359
13.
Zurück zum Zitat Kefato ZT, Sheikh N, Montresor A (2017) Mineral: multi-modal network representation learning. In: International Workshop on Machine Learning, Optimization, and Big Data, pp 286–298 Kefato ZT, Sheikh N, Montresor A (2017) Mineral: multi-modal network representation learning. In: International Workshop on Machine Learning, Optimization, and Big Data, pp 286–298
16.
17.
Zurück zum Zitat Leskovec J, Kleinberg J, Faloutsos C (2007) Graph evolution: densification and shrinking diameters. ACM Trans Knowl Discov Data (TKDD) 1(1):2–es Leskovec J, Kleinberg J, Faloutsos C (2007) Graph evolution: densification and shrinking diameters. ACM Trans Knowl Discov Data (TKDD) 1(1):2–es
18.
Zurück zum Zitat Liben-Nowell D, Kleinberg J (2007) The link-prediction problem for social networks. J Am Soc Inform Sci Technol 58(7):1019–1031CrossRef Liben-Nowell D, Kleinberg J (2007) The link-prediction problem for social networks. J Am Soc Inform Sci Technol 58(7):1019–1031CrossRef
19.
Zurück zum Zitat Pan S, Wu J, Zhu X et al (2016) Tri-party deep network representation. Network 11(9):12 Pan S, Wu J, Zhu X et al (2016) Tri-party deep network representation. Network 11(9):12
20.
Zurück zum Zitat Pan S, Hu R, Long G et al. (2018) Adversarially regularized graph autoencoder for graph embedding. arXiv preprint arXiv:1802.04407 Pan S, Hu R, Long G et al. (2018) Adversarially regularized graph autoencoder for graph embedding. arXiv preprint arXiv:​1802.​04407
21.
Zurück zum Zitat Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 701–710 Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 701–710
22.
Zurück zum Zitat Perozzi B, Kulkarni V, Skiena S (2016) Walklets: Multiscale graph embeddings for interpretable network classification. arXiv preprint arXiv: 1605.02115 Perozzi B, Kulkarni V, Skiena S (2016) Walklets: Multiscale graph embeddings for interpretable network classification. arXiv preprint arXiv:​ 1605.​02115
23.
Zurück zum Zitat Qin J, Zeng X, Wu S et al (2020) E-GCN: graph convolution with estimated labels. Appl Intell 51(7):5007–5015CrossRef Qin J, Zeng X, Wu S et al (2020) E-GCN: graph convolution with estimated labels. Appl Intell 51(7):5007–5015CrossRef
24.
25.
Zurück zum Zitat Sun X, Guo J, Ding X, et al. (2016) A general framework for content-enhanced network representation learning. arXiv preprint arXiv: 1610.02906 Sun X, Guo J, Ding X, et al. (2016) A general framework for content-enhanced network representation learning. arXiv preprint arXiv:​ 1610.​02906
26.
Zurück zum Zitat Tang J, Qu M, Wang M, et al. (2015) Line: large-scale information network embedding. In: Proceedings of the 24th international conference on world wide web, pp 1067–1077 Tang J, Qu M, Wang M, et al. (2015) Line: large-scale information network embedding. In: Proceedings of the 24th international conference on world wide web, pp 1067–1077
27.
Zurück zum Zitat Tu C, Liu H, Liu Z, et al. (2017) Cane: Context-aware network embedding for relation modeling. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp 1722–1731 Tu C, Liu H, Liu Z, et al. (2017) Cane: Context-aware network embedding for relation modeling. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp 1722–1731
28.
Zurück zum Zitat Vinh NX, Epps J, Bailey J (2010) Information theoretic measures for clusterings comparison: variants, properties, normalization and correction for chance. J Mach Learn Res 11:2837–2854MathSciNetMATH Vinh NX, Epps J, Bailey J (2010) Information theoretic measures for clusterings comparison: variants, properties, normalization and correction for chance. J Mach Learn Res 11:2837–2854MathSciNetMATH
29.
Zurück zum Zitat Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pp 1225–1234 Wang D, Cui P, Zhu W (2016) Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining, pp 1225–1234
30.
Zurück zum Zitat Wang W, Tao C, Gan Z et al (2019) Improving textual network learning with variational homophilic embeddings. arXiv preprint arXiv:1909.13456 Wang W, Tao C, Gan Z et al (2019) Improving textual network learning with variational homophilic embeddings. arXiv preprint arXiv:​1909.​13456
31.
Zurück zum Zitat Xie J, Girshick R, Farhadi A (2016) Unsupervised deep embedding for clustering analysis. In: International conference on machine learning. PLMR. pp 478–487 Xie J, Girshick R, Farhadi A (2016) Unsupervised deep embedding for clustering analysis. In: International conference on machine learning. PLMR. pp 478–487
32.
Zurück zum Zitat Yang C, Liu Z, Zhao D et al (2015) Network representation learning with rich text information. In: IJCAI, pp 2111–2117 Yang C, Liu Z, Zhao D et al (2015) Network representation learning with rich text information. In: IJCAI, pp 2111–2117
33.
Zurück zum Zitat Yang C, Pal A, Zhai A, et al. (2020) MultiSage: Empowering GCN with Contextualized Multi-Embeddings on Web-Scale Multipartite Networks. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 2434–2443 Yang C, Pal A, Zhai A, et al. (2020) MultiSage: Empowering GCN with Contextualized Multi-Embeddings on Web-Scale Multipartite Networks. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 2434–2443
34.
Zurück zum Zitat Yu X, Ren X, Sun Y et al (2014) Personalized entity recommendation: a heterogeneous information network approach. In: Proceedings of the 7th ACM international conference on Web search and data mining, pp 283–292 Yu X, Ren X, Sun Y et al (2014) Personalized entity recommendation: a heterogeneous information network approach. In: Proceedings of the 7th ACM international conference on Web search and data mining, pp 283–292
Metadaten
Titel
Context-sensitive graph representation learning
verfasst von
Jisheng Qin
Xiaoqin Zeng
Shengli Wu
Yang Zou
Publikationsdatum
05.01.2023
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 6/2023
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-022-01755-9

Weitere Artikel der Ausgabe 6/2023

International Journal of Machine Learning and Cybernetics 6/2023 Zur Ausgabe