Skip to main content

2019 | OriginalPaper | Buchkapitel

Improved DeepWalk Algorithm Based on Preference Random Walk

verfasst von : Zhonglin Ye, Haixing Zhao, Ke Zhang, Yu Zhu, Yuzhi Xiao, Zhaoyang Wang

Erschienen in: Natural Language Processing and Chinese Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Network representation learning based on neural network originates from language modeling based on neural network. These two types of tasks are then studied and applied along different paths. DeepWalk is the most classical network representation learning algorithm, which samples the next hop nodes of the walker with an equal probability method through the random walk strategy. Node2vec improves the random walk procedures, thus improving the performance of node2vec algorithm on various tasks. Therefore, we propose an improved DeepWalk algorithm based on preference random walk (PDW), which modifies the single undirected edge into two one-way directed edges in the network, and then gives each one-way directed edge a walk probability based on local random walk algorithm. In the procedures of acquiring walk sequences, the walk probability of the paths that have been walked will be attenuated according to the attenuation coefficient. For the last hop node of the current node in the walk sequences, an inhibition coefficient is set to prevent random walker from returning to the last node with a greater probability. In addition, we introduce the Alias sampling method in order to obtain the next hop node from the neighboring nodes of current node with a non-equal probability sampling. The experimental results show that the proposed PDW algorithm possesses a stable performance of network representation learning, the network node classification performance is better than that of the baseline algorithms used in this paper.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Vedanayaki, M.: A study of data mining and social network analysis. J. Test. Eval. 40(7), 663–681 (2014) Vedanayaki, M.: A study of data mining and social network analysis. J. Test. Eval. 40(7), 663–681 (2014)
2.
Zurück zum Zitat Bhat, S.Y., Abulaish, M.: Analysis and mining of online social networks: emerging trends and challenges. Wiley Interdisc. Rev. Data Min. Knowl. Discovery 3(6), 408–444 (2013)CrossRef Bhat, S.Y., Abulaish, M.: Analysis and mining of online social networks: emerging trends and challenges. Wiley Interdisc. Rev. Data Min. Knowl. Discovery 3(6), 408–444 (2013)CrossRef
3.
Zurück zum Zitat Perozzi, B., Al-Rfou, R., Skiena, S., et al.: DeepWalk: online learning of social representations. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 701–710. ACM, New York (2014) Perozzi, B., Al-Rfou, R., Skiena, S., et al.: DeepWalk: online learning of social representations. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 701–710. ACM, New York (2014)
4.
Zurück zum Zitat Tu, C.C., Zhang, W.C., Liu, Z.Y., et al.: Max-margin DeepWalk: discriminative learning of network representation. In: International Joint Conference on Artificial Intelligence, pp. 3889–3895. AAAI, Palo Alto (2015) Tu, C.C., Zhang, W.C., Liu, Z.Y., et al.: Max-margin DeepWalk: discriminative learning of network representation. In: International Joint Conference on Artificial Intelligence, pp. 3889–3895. AAAI, Palo Alto (2015)
5.
Zurück zum Zitat Yang, C., Liu, Z.Y., Zhao, D., et al.: Network representation learning with rich text information. In: International Conference on Artificial Intelligence, pp. 2111–2117. AAAI, Palo Alto (2015) Yang, C., Liu, Z.Y., Zhao, D., et al.: Network representation learning with rich text information. In: International Conference on Artificial Intelligence, pp. 2111–2117. AAAI, Palo Alto (2015)
6.
Zurück zum Zitat Wang, D., Cui, P., Zhu, W., et al.: Structural deep network embedding. In: The 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1225–1234. ACM, New York (2016) Wang, D., Cui, P., Zhu, W., et al.: Structural deep network embedding. In: The 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1225–1234. ACM, New York (2016)
7.
Zurück zum Zitat Zhang, D., Jie, Y., Zhu, X., et al.: Network representation learning: a survey. IEEE Trans. Big Data PP(99), 1 (2017) Zhang, D., Jie, Y., Zhu, X., et al.: Network representation learning: a survey. IEEE Trans. Big Data PP(99), 1 (2017)
9.
Zurück zum Zitat Doncheva, N.T., Morris, J.H., Gorodkin, J., et al.: Cytoscape StringApp: network analysis and visualization of proteomics data. J. Proteome Res. 18(2), 623–632 (2019)CrossRef Doncheva, N.T., Morris, J.H., Gorodkin, J., et al.: Cytoscape StringApp: network analysis and visualization of proteomics data. J. Proteome Res. 18(2), 623–632 (2019)CrossRef
11.
Zurück zum Zitat Yu, X., Ren, X., Sun, Y.Z., et al.: Personalized entity recommendation: a heterogeneous information network approach. In: ACM International Conference on Web Search and Data Mining, pp. 283–292. ACM, New York (2014) Yu, X., Ren, X., Sun, Y.Z., et al.: Personalized entity recommendation: a heterogeneous information network approach. In: ACM International Conference on Web Search and Data Mining, pp. 283–292. ACM, New York (2014)
12.
Zurück zum Zitat Grover, A., Leskovec, J.: Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 855–864. ACM, New York (2016) Grover, A., Leskovec, J.: Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 855–864. ACM, New York (2016)
13.
Zurück zum Zitat Ohata, F., Kondou, K., Inoue, K., et al.: Alias analysis method for object-oriented programs using alias flow graphs. Syst. Comput. Japan 35(4), 49–59 (2004)CrossRef Ohata, F., Kondou, K., Inoue, K., et al.: Alias analysis method for object-oriented programs using alias flow graphs. Syst. Comput. Japan 35(4), 49–59 (2004)CrossRef
14.
Zurück zum Zitat Lai, S., Liu, K., He, S., et al.: How to generate a good word embedding. IEEE Intell. Syst. 31(6), 5–14 (2016)CrossRef Lai, S., Liu, K., He, S., et al.: How to generate a good word embedding. IEEE Intell. Syst. 31(6), 5–14 (2016)CrossRef
15.
Zurück zum Zitat Mikolov, T., Sutskever, I., Chen, K., et al.: Distributed representations of words and phrases and their compositionality. In: Twenty-Seventh Conference on Neural Information Processing System, pp. 3111–3119. MIT, Cambridge (2013) Mikolov, T., Sutskever, I., Chen, K., et al.: Distributed representations of words and phrases and their compositionality. In: Twenty-Seventh Conference on Neural Information Processing System, pp. 3111–3119. MIT, Cambridge (2013)
17.
Zurück zum Zitat Kingman, J.F.C.: Markov transition probabilities. Zeitschrift Für Wahrscheinlichkeitstheorie Und Verwandte Gebiete 7(4), 248–270 (1967)MathSciNetCrossRef Kingman, J.F.C.: Markov transition probabilities. Zeitschrift Für Wahrscheinlichkeitstheorie Und Verwandte Gebiete 7(4), 248–270 (1967)MathSciNetCrossRef
18.
Zurück zum Zitat Liu, W., Lü, L.Y.: Link prediction based on local random walk. Europhys. Lett. 89(5), 58007 (2010)CrossRef Liu, W., Lü, L.Y.: Link prediction based on local random walk. Europhys. Lett. 89(5), 58007 (2010)CrossRef
19.
Zurück zum Zitat Tang, J., Qu, M., Wang, M., et al.: LINE: large-scale information network embedding. In: International Conference on World Wide Web, pp. 1067–1077. Springer, Heidelberg (2014) Tang, J., Qu, M., Wang, M., et al.: LINE: large-scale information network embedding. In: International Conference on World Wide Web, pp. 1067–1077. Springer, Heidelberg (2014)
21.
Zurück zum Zitat Yang, C., Sun, M., Liu, Z., et al.: Fast network embedding enhancement via high order proximity approximation. In: International Joint Conference on Artificial Intelligence, pp. 3894–3900. Morgan Kaufmann, San Francisco (2017) Yang, C., Sun, M., Liu, Z., et al.: Fast network embedding enhancement via high order proximity approximation. In: International Joint Conference on Artificial Intelligence, pp. 3894–3900. Morgan Kaufmann, San Francisco (2017)
22.
Zurück zum Zitat Cao, S., Lu, W., Xu, Q., et al.: GraRep: learning graph representations with global structural information. In: Conference on Information and Knowledge Management, pp. 891–900. ACM, New York (2015) Cao, S., Lu, W., Xu, Q., et al.: GraRep: learning graph representations with global structural information. In: Conference on Information and Knowledge Management, pp. 891–900. ACM, New York (2015)
23.
Zurück zum Zitat Fan, R.E., Chang, K.W., Hsieh, C.J., et al.: LIBLINEAR: a library for large linear classification. J. Mach. Learn. Res. 9(9), 1871–1874 (2008)MATH Fan, R.E., Chang, K.W., Hsieh, C.J., et al.: LIBLINEAR: a library for large linear classification. J. Mach. Learn. Res. 9(9), 1871–1874 (2008)MATH
Metadaten
Titel
Improved DeepWalk Algorithm Based on Preference Random Walk
verfasst von
Zhonglin Ye
Haixing Zhao
Ke Zhang
Yu Zhu
Yuzhi Xiao
Zhaoyang Wang
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-32233-5_21