ABSTRACT
Given the rich real-life applications of network mining as well as the surge of representation learning in recent years, network embedding has become the focal point of increasing research interests in both academic and industrial domains. Nevertheless, the complete temporal formation process of networks characterized by sequential interactive events between nodes has yet seldom been modeled in the existing studies, which calls for further research on the so-called temporal network embedding problem. In light of this, in this paper, we introduce the concept of neighborhood formation sequence to describe the evolution of a node, where temporal excitation effects exist between neighbors in the sequence, and thus we propose a Hawkes process based Temporal Network Embedding (HTNE) method. HTNE well integrates the Hawkes process into network embedding so as to capture the influence of historical neighbors on the current neighbors. In particular, the interactions of low-dimensional vectors are fed into the Hawkes process as base rate and temporal influence, respectively. In addition, attention mechanism is also integrated into HTNE to better determine the influence of historical neighbors on current neighbors of a node. Experiments on three large-scale real-life networks demonstrate that the embeddings learned from the proposed HTNE model achieve better performance than state-of-the-art methods in various tasks including node classification, link prediction, and embedding visualization. In particular, temporal recommendation based on arrival rate inferred from node embeddings shows excellent predictive power of the proposed model.
Supplemental Material
- Amr Ahmed, Nino Shervashidze, Shravan Narayanamurthy, Vanja Josifovski, and Alexander J. Smola . 2013. Distributed Large-scale Natural Graph Factorization WWW. ACM, New York, NY, USA, 37--48. Google ScholarDigital Library
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio . 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473.Google Scholar
- Mikhail Belkin and Partha Niyogi . 2001. Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering NIPS. MIT Press, Cambridge, MA, USA, 585--591. Google ScholarDigital Library
- HongYun Cai, Vincent W. Zheng, and Kevin Chen-Chuan Chang . 2017. A Comprehensive Survey of Graph Embedding: Problems, Techniques and Applications. CoRR Vol. abs/1709.07604 (2017).Google Scholar
- Sandro Cavallari, Vincent W. Zheng, Hongyun Cai, Kevin Chen-Chuan Chang, and Erik Cambria . 2017. Learning Community Embedding with Community Detection and Node Embedding on Graphs CIKM. 377--386. Google ScholarDigital Library
- Quanyu Dai, Qiang Li, Jian Tang, and Dan Wang . 2017. Adversarial Network Embedding. CoRR Vol. abs/1711.07838 (2017).Google Scholar
- Nan Du, Yichen Wang, Niao He, and Le Song . 2015. Time-sensitive Recommendation from Recurrent User Activities NIPS. 3492--3500. Google ScholarDigital Library
- Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio . 2014. Generative Adversarial Nets. In NIPS. MIT Press, Cambridge, MA, USA, 2672--2680. Google ScholarDigital Library
- Aditya Grover and Jure Leskovec . 2016. Node2Vec: Scalable Feature Learning for Networks. In SIGKDD. ACM, New York, NY, USA, 855--864. Google ScholarDigital Library
- William L. Hamilton, Rex Ying, and Jure Leskovec . 2017. Inductive Representation Learning on Large Graphs. CoRR Vol. abs/1706.02216 (2017).Google Scholar
- Alan G Hawkes . 1971. Spectra of some self-exciting and mutually exciting point processes. Biometrika Vol. 58, 1 (1971), 83--90.Google ScholarCross Ref
- Petter Holme and Jari Saramäki . 2012. Temporal networks. Physics Reports Vol. 519, 3 (2012), 97 -- 125.Google ScholarCross Ref
- Joseph B Kruskal and Myron Wish . 1978. Multidimensional Scaling.CRC press. 875--878 pages.Google Scholar
- Rémi Lemonnier, Kevin Scaman, and Argyris Kalogeratos . 2017. Multivariate Hawkes Processes for Large-Scale Inference AAAI.Google Scholar
- Remi Lemonnier and Nicolas Vayatis . 2014. Nonparametric Markovian Learning of Triggering Kernels for Mutually Exciting and Mutually Inhibiting Multivariate Hawkes Processes Machine Learning and Knowledge Discovery in Databases. 161--176. Google ScholarDigital Library
- Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean . 2013 a. Efficient Estimation of Word Representations in Vector Space. CoRR Vol. abs/1301.3781 (2013).Google Scholar
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, and Jeffrey Dean . 2013 b. Distributed Representations of Words and Phrases and Their Compositionality NIPS. Curran Associates Inc., USA, 3111--3119. Google ScholarDigital Library
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean . 2013 c. Distributed Representations of Words and Phrases and their Compositionality. In NIPS. 3111--3119. Google ScholarDigital Library
- Shirui Pan, Jia Wu, Xingquan Zhu, Chengqi Zhang, and Yang Wang . 2016. Tri-party Deep Network Representation. In IJCAI. AAAI Press, 1895--1901. Google ScholarDigital Library
- Bryan Perozzi, Rami Al-Rfou, and Steven Skiena . 2014. DeepWalk: Online Learning of Social Representations SIGKDD. ACM, New York, NY, USA, 701--710. Google ScholarDigital Library
- Sam T. Roweis and Lawrence K. Saul . 2000. Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science Vol. 290, 5500 (2000), 2323--2326.Google ScholarCross Ref
- Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei . 2015. LINE: Large-scale Information Network Embedding. In WWW. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 1067--1077. Google ScholarDigital Library
- Joshua B. Tenenbaum, Vin de Silva, and John C. Langford . 2000. A Global Geometric Framework for Nonlinear Dimensionality Reduction. Science Vol. 290, 5500 (2000), 2319--2323.Google ScholarCross Ref
- Laurens van der Maaten and Geoffrey E. Hinton . 2008. Visualizing High-Dimensional Data Using t-SNE. JMLR Vol. 9 (2008), 2579--2605.Google Scholar
- Daixin Wang, Peng Cui, and Wenwu Zhu . 2016. Structural Deep Network Embedding. In SIGKDD. ACM, New York, NY, USA, 1225--1234. Google ScholarDigital Library
- Hongwei Wang, Jia Wang, Jialin Wang, Miao Zhao, Weinan Zhang, Fuzheng Zhang, Xing Xie, and Minyi Guo . 2017 b. GraphGAN: Graph Representation Learning with Generative Adversarial Nets. CoRR Vol. abs/1711.08267 (2017).Google Scholar
- Jingyuan Wang, Fei Gao, Peng Cui, Chao Li, and Zhang Xiong . 2014. Discovering urban spatio-temporal structure from time-evolving traffic networks Proceedings of the 16th Asia-Pacific Web Conference. Springer International Publishing, 93--104.Google Scholar
- Xiao Wang, Peng Cui, Jing Wang, Jian Pei, Wenwu Zhu, and Shiqiang Yang . 2017 a. Community Preserving Network Embedding.Google Scholar
- Lekui Zhou, Yang Yang, Xiang Ren, Fei Wu, and Yueting Zhuang . 2018. Dynamic Network Embedding by Modeling Triadic Closure Process The AAAI Conference on Artificial Intelligence.Google Scholar
- L. Zhu, D. Guo, J. Yin, G. V. Steeg, and A. Galstyan . 2016. Scalable Temporal Latent Space Inference for Link Prediction in Dynamic Social Networks. IEEE Transactions on Knowledge and Data Engineering Vol. 28, 10 (Oct . 2016), 2765--2777. Google ScholarDigital Library
Index Terms
- Embedding Temporal Network via Neighborhood Formation
Recommendations
Temporal Network Embedding with Micro- and Macro-dynamics
CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge ManagementNetwork embedding aims to embed nodes into a low-dimensional space, while capturing the network structures and properties. Although quite a few promising network embedding methods have been proposed, most of them focus on static networks. In fact, ...
Embedding temporal networks inductively via mining neighborhood and community influences
AbstractNetwork embedding aims to generate an embedding for each node in a network, which facilitates downstream machine learning tasks such as node classification and link prediction. Current work mainly focuses on transductive network embedding, i.e. ...
Continuous temporal network embedding by modeling neighborhood propagation process
AbstractNetwork embedding has become the focal point of increasing research interests in academic and industrial domains. Temporal networks are evolved by adding nodes and edges sequentially, which should be regarded as neighborhood propagation processes ...
Comments