Juan-Hui Li
Skip Abstract Section
Abstract
Recently, network embedding has received a large amount of attention in network analysis. Although some network embedding methods have been developed from different perspectives, on one hand, most of the existing methods only focus on leveraging the plain network structure, ignoring the abundant attribute information of nodes. On the other hand, for some methods integrating the attribute information, only the lower-order proximities (e.g., microscopic proximity structure) are taken into account, which may suffer if there exists the sparsity issue and the attribute information is noisy. To overcome this problem, the attribute information and mesoscopic community structure are utilized. In this article, we propose a novel network embedding method termed Attributed Network Embedding with Micro-Meso structure, which is capable of preserving both the attribute information and the structural information including the microscopic proximity structure and mesoscopic community structure. In particular, both the microscopic proximity structure and node attributes are factorized by Nonnegative Matrix Factorization (NMF), from which the low-dimensional node representations can be obtained. For the mesoscopic community structure, a community membership strength matrix is inferred by a generative model (i.e., BigCLAM) or modularity from the linkage structure, which is then factorized by NMF to obtain the low-dimensional node representations. The three components are jointly correlated by the low-dimensional node representations, from which two objective functions (i.e., ANEM_B and ANEM_M) can be defined. Two efficient alternating optimization schemes are proposed to solve the optimization problems. Extensive experiments have been conducted to confirm the superior performance of the proposed models over the state-of-the-art network embedding methods.
- Zeynep Akata, Christian Thurau, and Christian Bauckhage. 2011. Non-negative matrix factorization in multimodality data for segmentation and label prediction. In Proceedings of the 16th Computer Vision Winter Workshop.Google Scholar
- John D. Burger, John Henderson, George Kim, and Guido Zarrella. 2011. Discriminating gender on Twitter. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 1301--1309.Google Scholar
- Deng Cai, Xiaofei He, Jiawei Han, and Thomas S. Huang. 2011. Graph regularized nonnegative matrix factorization for data representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 8 (2011), 1548--1560.Google ScholarDigital Library
- Shaosheng Cao, Wei Lu, and Qiongkai Xu. 2015. GraRep: Learning graph representations with global structural information. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. 891--900.Google ScholarDigital Library
- Dorwin Cartwright and Frank Harary. 1956. Structural balance: A generalization of Heider’s theory. Psychological Review 63, 5 (1956), 277.Google ScholarCross Ref
- Sandro Cavallari, Vincent W. Zheng, Hongyun Cai, Kevin Chen-Chuan Chang, and Erik Cambria. 2017. Learning community embedding with community detection and node embedding on graphs. In Proceedings of the 2017 ACM International on Conference on Information and Knowledge Management.Google ScholarDigital Library
- Yukuo Cen, Xu Zou, Jianwei Zhang, Hongxia Yang, Jingren Zhou, and Jie Tang. 2019. Representation learning for attributed multiplex heterogeneous network. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 1358--1368.Google ScholarDigital Library
- Jonathan Chang and David Blei. 2009. Relational topic models for document networks. In Proceedings of the 12th International Conference on Artificial Intelligence and Statistics. 81--88.Google Scholar
- Hongxu Chen, Hongzhi Yin, Weiqing Wang, Hao Wang, Quoc Viet Hung Nguyen, and Xue Li. 2018. PME: Projected metric embedding on heterogeneous networks for link prediction. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. Yike Guo and Faisal Farooq (Eds.). ACM, 1177--1186.Google ScholarDigital Library
- Siheng Chen, Sufeng Niu, Leman Akoglu, Jelena Kovačević, and Christos Faloutsos. 2017. Fast, warped graph embedding: Unifying framework and one-click algorithm. arXiv preprint arXiv:1702.05764 (2017).Google Scholar
- Fan R. K. Chung and Fan Chung Graham. 1997. Spectral Graph Theory. Number 92. American Mathematical Society.Google Scholar
- Marek Cygan, Marcin Pilipczuk, Michał Pilipczuk, and Jakub Onufry Wojtaszczyk. 2012. Sitting closer to friends than enemies, revisited. In Proceedings of the International Symposium on Mathematical Foundations of Computer Science. Springer, 296--307.Google ScholarDigital Library
- Hongchang Gao and Heng Huang. 2018. Deep attributed network embedding. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. Vol. 18. New York, NY, 3364--3370.Google ScholarCross Ref
- Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In Proceedings of the 2016 ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 855--864.Google ScholarDigital Library
- Xiao Huang, Jundong Li, and Xia Hu. 2017a. Accelerated attributed network embedding. In Proceedings of the 2017 SIAM International Conference on Data Mining. 633--641.Google ScholarCross Ref
- Xiao Huang, Jundong Li, and Xia Hu. 2017b. Label informed attributed network embedding. In Proceedings of the 10th ACM International Conference on Web Search and Data Mining. 731--739.Google ScholarDigital Library
- Xiao Huang, Jundong Li, Na Zou, and Xia Hu. 2018a. A general embedding framework for heterogeneous information learning in large-scale networks. ACM Transactions on Knowledge Discovery from Data 12, 6 (2018), 1--24.Google Scholar
- Xiao Huang, Qingquan Song, Jundong Li, and Xia Ben Hu. 2018b. Exploring expert cognition for attributed network embedding. In Proceedings of the 2018 ACM International Conference on Web Search and Data Mining.Google ScholarDigital Library
- Yi-An Lai, Chin-Chi Hsu, Wen Hao Chen, Mi-Yen Yeh, and Shou-De Lin. 2017. Preserving proximity and global ranking for node embedding. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 5261--5270.Google Scholar
- Tuan M. V. Le and Hady W. Lauw. 2014. Probabilistic latent document network embedding. In Proceedings of the 2014 IEEE International Conference on Data Mining (ICDM’14). IEEE, 270--279.Google Scholar
- Daniel D. Lee and H. Sebastian Seung. 1999. Learning the parts of objects by non-negative matrix factorization. Nature 401, 6755 (1999), 788.Google Scholar
- Daniel D. Lee and H. Sebastian Seung. 2001. Algorithms for non-negative matrix factorization. In Proceedings of the 2001 International Conference on Neural Information Processing Systems. 556--562.Google Scholar
- Chaozhuo Li, Zhoujun Li, Senzhang Wang, Yang Yang, Xiaoming Zhang, and Jianshe Zhou. 2017b. Semi-supervised network embedding. In Proceedings of the International Conference on Database Systems for Advanced Applications. Springer, 131--147.Google ScholarCross Ref
- Chaozhuo Li, Senzhang Wang, Dejian Yang, Zhoujun Li, Yang Yang, Xiaoming Zhang, and Jianshe Zhou. 2017d. PPNE: Property preserving network embedding. In Proceedings of the International Conference on Database Systems for Advanced Applications. 163--179.Google ScholarCross Ref
- Hang Li, Haozheng Wang, Zhenglu Yang, and Masato Odagaki. 2017c. Variation autoencoder based network representation learning for classification. In Proceedings of ACL 2017, Student Research Workshop. 56--61.Google ScholarCross Ref
- Jundong Li, Harsh Dani, Xia Hu, Jiliang Tang, Yi Chang, and Huan Liu. 2017a. Attributed network embedding for learning in a dynamic environment. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 387--396.Google ScholarDigital Library
- Juan-Hui Li, Chang-Dong Wang, Ling Huang, Dong Huang, Jian-Huang Lai, and Pei Chen. 2018. Attributed network embedding with micro-meso structure. In Proceedings of the 23rd International Conference on Database Systems for Advanced Applications. 20--36.Google ScholarDigital Library
- Lizi Liao, Xiangnan He, Hanwang Zhang, and Tat-Seng Chua. 2018. Attributed social network embedding. IEEE Transactions on Knowledge and Data Engineering 30, 12 (2018), 2257--2270.Google ScholarDigital Library
- Liyuan Liu, Linli Xu, Zhen Wangy, and Enhong Chen. 2015. Community detection based on structure and content: A content propagation perspective. In Proceedings of the 2015 IEEE International Conference on Data Mining. 271--280.Google ScholarDigital Library
- Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of Machine Learning Research 9, 86 (2008), 2579--2605.Google Scholar
- Zaiqiao Meng, Shangsong Liang, Hongyan Bao, and Xiangliang Zhang. 2019. Co-embedding attributed networks. In Proceedings of the 2019 ACM International Conference on Web Search and Data Mining. ACM, 393--401.Google ScholarDigital Library
- Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013).Google Scholar
- Mark E. J. Newman. 2006a. Finding community structure in networks using the eigenvectors of matrices. Physical Review E 74, 3 (2006), 036104.Google ScholarCross Ref
- Mark E. J. Newman. 2006b. Modularity and community structure in networks. Proceedings of the National Academy of Sciences 103, 23 (2006), 8577--8582.Google ScholarCross Ref
- Mingdong Ou, Peng Cui, Jian Pei, Ziwei Zhang, and Wenwu Zhu. 2016. Asymmetric transitivity preserving graph embedding. In Proceedings of the 2016 ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1105--1114.Google ScholarDigital Library
- Shirui Pan, Jia Wu, Xingquan Zhu, Chengqi Zhang, and Yang Wang. 2016. Tri-party deep network representation. In Proceedings of the 2016 International Joint Conference on Artificial Intelligence. 1895--1901.Google Scholar
- Marco Pennacchiotti and Ana-Maria Popescu. 2011. Democrats, republicans and starbucks afficionados: user classification in Twitter. In Proceedings of the 2011 ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 430--438.Google ScholarDigital Library
- Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online learning of social representations. In Proceedings of the 2014 ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 701--710.Google ScholarDigital Library
- Jiezhong Qiu, Yuxiao Dong, Hao Ma, Jian Li, Kuansan Wang, and Jie Tang. 2018. Network embedding as matrix factorization: Unifying deepwalk, line, pte, and node2vec. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining. ACM, 459--467.Google ScholarDigital Library
- Leonardo F. R. Ribeiro, Pedro H. P. Saverese, and Daniel R. Figueiredo. 2017. struc2vec: Learning node representations from structural identity. In Proceedings of the 2017 ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 385--394.Google Scholar
- Ludovic Dos Santos, Benjamin Piwowarski, Ludovic Denoyer, and Patrick Gallinari. 2018. Representation learning for classification in heterogeneous graphs with application to social networks. ACM Transactions on Knowledge Discovery from Data 12, 5 (2018), 62.Google Scholar
- Xiaofei Sun, Jiang Guo, Xiao Ding, and Ting Liu. 2016. A general framework for content-enhanced network representation learning. arXiv preprint arXiv:1610.02906 (2016).Google Scholar
- Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015. Line: Large-scale information network embedding. In Proceedings of the 24th International Conference on World Wide Web. 1067--1077.Google ScholarDigital Library
- Joshua B. Tenenbaum, Vin De Silva, and John C. Langford. 2000. A global geometric framework for nonlinear dimensionality reduction. Science 290, 5500 (2000), 2319--2323.Google ScholarCross Ref
- Cunchao Tu, Weicheng Zhang, Zhiyuan Liu, and Maosong Sun. 2016. Max-margin deepwalk: Discriminative learning of network representation. In Proceedings of the 2016 International Joint Conference on Artificial Intelligence. 3889--3895.Google Scholar
- Ulrike Von Luxburg. 2007. A tutorial on spectral clustering. Statistics and Computing 17, 4 (2007), 395--416.Google ScholarDigital Library
- Chang-Dong Wang, Wei Shi, Ling Huang, Kun-Yu Lin, Dong Huang, and Philip S. Yu. 2020. Node-pair information preserving network embedding based on adversarial networks. IEEE Transactions on Cybernetics (2020), 1--15.Google Scholar
- Daixin Wang, Peng Cui, and Wenwu Zhu. 2016. Structural deep network embedding. In Proceedings of the 2016 ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1225--1234.Google ScholarDigital Library
- Hongwei Wang, Fuzheng Zhang, Min Hou, Xing Xie, Minyi Guo, and Qi Liu. 2018. SHINE: Signed heterogeneous information network embedding for sentiment link prediction. In Proceedings of the 2018 ACM International Conference on Web Search and Data Mining.Google ScholarDigital Library
- Suhang Wang, Jiliang Tang, Charu Aggarwal, Yi Chang, and Huan Liu. 2017b. Signed network embedding in social media. In Proceedings of the 2017 SIAM International Conference on Data Mining. SIAM, 327--335.Google ScholarCross Ref
- Xiao Wang, Peng Cui, Jing Wang, Jian Pei, Wenwu Zhu, and Shiqiang Yang. 2017a. Community preserving network embedding. In Proceedings of the 31st AAAI Conference on Artificial Intelligence. 203--209.Google ScholarCross Ref
- Cheng Yang, Zhiyuan Liu, Deli Zhao, Maosong Sun, and Edward Y. Chang. 2015. Network representation learning with rich text information. In Proceedings of the 2015 International Joint Conference on Artificial Intelligence. 2111--2117.Google Scholar
- Dejian Yang, Senzhang Wang, Chaozhuo Li, Xiaoming Zhang, and Zhoujun Li. 2017. From properties to links: Deep network embedding on incomplete graphs. In Proceedings of the 2017 ACM International on Conference on Information and Knowledge Management. 367--376.Google ScholarDigital Library
- Jaewon Yang and Jure Leskovec. 2013. Overlapping community detection at scale: A nonnegative matrix factorization approach. In Proceedings of the 2013 ACM International Conference on Web Search and Data Mining. 587--596.Google ScholarDigital Library
- Zhen Zhang, Hongxia Yang, Jiajun Bu, Sheng Zhou, Pinggang Yu, Jianwei Zhang, Martin Ester, and Can Wang. 2018. ANRL: Attributed network representation learning via deep neural networks. In Proceedings of the 2018 International Joint Conference on Artificial Intelligence. ijcai.org, 3155--3161.Google ScholarCross Ref
- Bin Zhao, Prithviraj Sen, and Lise Getoor. 2006. Event classification and relationship labeling in affiliation networks. In Proceedings of the Workshop on Statistical Network Analysis (SNA) at the 23rd International Conference on Machine Learning.Google Scholar
- Wayne Xin Zhao, Feifan Fan, Ji-Rong Wen, and Edward Y. Chang. 2018. Joint representation learning for location-based social networks with multi-grained sequential contexts. ACM Transactions on Knowledge Discovery from Data 12, 2 (2018), 22.Google Scholar
- Le-kui Zhou, Yang Yang, Xiang Ren, Fei Wu, and Yueting Zhuang. 2018. Dynamic network embedding by modeling triadic closure process. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence, (AAAI’18), the 30th Innovative Applications of Artificial Intelligence (IAAI’18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI’18). Sheila A. McIlraith and Kilian Q. Weinberger (Eds.). AAAI Press, 571--578.Google Scholar
Index Terms
- Attributed Network Embedding with Micro-Meso Structure
Recommendations
Attributed Network Embedding with Micro-meso Structure
Database Systems for Advanced ApplicationsAbstractRecently, network embedding has received a large amount of attention in network analysis. Although some network embedding methods have been developed from different perspectives, on one hand, most of the existing methods only focus on leveraging ...
Structure-guided attributed network embedding with “centroid” enhancement
AbstractAttributed network embedding aims at learning low-dimensional network representations in terms of both network structure and attribute information. Most existing methods deal with network structure and attributes separately and combine them in ...
Structural Role Enhanced Attributed Network Embedding
Web Information Systems Engineering – WISE 2019AbstractIn recent years, network embedding methods based on deep learning to process network structure data have attracted widespread attention. It aims to represent nodes in the network as low-dimensional dense real-value vectors and effectively preserve ...
Comments