Skip to main content
Top
Published in: Knowledge and Information Systems 5/2021

17-03-2021 | Regular Paper

Unifying community detection and network embedding in attributed networks

Authors: Yu Ding, Hao Wei, Guyu Hu, Zhisong Pan, Shuaihui Wang

Published in: Knowledge and Information Systems | Issue 5/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Traditionally, community detection and network embedding are two separate tasks. Network embedding aims to output a vector representation for each node in the network, and community detection aims to find all densely connected groups of nodes and well separate them from others. Most of the existing approaches do community detection and network embedding in a separate manner, and ignore node attributes information, which leads to poor results. In this paper, we propose a novel model that jointly solves the network embedding and community detection problems together. The model can make use of the network local information, the global information and node attributes information collaboratively. We empirically show that by jointly solving these two problems together, the model can greatly improve the ability of community detection, but also learn better network embedding than the advanced baseline methods. We evaluate the proposed model on several datasets, and the experimental results have shown the effectiveness and advancement of our model.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Girvan M, Newman ME (2002) Community structure in social and biological networks. Proc Natl Acad Sci U S A 99(12):7821–7826MathSciNetCrossRef Girvan M, Newman ME (2002) Community structure in social and biological networks. Proc Natl Acad Sci U S A 99(12):7821–7826MathSciNetCrossRef
2.
go back to reference Newman MEJ, Girvan M (2004) Finding and evaluating community structure in networks. Phys Rev E Stat Nonlinear Soft Matter Phys 69(2):026113CrossRef Newman MEJ, Girvan M (2004) Finding and evaluating community structure in networks. Phys Rev E Stat Nonlinear Soft Matter Phys 69(2):026113CrossRef
3.
go back to reference Blondel VD, Guillaume JL, Lambiotte R et al (2008) Fast unfolding of communities in large networks. J Stat Mech 2008(10):155–168CrossRef Blondel VD, Guillaume JL, Lambiotte R et al (2008) Fast unfolding of communities in large networks. J Stat Mech 2008(10):155–168CrossRef
4.
go back to reference Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: online learning of social representations. In: The ACM SIGKDD International Conference, pp 701–710. ACM Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: online learning of social representations. In: The ACM SIGKDD International Conference, pp 701–710. ACM
5.
go back to reference Tang J, Qu M, Wang M, Zhang M, Yan J, Mei Q (2015) Line: large-scale information network embedding. In: International Conference on World Wide Web, pp. 1067–1077 Tang J, Qu M, Wang M, Zhang M, Yan J, Mei Q (2015) Line: large-scale information network embedding. In: International Conference on World Wide Web, pp. 1067–1077
6.
go back to reference Grover A, Leskovec J (2016) node2vec: scalable feature learning for networks. In: The ACM SIGKDD International Conference Grover A, Leskovec J (2016) node2vec: scalable feature learning for networks. In: The ACM SIGKDD International Conference
7.
go back to reference Xun G (2017) Collaboratively improving topic discovery and word embeddings by coordinating global and local contexts. In: ACM Sigkdd International Conference ACM Xun G (2017) Collaboratively improving topic discovery and word embeddings by coordinating global and local contexts. In: ACM Sigkdd International Conference ACM
8.
go back to reference Yang C, Liu Z, Zhao D, Sun M, Chang EY (2015) Network representation learning with rich text information. In: International Conference on Artificial Intelligence, pp 2111–2117 Yang C, Liu Z, Zhao D, Sun M, Chang EY (2015) Network representation learning with rich text information. In: International Conference on Artificial Intelligence, pp 2111–2117
9.
go back to reference Wang D, Li T, Zhu S, Ding C (2008) Multi-document summarization via sentence-level semantic analysis and symmetric matrix factorization. In: Proceedings of the 31st international ACM SIGIR conference on Research and development in information retrieval, pp 307–314. ACM Wang D, Li T, Zhu S, Ding C (2008) Multi-document summarization via sentence-level semantic analysis and symmetric matrix factorization. In: Proceedings of the 31st international ACM SIGIR conference on Research and development in information retrieval, pp 307–314. ACM
10.
go back to reference Yang Z; Hao T, Dikmen O, Chen X, Oja E (2012) Clustering by nonnegative matrix factorization using graph random walk. In: Advances in Neural Information Processing Systems, pp 1079–1087 Yang Z; Hao T, Dikmen O, Chen X, Oja E (2012) Clustering by nonnegative matrix factorization using graph random walk. In: Advances in Neural Information Processing Systems, pp 1079–1087
11.
go back to reference Wang X, Jin D, Cao X, Yang L, Zhang W (2016) Semantic community identification in large attribute networks. In: Thirtieth AAAI Conference on Artificial Intelligence Wang X, Jin D, Cao X, Yang L, Zhang W (2016) Semantic community identification in large attribute networks. In: Thirtieth AAAI Conference on Artificial Intelligence
12.
go back to reference Meng W, Chaokun W, Jeffrey XY, Jun Z (2015) Community detection in social networks: an in-depth benchmarking study with a procedure-oriented framework. In: PVLDB 8, 10 (June 2015), pp 998–1009 Meng W, Chaokun W, Jeffrey XY, Jun Z (2015) Community detection in social networks: an in-depth benchmarking study with a procedure-oriented framework. In: PVLDB 8, 10 (June 2015), pp 998–1009
13.
go back to reference Wang F, Li T, Wang X et al (2011) Community discovery using nonnegative matrix factorization. Data Min Knowl Disc 22(3):493–521MathSciNetCrossRef Wang F, Li T, Wang X et al (2011) Community discovery using nonnegative matrix factorization. Data Min Knowl Disc 22(3):493–521MathSciNetCrossRef
14.
go back to reference Yang J, Mcauley J, Leskovec J (2014) Community detection in networks with node attributes Yang J, Mcauley J, Leskovec J (2014) Community detection in networks with node attributes
15.
go back to reference Karrer B, Newman MEJ (2011) Stochastic blockmodels and community structure in networks. Phys Rev E Stat Nonlinear Soft Matter Phys 83(2):016107MathSciNetCrossRef Karrer B, Newman MEJ (2011) Stochastic blockmodels and community structure in networks. Phys Rev E Stat Nonlinear Soft Matter Phys 83(2):016107MathSciNetCrossRef
16.
go back to reference Yang Z, Hao T, Dikmen O et al (2012) Clustering by nonnegative matrix factorization using graph random walk. In: International Conference on Neural Information Processing Systems. Curran Associates Inc Yang Z, Hao T, Dikmen O et al (2012) Clustering by nonnegative matrix factorization using graph random walk. In: International Conference on Neural Information Processing Systems. Curran Associates Inc
17.
go back to reference Mrinmaya S, Avinava D, Shashank S, Eric PX, Eduard H (2014) Spatial compactness meets topical consistency: jointly modeling links and content for community detection. In: WSDM, pp 503–512 Mrinmaya S, Avinava D, Shashank S, Eric PX, Eduard H (2014) Spatial compactness meets topical consistency: jointly modeling links and content for community detection. In: WSDM, pp 503–512
18.
go back to reference Sun Y, Aggarwal CC, Han J (2012) Relation strength-aware clustering of heterogeneous information networks with incomplete attributes. In: PVLDB 5, 5 (Jan. 2012), pp 394–405 Sun Y, Aggarwal CC, Han J (2012) Relation strength-aware clustering of heterogeneous information networks with incomplete attributes. In: PVLDB 5, 5 (Jan. 2012), pp 394–405
19.
go back to reference Cai HY, Zheng VW, Zhu F, Chen-Chuan Chang K, Huang Z (2017) From community detection to community profiling. In: PVLDB 10, 7 (2017), pp 817–828 Cai HY, Zheng VW, Zhu F, Chen-Chuan Chang K, Huang Z (2017) From community detection to community profiling. In: PVLDB 10, 7 (2017), pp 817–828
20.
go back to reference Xie J, Kelley K, Szymanski BK (2013) Overlapping community detection in networks: the state-of-the-art and comparative study. In: ACM CSUR 45, 4 (2013), 43:1–43:35 Xie J, Kelley K, Szymanski BK (2013) Overlapping community detection in networks: the state-of-the-art and comparative study. In: ACM CSUR 45, 4 (2013), 43:1–43:35
21.
go back to reference Atzmueller M, Doerfel S, Mitzlaff F (2016) Description-oriented community detection using exhaustive subgroup discovery. Inform Sci 329(2):965–984CrossRef Atzmueller M, Doerfel S, Mitzlaff F (2016) Description-oriented community detection using exhaustive subgroup discovery. Inform Sci 329(2):965–984CrossRef
22.
go back to reference He D, Feng Z, Jin, D, Wang X, and Zhang W (2017) Joint identification of network communities and semantics via integrative modeling of network topologies and node contents. In: AAAI 2017, pp 116–124 He D, Feng Z, Jin, D, Wang X, and Zhang W (2017) Joint identification of network communities and semantics via integrative modeling of network topologies and node contents. In: AAAI 2017, pp 116–124
23.
go back to reference Kozdoba M, Mannor S (2015) Community detection via measure space embedding. In: NIPS. Pp 2890–2898 Kozdoba M, Mannor S (2015) Community detection via measure space embedding. In: NIPS. Pp 2890–2898
24.
go back to reference Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: NIPS, pp 3111–3119 Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: NIPS, pp 3111–3119
25.
go back to reference Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRef Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRef
26.
go back to reference Li P, Hastie TJ, Church KE (2006) Very sparse random projections. In: Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp 287–296 Li P, Hastie TJ, Church KE (2006) Very sparse random projections. In: Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp 287–296
27.
go back to reference Hu Q, Xie S, Lin S, Wang S, Philip SY (2016) Clustering embedded approaches for efficient information network inference. Data Sci Eng 1(1):29–40CrossRef Hu Q, Xie S, Lin S, Wang S, Philip SY (2016) Clustering embedded approaches for efficient information network inference. Data Sci Eng 1(1):29–40CrossRef
28.
go back to reference Cheng W, Greaves C, Warren M (2006) From n-gram to skip-gram to concgram. Int J Corp Linguist 11(4):411–433CrossRef Cheng W, Greaves C, Warren M (2006) From n-gram to skip-gram to concgram. Int J Corp Linguist 11(4):411–433CrossRef
29.
go back to reference Cao S, Lu W, Xu Q (2015) Grarep: learning graph representations with global structural information. In: KDD Cao S, Lu W, Xu Q (2015) Grarep: learning graph representations with global structural information. In: KDD
30.
go back to reference Wang D, Cui P, Zhu W (2016) Structural deep network embedding In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, pp 1225–1234 Wang D, Cui P, Zhu W (2016) Structural deep network embedding In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, pp 1225–1234
31.
go back to reference Bruna J, Zaremba W, Szlam A, LeCun Y (2014) Spectral networks and locally connected networks on graphs. In: ICLR Bruna J, Zaremba W, Szlam A, LeCun Y (2014) Spectral networks and locally connected networks on graphs. In: ICLR
32.
go back to reference Kipf TN, Welling M (2016) Variational graph auto-encoders. ArXiv:1611.07308 Kipf TN, Welling M (2016) Variational graph auto-encoders. ArXiv:1611.07308
33.
go back to reference Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: ICLR Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: ICLR
34.
go back to reference Huang X, Li J, Hu X (2017) Label Informed Attributed Network Embedding. In: WSDM. ACM, pp 731–739 Huang X, Li J, Hu X (2017) Label Informed Attributed Network Embedding. In: WSDM. ACM, pp 731–739
35.
go back to reference Liang J, Jacobs P, Sun J et al (2018) Semi-supervised embedding in attributed networks with outliers Liang J, Jacobs P, Sun J et al (2018) Semi-supervised embedding in attributed networks with outliers
36.
go back to reference Zhang Z, Yang H, Bu J, Zhou S, Yu P, Zhang J, Ester M, Wang C (2018) ANRL: Attributed network representation learning via deep neural networks. In: IJCAI 2018 Zhang Z, Yang H, Bu J, Zhou S, Yu P, Zhang J, Ester M, Wang C (2018) ANRL: Attributed network representation learning via deep neural networks. In: IJCAI 2018
37.
go back to reference Gao H, Huang H (2018) Deep attributed network embedding. In: IJCAI 2018 Gao H, Huang H (2018) Deep attributed network embedding. In: IJCAI 2018
38.
go back to reference Wu W, Li B, Chen L, Zhang C (2018) Efficient attributed network embedding via recursive randomized hashing. IJCAI 2018 Wu W, Li B, Chen L, Zhang C (2018) Efficient attributed network embedding via recursive randomized hashing. IJCAI 2018
39.
go back to reference Liu J, He Z, Wei L, Huang Y (2018) Content to node: self-translation network embedding. In: SIGKDD, 2018 Liu J, He Z, Wei L, Huang Y (2018) Content to node: self-translation network embedding. In: SIGKDD, 2018
40.
go back to reference Tian F, Gao B, Cui Q, Chen E, Liu T-Y (2014) Learning Deep Representations for Graph Clustering. In: AAAI, pp 1293–1299 Tian F, Gao B, Cui Q, Chen E, Liu T-Y (2014) Learning Deep Representations for Graph Clustering. In: AAAI, pp 1293–1299
41.
go back to reference Wang X, Cui P, Wang J, Pei J, Zhu W, Yang S (2017) Community preserving network embedding. In: AAAI 2017 Wang X, Cui P, Wang J, Pei J, Zhu W, Yang S (2017) Community preserving network embedding. In: AAAI 2017
42.
go back to reference Cavallari S, Zheng VW, Cai H et al (2017) Learning community embedding with community detection and node embedding on graphs. In: ACM on Conference on Information and Knowledge Management. ACM, 2017, pp 377–386 Cavallari S, Zheng VW, Cai H et al (2017) Learning community embedding with community detection and node embedding on graphs. In: ACM on Conference on Information and Knowledge Management. ACM, 2017, pp 377–386
43.
go back to reference Tu C, Zeng X, Wang H, et al. (2016) A unified framework for community detection and network representation learning. IEEE Trans Knowl Data Eng PP(99):1–1. Tu C, Zeng X, Wang H, et al. (2016) A unified framework for community detection and network representation learning. IEEE Trans Knowl Data Eng PP(99):1–1.
44.
go back to reference Li Y, Sha C, Huang X, Zhang Y (2018) Community detection in attributed graphs: an embedding approach. In: AAAI 2018 Li Y, Sha C, Huang X, Zhang Y (2018) Community detection in attributed graphs: an embedding approach. In: AAAI 2018
45.
go back to reference Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, pp 3111–3119 Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, pp 3111–3119
46.
go back to reference Bojchevski A, Gunnemann S (2018) Bayesian robust attributed graph clustering: joint learning of partial anomalies and group structure. In: AAAI 2018 Bojchevski A, Gunnemann S (2018) Bayesian robust attributed graph clustering: joint learning of partial anomalies and group structure. In: AAAI 2018
48.
go back to reference van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. JMLR 9(2008):2579–2605MATH van der Maaten L, Hinton G (2008) Visualizing data using t-SNE. JMLR 9(2008):2579–2605MATH
Metadata
Title
Unifying community detection and network embedding in attributed networks
Authors
Yu Ding
Hao Wei
Guyu Hu
Zhisong Pan
Shuaihui Wang
Publication date
17-03-2021
Publisher
Springer London
Published in
Knowledge and Information Systems / Issue 5/2021
Print ISSN: 0219-1377
Electronic ISSN: 0219-3116
DOI
https://doi.org/10.1007/s10115-021-01557-5

Other articles of this Issue 5/2021

Knowledge and Information Systems 5/2021 Go to the issue

Premium Partner