Skip to main content
Erschienen in: Peer-to-Peer Networking and Applications 2/2017

05.05.2016

Finding overlapping communities based on Markov chain and link clustering

verfasst von: Xiaoheng Deng, Genghao Li, Mianxiong Dong, Kaoru Ota

Erschienen in: Peer-to-Peer Networking and Applications | Ausgabe 2/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Since community structure is an important feature of complex network, the study of community detection has attracted more and more attention in recent years. Despite most researchers focus on identifying disjoint communities, communities in many real networks often overlap. In this paper, we proposed a novel MCLC algorithm to discover overlapping communities, which using random walk on the line graph and attraction intensity. Unlike traditional random walk starting from a node, our random walk starts from a link. First we transform an undirected network graph to a weighted line graph, and then random walks on this line graph can be associated with a Markov chain. By calculating the transition probability of the Markov chain, we obtain the similarity between link pairs. Next the links can be clustered into “link communities” by a linkage method, and these nodes between link communities can be overlapping nodes. When converting the “link communities” into the “node communities”, we make a definition of attraction intensity to control the overlapping size. Finally the detected communities are permitted overlapped. Experiments on synthetic networks and some real world networks validate the effectiveness and efficiency of the proposed algorithm. Comparing overlapping modularity Q o v with other related algorithms, the results of this algorithm are satisfactory.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Strogatz SH (2001) Exploring complex networks. Nature 410(6825):268–276CrossRef Strogatz SH (2001) Exploring complex networks. Nature 410(6825):268–276CrossRef
3.
Zurück zum Zitat Newman ME, Girvan M (2004) Finding and evaluating community structure in networks. Physical review E 69(2):026113CrossRef Newman ME, Girvan M (2004) Finding and evaluating community structure in networks. Physical review E 69(2):026113CrossRef
4.
Zurück zum Zitat Radicchi F, Castellano C, Cecconi F, Loreto V, Parisi D (2004) Defining and identifying communities in networks. Proc Natl Acad Sci USA 101(9):2658–2663CrossRef Radicchi F, Castellano C, Cecconi F, Loreto V, Parisi D (2004) Defining and identifying communities in networks. Proc Natl Acad Sci USA 101(9):2658–2663CrossRef
5.
Zurück zum Zitat Rosvall M, Bergstrom CT (2008) Maps of random walks on complex networks reveal community structure. Proc Natl Acad Sci 105(4):1118–1123CrossRef Rosvall M, Bergstrom CT (2008) Maps of random walks on complex networks reveal community structure. Proc Natl Acad Sci 105(4):1118–1123CrossRef
6.
Zurück zum Zitat Mianxiong D, Kimata T, Sugiura K, Zettsu K (2014) Quality-of-experience (qoe) in emerging mobile social networks. IEICE TRANSACTIONS on Information and Systems 97(10):2606–2612 Mianxiong D, Kimata T, Sugiura K, Zettsu K (2014) Quality-of-experience (qoe) in emerging mobile social networks. IEICE TRANSACTIONS on Information and Systems 97(10):2606–2612
7.
Zurück zum Zitat Ping Y, Cao Z, Zhu H (2014) Sybil-aware least cost rumor blocking in social networks. In: Global communications conference (GLOBECOM), 2014 IEEE, IEEE, pp 692–697 Ping Y, Cao Z, Zhu H (2014) Sybil-aware least cost rumor blocking in social networks. In: Global communications conference (GLOBECOM), 2014 IEEE, IEEE, pp 692–697
8.
Zurück zum Zitat Li M., Zhu H., Gao Z., Chen S., Yu L., Hu S., Ren K. (2014) All your location are belong to us: Breaking mobile social networks for automated user location tracking. In: Proceedings of the 15th ACM international symposium on mobile ad hoc networking and computing, ACM, pp 43–52 Li M., Zhu H., Gao Z., Chen S., Yu L., Hu S., Ren K. (2014) All your location are belong to us: Breaking mobile social networks for automated user location tracking. In: Proceedings of the 15th ACM international symposium on mobile ad hoc networking and computing, ACM, pp 43–52
9.
Zurück zum Zitat Zhu H, Lin X, Lu R, Fan Y, Shen X (2009) Smart A secure multilayer credit-based incentive scheme for delay-tolerant networks. IEEE Trans Veh Technol 58(8):4628–4639CrossRef Zhu H, Lin X, Lu R, Fan Y, Shen X (2009) Smart A secure multilayer credit-based incentive scheme for delay-tolerant networks. IEEE Trans Veh Technol 58(8):4628–4639CrossRef
10.
Zurück zum Zitat Du S, Zhu H, Li X, Ota K, Dong M (2013) Mixzone in motion: achieving dynamically cooperative location privacy protection in delay-tolerant networks. IEEE Trans Veh Technol 62(9):4565–4575CrossRef Du S, Zhu H, Li X, Ota K, Dong M (2013) Mixzone in motion: achieving dynamically cooperative location privacy protection in delay-tolerant networks. IEEE Trans Veh Technol 62(9):4565–4575CrossRef
11.
Zurück zum Zitat Zhu H, Du S, Gao Z, Dong M, Cao Z (2014) A probabilistic misbehavior detection scheme toward efficient trust establishment in delay-tolerant networks. IEEE Trans Parallel Distrib Syst 25(1):22–32CrossRef Zhu H, Du S, Gao Z, Dong M, Cao Z (2014) A probabilistic misbehavior detection scheme toward efficient trust establishment in delay-tolerant networks. IEEE Trans Parallel Distrib Syst 25(1):22–32CrossRef
12.
Zurück zum Zitat Tao J, Tan C, Zhang Z, He J, Xu Y (2015) Opportunistic forwarding based on the weighted social characteristics in msns. In: Communications (ICC), 2015 IEEE international conference on IEEE, pp 6318–6323 Tao J, Tan C, Zhang Z, He J, Xu Y (2015) Opportunistic forwarding based on the weighted social characteristics in msns. In: Communications (ICC), 2015 IEEE international conference on IEEE, pp 6318–6323
13.
Zurück zum Zitat Wang T, Chen Z, Li K, Deng X, Li D (2014) Memory does not necessarily promote cooperation in dilemma games. Physica A: Statistical Mechanics and its Applications 395:218–227MathSciNetCrossRef Wang T, Chen Z, Li K, Deng X, Li D (2014) Memory does not necessarily promote cooperation in dilemma games. Physica A: Statistical Mechanics and its Applications 395:218–227MathSciNetCrossRef
14.
Zurück zum Zitat Jonsson PF, Cavanna T, Zicha D, Bates PA (2006) Cluster analysis of networks generated through homology: automatic identification of important protein communities involved in cancer metastasis. BMC bioinformatics 7(1):2CrossRef Jonsson PF, Cavanna T, Zicha D, Bates PA (2006) Cluster analysis of networks generated through homology: automatic identification of important protein communities involved in cancer metastasis. BMC bioinformatics 7(1):2CrossRef
15.
Zurück zum Zitat Krause AE, Frank KA, Mason DM, Ulanowicz RE, Taylor WW (2003) Compartments revealed in food-web structure. Nature 426(6964):282–285CrossRef Krause AE, Frank KA, Mason DM, Ulanowicz RE, Taylor WW (2003) Compartments revealed in food-web structure. Nature 426(6964):282–285CrossRef
16.
Zurück zum Zitat Piccardi C, Calatroni L, Bertoni F (2010) Communities in italian corporate networks. Physica A: Statistical Mechanics and its Applications 389(22):5247–5258CrossRef Piccardi C, Calatroni L, Bertoni F (2010) Communities in italian corporate networks. Physica A: Statistical Mechanics and its Applications 389(22):5247–5258CrossRef
18.
Zurück zum Zitat Kernighan BW, Lin S (1970) An efficient heuristic procedure for partitioning graphs. Bell system technical journal 49(2):291–307CrossRefMATH Kernighan BW, Lin S (1970) An efficient heuristic procedure for partitioning graphs. Bell system technical journal 49(2):291–307CrossRefMATH
19.
Zurück zum Zitat Pothen A, Simon HD, Liou KP (1990) Partitioning sparse matrices with eigenvectors of graphs. SIAM J Matrix Anal Appl 11(3):430–452MathSciNetCrossRefMATH Pothen A, Simon HD, Liou KP (1990) Partitioning sparse matrices with eigenvectors of graphs. SIAM J Matrix Anal Appl 11(3):430–452MathSciNetCrossRefMATH
20.
Zurück zum Zitat Hastie T, Tibshirani R, Friedman J, Franklin J (2005) The elements of statistical learning: data mining, inference and prediction. Math Intell 27(2):83–85 Hastie T, Tibshirani R, Friedman J, Franklin J (2005) The elements of statistical learning: data mining, inference and prediction. Math Intell 27(2):83–85
21.
Zurück zum Zitat Blondel VD, Guillaume JL, Lambiotte R, Lefebvre E (2008) Fast unfolding of communities in large networks. J Stat Mech Theory Exp 2008(10):10008CrossRef Blondel VD, Guillaume JL, Lambiotte R, Lefebvre E (2008) Fast unfolding of communities in large networks. J Stat Mech Theory Exp 2008(10):10008CrossRef
22.
Zurück zum Zitat Palla G, Derényi I, Farkas I, Vicsek T (2005) Uncovering the overlapping community structure of complex networks in nature and society. Nature 435(7043):814–818CrossRef Palla G, Derényi I, Farkas I, Vicsek T (2005) Uncovering the overlapping community structure of complex networks in nature and society. Nature 435(7043):814–818CrossRef
23.
Zurück zum Zitat Lancichinetti A, Fortunato S, Kertész J (2009) Detecting the overlapping and hierarchical community structure in complex networks. New J Phys 11(3):033015CrossRef Lancichinetti A, Fortunato S, Kertész J (2009) Detecting the overlapping and hierarchical community structure in complex networks. New J Phys 11(3):033015CrossRef
24.
Zurück zum Zitat Wang X, Jiao L, Wu J (2009) Adjusting from disjoint to overlapping community detection of complex networks. Physica A: Statistical Mechanics and its Applications 388(24):5045–5056CrossRef Wang X, Jiao L, Wu J (2009) Adjusting from disjoint to overlapping community detection of complex networks. Physica A: Statistical Mechanics and its Applications 388(24):5045–5056CrossRef
25.
Zurück zum Zitat Ahn YY, Bagrow JP, Lehmann S (2010) Link communities reveal multiscale complexity in networks. Nature 466(7307):761–764CrossRef Ahn YY, Bagrow JP, Lehmann S (2010) Link communities reveal multiscale complexity in networks. Nature 466(7307):761–764CrossRef
26.
Zurück zum Zitat Havemann F, Heinz M, Struck A, Gläser J (2011) Identification of overlapping communities and their hierarchy by locally calculating community-changing resolution levels. J Stat Mech Theory Exp 2011(01):P01023CrossRef Havemann F, Heinz M, Struck A, Gläser J (2011) Identification of overlapping communities and their hierarchy by locally calculating community-changing resolution levels. J Stat Mech Theory Exp 2011(01):P01023CrossRef
27.
Zurück zum Zitat Xie J, Szymanski BK (2012) Towards linear time overlapping community detection in social networks. In: Advances in knowledge discovery and data mining, Springer, pp 25–36 Xie J, Szymanski BK (2012) Towards linear time overlapping community detection in social networks. In: Advances in knowledge discovery and data mining, Springer, pp 25–36
28.
Zurück zum Zitat Dickinson B, Valyou B, Hu W (2013) A genetic algorithm for identifying overlapping communities in social networks using an optimized search space. Soc Networks:2013 Dickinson B, Valyou B, Hu W (2013) A genetic algorithm for identifying overlapping communities in social networks using an optimized search space. Soc Networks:2013
29.
Zurück zum Zitat Mu C, Liu Y, Liu Y, Wu J, Jiao L (2014) Two-stage algorithm using influence coefficient for detecting the hierarchical, non-overlapping and overlapping community structure. Physica A: Statistical Mechanics and its Applications 408:47–61MathSciNetCrossRef Mu C, Liu Y, Liu Y, Wu J, Jiao L (2014) Two-stage algorithm using influence coefficient for detecting the hierarchical, non-overlapping and overlapping community structure. Physica A: Statistical Mechanics and its Applications 408:47–61MathSciNetCrossRef
30.
Zurück zum Zitat Evans T, Lambiotte R (2009) Line graphs, link partitions, and overlapping communities. Physical Review E 80(1):016105CrossRef Evans T, Lambiotte R (2009) Line graphs, link partitions, and overlapping communities. Physical Review E 80(1):016105CrossRef
31.
32.
Zurück zum Zitat Deng X, Li G, Dong M (2015) Finding overlapping communities with random walks on line graph and attraction intensity. In: Wireless algorithms, systems, and applications, Springer, pp 94–103 Deng X, Li G, Dong M (2015) Finding overlapping communities with random walks on line graph and attraction intensity. In: Wireless algorithms, systems, and applications, Springer, pp 94–103
33.
Zurück zum Zitat Van Dongen S (2014) Graph clustering by flow simulation University of Utrecht Van Dongen S (2014) Graph clustering by flow simulation University of Utrecht
34.
Zurück zum Zitat Yang B, Cheung WK, Liu J (2007) Community mining from signed social networks. IEEE Trans Knowl Data Eng 19(10):1333–1348CrossRef Yang B, Cheung WK, Liu J (2007) Community mining from signed social networks. IEEE Trans Knowl Data Eng 19(10):1333–1348CrossRef
35.
Zurück zum Zitat Steinhaeuser K, Chawla NV (2010) Identifying and evaluating community structure in complex networks. Pattern Recognit Lett 31(5):413–421CrossRef Steinhaeuser K, Chawla NV (2010) Identifying and evaluating community structure in complex networks. Pattern Recognit Lett 31(5):413–421CrossRef
36.
Zurück zum Zitat Lancichinetti A, Fortunato S, Radicchi F (2008) Benchmark graphs for testing community detection algorithms. PHYSICAL REVIEW E 78(4,2) Lancichinetti A, Fortunato S, Radicchi F (2008) Benchmark graphs for testing community detection algorithms. PHYSICAL REVIEW E 78(4,2)
37.
Zurück zum Zitat Lancichinetti A, Fortunato S (2009) Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities. PHYSICAL REVIEW E 80(1,2) Lancichinetti A, Fortunato S (2009) Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities. PHYSICAL REVIEW E 80(1,2)
38.
Zurück zum Zitat Danon L, Diaz-Guilera A, Duch J, Arenas A (2005) Comparing community structure identification. JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT Danon L, Diaz-Guilera A, Duch J, Arenas A (2005) Comparing community structure identification. JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT
39.
Zurück zum Zitat Zachary WW (1977) An information flow model for conflict and fission in small groups. J Anthropol Res:452–473 Zachary WW (1977) An information flow model for conflict and fission in small groups. J Anthropol Res:452–473
40.
Zurück zum Zitat Lusseau D, Schneider K, Boisseau OJ, Haase P, Slooten E, Dawson SM (2003) The bottlenose dolphin community of doubtful sound features a large proportion of long-lasting associations. Behav Ecol Sociobiol 54(4):396–405CrossRef Lusseau D, Schneider K, Boisseau OJ, Haase P, Slooten E, Dawson SM (2003) The bottlenose dolphin community of doubtful sound features a large proportion of long-lasting associations. Behav Ecol Sociobiol 54(4):396–405CrossRef
41.
Zurück zum Zitat Jin D, Yang B, Baquero C, Liu D, He D, Liu J (2011) A markov random walk under constraint for discovering overlapping communities in complex networks. J Stat Mech Theory Exp 2011(05):P05031CrossRef Jin D, Yang B, Baquero C, Liu D, He D, Liu J (2011) A markov random walk under constraint for discovering overlapping communities in complex networks. J Stat Mech Theory Exp 2011(05):P05031CrossRef
42.
Zurück zum Zitat Shen H, Cheng X, Cai K, Hu MB (2009) Detect overlapping and hierarchical community structure in networks. Physica A: Statistical Mechanics and its Applications 388(8):1706–1712CrossRef Shen H, Cheng X, Cai K, Hu MB (2009) Detect overlapping and hierarchical community structure in networks. Physica A: Statistical Mechanics and its Applications 388(8):1706–1712CrossRef
43.
Zurück zum Zitat Newman ME (2004) Fast algorithm for detecting community structure in networks. Physical review E 69(6):066133CrossRef Newman ME (2004) Fast algorithm for detecting community structure in networks. Physical review E 69(6):066133CrossRef
Metadaten
Titel
Finding overlapping communities based on Markov chain and link clustering
verfasst von
Xiaoheng Deng
Genghao Li
Mianxiong Dong
Kaoru Ota
Publikationsdatum
05.05.2016
Verlag
Springer US
Erschienen in
Peer-to-Peer Networking and Applications / Ausgabe 2/2017
Print ISSN: 1936-6442
Elektronische ISSN: 1936-6450
DOI
https://doi.org/10.1007/s12083-016-0457-0

Weitere Artikel der Ausgabe 2/2017

Peer-to-Peer Networking and Applications 2/2017 Zur Ausgabe