Skip to main content

2015 | OriginalPaper | Buchkapitel

12. A Survey of Community Detection Algorithms Based On Analysis-Intent

verfasst von : Napoleon C. Paxton, Stephen Russell, Ira S. Moskowitz, Paul Hyden

Erschienen in: Cyber Warfare

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

There has been a significant amount of research dedicated to identifying community structures within graphs. Most of these studies have focused on partitioning techniques and the resultant quality of discovered groupings (communities) without regard for the intent of the analysis being conducted (analysis-intent). In many cases, a given network community can be composed of significantly different elements depending upon the context in which a partitioning technique is used or applied. Moreover, the number of communities within a network will vary greatly depending on the analysis-intent and thus the discretion quality and performance of algorithms will similarly vary. In this survey we review several algorithms from the literature developed to discover community structure within networks. We review these approaches from two analysis perspectives: role/process focused (category-based methods) and topological structure or connection focused (event-based methods). We discuss the strengths and weaknesses of each algorithm and provide suggestions on the algorithms’ use depending on analysis context.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
In the botnet scenario depicted in Fig.12.1 we only consider three layers of nodes (Botmaster, Bots, and Victims). In many cases a fourth layer is present in between the Botmaster and the Bots (Command and Control). We chose not to include this layer for sake of clarity. Also, in many cases the Botmaster layer and the Command and Control layer are the same.
 
Literatur
Zurück zum Zitat Block, P., Community: The Structure of Belonging, Berrett-Koehler, 2008. Block, P., Community: The Structure of Belonging, Berrett-Koehler, 2008.
Zurück zum Zitat Laut, I., Rath, C., Worner, L., Nosenko, V., Zhdanov, S., Schablinski, J., Block, D., Thomas, H., and Morfill, G., Network analysis of three-dimensional complex plasma clusters in a rotating electric field. Physical Review E, 2014.89(2). Laut, I., Rath, C., Worner, L., Nosenko, V., Zhdanov, S., Schablinski, J., Block, D., Thomas, H., and Morfill, G., Network analysis of three-dimensional complex plasma clusters in a rotating electric field. Physical Review E, 2014.89(2).
Zurück zum Zitat Kim, E, Hwang, D, and Ko, T., Multiscale ensemble clustering for finding modules in complex networks. Physical Review E, 2012.85(2): p. 026119. Kim, E, Hwang, D, and Ko, T., Multiscale ensemble clustering for finding modules in complex networks. Physical Review E, 2012.85(2): p. 026119.
Zurück zum Zitat Scibetta, M., Boano, f., Revelli, R., and Ridolfi, L., Community Detection as a Tool for District Metered Areas Identification. Procedia Engineering, 2014.70: p. 1518. Scibetta, M., Boano, f., Revelli, R., and Ridolfi, L., Community Detection as a Tool for District Metered Areas Identification. Procedia Engineering, 2014.70: p. 1518.
Zurück zum Zitat Fortunato, S.,Community detection in graphs. Physics Reports, 2010.486: p. 99. Fortunato, S.,Community detection in graphs. Physics Reports, 2010.486: p. 99.
Zurück zum Zitat Jin, D., et al.,Extending a configuration model to find communities in complex networks. Journal of Statistical Mechanics: Theory and Experiment, 2013.2013(09): p. P09013.CrossRef Jin, D., et al.,Extending a configuration model to find communities in complex networks. Journal of Statistical Mechanics: Theory and Experiment, 2013.2013(09): p. P09013.CrossRef
Zurück zum Zitat Jia, Y., Garland, M., and Hart, J., Social Network Clustering and Visualization using Hierarchical Edge Bundles. Computer Graphics Forum, 2011: p. no. Jia, Y., Garland, M., and Hart, J., Social Network Clustering and Visualization using Hierarchical Edge Bundles. Computer Graphics Forum, 2011: p. no.
Zurück zum Zitat Leydesdorff, L. and Ahrweiler, P., In search of a network theory of innovations: Relations, positions, and perspectives. Journal of the Association for Information Science and Technology, 2014: p. n/a. Leydesdorff, L. and Ahrweiler, P., In search of a network theory of innovations: Relations, positions, and perspectives. Journal of the Association for Information Science and Technology, 2014: p. n/a.
Zurück zum Zitat Evans, T.S.,Clique graphs and overlapping communities. Journal of Statistical Mechanics: Theory and Experiment, 2010.2010(12): p. P12037.CrossRef Evans, T.S.,Clique graphs and overlapping communities. Journal of Statistical Mechanics: Theory and Experiment, 2010.2010(12): p. P12037.CrossRef
Zurück zum Zitat Community detection algorithms: A comparative analysis. Physical Review E, 2009.80(5): p. 056117. Community detection algorithms: A comparative analysis. Physical Review E, 2009.80(5): p. 056117.
Zurück zum Zitat Branting, K.L., Context-Sensitive Detection of Local Community Structure, Social Network Analysis and Mining, 1869–5450:1–11, Springer (2011) Branting, K.L., Context-Sensitive Detection of Local Community Structure, Social Network Analysis and Mining, 1869–5450:1–11, Springer (2011)
Zurück zum Zitat Palla, G., et al., Overlapping community detection in networks: The state-of-the-art and comparative study. ACM Computing Surveys (CSUR), 2005.435(7043): p. 5. Palla, G., et al., Overlapping community detection in networks: The state-of-the-art and comparative study. ACM Computing Surveys (CSUR), 2005.435(7043): p. 5.
Zurück zum Zitat Dietrich, C.J., C. Rossow, and N. Pohlmann, CoCoSpot: Clustering and recognizing botnet command and control channels using traffic analysis. Computer Networks, 2013.57(2): p. 475–486.CrossRef Dietrich, C.J., C. Rossow, and N. Pohlmann, CoCoSpot: Clustering and recognizing botnet command and control channels using traffic analysis. Computer Networks, 2013.57(2): p. 475–486.CrossRef
Zurück zum Zitat Chan, S.-Y., P. Hui, and K. Xu. CommunityDetection of Time-Varying Mobile Social Networks. in1st International Conference on Complex Sciences: Theory and Applications (Complex 2009). 2009. Shanghai, China: Springer. Chan, S.-Y., P. Hui, and K. Xu. CommunityDetection of Time-Varying Mobile Social Networks. in1st International Conference on Complex Sciences: Theory and Applications (Complex 2009). 2009. Shanghai, China: Springer.
Zurück zum Zitat Jiashun, J.FAST COMMUNITY DETECTION BY SCORE. 2012; Available from: arXiv:1211.5803. Jiashun, J.FAST COMMUNITY DETECTION BY SCORE. 2012; Available from: arXiv:1211.5803.
Zurück zum Zitat Dang, T.A. and E. Viennet.Community Detection based on Structural and Attribute Similarities. inThe Sixth International Conference on Digital Society. 2012. Valencia, Spain: IARIA. Dang, T.A. and E. Viennet.Community Detection based on Structural and Attribute Similarities. inThe Sixth International Conference on Digital Society. 2012. Valencia, Spain: IARIA.
Zurück zum Zitat Girvan, M. and M.E.J. Newman,Community structure in social and biological networks. Proceedings of the National Academy of Sciences, 2002.99(12): p. 7821–7826. Girvan, M. and M.E.J. Newman,Community structure in social and biological networks. Proceedings of the National Academy of Sciences, 2002.99(12): p. 7821–7826.
Zurück zum Zitat Newman, M.E.J. and M. Girvan,Finding and evaluating community structure in networks. Physics Review E, 2004.69(026113). Newman, M.E.J. and M. Girvan,Finding and evaluating community structure in networks. Physics Review E, 2004.69(026113).
Zurück zum Zitat Yoo, A., et al.A Scalable Distributed Parallel Breadth-First Search Algorithm on BlueGene/L. inACM/IEEE Conference on Supercomputing. 2005. Washington, D.C. Yoo, A., et al.A Scalable Distributed Parallel Breadth-First Search Algorithm on BlueGene/L. inACM/IEEE Conference on Supercomputing. 2005. Washington, D.C.
Zurück zum Zitat Ward, J.H.,Hierarchical grouping to optimize an objective function. Journal of the American Stastical Association, 1963.58. Ward, J.H.,Hierarchical grouping to optimize an objective function. Journal of the American Stastical Association, 1963.58.
Zurück zum Zitat Orman, G.K., V. Labatut, and H. Cherifi,Comparative evaluation of community detection algorithms: a topological approach. Journal of Statistical Mechanics: Theory and Experiment, -2012.2012(08): p. P08001.CrossRef Orman, G.K., V. Labatut, and H. Cherifi,Comparative evaluation of community detection algorithms: a topological approach. Journal of Statistical Mechanics: Theory and Experiment, -2012.2012(08): p. P08001.CrossRef
Zurück zum Zitat Huang, J., Sun, H., Han, J., Feng, B.,Density-based shrinkage for revealing hierarchical and overlapping community structure in networks. Physica A Statistical Mechanics and its Applications, 2011.390(11): p. 2160. Huang, J., Sun, H., Han, J., Feng, B.,Density-based shrinkage for revealing hierarchical and overlapping community structure in networks. Physica A Statistical Mechanics and its Applications, 2011.390(11): p. 2160.
Zurück zum Zitat MacKay, D.J.C.,Information Theory, Inference, and Learning Algorithms, ed. C.U. Press. Vol. 1. 1995, Cambridge: Cambridge Univeristy Press. 640. MacKay, D.J.C.,Information Theory, Inference, and Learning Algorithms, ed. C.U. Press. Vol. 1. 1995, Cambridge: Cambridge Univeristy Press. 640.
Zurück zum Zitat Morup, M. and M.N. Schmidt,Bayesian community detection. Neural Computation, 2012. Morup, M. and M.N. Schmidt,Bayesian community detection. Neural Computation, 2012.
Zurück zum Zitat Karrer, B. and M.E.J. Newman,Stochastic blockmodels and community structure in networks. Physics Review E, 2011.83(016107): p. 11.MathSciNet Karrer, B. and M.E.J. Newman,Stochastic blockmodels and community structure in networks. Physics Review E, 2011.83(016107): p. 11.MathSciNet
Zurück zum Zitat Hierarchical Block Structures and High-Resolution Model Selection in Large Networks. Physical Review X, 2014.4(1). Hierarchical Block Structures and High-Resolution Model Selection in Large Networks. Physical Review X, 2014.4(1).
Zurück zum Zitat Nascimento, M. and Pitsoulis, L.,Community detection by modularity maximization using GRASP with path relinking. Computers & Operations Research, 2013. Nascimento, M. and Pitsoulis, L.,Community detection by modularity maximization using GRASP with path relinking. Computers & Operations Research, 2013.
Zurück zum Zitat Tyler, J.R., D.M. Wilkinson, and B.A. Huberman.Email as spectorscopy: automated discovery of community structure within organizations. inInternational Conference on Communities and Technologies. 2003. Kluwer Academic, Dordrecht. Tyler, J.R., D.M. Wilkinson, and B.A. Huberman.Email as spectorscopy: automated discovery of community structure within organizations. inInternational Conference on Communities and Technologies. 2003. Kluwer Academic, Dordrecht.
Zurück zum Zitat Sales-Pardo, M., et al.,Extracting the hierarchical organization of complex systems. National Academy of Sciences, 2007.104(39). Sales-Pardo, M., et al.,Extracting the hierarchical organization of complex systems. National Academy of Sciences, 2007.104(39).
Zurück zum Zitat Clauset, A., C. Moore, and M.E.J. Newman,Hierarchical structure and the prediction of missing links in networks. 453, 2008.7191(98). Clauset, A., C. Moore, and M.E.J. Newman,Hierarchical structure and the prediction of missing links in networks. 453, 2008.7191(98).
Zurück zum Zitat Liben-Nowell, D. and J. Kleinberg.The Link-Prediction Problem for Social Networks. in Twelth International Conference on Information and Knowledge Management. 2003. New York, NY: ACM. Liben-Nowell, D. and J. Kleinberg.The Link-Prediction Problem for Social Networks. in Twelth International Conference on Information and Knowledge Management. 2003. New York, NY: ACM.
Zurück zum Zitat Clauset, A., M.E.J. Newman, and C. Moore,Finding community structure in very large networks. Physical Review E, 2004.70(066111). Clauset, A., M.E.J. Newman, and C. Moore,Finding community structure in very large networks. Physical Review E, 2004.70(066111).
Zurück zum Zitat Hopcroft, J., et al.,Natural Communities in Large Linked Networks. Proceedings of the National Academy of Sciences, 2004.101(5249). Hopcroft, J., et al.,Natural Communities in Large Linked Networks. Proceedings of the National Academy of Sciences, 2004.101(5249).
Zurück zum Zitat Bagrow, J.P. and E.M. Bollt,A local method for detecting communties. Physical Review E, 2005.72(046108). Bagrow, J.P. and E.M. Bollt,A local method for detecting communties. Physical Review E, 2005.72(046108).
Zurück zum Zitat Rodrigues, F.A., G. Travieso, and L.d.F. Costa,Characterization of complex networks: A survey of measurements. International Journal of Modern Physics C, 2007.18(937). Rodrigues, F.A., G. Travieso, and L.d.F. Costa,Characterization of complex networks: A survey of measurements. International Journal of Modern Physics C, 2007.18(937).
Zurück zum Zitat Ahn, Y., J.P. Bagrow, and S. Lehmann.Communities and Hierarchical Organization of Links in Complex Networks. 2009; Available from: arxiv:0903.3178. Ahn, Y., J.P. Bagrow, and S. Lehmann.Communities and Hierarchical Organization of Links in Complex Networks. 2009; Available from: arxiv:0903.3178.
Zurück zum Zitat Wang, J., et al.,A Fast Hierarchical Clustering Algorithm for Functional Modules Discovery in Protein Interaction Networks. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2011.8(3). Wang, J., et al.,A Fast Hierarchical Clustering Algorithm for Functional Modules Discovery in Protein Interaction Networks. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2011.8(3).
Zurück zum Zitat Shen, H.-W., X.-Q. Cheng, and J.-F. Guo,Quantifying and identifying the overlapping community structure in networks. Journal of Statistical Mechanics: Theory and Experiment, 2009.2009(07): p. P07042.CrossRef Shen, H.-W., X.-Q. Cheng, and J.-F. Guo,Quantifying and identifying the overlapping community structure in networks. Journal of Statistical Mechanics: Theory and Experiment, 2009.2009(07): p. P07042.CrossRef
Zurück zum Zitat Nicosia, V., et al.,Extending the definition of modularity to directed graphs with overlapping communities. J. Stat. Mech., 2009(P03024). Nicosia, V., et al.,Extending the definition of modularity to directed graphs with overlapping communities. J. Stat. Mech., 2009(P03024).
Zurück zum Zitat Papadopoulos, S., et al.Bridge Bounding: A Local Approach for Efficient Community Discovery in Complex Networks. 2009; Available from: arXiv:0902.0871. Papadopoulos, S., et al.Bridge Bounding: A Local Approach for Efficient Community Discovery in Complex Networks. 2009; Available from: arXiv:0902.0871.
Zurück zum Zitat Reichardt, J. and S. Bornholdt.Stastical Mechanics of Community Detection. 2006; Available from: arXiv:cond-mat/0603718. Reichardt, J. and S. Bornholdt.Stastical Mechanics of Community Detection. 2006; Available from: arXiv:cond-mat/0603718.
Zurück zum Zitat Barber, M.J., et al.,Searching for communities in bipartie networks. In Proceedings of 5th Jagna International Workshop on Stochastic and Quantum Dynamics of Biomolecular Systems, 2008. Barber, M.J., et al.,Searching for communities in bipartie networks. In Proceedings of 5th Jagna International Workshop on Stochastic and Quantum Dynamics of Biomolecular Systems, 2008.
Zurück zum Zitat Danon, L., et al.,Comparing community structure identification. Journal of Statistical Mechanics: Theory and Experiment, 2005.2005(September 2005). Danon, L., et al.,Comparing community structure identification. Journal of Statistical Mechanics: Theory and Experiment, 2005.2005(September 2005).
Zurück zum Zitat Guimera, R., et al.,Community analysis in social networks. Physics Review E, 2003.68(065103). Guimera, R., et al.,Community analysis in social networks. Physics Review E, 2003.68(065103).
Zurück zum Zitat Li, J.Z., et al., Worldwide Human Relationships Inferred from Genome-Wide Patterns of Variation. Science, 2008.319(5866). Li, J.Z., et al., Worldwide Human Relationships Inferred from Genome-Wide Patterns of Variation. Science, 2008.319(5866).
Zurück zum Zitat Fortunato, S. and M. Barthelemy,Resolution limit in community detection. Proceedings of the National Academy of Sciences, 2006.104(1). Fortunato, S. and M. Barthelemy,Resolution limit in community detection. Proceedings of the National Academy of Sciences, 2006.104(1).
Zurück zum Zitat Ruan, J. and W. Zhang,Identifying network communities with a high resolution. Physics Review E, 2008.77(016104). Ruan, J. and W. Zhang,Identifying network communities with a high resolution. Physics Review E, 2008.77(016104).
Zurück zum Zitat Berry, J.W., et al.Tolerating the Community Detection Resolution Limit with Edge Weighting. Physics and Society 2009; Available from: arxiv.org/abs/0903.1072. Berry, J.W., et al.Tolerating the Community Detection Resolution Limit with Edge Weighting. Physics and Society 2009; Available from: arxiv.org/abs/0903.1072.
Zurück zum Zitat Hofman, J. and C. Wiggins,Bayesian approach to network modularity. Physical review letters, 2008.100(258701). Hofman, J. and C. Wiggins,Bayesian approach to network modularity. Physical review letters, 2008.100(258701).
Zurück zum Zitat Psorakis, I., Roberts,S., Ebden, M., and Sheldon, B., Overlapping Community Detection Using Bayesian Non-Negative Matrix Factorization, Phys., Rev. E83, June 2011 Psorakis, I., Roberts,S., Ebden, M., and Sheldon, B., Overlapping Community Detection Using Bayesian Non-Negative Matrix Factorization, Phys., Rev. E83, June 2011
Zurück zum Zitat Pisorakis, I., Roberts, S., Ebden, M., and Sheldon, B.,Overlapping community detection using Bayesian non-negative matrix factorization. Physical Review E, 2011.83(6): p. 066114. Pisorakis, I., Roberts, S., Ebden, M., and Sheldon, B.,Overlapping community detection using Bayesian non-negative matrix factorization. Physical Review E, 2011.83(6): p. 066114.
Zurück zum Zitat Airoldi, E., et al.,Mixed membership stochastic blockmodels. Journal of Machine Learning Research, 2008.9. Airoldi, E., et al.,Mixed membership stochastic blockmodels. Journal of Machine Learning Research, 2008.9.
Zurück zum Zitat Barbieri, N., F. Bonchi, and G. Manco.Cascade-based Community Detection. inProceedings of the sixth ACM International Conference on Web Search and Data Mining. 2013. New York, NY: ACM. Barbieri, N., F. Bonchi, and G. Manco.Cascade-based Community Detection. inProceedings of the sixth ACM International Conference on Web Search and Data Mining. 2013. New York, NY: ACM.
Zurück zum Zitat Chen, Y., V. Kawadia, and R. Urgaonkar.Detecting Overlapping Temporal Community Structure in Time-Evolving Networks. 2013; Available from: arXiv:1303.7226. Chen, Y., V. Kawadia, and R. Urgaonkar.Detecting Overlapping Temporal Community Structure in Time-Evolving Networks. 2013; Available from: arXiv:1303.7226.
Zurück zum Zitat Rosvall, M. and C.T. Bergstrom,An information-theoretic framework for resolving community structure in complex networks. Proceedings of the National Academy of Sciences, 2007.104(18): p. 7327–7331.CrossRef Rosvall, M. and C.T. Bergstrom,An information-theoretic framework for resolving community structure in complex networks. Proceedings of the National Academy of Sciences, 2007.104(18): p. 7327–7331.CrossRef
Zurück zum Zitat Rosvall, M. and C. Bergstrom,Maps of random walks on complex networks reveal community structure. National Academy of Sciences, 2008.105(4). Rosvall, M. and C. Bergstrom,Maps of random walks on complex networks reveal community structure. National Academy of Sciences, 2008.105(4).
Zurück zum Zitat Rosvall, M., D. Axelsson, and C.T. Bergstrom,The map equation. The European Physical Journal Special Topics, 2009.178. Rosvall, M., D. Axelsson, and C.T. Bergstrom,The map equation. The European Physical Journal Special Topics, 2009.178.
Zurück zum Zitat Lehmann, S., M. Schwartz, and L.K. Hansen,Biclique communities. Physical Review E, 2008.78(016108). Lehmann, S., M. Schwartz, and L.K. Hansen,Biclique communities. Physical Review E, 2008.78(016108).
Zurück zum Zitat Kumpula, J.M., et al.,Sequential algorithm for fast clique percolation. Physical Review E, 2008.78(026109). Kumpula, J.M., et al.,Sequential algorithm for fast clique percolation. Physical Review E, 2008.78(026109).
Metadaten
Titel
A Survey of Community Detection Algorithms Based On Analysis-Intent
verfasst von
Napoleon C. Paxton
Stephen Russell
Ira S. Moskowitz
Paul Hyden
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-14039-1_12