Skip to main content
Erschienen in: Social Network Analysis and Mining 4/2012

01.12.2012 | Original Article

Overlapping community detection using a community optimized graph swarm

verfasst von: Bradley S. Rees, Keith B. Gallagher

Erschienen in: Social Network Analysis and Mining | Ausgabe 4/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Detection of communities within social networks is a nontrivial problem. Allowing communities to overlap—i.e. nodes can belong to more than one community simultaneously—further complicates the problem. Nevertheless, people do belong to multiple social groups simultaneously and being able to detect overlapping communities is an important step into being able to understand and analyze social networks. A common practice in community detection (clustering) is to view the network (graph) as a whole and have a central control process determine how nodes are clustered. That central control, we believe, is a limitation to performance. In our previous work, we showed that the individual’s view of his or hers social groups could be aggregated to produce communities. In this paper, we propose a unique approach to community detection that combines the individual’s view of a community, not having the view the graph as a whole, with swarm intelligence as a means of removing the central control mechanism. Our approach offers a community detection solution that finds overlapping communities while running in O(n log 2 n) time.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Barabási A-L (2002) Linked: the new science of networks. Perseus, Cambridge Barabási A-L (2002) Linked: the new science of networks. Perseus, Cambridge
Zurück zum Zitat Baumes J, Goldberg M, Magdon-ismail M (2005) Efficient identification of overlapping communities. In: IEEE international conference on intelligence and security informatics (ISI), pp 27–36 Baumes J, Goldberg M, Magdon-ismail M (2005) Efficient identification of overlapping communities. In: IEEE international conference on intelligence and security informatics (ISI), pp 27–36
Zurück zum Zitat Beni G, Wang J (1989) Swarm intelligence in cellular robotic systems. In: NATO advanced workshop on robots and biological systems, vol 102 Beni G, Wang J (1989) Swarm intelligence in cellular robotic systems. In: NATO advanced workshop on robots and biological systems, vol 102
Zurück zum Zitat Boguna M, Pastor-Satorras R, Diaz-Guilera A, Arenas A (2004) Models of social networks based on social distance attachment. Phys Rev E 70:056122 Boguna M, Pastor-Satorras R, Diaz-Guilera A, Arenas A (2004) Models of social networks based on social distance attachment. Phys Rev E 70:056122
Zurück zum Zitat Brandes U, Delling D, Gaertler M, Gorke R, Hoefer M, Nikoloski Z, Wagner D (2008) On modularity clustering. IEEE Trans Knowl Data Eng 20(2):172–188CrossRef Brandes U, Delling D, Gaertler M, Gorke R, Hoefer M, Nikoloski Z, Wagner D (2008) On modularity clustering. IEEE Trans Knowl Data Eng 20(2):172–188CrossRef
Zurück zum Zitat Buchanan M (2003) Nexus: small worlds and the groundbreaking theory of networks, W. W. Norton & Company Buchanan M (2003) Nexus: small worlds and the groundbreaking theory of networks, W. W. Norton & Company
Zurück zum Zitat Chartrand G (1985 [1977]). Introductory graph theory, Dover Publications, Inc., New York Chartrand G (1985 [1977]). Introductory graph theory, Dover Publications, Inc., New York
Zurück zum Zitat Clauset A (2005) Finding local community structure in networks. Phys Rev E 72:026132+ Clauset A (2005) Finding local community structure in networks. Phys Rev E 72:026132+
Zurück zum Zitat Clauset A, Newman MEJ, Moore C (2004) Finding community structure in very large networks. Phys Rev E 70:066111+ Clauset A, Newman MEJ, Moore C (2004) Finding community structure in very large networks. Phys Rev E 70:066111+
Zurück zum Zitat Davis G, Carley K (2008) Clearing the fog: Fuzzy, overlapping groups for social networks. Social Netw 30:201–212CrossRef Davis G, Carley K (2008) Clearing the fog: Fuzzy, overlapping groups for social networks. Social Netw 30:201–212CrossRef
Zurück zum Zitat de Oliveira TBS, Zhao L (2008). Complex network community detection based on swarm aggregation. In: Proceedings of the 2008 fourth international conference on natural computation, vol 7, ICNC’08, IEEE Computer Society, Washington, DC, pp 604–608 de Oliveira TBS, Zhao L (2008). Complex network community detection based on swarm aggregation. In: Proceedings of the 2008 fourth international conference on natural computation, vol 7, ICNC’08, IEEE Computer Society, Washington, DC, pp 604–608
Zurück zum Zitat Deŕenyi I, Palla G, Vicsek T (2005) Clique percolation in random networks. Phys Rev Lett 94:160202+ Deŕenyi I, Palla G, Vicsek T (2005) Clique percolation in random networks. Phys Rev Lett 94:160202+
Zurück zum Zitat Donetti L, Munoz MA (2004) Detecting network communities: a new systematic and efficient algorithm, 2004. J Stat Mech Theory Exp 10:10012CrossRef Donetti L, Munoz MA (2004) Detecting network communities: a new systematic and efficient algorithm, 2004. J Stat Mech Theory Exp 10:10012CrossRef
Zurück zum Zitat Du N, Wu B, Pei X, Wang B, Xu L (2007) Community detection in large-scale social networks. In: WebKDD/SNA-KDD’07 proceedings of the 9th WebKDD and 1st SNA-KDD 2007 workshop on web mining and social network analysis, ACM, NY, pp 16–25 Du N, Wu B, Pei X, Wang B, Xu L (2007) Community detection in large-scale social networks. In: WebKDD/SNA-KDD’07 proceedings of the 9th WebKDD and 1st SNA-KDD 2007 workshop on web mining and social network analysis, ACM, NY, pp 16–25
Zurück zum Zitat Du N, Wang B, Wu B (2008) Overlapping community structure detection in networks. In: CIKM’08 proceeding of the 17th ACM conference on information and knowledge management, NY, pp 1371–1372 Du N, Wang B, Wu B (2008) Overlapping community structure detection in networks. In: CIKM’08 proceeding of the 17th ACM conference on information and knowledge management, NY, pp 1371–1372
Zurück zum Zitat Everett MG, Borgatti SP (2005) Ego network betweenness. Social Netw 27(1):31–38CrossRef Everett MG, Borgatti SP (2005) Ego network betweenness. Social Netw 27(1):31–38CrossRef
Zurück zum Zitat Ferber J (1999). Multi-agent systems: an introduction to distributed artificial intelligence, 1st edn. Addison-Wesley Longman Publishing Co., Inc., Boston Ferber J (1999). Multi-agent systems: an introduction to distributed artificial intelligence, 1st edn. Addison-Wesley Longman Publishing Co., Inc., Boston
Zurück zum Zitat Freeman LC (1979) Centrality in social networks conceptual clarification. Social Netw 1(3) Freeman LC (1979) Centrality in social networks conceptual clarification. Social Netw 1(3)
Zurück zum Zitat Gleiser PM, Danon L (2003) Community structure in jazz. Adv Complex Syst (ACS) 6(4):565–573 Gleiser PM, Danon L (2003) Community structure in jazz. Adv Complex Syst (ACS) 6(4):565–573
Zurück zum Zitat Granovetter MS (1973) The strength of weak ties. Am J Sociol 78(6):1360–1380CrossRef Granovetter MS (1973) The strength of weak ties. Am J Sociol 78(6):1360–1380CrossRef
Zurück zum Zitat Gregory S (2007) An algorithm to find overlapping community structure in networks. In: PKDD 2007 proceedings of the 11th European conference on principles and practice of knowledge discovery in databases, Springer, Berlin, pp 91–102 Gregory S (2007) An algorithm to find overlapping community structure in networks. In: PKDD 2007 proceedings of the 11th European conference on principles and practice of knowledge discovery in databases, Springer, Berlin, pp 91–102
Zurück zum Zitat Guimera, Danon L, Diaz-Guilera A, Giralt F, Arenas A (2003) Phys Rev E 68:065103(R) Guimera, Danon L, Diaz-Guilera A, Giralt F, Arenas A (2003) Phys Rev E 68:065103(R)
Zurück zum Zitat Hartmann V (2005) Evolving agent swarms for clustering and sorting. In: Proceedings of the 2005 conference on genetic and evolutionary computation, GECCO’05, ACM, New York, pp. 217–224 Hartmann V (2005) Evolving agent swarms for clustering and sorting. In: Proceedings of the 2005 conference on genetic and evolutionary computation, GECCO’05, ACM, New York, pp. 217–224
Zurück zum Zitat Hwang W, Kim T, Ramanathan M, Zhang A (2008) Bridging centrality: graph mining from element level to group level. In: KDD’08 proceeding of the 14th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 336–344 Hwang W, Kim T, Ramanathan M, Zhang A (2008) Bridging centrality: graph mining from element level to group level. In: KDD’08 proceeding of the 14th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 336–344
Zurück zum Zitat Kleinberg J (2000) The small-world phenomenon: an algorithmic perspective. In: Proceedings of the 32nd ACM symposium on theory of computing, pp 163–170 Kleinberg J (2000) The small-world phenomenon: an algorithmic perspective. In: Proceedings of the 32nd ACM symposium on theory of computing, pp 163–170
Zurück zum Zitat Lancichinetti A, Fortunato S (2009a) Community detection algorithms: a comparative analysis. Phys Rev E 80:056117CrossRef Lancichinetti A, Fortunato S (2009a) Community detection algorithms: a comparative analysis. Phys Rev E 80:056117CrossRef
Zurück zum Zitat Lancichinetti A, Fortunato S (2009b) Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities. Phys Rev E 80:016118CrossRef Lancichinetti A, Fortunato S (2009b) Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities. Phys Rev E 80:016118CrossRef
Zurück zum Zitat Lancichinetti A, Fortunato S, Radicchi F (2008) Benchmark graphs for testing community detection algorithms. Phys Rev E 78:046110CrossRef Lancichinetti A, Fortunato S, Radicchi F (2008) Benchmark graphs for testing community detection algorithms. Phys Rev E 78:046110CrossRef
Zurück zum Zitat Lancichinetti A, Fortunato S, Kertesz J (2009). Detecting the overlapping and hierarchical community structure of complex networks, New J Phys 11 Lancichinetti A, Fortunato S, Kertesz J (2009). Detecting the overlapping and hierarchical community structure of complex networks, New J Phys 11
Zurück zum Zitat Leung H, Kothari R, Minai AA (2003) Phase transition in a swarm algorithm for self-organized construction. Phys Rev E 68:046111CrossRef Leung H, Kothari R, Minai AA (2003) Phase transition in a swarm algorithm for self-organized construction. Phys Rev E 68:046111CrossRef
Zurück zum Zitat Liu Y, Wang Q, Wang Q, Yao Q, Liu Y (2007) Email community detection using artificial ant colony clustering. In: Chang KC-C, Wang W, 0002 LC, Ellis CA, Hsu C-H, Tsoi AC, Wang H (eds) APWeb/WAIM Workshops, Lecture notes in computer science, vol 4537, Springer, pp 287–298 Liu Y, Wang Q, Wang Q, Yao Q, Liu Y (2007) Email community detection using artificial ant colony clustering. In: Chang KC-C, Wang W, 0002 LC, Ellis CA, Hsu C-H, Tsoi AC, Wang H (eds) APWeb/WAIM Workshops, Lecture notes in computer science, vol 4537, Springer, pp 287–298
Zurück zum Zitat Liu Y, Luo J, Yang H, Liu L (2010) Finding closely communicating community based on ant colony clustering model. In: International conference on artificial intelligence and computational intelligence, vol 3, pp 127–131 Liu Y, Luo J, Yang H, Liu L (2010) Finding closely communicating community based on ant colony clustering model. In: International conference on artificial intelligence and computational intelligence, vol 3, pp 127–131
Zurück zum Zitat Lusseau D, Schneider K, Boisseau OJ, Haase P, Slooten E, Dawson SM (2003) The bottlenose dolphin community of doubtful sound features a large proportion of long-lasting associations. Behav Ecol Sociobiol 54:396–405CrossRef Lusseau D, Schneider K, Boisseau OJ, Haase P, Slooten E, Dawson SM (2003) The bottlenose dolphin community of doubtful sound features a large proportion of long-lasting associations. Behav Ecol Sociobiol 54:396–405CrossRef
Zurück zum Zitat Moody J, White DR (2003) Structural cohesion and embeddedness: a hierarchical concept of social groups. Am Sociol Rev 68(1):103–127CrossRef Moody J, White DR (2003) Structural cohesion and embeddedness: a hierarchical concept of social groups. Am Sociol Rev 68(1):103–127CrossRef
Zurück zum Zitat Newman MEJ (2004) Fast algorithm for detecting community structure in networks. Phys Rev E 69(6):066133+CrossRef Newman MEJ (2004) Fast algorithm for detecting community structure in networks. Phys Rev E 69(6):066133+CrossRef
Zurück zum Zitat Newman MEJ, Girvan M (2003) Finding and evaluating community structure in networks. Phys Rev E 69(12):026113 Newman MEJ, Girvan M (2003) Finding and evaluating community structure in networks. Phys Rev E 69(12):026113
Zurück zum Zitat Newman ME, Park J (2003) Why social networks are different from other types of networks. Phys Rev E 68(3):036122+CrossRef Newman ME, Park J (2003) Why social networks are different from other types of networks. Phys Rev E 68(3):036122+CrossRef
Zurück zum Zitat Noack A, Rotta R (2009) Multi-level algorithms for modularity clustering. In: SEA’09 proceedings of the 8th international symposium on experimental algorithms, Springer, Berlin, pp 257–268 Noack A, Rotta R (2009) Multi-level algorithms for modularity clustering. In: SEA’09 proceedings of the 8th international symposium on experimental algorithms, Springer, Berlin, pp 257–268
Zurück zum Zitat Palla G, Derenyi I, Farkas I, Vicsek T (2005) Uncovering the overlapping community structure of complex networks in nature and society. Nature 435:814CrossRef Palla G, Derenyi I, Farkas I, Vicsek T (2005) Uncovering the overlapping community structure of complex networks in nature and society. Nature 435:814CrossRef
Zurück zum Zitat Radicchi F, Castellano C, Cecconi F, Loreto V, Parisi D (2004) Defining and identifying communities in networks. Proc Natl Acad Sci USA 101(9):2658–2663CrossRef Radicchi F, Castellano C, Cecconi F, Loreto V, Parisi D (2004) Defining and identifying communities in networks. Proc Natl Acad Sci USA 101(9):2658–2663CrossRef
Zurück zum Zitat Rees BS, Gallagher KB (2010) Overlapping community detection by collective friendship group inference. In: International conference on advances in social network analysis and mining, vol 0, pp 375–379 Rees BS, Gallagher KB (2010) Overlapping community detection by collective friendship group inference. In: International conference on advances in social network analysis and mining, vol 0, pp 375–379
Zurück zum Zitat Rees BS, Gallagher KB (2011) EgoClustering: overlapping community detection via merged friendship-groups. In: Özyer T et al. (eds) The influence of technology on social network analysis and mining, Springer Press, (in press) Rees BS, Gallagher KB (2011) EgoClustering: overlapping community detection via merged friendship-groups. In: Özyer T et al. (eds) The influence of technology on social network analysis and mining, Springer Press, (in press)
Zurück zum Zitat Xie J, Kelley S, Szymanski, BK (2011) Overlapping community detection in networks: the state of the art and comparative study. CoRR abs/1110.5813 Xie J, Kelley S, Szymanski, BK (2011) Overlapping community detection in networks: the state of the art and comparative study. CoRR abs/1110.5813
Zurück zum Zitat Travers J, Milgram S (1969) An experimental study of the small world problem. Sociometry 32(4):425–443CrossRef Travers J, Milgram S (1969) An experimental study of the small world problem. Sociometry 32(4):425–443CrossRef
Zurück zum Zitat Wakita K, Tsurumi T (2007) Finding community structure in mega-scale social networks. In: WWW’07 proceedings of the 16th international conference on World Wide Web, ACM, pp 1275–1276 Wakita K, Tsurumi T (2007) Finding community structure in mega-scale social networks. In: WWW’07 proceedings of the 16th international conference on World Wide Web, ACM, pp 1275–1276
Zurück zum Zitat Wasserman S, Faust K (1994) Social network analysis. Methods and applications. University Press, CambridgeCrossRef Wasserman S, Faust K (1994) Social network analysis. Methods and applications. University Press, CambridgeCrossRef
Zurück zum Zitat Watts DJ, Strogatz SH (1998) Collective dynamics of ‘small-world’ networks. Nature 393(6684):440–442CrossRef Watts DJ, Strogatz SH (1998) Collective dynamics of ‘small-world’ networks. Nature 393(6684):440–442CrossRef
Zurück zum Zitat Weiss G (1999) Multiagent systems: a modern approach to distributed artificial intelligence. MIT Press, Cambridge Weiss G (1999) Multiagent systems: a modern approach to distributed artificial intelligence. MIT Press, Cambridge
Zurück zum Zitat Whitney DE, Alderson D (2010) Are technological and social net-works really different? In: Minai A, Braha D, Bar-Yam Y (eds) Unifying themes in complex systems, Springer, Berlin, pp 74–81 Whitney DE, Alderson D (2010) Are technological and social net-works really different? In: Minai A, Braha D, Bar-Yam Y (eds) Unifying themes in complex systems, Springer, Berlin, pp 74–81
Zurück zum Zitat Zachary W (1977) An information flow model for conflict and fission in small groups. J Anthropol Res 33:452–473 Zachary W (1977) An information flow model for conflict and fission in small groups. J Anthropol Res 33:452–473
Zurück zum Zitat Zhang S, Wang R, Zhang X (2007) Identification of overlapping community structure in complex networks using fuzzy cc-means clustering. Phys A: Stat Mech Appl 374:483–490CrossRef Zhang S, Wang R, Zhang X (2007) Identification of overlapping community structure in complex networks using fuzzy cc-means clustering. Phys A: Stat Mech Appl 374:483–490CrossRef
Metadaten
Titel
Overlapping community detection using a community optimized graph swarm
verfasst von
Bradley S. Rees
Keith B. Gallagher
Publikationsdatum
01.12.2012
Verlag
Springer Vienna
Erschienen in
Social Network Analysis and Mining / Ausgabe 4/2012
Print ISSN: 1869-5450
Elektronische ISSN: 1869-5469
DOI
https://doi.org/10.1007/s13278-012-0050-3

Weitere Artikel der Ausgabe 4/2012

Social Network Analysis and Mining 4/2012 Zur Ausgabe