Skip to main content
Top
Published in: Neural Computing and Applications 10/2021

01-09-2020 | Original Article

A local-to-global scheme-based multi-objective evolutionary algorithm for overlapping community detection on large-scale complex networks

Authors: Haiping Ma, Haipeng Yang, Kefei Zhou, Lei Zhang, Xingyi Zhang

Published in: Neural Computing and Applications | Issue 10/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recently, multi-objective evolutionary algorithms (MOEAs) have been shown promising performance for detecting overlapping community structure in complex networks. However, it is still challenging to design MOEAs for overlapping community detection on large-scale complex networks due to the curse of dimensionality. Along this avenue, this paper proposes a local-to-global scheme-based MOEA named LG-MOEA for overlapping community detection on large-scale complex networks, which mainly consists of two stages: a local community structure detection stage and a global community structure determination stage. To be specific, in the local community structure detection stage, the key nodes that are central to community and essential to the connectedness of community are firstly identified. Then for each key node, an MOEA with the proposed community boundary control strategy is suggested to detect a set of local overlapping communities through local expansion around the key node. In the global community structure determination stage, a single objective evolutionary algorithm is adopted to search for a suitable local overlapping community for each key node and combine them as one global community partition of the whole network. The proposed LG-MOEA is compared with several competitive overlapping community detection algorithms on both real-world small-scale and large-scale networks, and the experimental results show its superiority for overlapping community detection in terms of the generalized normalized mutual information gNMI and the extended modularity \(Q_{ov}\), especially has competitive superiority for large-scale complex networks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Zhang X, Zhou K, Pan H, Zhang L, Zeng X, Jin Y (2020) A network reduction-based multiobjective evolutionary algorithm for community detection in large-scale complex networks. IEEE Trans Syst Man Cybern 50(2):703–716 Zhang X, Zhou K, Pan H, Zhang L, Zeng X, Jin Y (2020) A network reduction-based multiobjective evolutionary algorithm for community detection in large-scale complex networks. IEEE Trans Syst Man Cybern 50(2):703–716
2.
go back to reference Wasserman S, Faust K (2015) Social network analysis methods and applications. Struct Anal Soc Sci 24(435):219–220MATH Wasserman S, Faust K (2015) Social network analysis methods and applications. Struct Anal Soc Sci 24(435):219–220MATH
3.
go back to reference Pastorsatorras R, Vespignani A (2007) Evolution and structure of the Internet: a statistical physics approach. Cambridge University Press, Cambridge Pastorsatorras R, Vespignani A (2007) Evolution and structure of the Internet: a statistical physics approach. Cambridge University Press, Cambridge
4.
go back to reference Clara P, Rombo S SE (2014) Algorithms and tools for protein-protein interaction networks clustering, with a special focus on population-based stochastic methods. Bioinformatics 30(10):1343–1352CrossRef Clara P, Rombo S SE (2014) Algorithms and tools for protein-protein interaction networks clustering, with a special focus on population-based stochastic methods. Bioinformatics 30(10):1343–1352CrossRef
5.
go back to reference Girvan M, Newman MEJ (2002) Community structure in social and biological networks. Proc Natl Acad Sci 99(12):7821–7826MathSciNetCrossRef Girvan M, Newman MEJ (2002) Community structure in social and biological networks. Proc Natl Acad Sci 99(12):7821–7826MathSciNetCrossRef
6.
go back to reference Pizzuti C (2012) A multiobjective genetic algorithm to find communities in complex networks. IEEE Trans Evol Comput 16(3):418–430CrossRef Pizzuti C (2012) A multiobjective genetic algorithm to find communities in complex networks. IEEE Trans Evol Comput 16(3):418–430CrossRef
7.
go back to reference Gong M, Ma L, Zhang Q, Jiao L, Gong M, Ma L, Zhang Q, Jiao L (2012) Community detection in networks by using multiobjective evolutionary algorithm with decomposition. Physica A 391(15):4050–4060CrossRef Gong M, Ma L, Zhang Q, Jiao L, Gong M, Ma L, Zhang Q, Jiao L (2012) Community detection in networks by using multiobjective evolutionary algorithm with decomposition. Physica A 391(15):4050–4060CrossRef
8.
go back to reference Shi C, Yan Z, Cai Y, Wu B (2012) Multi-objective community detection in complex networks. Appl Soft Comput 12(2):850–859CrossRef Shi C, Yan Z, Cai Y, Wu B (2012) Multi-objective community detection in complex networks. Appl Soft Comput 12(2):850–859CrossRef
9.
go back to reference Gong M, Cai Q, Chen X, Ma L (2014) Complex network clustering by multiobjective discrete particle swarm optimization based on decomposition. IEEE Trans Evol Comput 18(1):82–97CrossRef Gong M, Cai Q, Chen X, Ma L (2014) Complex network clustering by multiobjective discrete particle swarm optimization based on decomposition. IEEE Trans Evol Comput 18(1):82–97CrossRef
10.
go back to reference Rosvall M, Bergstrom CT (2007) Maps of random walks on complex networks reveal community structure. Proc Natl Acad Sci USA 105(4):1118–1123CrossRef Rosvall M, Bergstrom CT (2007) Maps of random walks on complex networks reveal community structure. Proc Natl Acad Sci USA 105(4):1118–1123CrossRef
11.
go back to reference Pons P, Latapy M (2005) Computing communities in large networks using random walks. In: Proceedings of 20th international symposium on computer and information sciences, pp 284–293 Pons P, Latapy M (2005) Computing communities in large networks using random walks. In: Proceedings of 20th international symposium on computer and information sciences, pp 284–293
12.
13.
go back to reference JöRg R, Stefan B (2006) Statistical mechanics of community detection. Phys Rev E Stat Nonlinear Soft Matter Phys 74(1):016110MathSciNetCrossRef JöRg R, Stefan B (2006) Statistical mechanics of community detection. Phys Rev E Stat Nonlinear Soft Matter Phys 74(1):016110MathSciNetCrossRef
14.
go back to reference Su Y, Zhou K, Zhang X, Cheng R, Zheng C (2020) A parallel multi-objective evolutionary algorithm for community detection in large-scale complex networks. Information Science (Major Revision) Su Y, Zhou K, Zhang X, Cheng R, Zheng C (2020) A parallel multi-objective evolutionary algorithm for community detection in large-scale complex networks. Information Science (Major Revision)
15.
go back to reference Wen X, Chen W, Lin Y, Gu T, Zhang H, Li Y, Yin Y, Zhang J (2017) A maximal clique based multiobjective evolutionary algorithm for overlapping community detection. IEEE Trans Evol Comput 21(3):363–377 Wen X, Chen W, Lin Y, Gu T, Zhang H, Li Y, Yin Y, Zhang J (2017) A maximal clique based multiobjective evolutionary algorithm for overlapping community detection. IEEE Trans Evol Comput 21(3):363–377
16.
go back to reference Ren W, Yan G, Liao X et al (2009) Simple probabilistic algorithm for detecting community structure. Phys Rev E 79(33):036111CrossRef Ren W, Yan G, Liao X et al (2009) Simple probabilistic algorithm for detecting community structure. Phys Rev E 79(33):036111CrossRef
17.
go back to reference Lu M, Zhang Z, Qu Z, Kang Y (2019) Lpanni: overlapping community detection using label propagation in large-scale complex networks. IEEE Trans Knowl Data Eng 31(9):1736–1749CrossRef Lu M, Zhang Z, Qu Z, Kang Y (2019) Lpanni: overlapping community detection using label propagation in large-scale complex networks. IEEE Trans Knowl Data Eng 31(9):1736–1749CrossRef
18.
go back to reference Brian K, Newman MEJ (2005) Uncovering the overlapping community structures of complex networks in nature and society. Nature 435(7043):814–818CrossRef Brian K, Newman MEJ (2005) Uncovering the overlapping community structures of complex networks in nature and society. Nature 435(7043):814–818CrossRef
19.
go back to reference Shen H, Cheng X, Cai K (2009) Detect overlapping and hierarchical community structure in networks. Physica A 388(8):1706–1712CrossRef Shen H, Cheng X, Cai K (2009) Detect overlapping and hierarchical community structure in networks. Physica A 388(8):1706–1712CrossRef
20.
go back to reference Zhang X, Wang C, Su Y, Pan L, Zhang H (2017) A fast overlapping community detection algorithm based on weak cliques for large-scale networks. IEEE Trans Comput Soc Syst 4(4):218–230CrossRef Zhang X, Wang C, Su Y, Pan L, Zhang H (2017) A fast overlapping community detection algorithm based on weak cliques for large-scale networks. IEEE Trans Comput Soc Syst 4(4):218–230CrossRef
21.
go back to reference Shi C, Cai Y, Fu D, Dong Y, Wu B (2013) A link clustering based overlapping community detection algorithm. Data Knowl Eng 87:394–404CrossRef Shi C, Cai Y, Fu D, Dong Y, Wu B (2013) A link clustering based overlapping community detection algorithm. Data Knowl Eng 87:394–404CrossRef
22.
go back to reference Jin D, Gabrys B, Dang J (2015) Combined node and link partitions method for finding overlapping communities in complex networks. Sci Rep 5(1):8600–8600CrossRef Jin D, Gabrys B, Dang J (2015) Combined node and link partitions method for finding overlapping communities in complex networks. Sci Rep 5(1):8600–8600CrossRef
23.
go back to reference Bandyopadhyay S, Chowdhary G, Sengupta D (2015) Focs: fast overlapped community search. IEEE Trans Knowl Data Eng 27(11):2974–2985CrossRef Bandyopadhyay S, Chowdhary G, Sengupta D (2015) Focs: fast overlapped community search. IEEE Trans Knowl Data Eng 27(11):2974–2985CrossRef
24.
go back to reference Liu Z, Xiang B, Guo W, Chen Y, Guo K, Zheng J (2019) Overlapping community detection algorithm based on coarsening and local overlapping modularity. IEEE Access 7:57943–57955CrossRef Liu Z, Xiang B, Guo W, Chen Y, Guo K, Zheng J (2019) Overlapping community detection algorithm based on coarsening and local overlapping modularity. IEEE Access 7:57943–57955CrossRef
25.
go back to reference Li Y, Wang Y, Chen J, Jiao L, Shang R (2015) Overlapping community detection through an improved multi-objective quantum-behaved particle swarm optimization. J Heuristics 21(4):549–575CrossRef Li Y, Wang Y, Chen J, Jiao L, Shang R (2015) Overlapping community detection through an improved multi-objective quantum-behaved particle swarm optimization. J Heuristics 21(4):549–575CrossRef
26.
go back to reference Liu C, Liu J, Jiang Z (2014) A multiobjective evolutionary algorithm based on similarity for community detection from signed social networks. IEEE Trans Cybern 44(12):2274–2287CrossRef Liu C, Liu J, Jiang Z (2014) A multiobjective evolutionary algorithm based on similarity for community detection from signed social networks. IEEE Trans Cybern 44(12):2274–2287CrossRef
27.
go back to reference Liu J, Zhong W, Abbass HA, Green DG (2010) Separated and overlapping community detection in complex networks using multiobjective evolutionary algorithms. In: Proceedings of 2010 congress on evolutionary computation, pp 1–7 Liu J, Zhong W, Abbass HA, Green DG (2010) Separated and overlapping community detection in complex networks using multiobjective evolutionary algorithms. In: Proceedings of 2010 congress on evolutionary computation, pp 1–7
28.
go back to reference Zhang L, Pan H, Su Y, Zhang X, Niu Y (2017) A mixed representation-based multiobjective evolutionary algorithm for overlapping community detection. IEEE Trans Syst Man Cybern 47(9):2703–2716 Zhang L, Pan H, Su Y, Zhang X, Niu Y (2017) A mixed representation-based multiobjective evolutionary algorithm for overlapping community detection. IEEE Trans Syst Man Cybern 47(9):2703–2716
29.
go back to reference Fortunato S, Barthelemy M (2007) Resolution limit in community detection. Proc Natl Acad Sci USA 104(1):36–41CrossRef Fortunato S, Barthelemy M (2007) Resolution limit in community detection. Proc Natl Acad Sci USA 104(1):36–41CrossRef
30.
go back to reference Pizzuti C (2009) A multi-objective genetic algorithm for community detection in networks. In: Proceedings of 21st international conference on tools with artificial intelligence, pp 379–386 Pizzuti C (2009) A multi-objective genetic algorithm for community detection in networks. In: Proceedings of 21st international conference on tools with artificial intelligence, pp 379–386
31.
go back to reference Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197CrossRef Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197CrossRef
32.
go back to reference Corne DW, Jerram NR, Knowles JD, Oates MJ (2001) PESA-II: region-based selection in evolutionary multiobjective optimization. In: Proceedings of the 3rd annual conference on genetic and evolutionary computation, pp 283–290 Corne DW, Jerram NR, Knowles JD, Oates MJ (2001) PESA-II: region-based selection in evolutionary multiobjective optimization. In: Proceedings of the 3rd annual conference on genetic and evolutionary computation, pp 283–290
33.
go back to reference Zhang T, Wu B (2012) A method for local community detection by finding core nodes. In: International conference on advances in social networks analysis and mining, pp 1171–1176 Zhang T, Wu B (2012) A method for local community detection by finding core nodes. In: International conference on advances in social networks analysis and mining, pp 1171–1176
34.
go back to reference Luo W, Zhang D, Hao J, Li N, Hu Y (2018) Local community detection with the dynamic membership function. IEEE Trans Fuzzy Syst 26(5):3136–3150CrossRef Luo W, Zhang D, Hao J, Li N, Hu Y (2018) Local community detection with the dynamic membership function. IEEE Trans Fuzzy Syst 26(5):3136–3150CrossRef
35.
go back to reference Palazuelos C, Zorrilla M (2011) Fringe: a new approach to the detection of overlapping communities in graphs. In: International conference on computational science & its applications, pp 638–653 Palazuelos C, Zorrilla M (2011) Fringe: a new approach to the detection of overlapping communities in graphs. In: International conference on computational science & its applications, pp 638–653
36.
go back to reference Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731CrossRef Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731CrossRef
37.
go back to reference Whang JJ, Gleich DF, Dhillon IS (2016) Overlapping community detection using neighborhood-inflated seed expansion. IEEE Trans Knowl Data Eng 28(5):1272–1284CrossRef Whang JJ, Gleich DF, Dhillon IS (2016) Overlapping community detection using neighborhood-inflated seed expansion. IEEE Trans Knowl Data Eng 28(5):1272–1284CrossRef
38.
go back to reference Newman M (2011) Communities, modules and large-scale structure in networks. Nat Phys 8:25–31CrossRef Newman M (2011) Communities, modules and large-scale structure in networks. Nat Phys 8:25–31CrossRef
39.
go back to reference Lancichinetti A, Fortunato S, Kertész J (2008) Detecting the overlapping and hierarchical community structure in complex networks. New J Phys 11(3):033015CrossRef Lancichinetti A, Fortunato S, Kertész J (2008) Detecting the overlapping and hierarchical community structure in complex networks. New J Phys 11(3):033015CrossRef
40.
go back to reference Ahn Y, Bagrow JP, Lehmann S (2010) Link communities reveal multiscale complexity in networks. Nature 466(7307):761–764CrossRef Ahn Y, Bagrow JP, Lehmann S (2010) Link communities reveal multiscale complexity in networks. Nature 466(7307):761–764CrossRef
41.
go back to reference Yang J, Leskovec J (2013) Overlapping community detection at scale: a nonnegative matrix factorization approach. In: Web search and data mining, pp 587–596 Yang J, Leskovec J (2013) Overlapping community detection at scale: a nonnegative matrix factorization approach. In: Web search and data mining, pp 587–596
42.
go back to reference Chen Q, Wu T, Fang M (2013) Detecting local community structures in complex networks based on local degree central nodes. Physica A Stat Mech Appl 392(3):529–537CrossRef Chen Q, Wu T, Fang M (2013) Detecting local community structures in complex networks based on local degree central nodes. Physica A Stat Mech Appl 392(3):529–537CrossRef
43.
go back to reference Zachary WW (1977) An information flow model for conflict and fission in small groups. J Anthropol Res 33(4):452–473CrossRef Zachary WW (1977) An information flow model for conflict and fission in small groups. J Anthropol Res 33(4):452–473CrossRef
44.
go back to reference Lusseau D (2003) The emergent properties of a dolphin social network. Proc R Soc B Biol Sci 270(2):186–188 Lusseau D (2003) The emergent properties of a dolphin social network. Proc R Soc B Biol Sci 270(2):186–188
45.
go back to reference Newman MEJ (2006) Modularity and community structure in networks. Proc Natl Acad Sci 103(23):8577–8582CrossRef Newman MEJ (2006) Modularity and community structure in networks. Proc Natl Acad Sci 103(23):8577–8582CrossRef
46.
go back to reference Gregory S (2007) An algorithm to find overlapping community structure in networks. In: European conference on principles of data mining and knowledge discovery, pp 91–102 Gregory S (2007) An algorithm to find overlapping community structure in networks. In: European conference on principles of data mining and knowledge discovery, pp 91–102
48.
go back to reference Lancichinetti A, Fortunato S, Kertész J (2009) Detecting the overlapping and hierarchical community structure in complex networks. New J Phys 11(3):033015CrossRef Lancichinetti A, Fortunato S, Kertész J (2009) Detecting the overlapping and hierarchical community structure in complex networks. New J Phys 11(3):033015CrossRef
49.
go back to reference Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(1):1–30MathSciNetMATH Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(1):1–30MathSciNetMATH
Metadata
Title
A local-to-global scheme-based multi-objective evolutionary algorithm for overlapping community detection on large-scale complex networks
Authors
Haiping Ma
Haipeng Yang
Kefei Zhou
Lei Zhang
Xingyi Zhang
Publication date
01-09-2020
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 10/2021
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05311-w

Other articles of this Issue 10/2021

Neural Computing and Applications 10/2021 Go to the issue

S.I. : Higher Level Artificial Neural Network Based Intelligent Systems

An automated estimator for Cobb angle measurement using multi-task networks

Premium Partner