skip to main content
10.1145/2858036.2858071acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
note

Communities Found by Users -- not Algorithms: Comparing Human and Algorithmically Generated Communities

Published:07 May 2016Publication History

ABSTRACT

Many algorithms have been created to automatically detect community structures in social networks. These algorithms have been studied from the perspective of optimisation extensively. However, which community finding algorithm most closely matches the human notion of communities? In this paper, we conduct a user study to address this question. In our experiment, users collected their own Facebook network and manually annotated it, indicating their social communities. Given this annotation, we run state-of-the-art community finding algorithms on the network and use Normalised Mutual Information (NMI) to compare annotated communities with automatically detected ones. Our results show that the Infomap algorithm has the greatest similarity to user defined communities, with Girvan-Newman and Louvain algorithms also performing well.

References

  1. R. Aldecoa and I. Marín. 2013. Exploring the limits of community detection strategies in complex networks. Scientific Reports 3 (2013), 2216 EP.Google ScholarGoogle Scholar
  2. V. D. Blondel, J. Guillaume, R. Lambiotte, and E. Lefebvre. 2008. Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment 2008, 10 (Oct. 2008), P10008. DOI:http://dx.doi.org/10.1088/1742-5468/2008/10/P10008Google ScholarGoogle ScholarCross RefCross Ref
  3. M. Bostock, V. Ogievetsky, and J. Heer. 2011. D3 Data-Driven Documents. IEEE Transactions on Visualization and Computer Graphics 17, 12 (Dec. 2011), 2301--2309. DOI: http://dx.doi.org/10.1109/TVCG.2011.185 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. T. Dwyer, L. Bongshin, D. Fisher, K.I. Quinn, P. Isenberg, G. Robertson, and C. North. 2009. A Comparison of User-Generated and Automatic Graph Layouts. Visualization and Computer Graphics, IEEE Transactions on 15, 6 (2009), 961--968. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. P.A. Estevez, M. Tesmer, C.A. Perez, and J.M. Zurada. 2009. Normalized Mutual Information Feature Selection. Neural Networks, IEEE Transactions on 20, 2 (Feb 2009), 189--201. DOI: http://dx.doi.org/10.1109/TNN.2008.2005601 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. M. Girvan and M. E. J. Newman. 2002. Community structure in social and biological networks. Proceedings of the National Academy of Sciences 99, 12 (2002), 7821--7826. DOI: http://dx.doi.org/10.1073/pnas.122653799Google ScholarGoogle ScholarCross RefCross Ref
  7. D. Hansen, B. Shneiderman, and M. A. Smith. 2010. Analyzing Social Media Networks with NodeXL: Insights from a Connected World. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. B. Hogan, J. A. Carrasco, and B. Wellman. 2007. Visualizing personal networks: working with participant-aided sociograms. Field Methods 19, 2 (2007), 116--144.Google ScholarGoogle ScholarCross RefCross Ref
  9. A. Lancichinetti and S. Fortunato. 2009. Community detection algorithms: A comparative analysis. Phys. Rev. E 80 (Nov 2009), 056117. Issue 5. DOI: http://dx.doi.org/10.1103/PhysRevE.80.056117Google ScholarGoogle ScholarCross RefCross Ref
  10. A. Lancichinetti, S. Fortunato, and F. Radicchi. 2008. Benchmark graphs for testing community detection algorithms. Phys. Rev. E 78 (Oct 2008), 046110. Issue 4. DOI: http://dx.doi.org/10.1103/PhysRevE.78.046110Google ScholarGoogle ScholarCross RefCross Ref
  11. A. Lancichinetti, F. Radicchi, J. J. Ramasco, and S. Fortunato. 2011. Finding Statistically Significant Communities in Networks. PLoS ONE 6, 4 (04 2011), e18961. DOI: http://dx.doi.org/10.1371/journal.pone.0018961Google ScholarGoogle Scholar
  12. G. K. Orman, V. Labatut, and H. Cherifi. 2013. Towards Realistic Artificial Benchmark for Community Detection Algorithms Evaluation. Int. J. Web Based Communities 9, 3 (June 2013), 349--370. DOI: http://dx.doi.org/10.1504/IJWBC.2013.054908 Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. G. Palla, I. Derenyi, I. Farkas, and T. Vicsek. 2005. Uncovering the overlapping community structure of complex networks in nature and society. Nature 435, 7043 (09 06 2005), 814--818. http://dx.doi.org/10.1038/nature03607Google ScholarGoogle Scholar
  14. H.C. Purchase, C. Pilcher, and B. Plimmer. 2012. Graph Drawing Aesthetics -- Created by Users, Not Algorithms. Visualization and Computer Graphics, IEEE Transactions on 18, 1 (Jan 2012), 81--92. DOI: http://dx.doi.org/10.1109/TVCG.2010.269 Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. H. C. Purchase. 2013. Sketched Graph Drawing: A Lesson in Empirical Studies. In Proc. of Graph Drawing (GD '13). LNCS, Vol. 8242. 232--243.Google ScholarGoogle Scholar
  16. H. C. Purchase. 2014. A healthy critical attitude: Revisiting the results of a graph drawing study. Journal of Graph Algorithms and Applications 18, 2 (2014), 281--311. DOI: http://dx.doi.org/10.7155/jgaa.00323Google ScholarGoogle ScholarCross RefCross Ref
  17. M. Rosvall, D. Axelsson, and C. T. Bergstrom. 2009. The map equation. The European Physical Journal Special Topics 178, 1 (2009), 13--23. DOI: http://dx.doi.org/10.1140/epjst/e2010-01179--1Google ScholarGoogle ScholarCross RefCross Ref
  18. M. Rosvall and C. T. Bergstrom. 2007. An information-theoretic framework for resolving community structure in complex networks. Proceedings of the National Academy of Sciences 104, 18 (2007), 7327--7331. DOI: http://dx.doi.org/10.1073/pnas.0611034104Google ScholarGoogle ScholarCross RefCross Ref
  19. F. van Ham and B. Rogowitz. 2008. Perceptual Organization in User-Generated Graph Layouts. Visualization and Computer Graphics, IEEE Transactions on 14, 6 (Nov 2008), 1333--1339. DOI: http://dx.doi.org/10.1109/TVCG.2008.155 Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. E. Ziv, M. Middendorf, and C. H. Wiggins. 2005. Information-theoretic approach to network modularity. Physical Review E 71(4 Pt 2) (Apr 2005), 046117. Epub 2005 Apr 14. http://link.aps.org/abstract/PRE/v71/e046117Google ScholarGoogle Scholar

Index Terms

  1. Communities Found by Users -- not Algorithms: Comparing Human and Algorithmically Generated Communities

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
      May 2016
      6108 pages
      ISBN:9781450333627
      DOI:10.1145/2858036

      Copyright © 2016 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 7 May 2016

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • note

      Acceptance Rates

      CHI '16 Paper Acceptance Rate565of2,435submissions,23%Overall Acceptance Rate6,199of26,314submissions,24%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader