Skip to main content
Top

2022 | OriginalPaper | Chapter

Selecting Informative Features for Post-hoc Community Explanation

Authors : Sophie Sadler, Derek Greene, Daniel Archambault

Published in: Complex Networks & Their Applications X

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Community finding algorithms are complex, often stochastic algorithms used to detect highly-connected groups of nodes in a graph. As with “black-box” machine learning models, these algorithms typically provide little in the way of explanation or insight into their outputs. In this research paper, inspired by recent work in explainable artificial intelligence (XAI), we look to develop post-hoc explanations for community finding, which are agnostic of the choice of algorithm. Specifically, we propose a new approach to identify features that indicate whether a set of nodes comprises a coherent community or not. We evaluate our methodology, which selects interpretable features from a longlist of candidates, in the context of three well-known community finding algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
A non-proceedings poster on this topic was presented at the GEM workshop at ECML-PKDD 2021.
 
2
Results and implementations for the statistical analysis process are available on OSF: https://​osf.​io/​g4bwt/​.
 
Literature
1.
go back to reference Blondel, V.D., Guillaume, J.L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. J. Stat. Mech. Theory Exp. 2008(10), P10008 (2008)CrossRefMATH Blondel, V.D., Guillaume, J.L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. J. Stat. Mech. Theory Exp. 2008(10), P10008 (2008)CrossRefMATH
3.
go back to reference Brown, R.C., Fischer, T., Goldwich, A.D., Keller, F., Young, R., Plener, P.L.: #cutting: non-suicidal self-injury (NSSI) on Instagram. Psychol. Med. 48(2), 337–346 (2017)CrossRef Brown, R.C., Fischer, T., Goldwich, A.D., Keller, F., Young, R., Plener, P.L.: #cutting: non-suicidal self-injury (NSSI) on Instagram. Psychol. Med. 48(2), 337–346 (2017)CrossRef
4.
go back to reference Chakraborty, T., Srinivasan, S., Ganguly, N., Bhowmick, S., Mukherjee, A.: Constant communities in complex networks. Sci. Rep. 3(1), 1–9 (2013)CrossRef Chakraborty, T., Srinivasan, S., Ganguly, N., Bhowmick, S., Mukherjee, A.: Constant communities in complex networks. Sci. Rep. 3(1), 1–9 (2013)CrossRef
5.
go back to reference Dao, V.L., Bothorel, C., Lenca, P.: Community structures evaluation in complex networks: a descriptive approach. In: Shmueli E., Barzel B., Puzis R. (eds) 3rd International Winter School and Conference on Network Science. NetSci-X 2017. Springer Proceedings in Complexity, pp. 11–19. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-55471-6_2 (2017) Dao, V.L., Bothorel, C., Lenca, P.: Community structures evaluation in complex networks: a descriptive approach. In: Shmueli E., Barzel B., Puzis R. (eds) 3rd International Winter School and Conference on Network Science. NetSci-X 2017. Springer Proceedings in Complexity, pp. 11–19. Springer, Cham (2017). https://​doi.​org/​10.​1007/​978-3-319-55471-6_​2 (2017)
8.
go back to reference Hagberg, A., Swart, P.S., Chult, D.: Exploring network structure, dynamics, and function using networkx. Technical report, Los Alamos National Lab., NM (2008) Hagberg, A., Swart, P.S., Chult, D.: Exploring network structure, dynamics, and function using networkx. Technical report, Los Alamos National Lab., NM (2008)
9.
go back to reference Keane, M.T., Kenny, E.M.: How case-based reasoning explains neural networks: a theoretical analysis of XAI using Post-Hoc explanation-by-example from a survey of ANN-CBR twin-systems. In: Bach, K., Marling, C. (eds) Case-Based Reasoning Research and Development. ICCBR 2019. LNCS, vol. 11680, pp. 155–171. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29249-2_11 Keane, M.T., Kenny, E.M.: How case-based reasoning explains neural networks: a theoretical analysis of XAI using Post-Hoc explanation-by-example from a survey of ANN-CBR twin-systems. In: Bach, K., Marling, C. (eds) Case-Based Reasoning Research and Development. ICCBR 2019. LNCS, vol. 11680, pp. 155–171. Springer, Cham (2019). https://​doi.​org/​10.​1007/​978-3-030-29249-2_​11
10.
go back to reference Keane, M.T., Kenny, E.M.: The Twin-System Approach as One Generic Solution for XAI: An Overview of ANN-CBR Twins for Explaining Deep Learning. arXiv 1905.08069 (2019) Keane, M.T., Kenny, E.M.: The Twin-System Approach as One Generic Solution for XAI: An Overview of ANN-CBR Twins for Explaining Deep Learning. arXiv 1905.08069 (2019)
11.
go back to reference Lancichinetti, A., Fortunato, S.: Community detection algorithms: a comparative analysis. Phys. Rev. E Stat. Nonlinear Soft Matter Phys. 80(5), 1–12 (2009)CrossRef Lancichinetti, A., Fortunato, S.: Community detection algorithms: a comparative analysis. Phys. Rev. E Stat. Nonlinear Soft Matter Phys. 80(5), 1–12 (2009)CrossRef
12.
go back to reference Lancichinetti, A., Fortunato, S.: Consensus clustering in complex networks. Sci. Rep. 2(1), 1–7 (2012)CrossRef Lancichinetti, A., Fortunato, S.: Consensus clustering in complex networks. Sci. Rep. 2(1), 1–7 (2012)CrossRef
13.
go back to reference Lancichinetti, A., Fortunato, S., Radicchi, F.: Benchmark graphs for testing community detection algorithms. Phys. Rev. E Stat. Nonlinear Soft Matter Physics 78(4), 1–6 (2008)CrossRef Lancichinetti, A., Fortunato, S., Radicchi, F.: Benchmark graphs for testing community detection algorithms. Phys. Rev. E Stat. Nonlinear Soft Matter Physics 78(4), 1–6 (2008)CrossRef
14.
go back to reference Lee, A., Archambault, D.: Communities found by Users – not algorithms. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 2396–2400 (2016) Lee, A., Archambault, D.: Communities found by Users – not algorithms. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 2396–2400 (2016)
15.
go back to reference Loyola-Gonzalez, O., Gutierrez-Rodríguez, A.E., Medina-Pérez, M.A., Monroy, R., Martínez-Trinidad, J.F., Carrasco-Ochoa, J.A., Garcia-Borroto, M.: An explainable artificial intelligence model for clustering numerical databases. IEEE Access 8, 52370–52384 (2020)CrossRef Loyola-Gonzalez, O., Gutierrez-Rodríguez, A.E., Medina-Pérez, M.A., Monroy, R., Martínez-Trinidad, J.F., Carrasco-Ochoa, J.A., Garcia-Borroto, M.: An explainable artificial intelligence model for clustering numerical databases. IEEE Access 8, 52370–52384 (2020)CrossRef
16.
go back to reference Lundberg, S.M., Lee, S.I.: A unified approach to interpreting model predictions. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 4768–4777 (2017) Lundberg, S.M., Lee, S.I.: A unified approach to interpreting model predictions. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 4768–4777 (2017)
18.
go back to reference Morichetta, A., Casas, P., Mellia, M.: EXPLAIN-IT: towards explainable AI for unsupervised network traffic analysis. In: Proceedings of the 3rd ACM CoNEXT Workshop on Big DAta, Machine Learning and Artificial Intelligence for Data Communication Networks, pp. 22–28 (2019) Morichetta, A., Casas, P., Mellia, M.: EXPLAIN-IT: towards explainable AI for unsupervised network traffic analysis. In: Proceedings of the 3rd ACM CoNEXT Workshop on Big DAta, Machine Learning and Artificial Intelligence for Data Communication Networks, pp. 22–28 (2019)
19.
go back to reference Newman, M., Clauset, A.: Structure and inference in annotated networks. Nat. Commun. 7, 1–11 (2016)CrossRef Newman, M., Clauset, A.: Structure and inference in annotated networks. Nat. Commun. 7, 1–11 (2016)CrossRef
20.
go back to reference Orman, G., Labatut, V., Cherifi, H.: Comparative evaluation of community detection algorithms: a topological approach. J. Stat. Mech. Theory Exp. 2012(08), P08001 (2012)CrossRef Orman, G., Labatut, V., Cherifi, H.: Comparative evaluation of community detection algorithms: a topological approach. J. Stat. Mech. Theory Exp. 2012(08), P08001 (2012)CrossRef
21.
go back to reference Raghavan, U.N., Albert, R., Kumara, S.: Near linear time algorithm to detect community structures in large-scale networks. Phys. Rev. E 76(3), 036106 (2007)CrossRef Raghavan, U.N., Albert, R., Kumara, S.: Near linear time algorithm to detect community structures in large-scale networks. Phys. Rev. E 76(3), 036106 (2007)CrossRef
22.
go back to reference Ribeiro, M.T., Singh, S., Guestrin, C.: “Why should I trust you?” Explaining the predictions of any classifier. In: Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135–1144 (2016) Ribeiro, M.T., Singh, S., Guestrin, C.: “Why should I trust you?” Explaining the predictions of any classifier. In: Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135–1144 (2016)
23.
go back to reference Rosvall, M., Bergstrom, C.T.: Maps of random walks on complex networks reveal community structure. Proc Natl. Acad. Sci. USA 105(4), 1118–1123 (2008)CrossRef Rosvall, M., Bergstrom, C.T.: Maps of random walks on complex networks reveal community structure. Proc Natl. Acad. Sci. USA 105(4), 1118–1123 (2008)CrossRef
24.
25.
go back to reference Valente, T.W., Yon, G.G.V.: Diffusion/contagion processes on social networks. Health Educ. Beha. 47(2), 235–248 (2020)CrossRef Valente, T.W., Yon, G.G.V.: Diffusion/contagion processes on social networks. Health Educ. Beha. 47(2), 235–248 (2020)CrossRef
26.
go back to reference Wachter, S., Mittelstadt, B., Russell, C.: Counterfactual explanations without opening the black box: Automated decisions and the GDPR. Harvard J. Law Technol. 31, 841 (2017) Wachter, S., Mittelstadt, B., Russell, C.: Counterfactual explanations without opening the black box: Automated decisions and the GDPR. Harvard J. Law Technol. 31, 841 (2017)
27.
go back to reference Watts, D.J., Strogatz, S.H.: Collective dynamics of “small-world’’ networks. Nature 393, 440–442 (1998)CrossRefMATH Watts, D.J., Strogatz, S.H.: Collective dynamics of “small-world’’ networks. Nature 393, 440–442 (1998)CrossRefMATH
Metadata
Title
Selecting Informative Features for Post-hoc Community Explanation
Authors
Sophie Sadler
Derek Greene
Daniel Archambault
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-030-93409-5_25

Premium Partner