Skip to main content
Erschienen in: International Journal of Parallel Programming 1/2017

06.10.2015

Parallel Algorithms for Generating Random Networks with Given Degree Sequences

verfasst von: Maksudul Alam, Maleq Khan

Erschienen in: International Journal of Parallel Programming | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Random networks are widely used for modeling and analyzing complex processes. Many mathematical models have been proposed to capture diverse real-world networks. One of the most important aspects of these models is degree distribution. Chung–Lu (CL) model is a random network model, which can produce networks with any given arbitrary degree distribution. The complex systems we deal with nowadays are growing larger and more diverse than ever. Generating random networks with any given degree distribution consisting of billions of nodes and edges or more has become a necessity, which requires efficient and parallel algorithms. We present an MPI-based distributed memory parallel algorithm for generating massive random networks using CL model, which takes \(O\left( \frac{m+n}{P}+P\right) \) time with high probability and O(n) space per processor, where n, m, and P are the number of nodes, edges and processors, respectively. The time efficiency is achieved by using a novel load-balancing algorithm. Our algorithms scale very well to a large number of processors and can generate massive power–law networks with one billion nodes and 250 billion edges in one minute using 1024 processors.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Barabási, A., Albert, R.: Emergence of scaling in random networks. Science 286, 509–512 (1999) Barabási, A., Albert, R.: Emergence of scaling in random networks. Science 286, 509–512 (1999)
2.
Zurück zum Zitat Barrett, C., Beckman, R., Khan, M., Kumar, V., Marathe, M., Stretz, P., Dutta, T., Lewis, B.: Generation and analysis of large synthetic social contact networks. In: Proc. of the Winter Sim. Conf., pp. 1003–1014 (2009) Barrett, C., Beckman, R., Khan, M., Kumar, V., Marathe, M., Stretz, P., Dutta, T., Lewis, B.: Generation and analysis of large synthetic social contact networks. In: Proc. of the Winter Sim. Conf., pp. 1003–1014 (2009)
3.
Zurück zum Zitat Batagelj, V., Brandes, U.: Efficient generation of large random networks. Phys. Rev. E 71(3), 036113 (2005)CrossRef Batagelj, V., Brandes, U.: Efficient generation of large random networks. Phys. Rev. E 71(3), 036113 (2005)CrossRef
4.
Zurück zum Zitat Carlson, J., Doyle, J.: Highly optimized tolerance: a mechanism for power laws in designed systems. Phys. Rev. E 60(2), 1412–1427 (1999)CrossRef Carlson, J., Doyle, J.: Highly optimized tolerance: a mechanism for power laws in designed systems. Phys. Rev. E 60(2), 1412–1427 (1999)CrossRef
5.
Zurück zum Zitat Chakrabarti, D., Zhan, Y., Faloutsos, C.: R-MAT: A recursive model for graph mining. In: Fourth SIAM International Conference on Data Mining, vol. 4, 442–446 (2004) Chakrabarti, D., Zhan, Y., Faloutsos, C.: R-MAT: A recursive model for graph mining. In: Fourth SIAM International Conference on Data Mining, vol. 4, 442–446 (2004)
6.
Zurück zum Zitat Chassin, D., Posse, C.: Evaluating North American electric grid reliability using the Barabasi–Albert network model. Phys. A 335(2), 667–677 (2005)CrossRef Chassin, D., Posse, C.: Evaluating North American electric grid reliability using the Barabasi–Albert network model. Phys. A 335(2), 667–677 (2005)CrossRef
7.
Zurück zum Zitat Chung, F., Lu, L.: Connected components in random graphs with given expected degree sequences. Ann. Comb. 6(2), 125–145 (2002)MathSciNetCrossRefMATH Chung, F., Lu, L.: Connected components in random graphs with given expected degree sequences. Ann. Comb. 6(2), 125–145 (2002)MathSciNetCrossRefMATH
8.
Zurück zum Zitat Erdös, P., Rényi, A.: On the evolution of random graphs. In: Publications of the Mathematical Institute of the Hungarian Academy of Sciences, vol. 5, pp. 17–61 (1960) Erdös, P., Rényi, A.: On the evolution of random graphs. In: Publications of the Mathematical Institute of the Hungarian Academy of Sciences, vol. 5, pp. 17–61 (1960)
9.
Zurück zum Zitat Girvan, M., Newman, M.: Community structure in social and biological networks. Proc. Natl. Acad. Sci. USA 99(12), 7821–7826 (2002)MathSciNetCrossRefMATH Girvan, M., Newman, M.: Community structure in social and biological networks. Proc. Natl. Acad. Sci. USA 99(12), 7821–7826 (2002)MathSciNetCrossRefMATH
11.
Zurück zum Zitat Latora, V., Marchiori, M.: Vulnerability and protection of infrastructure networks. Phys. Rev. E 71(1), 015103 (2005)CrossRef Latora, V., Marchiori, M.: Vulnerability and protection of infrastructure networks. Phys. Rev. E 71(1), 015103 (2005)CrossRef
12.
Zurück zum Zitat Leskovec, J.: Dynamics of Large Networks. Ph.D. thesis, Carnegie Mellon University (2008) Leskovec, J.: Dynamics of Large Networks. Ph.D. thesis, Carnegie Mellon University (2008)
13.
Zurück zum Zitat Leskovec, J., Chakrabarti, D., Kleinberg, J., Faloutsos, C., Ghahramani, Z.: Kronecker graphs: an approach to modeling networks. J. Mach. Learn. Res. 11, 985–1042 (2010)MathSciNetMATH Leskovec, J., Chakrabarti, D., Kleinberg, J., Faloutsos, C., Ghahramani, Z.: Kronecker graphs: an approach to modeling networks. J. Mach. Learn. Res. 11, 985–1042 (2010)MathSciNetMATH
14.
Zurück zum Zitat Leskovec, J., Faloutsos, C.: Scalable modeling of real graphs using Kronecker multiplication. In: Proceedings of the 24th International Conference on Machine Learning, pp. 497–504 (2007) Leskovec, J., Faloutsos, C.: Scalable modeling of real graphs using Kronecker multiplication. In: Proceedings of the 24th International Conference on Machine Learning, pp. 497–504 (2007)
16.
Zurück zum Zitat Miller, J., Hagberg, A.: Efficient generation of networks with given expected degrees. In: Proceedings of Algorithms and Models for the Web-Graph, vol. 6732, pp. 115–126 (2011) Miller, J., Hagberg, A.: Efficient generation of networks with given expected degrees. In: Proceedings of Algorithms and Models for the Web-Graph, vol. 6732, pp. 115–126 (2011)
18.
Zurück zum Zitat Pinar, A., Aykanat, C.: Fast optimal load balancing algorithms for 1D partitioning. J. Parallel Distrib. Comput. 64(8), 974–996 (2004)CrossRefMATH Pinar, A., Aykanat, C.: Fast optimal load balancing algorithms for 1D partitioning. J. Parallel Distrib. Comput. 64(8), 974–996 (2004)CrossRefMATH
19.
Zurück zum Zitat Pinar, A., Seshadhri, C., Kolda, T.: The similarity between stochastic Kronecker and Chung-Lu graph models. In: Proceedings of the 12th International Conference of SDM, vol. 12, pp. 1071–1082 (2012) Pinar, A., Seshadhri, C., Kolda, T.: The similarity between stochastic Kronecker and Chung-Lu graph models. In: Proceedings of the 12th International Conference of SDM, vol. 12, pp. 1071–1082 (2012)
20.
Zurück zum Zitat Robins, G., Pattison, P., Kalish, Y., Lusher, D.: An introduction to exponential random graph (p*) models for social networks social networks. Soc. Netw. 29(2), 173–191 (2007)CrossRef Robins, G., Pattison, P., Kalish, Y., Lusher, D.: An introduction to exponential random graph (p*) models for social networks social networks. Soc. Netw. 29(2), 173–191 (2007)CrossRef
21.
Zurück zum Zitat Sanders, P., Träff, J.: Parallel prefix (scan) algorithms for MPI. In: Proceedings of the 13th Conference on Recent Advances in PVM and MPI, vol. 4192, pp. 49–57 (2006) Sanders, P., Träff, J.: Parallel prefix (scan) algorithms for MPI. In: Proceedings of the 13th Conference on Recent Advances in PVM and MPI, vol. 4192, pp. 49–57 (2006)
22.
Zurück zum Zitat Siganos, G., Faloutsos, M., Faloutsos, P., Faloutsos, C.: Power laws and the AS-level internet topology. IEEE/ACM Trans. Netw. 11(4), 514–524 (2003)CrossRefMATH Siganos, G., Faloutsos, M., Faloutsos, P., Faloutsos, C.: Power laws and the AS-level internet topology. IEEE/ACM Trans. Netw. 11(4), 514–524 (2003)CrossRefMATH
23.
Zurück zum Zitat Watts, D., Strogatz, S.: Collective dynamics of ‘small-world’ networks. Nature 393(6684), 409–410 (1998)CrossRef Watts, D., Strogatz, S.: Collective dynamics of ‘small-world’ networks. Nature 393(6684), 409–410 (1998)CrossRef
24.
Zurück zum Zitat Yang, J., Leskovec, J.: Patterns of temporal variation in online media. In: Proceedings of the 4th ACM International Conference on Web Search and Data Mining, pp. 177–186 (2011) Yang, J., Leskovec, J.: Patterns of temporal variation in online media. In: Proceedings of the 4th ACM International Conference on Web Search and Data Mining, pp. 177–186 (2011)
25.
Zurück zum Zitat Yang, J., Leskovec, J.: Defining and evaluating network communities based on ground-truth. In: Proceedings of the ACM SIGKDD Workshop, pp. 1–8 (2012) Yang, J., Leskovec, J.: Defining and evaluating network communities based on ground-truth. In: Proceedings of the ACM SIGKDD Workshop, pp. 1–8 (2012)
Metadaten
Titel
Parallel Algorithms for Generating Random Networks with Given Degree Sequences
verfasst von
Maksudul Alam
Maleq Khan
Publikationsdatum
06.10.2015
Verlag
Springer US
Erschienen in
International Journal of Parallel Programming / Ausgabe 1/2017
Print ISSN: 0885-7458
Elektronische ISSN: 1573-7640
DOI
https://doi.org/10.1007/s10766-015-0389-y

Weitere Artikel der Ausgabe 1/2017

International Journal of Parallel Programming 1/2017 Zur Ausgabe