Skip to main content
Erschienen in:
Buchtitelbild

2021 | OriginalPaper | Buchkapitel

Phoenix: A Scalable Streaming Hypergraph Analysis Framework

verfasst von : Kuldeep Kurte, Neena Imam, S. M. Shamimul Hasan, Ramakrishnan Kannan

Erschienen in: Advances in Data Science and Information Engineering

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present Phoenix, a scalable hypergraph analytics framework for data analytics and knowledge discovery that was implemented on the leadership class computing platforms at Oak Ridge National Laboratory (ORNL). Our software framework comprises a distributed implementation of a streaming server architecture which acts as a gateway for various hypergraph generators/external sources to connect. Phoenix has the capability to utilize diverse hypergraph generators, including HyGen, a very large-scale hypergraph generator developed by ORNL. Phoenix incorporates specific algorithms for efficient data representation by exploiting hidden structures of the hypergraphs. Our experimental results demonstrate Phoenix’s scalable and stable performance on massively parallel computing platforms. Phoenix’s superior performance is due to the merging of high-performance computing with data analytic.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat S. Agarwal, K. Branson, S. Belongie, Higher order learning with graphs, in Proceedings of the 23rd international conference on Machine learning (2006), pp. 17–24 S. Agarwal, K. Branson, S. Belongie, Higher order learning with graphs, in Proceedings of the 23rd international conference on Machine learning (2006), pp. 17–24
2.
Zurück zum Zitat A. Antelmi et al., SimpleHypergraphs.jl–novel software framework for modelling and analysis of hypergraphs, in International Workshop on Algorithms and Models for the Web-Graph (Springer, Cham, 2019), pp. 115–129 A. Antelmi et al., SimpleHypergraphs.jl–novel software framework for modelling and analysis of hypergraphs, in International Workshop on Algorithms and Models for the Web-Graph (Springer, Cham, 2019), pp. 115–129
5.
Zurück zum Zitat D. Ediger et al., STINGER: High performance data structure for streaming graphs, in 2012 IEEE Conference on High Performance Extreme Computing (2012), pp. 1–5 D. Ediger et al., STINGER: High performance data structure for streaming graphs, in 2012 IEEE Conference on High Performance Extreme Computing (2012), pp. 1–5
6.
Zurück zum Zitat E. Estrada, J. Rodriguez-Velazquez, Complex networks as hypergraphs (2005) . Arxiv preprint physics 0505137 E. Estrada, J. Rodriguez-Velazquez, Complex networks as hypergraphs (2005) . Arxiv preprint physics 0505137
7.
Zurück zum Zitat G. Feng, X. Meng, K. Ammar, DISTINGER: A distributed graph data structure for massive dynamic graph processing, in 2015 IEEE International Conference on Big Data (Big Data) (2015), pp. 1814–1822 G. Feng, X. Meng, K. Ammar, DISTINGER: A distributed graph data structure for massive dynamic graph processing, in 2015 IEEE International Conference on Big Data (Big Data) (2015), pp. 1814–1822
10.
Zurück zum Zitat V. Hernandez, J.E. Roman, V. Vidal, SLEPc: A scalable and flexible toolkit for the solution of eigenvalue problems. ACM Trans. Math. Softw. (TOMS) 31(3), 351–362 (2005) V. Hernandez, J.E. Roman, V. Vidal, SLEPc: A scalable and flexible toolkit for the solution of eigenvalue problems. ACM Trans. Math. Softw. (TOMS) 31(3), 351–362 (2005)
11.
Zurück zum Zitat P. Hintjens, ZeroMQ: messaging for many applications (O’Reilly Media, Newton, 2013) P. Hintjens, ZeroMQ: messaging for many applications (O’Reilly Media, Newton, 2013)
15.
Zurück zum Zitat W. Jiang et al., HyperX: A scalable hypergraph framework. IEEE Trans. Knowl. Data Eng. 31(5), 909–922 (2019)CrossRef W. Jiang et al., HyperX: A scalable hypergraph framework. IEEE Trans. Knowl. Data Eng. 31(5), 909–922 (2019)CrossRef
17.
Zurück zum Zitat J. Leskovec et al., Kronecker graphs: An approach to modeling networks. J. Mach. Learn. Res. 11, 985–1042 (2010)MathSciNetMATH J. Leskovec et al., Kronecker graphs: An approach to modeling networks. J. Mach. Learn. Res. 11, 985–1042 (2010)MathSciNetMATH
18.
Zurück zum Zitat A. Lugowski et al., Scalable complex graph analysis with the knowledge discovery toolbox, in 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2012), pp. 5345–5348 A. Lugowski et al., Scalable complex graph analysis with the knowledge discovery toolbox, in 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2012), pp. 5345–5348
24.
Zurück zum Zitat S. Schlag et al., K-way hypergraph partitioning via n-level recursive bisection, in 2016 Proceedings of the Eighteenth Workshop on Algorithm Engineering and Experiments (ALENEX) (SIAM, Philadelphia, 2016), pp. 53–67CrossRef S. Schlag et al., K-way hypergraph partitioning via n-level recursive bisection, in 2016 Proceedings of the Eighteenth Workshop on Algorithm Engineering and Experiments (ALENEX) (SIAM, Philadelphia, 2016), pp. 53–67CrossRef
25.
Zurück zum Zitat P. Sen et al., Collective classification in network data. AI Mag.29(3), 93–93 (2008) P. Sen et al., Collective classification in network data. AI Mag.29(3), 93–93 (2008)
27.
Zurück zum Zitat J. Winick, S. Jamin, Inet-3.0: Internet topology generator. Technical Report CSE-TR-456-02, University of Michigan, 2002 J. Winick, S. Jamin, Inet-3.0: Internet topology generator. Technical Report CSE-TR-456-02, University of Michigan, 2002
28.
Zurück zum Zitat M.M. Wolf, A.M. Klinvex, D.M. Dunlavy, Advantages to modeling relational data using hypergraphs versus graphs, in 2016 IEEE High Performance Extreme Computing Conference (HPEC) (2016), pp. 1–7 M.M. Wolf, A.M. Klinvex, D.M. Dunlavy, Advantages to modeling relational data using hypergraphs versus graphs, in 2016 IEEE High Performance Extreme Computing Conference (HPEC) (2016), pp. 1–7
29.
Zurück zum Zitat D.E. Womble et al., Early experiences on summit: data analytics and AI applications. IBM J. Res. Devel. 63(6), 2:1–2:9 (2019) D.E. Womble et al., Early experiences on summit: data analytics and AI applications. IBM J. Res. Devel. 63(6), 2:1–2:9 (2019)
30.
Zurück zum Zitat N. Yadati et al., HyperGCN: a new method for training graph convolutional networks on hypergraphs, in Advances in Neural Information Processing Systems (2019), pp. 1509–1520 N. Yadati et al., HyperGCN: a new method for training graph convolutional networks on hypergraphs, in Advances in Neural Information Processing Systems (2019), pp. 1509–1520
31.
Zurück zum Zitat A. Yoo, A.H. Baker, R. Pearce, A scalable eigensolver for large scale-free graphs using 2D graph partitioning, in Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (2011), pp. 1–11 A. Yoo, A.H. Baker, R. Pearce, A scalable eigensolver for large scale-free graphs using 2D graph partitioning, in Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (2011), pp. 1–11
32.
Zurück zum Zitat J. You et al., Graphrnn: Generating realistic graphs with deep autoregressive models (2018). Preprint. arXiv:1802.08773 J. You et al., Graphrnn: Generating realistic graphs with deep autoregressive models (2018). Preprint. arXiv:1802.08773
33.
Zurück zum Zitat D. Zhou, J. Huang, B. Schölkopf, Learning with hypergraphs: Clustering, classification, and embedding, in Advances in Neural Information Processing Systems (2007), pp. 1601–1608 D. Zhou, J. Huang, B. Schölkopf, Learning with hypergraphs: Clustering, classification, and embedding, in Advances in Neural Information Processing Systems (2007), pp. 1601–1608
Metadaten
Titel
Phoenix: A Scalable Streaming Hypergraph Analysis Framework
verfasst von
Kuldeep Kurte
Neena Imam
S. M. Shamimul Hasan
Ramakrishnan Kannan
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-71704-9_1

Premium Partner