Skip to main content

2016 | OriginalPaper | Buchkapitel

The Performance Evaluation of the Java Implementation of Graph500

verfasst von : Magdalena Ryczkowska, Marek Nowicki, Piotr Bala

Erschienen in: Parallel Processing and Applied Mathematics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Graph-based computations are used in many applications. Increasing size of analyzed data and its complexity make graph analysis a challenging task. In this paper we present performance evaluation of Java implementation of Graph500 benchmark. It has been developed with the help of the PCJ (Parallel Computations in Java) library for parallel and distributed computations in Java. PCJ is based on a PGAS (Partitioned Global Address Space) programming paradigm, where all communication details such as threads or network programming are hidden. In this paper, we present Java implementation details of first and second kernel from Graph500 benchmark. The results are compared with the existing MPI implementations of Graph500 benchmark, showing good scalability of PCJ library.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
PCJ has been appreciated as an efficient way of programming parallel applications, receiving HPC Challenge Class 2 Best Productivity Award [12].
 
Literatur
1.
Zurück zum Zitat Lumsdaine, A., Gregor, D., Hendrickson, B., Berry, J.: Challenges in parallel graph processing. Parallel Process. Lett. 17(01), 5–20 (2007)MathSciNetCrossRef Lumsdaine, A., Gregor, D., Hendrickson, B., Berry, J.: Challenges in parallel graph processing. Parallel Process. Lett. 17(01), 5–20 (2007)MathSciNetCrossRef
2.
Zurück zum Zitat Murphy, R.C., Wheeler, K.B., Barrett, B.W., Ang, J.A.: Introducing the Graph 500. Cray Users Group (CUG) (2010) Murphy, R.C., Wheeler, K.B., Barrett, B.W., Ang, J.A.: Introducing the Graph 500. Cray Users Group (CUG) (2010)
3.
Zurück zum Zitat Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008)CrossRef Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008)CrossRef
5.
Zurück zum Zitat Malewicz, G., Austern, M.H., Bik, A.J.C., Dehnert, J.C., Horn, I., Leiser, N., Czajkowski, G.: Pregel: a system for large-scale graph processing. In: SIGMOD (2011) Malewicz, G., Austern, M.H., Bik, A.J.C., Dehnert, J.C., Horn, I., Leiser, N., Czajkowski, G.: Pregel: a system for large-scale graph processing. In: SIGMOD (2011)
6.
Zurück zum Zitat Low, Y., Gonzalez, J., Kyrola, A., Bickson, D., Guestrin, C., Hellerstein, J.M.: GraphLab: a new framework for parallel machine learning. In: UAI (2010) Low, Y., Gonzalez, J., Kyrola, A., Bickson, D., Guestrin, C., Hellerstein, J.M.: GraphLab: a new framework for parallel machine learning. In: UAI (2010)
7.
Zurück zum Zitat Shun, J., Blelloch, G.E.: Ligra: a lightweight graph processing framework for shared memory. ACM SIGPLAN Not. 48(8), 135–146 (2013)CrossRef Shun, J., Blelloch, G.E.: Ligra: a lightweight graph processing framework for shared memory. ACM SIGPLAN Not. 48(8), 135–146 (2013)CrossRef
8.
Zurück zum Zitat Salihoglu, S., Widom, J.: GPS. A graph processing system. In: Proceedings of the 25th International Conference on Scientific and Statistical Database Management, p. 22. ACM (2013) Salihoglu, S., Widom, J.: GPS. A graph processing system. In: Proceedings of the 25th International Conference on Scientific and Statistical Database Management, p. 22. ACM (2013)
9.
Zurück zum Zitat Nowicki, M., Bala, P.: Parallel computations in Java with PCJ library. In: Smari, W.W., Zeljkovic, V. (eds.) International Conference on High Performance Computing and Simulation (HPCS 2012), pp. 381–387. IEEE (2012) Nowicki, M., Bala, P.: Parallel computations in Java with PCJ library. In: Smari, W.W., Zeljkovic, V. (eds.) International Conference on High Performance Computing and Simulation (HPCS 2012), pp. 381–387. IEEE (2012)
10.
Zurück zum Zitat Nowicki, M., Gorski, L., Grabarczyk, P., Bala, P.: PCJ - Java library for high performance computing in PGAS model. In: Smari, W.W., Zeljkovic, V. (eds.) International Conference on High Performance Computing and Simulation (HPCS 2014), pp. 202–209. IEEE (2014) Nowicki, M., Gorski, L., Grabarczyk, P., Bala, P.: PCJ - Java library for high performance computing in PGAS model. In: Smari, W.W., Zeljkovic, V. (eds.) International Conference on High Performance Computing and Simulation (HPCS 2014), pp. 202–209. IEEE (2014)
11.
Zurück zum Zitat Nowicki, M., Bała, P.: PCJ - new approach for parallel computations in java. In: Manninen, P., Öster, P. (eds.) PARA. LNCS, vol. 7782, pp. 115–125. Springer, Heidelberg (2013)CrossRef Nowicki, M., Bała, P.: PCJ - new approach for parallel computations in java. In: Manninen, P., Öster, P. (eds.) PARA. LNCS, vol. 7782, pp. 115–125. Springer, Heidelberg (2013)CrossRef
12.
Zurück zum Zitat Nowicki, M., Gorski, L., Bala, P.: HPC challenge PCJ benchmarks. In: The International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2014, New Orleans (2014) Nowicki, M., Gorski, L., Bala, P.: HPC challenge PCJ benchmarks. In: The International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2014, New Orleans (2014)
13.
Zurück zum Zitat Leskovec, J., Chakrabarti, D., Kleinberg, J., Faloutsos, C., Ghahramani, Z.: Kronecker graphs: an approach to modeling networks. J. Mach. Learn. Res. 11, 985–1042 (2010)MathSciNetMATH Leskovec, J., Chakrabarti, D., Kleinberg, J., Faloutsos, C., Ghahramani, Z.: Kronecker graphs: an approach to modeling networks. J. Mach. Learn. Res. 11, 985–1042 (2010)MathSciNetMATH
14.
Zurück zum Zitat Suzumura, T., Ueno, K., Sato, H., Fujisawa, K., Matsuoka, S.: Performance characteristics of Graph500 on large-scale distributed environment. In: IEEE International Symposium on Workload Characterization (IISWC 2011), pp. 149–158. IEEE (2011) Suzumura, T., Ueno, K., Sato, H., Fujisawa, K., Matsuoka, S.: Performance characteristics of Graph500 on large-scale distributed environment. In: IEEE International Symposium on Workload Characterization (IISWC 2011), pp. 149–158. IEEE (2011)
15.
Zurück zum Zitat Amer, A., Lu, H., Balaji, P., Matsuoka, S.: MPI+ threads applications at scale: a case study with parallel breadth-first search. In: 2nd Workshop on Parallel Programming Model for the Masses. IEEE (2015) Amer, A., Lu, H., Balaji, P., Matsuoka, S.: MPI+ threads applications at scale: a case study with parallel breadth-first search. In: 2nd Workshop on Parallel Programming Model for the Masses. IEEE (2015)
16.
Zurück zum Zitat Cong, G., Almasi, G., Saraswat, V.: Fast PGAS connected components algorithms. In: Proceedings of the Third Conference on Partitioned Global Address Space Programing Models, p. 13. ACM (2009) Cong, G., Almasi, G., Saraswat, V.: Fast PGAS connected components algorithms. In: Proceedings of the Third Conference on Partitioned Global Address Space Programing Models, p. 13. ACM (2009)
17.
Zurück zum Zitat Jose, J., Potluri, S., Luo, M., Sur, S., Panda, D.: UPC queues for scalable graph travelsals: design and evaluation on infiniband clusters. In: Conference on PGAS Programming Models (2011) Jose, J., Potluri, S., Luo, M., Sur, S., Panda, D.: UPC queues for scalable graph travelsals: design and evaluation on infiniband clusters. In: Conference on PGAS Programming Models (2011)
18.
Zurück zum Zitat Cong, G., Almasi, G., Saraswat, V.: Fast PGAS implementation of distributed graph algorithms. In: Proceedings of the ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, pp. 1–11. IEEE Computer Society (2010) Cong, G., Almasi, G., Saraswat, V.: Fast PGAS implementation of distributed graph algorithms. In: Proceedings of the ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, pp. 1–11. IEEE Computer Society (2010)
19.
Zurück zum Zitat Bao, N.T., Suzumura, T.: Toward highly scalable pregel-based graph processing platform with X10. In: Proceedings of the 22nd International Conference on World Wide Web Companion, pp. 501–508. International World Wide Web Conferences Steering Committee (2013) Bao, N.T., Suzumura, T.: Toward highly scalable pregel-based graph processing platform with X10. In: Proceedings of the 22nd International Conference on World Wide Web Companion, pp. 501–508. International World Wide Web Conferences Steering Committee (2013)
20.
Zurück zum Zitat Ryczkowska, M.: Evaluating PCJ library for graph problems - Graph500 in PCJ. In: Smari, W.W., Zeljkovic, V. (eds.) Internationa Conference on High Performance Computing and Simulation (HPCS 2014), pp. 1005–1007. IEEE (2014) Ryczkowska, M.: Evaluating PCJ library for graph problems - Graph500 in PCJ. In: Smari, W.W., Zeljkovic, V. (eds.) Internationa Conference on High Performance Computing and Simulation (HPCS 2014), pp. 1005–1007. IEEE (2014)
Metadaten
Titel
The Performance Evaluation of the Java Implementation of Graph500
verfasst von
Magdalena Ryczkowska
Marek Nowicki
Piotr Bala
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-32152-3_21

Premium Partner