Skip to main content
Erschienen in: The Journal of Supercomputing 7/2020

27.03.2019

Programming bsp and multi-bsp algorithms in ml

Erschienen in: The Journal of Supercomputing | Ausgabe 7/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The bsml and multi-ml languages have been designed for programming, à laml, algorithms of the respectively bsp and multi-bsp bridging models. multi-bsp is an extension of the well-know bsp model by taking into account the different levels of networks and memories of modern hierarchical architectures. This is a rather new model, as well as multi-ml is a new language, while bsp and bsml have been used for a long time in many different domains. Intuitively, designing and programming multi-bsp algorithms seems more complex than with bsp, and one can ask whether it is beneficial to rewrite bsp algorithms using the multi-bsp model. In this paper, we thus investigate the pro and cons of the aforementioned models and languages by experimenting with them on different typical applications. For this, we use a methodology to measure the level of difficulty of writing code and we also benchmark them in order to show whether writing multi-ml code is worth the effort.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Fußnoten
1
We currently make the hypothesis that the more complicated the codes are, the more complicated the algorithmic design is. We leave the problematic of algorithmic design for future work and we focus on code writing only.
 
2
We do not show the bsp parameters nor the multi-bsp ones because we do not use them at all in this work. In fact, cost prediction is rather impossible in some of our application cases, e.g. the state-space construction where the number of computing states is unknown and no upper bound is possible in practice [9].
 
Literatur
1.
Zurück zum Zitat Alabduljalil MA, Tang X, Yang T (2013) Optimizing parallel algorithms for all pairs similarity search. In: Proceedings of the Sixth ACM International Conference on Web Search and Data Mining, WSDM ’13, New York, NY, USA. ACM, pp 203–212 Alabduljalil MA, Tang X, Yang T (2013) Optimizing parallel algorithms for all pairs similarity search. In: Proceedings of the Sixth ACM International Conference on Web Search and Data Mining, WSDM ’13, New York, NY, USA. ACM, pp 203–212
2.
Zurück zum Zitat Allombert V (2017) Functional abstraction for programming multi-level architectures: formalisation and implementation Allombert V (2017) Functional abstraction for programming multi-level architectures: formalisation and implementation
3.
Zurück zum Zitat Allombert V, Gava F, Tesson J (2017) Multi-ML: programming multi-BSP algorithms in ML. Int J Parallel Program 45(2):20CrossRef Allombert V, Gava F, Tesson J (2017) Multi-ML: programming multi-BSP algorithms in ML. Int J Parallel Program 45(2):20CrossRef
4.
Zurück zum Zitat Alt MH (2007) Using algorithmic skeletons for efficient grid computing with predictable performance. Ph.D. thesis, Münster University Alt MH (2007) Using algorithmic skeletons for efficient grid computing with predictable performance. Ph.D. thesis, Münster University
5.
Zurück zum Zitat Bayardo RJ, Ma Y, Srikant R (2017) Scaling up all pairs similarity search. In: Proceedings of the 16th International Conference on World Wide Web, WWW ’07, New York, NY, USA. ACM, pp 131–140 Bayardo RJ, Ma Y, Srikant R (2017) Scaling up all pairs similarity search. In: Proceedings of the 16th International Conference on World Wide Web, WWW ’07, New York, NY, USA. ACM, pp 131–140
6.
Zurück zum Zitat Bisseling RH (2004) Parallel scientific computation: a structured approach using BSP and MPI. Oxford University Press, OxfordCrossRef Bisseling RH (2004) Parallel scientific computation: a structured approach using BSP and MPI. Oxford University Press, OxfordCrossRef
7.
Zurück zum Zitat Cappello F, Etiemble D (2000) MPI versus MPI+OpenMP on IBM SP for the NAS benchmarks. In: Proceedings of the 2000 ACM/IEEE Conference on Supercomputing, SC ’00, Washington, DC, USA. IEEE Computer Society Cappello F, Etiemble D (2000) MPI versus MPI+OpenMP on IBM SP for the NAS benchmarks. In: Proceedings of the 2000 ACM/IEEE Conference on Supercomputing, SC ’00, Washington, DC, USA. IEEE Computer Society
8.
Zurück zum Zitat Chakravarty MMT, Keller G, Lechtchinsky R, Pfannenstiel W (2001) Nepal-nested data parallelism in Haskell. In: Proceedings of the 7th International Euro-Par Conference Manchester on Parallel Processing, London, UK. Springer-Verlag, pp 524–534 Chakravarty MMT, Keller G, Lechtchinsky R, Pfannenstiel W (2001) Nepal-nested data parallelism in Haskell. In: Proceedings of the 7th International Euro-Par Conference Manchester on Parallel Processing, London, UK. Springer-Verlag, pp 524–534
9.
Zurück zum Zitat Clarke EM, Henzinger TA, Veith H, Bloem R (2012) Handbook of model checking. Springer, BerlinMATH Clarke EM, Henzinger TA, Veith H, Bloem R (2012) Handbook of model checking. Springer, BerlinMATH
10.
Zurück zum Zitat Cole M (2004) Bringing skeletons out of the closet: a pragmatic manifesto for skeletal parallel programming. Parallel Comput 30(3):389–406CrossRef Cole M (2004) Bringing skeletons out of the closet: a pragmatic manifesto for skeletal parallel programming. Parallel Comput 30(3):389–406CrossRef
11.
12.
Zurück zum Zitat Garavel H, Mateescu R, Smarandache I (2001) Parallel state space construction for model-checking. Research report Garavel H, Mateescu R, Smarandache I (2001) Parallel state space construction for model-checking. Research report
13.
Zurück zum Zitat Gava F (2008) BSP functional programming: examples of a cost based methodology. In: Bubak M, van Albada GD, Dongarra J, Sloot PMA (eds) Computational Science—ICCS 2008. Springer, Berlin Heidelberg, pp 375–385 Gava F (2008) BSP functional programming: examples of a cost based methodology. In: Bubak M, van Albada GD, Dongarra J, Sloot PMA (eds) Computational Science—ICCS 2008. Springer, Berlin Heidelberg, pp 375–385
14.
Zurück zum Zitat Gesbert L, Gava F, Loulergue F, Dabrowski F (2010) Bulk synchronous parallel ML with exceptions. Future Gener Comput Syst 26(3):486–490CrossRef Gesbert L, Gava F, Loulergue F, Dabrowski F (2010) Bulk synchronous parallel ML with exceptions. Future Gener Comput Syst 26(3):486–490CrossRef
15.
Zurück zum Zitat Hamidouche K, Falcou J, Etiemble D (2011) A framework for an automatic hybrid MPI+OpenMP code generation. In: Proceedings of the 19th High Performance Computing Symposia, San Diego, CA, USA. Society for Computer Simulation International, pp 48–55 Hamidouche K, Falcou J, Etiemble D (2011) A framework for an automatic hybrid MPI+OpenMP code generation. In: Proceedings of the 19th High Performance Computing Symposia, San Diego, CA, USA. Society for Computer Simulation International, pp 48–55
16.
Zurück zum Zitat Kessler CW (2000) NestStep: nested parallelism and virtual shared memory for the BSP model. J Supercomput 17(3):245–262CrossRef Kessler CW (2000) NestStep: nested parallelism and virtual shared memory for the BSP model. J Supercomput 17(3):245–262CrossRef
17.
Zurück zum Zitat Li C, Hains G (2012) SGL: towards a bridging model for heterogeneous hierarchical platforms. Int J Parallel Program 7(2):139–151 Li C, Hains G (2012) SGL: towards a bridging model for heterogeneous hierarchical platforms. Int J Parallel Program 7(2):139–151
18.
Zurück zum Zitat Loidl H-W, Rubio F, Scaife N, Hammond K, Horiguchi S, Klusik U, Loogen R, Michaelson GJ, Peña R, Priebe S, Rebón ÁJ, Trinder PW (2003) Comparing parallel functional languages: programming and performance. High Order Symb Comput 16(3):203–251CrossRef Loidl H-W, Rubio F, Scaife N, Hammond K, Horiguchi S, Klusik U, Loogen R, Michaelson GJ, Peña R, Priebe S, Rebón ÁJ, Trinder PW (2003) Comparing parallel functional languages: programming and performance. High Order Symb Comput 16(3):203–251CrossRef
19.
Zurück zum Zitat Malewicz G, Austern MH, Bik AJ, Dehnert JC, Horn I, Leiser N, Czajkowski G (2010) Pregel: a system for large-scale graph processing. In: Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, New York, NY, USA. ACM, pp 135–146 Malewicz G, Austern MH, Bik AJ, Dehnert JC, Horn I, Leiser N, Czajkowski G (2010) Pregel: a system for large-scale graph processing. In: Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, New York, NY, USA. ACM, pp 135–146
20.
Zurück zum Zitat Saad RT, Dal Zilio S, Berthomieu B (2011) Mixed shared-distributed hash tables approaches for parallel state space construction. In: International Symposium on Parallel and Distributed Computing (ISPDC 2011), Cluj-Napoca, Romania Saad RT, Dal Zilio S, Berthomieu B (2011) Mixed shared-distributed hash tables approaches for parallel state space construction. In: International Symposium on Parallel and Distributed Computing (ISPDC 2011), Cluj-Napoca, Romania
21.
Zurück zum Zitat Seo S, Yoon E, Kim J, Jin S, Kim J-S, Maeng S (2010) HAMA: an efficient matrix computation with the MapReduce framework. In: 2010 IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom), pp 721–726 Seo S, Yoon E, Kim J, Jin S, Kim J-S, Maeng S (2010) HAMA: an efficient matrix computation with the MapReduce framework. In: 2010 IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom), pp 721–726
22.
Zurück zum Zitat Sivaramakrishnan KC, Ziarek L, Jagannathan S (2014) MultiMLton: a multicore-aware runtime for standard ML. J Funct Program 24(06):613–674CrossRef Sivaramakrishnan KC, Ziarek L, Jagannathan S (2014) MultiMLton: a multicore-aware runtime for standard ML. J Funct Program 24(06):613–674CrossRef
23.
Zurück zum Zitat Skillicorn DB, Hill JMD, McColl WF (1997) Questions and answers about BSP. Sci Program 6(3):249–274 Skillicorn DB, Hill JMD, McColl WF (1997) Questions and answers about BSP. Sci Program 6(3):249–274
24.
Zurück zum Zitat Tang X, Alabduljalil M, Jin X, Yang T (2017) Partitioned similarity search with cache-conscious data traversal. ACM Trans Knowl Discov Data 11(3):1–34CrossRef Tang X, Alabduljalil M, Jin X, Yang T (2017) Partitioned similarity search with cache-conscious data traversal. ACM Trans Knowl Discov Data 11(3):1–34CrossRef
25.
Zurück zum Zitat Valiant LG (1990) A bridging model for parallel computation. Commun ACM 33(8):103–111CrossRef Valiant LG (1990) A bridging model for parallel computation. Commun ACM 33(8):103–111CrossRef
Metadaten
Titel
Programming bsp and multi-bsp algorithms in ml
Publikationsdatum
27.03.2019
Erschienen in
The Journal of Supercomputing / Ausgabe 7/2020
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-019-02822-9

Weitere Artikel der Ausgabe 7/2020

The Journal of Supercomputing 7/2020 Zur Ausgabe