Skip to main content
Erschienen in: The Journal of Supercomputing 11/2017

15.05.2017

Improvement of workload balancing using parallel loop self-scheduling on Intel Xeon Phi

verfasst von: Chao-Tung Yang, Chao-Wei Huang, Shuo-Tsung Chen

Erschienen in: The Journal of Supercomputing | Ausgabe 11/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In recent years, Intel promotes its new product Xeon Phi coprocessor, which is similar to the x86 architecture coprocessor. It has about 60 cores and can be regarded as a single computing node, with the computing power that cannot be ignored. This work aims to improve the workload balance by parallel loop self-scheduling scheme performed on Xeon Phi-based computer cluster. The proposed concept is implemented by hybrid MPI and OpenMP parallel programming in C language. Since parallel loop self-scheduling composes of static and dynamic allocation, weighting algorithm is adopted in the static part, while the well-known loop self-scheduling is adopted in dynamic part. The loop block is partitioned according to the weighting of MIC and HOST nodes. Accordingly, Xeon Phi with many-core is adopted to implement parallel loop self-scheduling. Finally, we test the performance in the experiments by four applicable problems: matrix multiplication, sparse matrix multiplication, Mandelbrot set and circuit meet. The experimental results indicate how to do the weight allocation and which scheduling method can achieve the best performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Heinecke A (2013) Accelerators in scientific computing is it worth the effort? In: 2013 International Conference on High Performance Computing and Simulation (HPCS), p 504 Heinecke A (2013) Accelerators in scientific computing is it worth the effort? In: 2013 International Conference on High Performance Computing and Simulation (HPCS), p 504
2.
Zurück zum Zitat Rosales C (2013) Porting to the intel xeon phi: opportunities and challenges. In: Extreme Scaling Workshop, pp 1–7 Rosales C (2013) Porting to the intel xeon phi: opportunities and challenges. In: Extreme Scaling Workshop, pp 1–7
3.
Zurück zum Zitat Hwu W mei (2014) What is ahead for parallel computing. J Parallel Distrib Comput 74:2574–2581CrossRef Hwu W mei (2014) What is ahead for parallel computing. J Parallel Distrib Comput 74:2574–2581CrossRef
4.
Zurück zum Zitat Andrew M, Justin R, Alan G, Herman L (2014) A multi-tiered optimization framework for heterogeneous computing. In: High Performance Extreme Computing Conference (HPEC), IEEE, pp 1–6 Andrew M, Justin R, Alan G, Herman L (2014) A multi-tiered optimization framework for heterogeneous computing. In: High Performance Extreme Computing Conference (HPEC), IEEE, pp 1–6
5.
Zurück zum Zitat Yang C-T, Shih W-C, Tseng S-S (2007) Dynamic partitioning of loop iterations on heterogeneous pc clusters. J Supercomput 44:1–23CrossRef Yang C-T, Shih W-C, Tseng S-S (2007) Dynamic partitioning of loop iterations on heterogeneous pc clusters. J Supercomput 44:1–23CrossRef
6.
7.
Zurück zum Zitat Wu C-C, Yang C-T, Lai K-C, Chiu P-H (2012) Designing parallel loop self-scheduling schemes using the hybrid mpi and openmp programming model for multi-core grid systems. J Supercomput 59:42–60CrossRef Wu C-C, Yang C-T, Lai K-C, Chiu P-H (2012) Designing parallel loop self-scheduling schemes using the hybrid mpi and openmp programming model for multi-core grid systems. J Supercomput 59:42–60CrossRef
8.
Zurück zum Zitat Shih W-C, Yang C-T, Tseng S-S (2007) A performance-based parallel loop scheduling on grid environments. J Supercomput 41:247–267CrossRef Shih W-C, Yang C-T, Tseng S-S (2007) A performance-based parallel loop scheduling on grid environments. J Supercomput 41:247–267CrossRef
9.
Zurück zum Zitat Yang C-T, Shih W-C, Cheng L-H (2012) Performance-based dynamic loop scheduling in heterogeneous computing environments. J Supercomput 59:414–442CrossRef Yang C-T, Shih W-C, Cheng L-H (2012) Performance-based dynamic loop scheduling in heterogeneous computing environments. J Supercomput 59:414–442CrossRef
10.
Zurück zum Zitat Ca B, Gb L (2002) Load balancing for heterogeneous clusters of pcs. Future Gener Comput Syst 18:389–400CrossRef Ca B, Gb L (2002) Load balancing for heterogeneous clusters of pcs. Future Gener Comput Syst 18:389–400CrossRef
11.
Zurück zum Zitat Yagoubi B, Slimani Y (2007) Load balancing strategy in grid environment. J Inf Technol Appl 1:285–296 Yagoubi B, Slimani Y (2007) Load balancing strategy in grid environment. J Inf Technol Appl 1:285–296
12.
Zurück zum Zitat Abdelkader DM, Omara F (2012) Dynamic task scheduling algorithm with load balancing for heterogeneous computing system. Egypt Inf J 13:135–145CrossRef Abdelkader DM, Omara F (2012) Dynamic task scheduling algorithm with load balancing for heterogeneous computing system. Egypt Inf J 13:135–145CrossRef
13.
Zurück zum Zitat Yang C-T, Wu C-C, Chang J-H (2011) Performance-based parallel loop self-scheduling using hybrid openmp and mpi programming on multicore smp clusters. Concurr Comput Pract Exp 23:721–744CrossRef Yang C-T, Wu C-C, Chang J-H (2011) Performance-based parallel loop self-scheduling using hybrid openmp and mpi programming on multicore smp clusters. Concurr Comput Pract Exp 23:721–744CrossRef
14.
Zurück zum Zitat Huang CW, Kuo CF, Yang CT, Liu JC, Chen ST (2015) Improvement of workload balancing using parallel loop self-scheduling on xeon phi. In: Seventh International Symposium on Parallel Architectures, Algorithms and Programming (PAAP), pp 80–86 Huang CW, Kuo CF, Yang CT, Liu JC, Chen ST (2015) Improvement of workload balancing using parallel loop self-scheduling on xeon phi. In: Seventh International Symposium on Parallel Architectures, Algorithms and Programming (PAAP), pp 80–86
21.
Zurück zum Zitat Yang C-T, Cheng K-W, Li K-C (2005) An enhanced parallel loop self-scheduling scheme for cluster environments. J Supercomput 34:315–335CrossRef Yang C-T, Cheng K-W, Li K-C (2005) An enhanced parallel loop self-scheduling scheme for cluster environments. J Supercomput 34:315–335CrossRef
22.
Zurück zum Zitat Yang C-T, Chang S-C (2004) A parallel loop self-scheduling on extremely heterogeneous pc clusters. J Inf Sci Eng 20:263–273 Yang C-T, Chang S-C (2004) A parallel loop self-scheduling on extremely heterogeneous pc clusters. J Inf Sci Eng 20:263–273
23.
Zurück zum Zitat Yang C-T, Cheng K-W, Shih W-C (2007) On development of an efficient parallel loop self-scheduling for grid computing environments. Parallel Comput 33:467–487CrossRef Yang C-T, Cheng K-W, Shih W-C (2007) On development of an efficient parallel loop self-scheduling for grid computing environments. Parallel Comput 33:467–487CrossRef
24.
Zurück zum Zitat Han Y, Chronopoulos AT Scalable loop self-scheduling schemes implemented on large-scale clusters. In: IEEE International Symposium on Parallel and Distributed Processing, pp 1735–1742 Han Y, Chronopoulos AT Scalable loop self-scheduling schemes implemented on large-scale clusters. In: IEEE International Symposium on Parallel and Distributed Processing, pp 1735–1742
25.
Zurück zum Zitat Sukhija N, Banicescu I, Ciorba FM (2015) Investigating the resilience of dynamic loop scheduling in heterogeneous computing systems. In: 14th International Symposium on Parallel and Distributed Computing, pp 194–203 Sukhija N, Banicescu I, Ciorba FM (2015) Investigating the resilience of dynamic loop scheduling in heterogeneous computing systems. In: 14th International Symposium on Parallel and Distributed Computing, pp 194–203
26.
Zurück zum Zitat Carino RL, Banicescu I Dynamic scheduling parallel loops with variable iterate execution times. In: Proceedings 16th International Parallel and Distributed Processing Symposium, p 8 Carino RL, Banicescu I Dynamic scheduling parallel loops with variable iterate execution times. In: Proceedings 16th International Parallel and Distributed Processing Symposium, p 8
27.
Zurück zum Zitat Riakiotakis I, Papakonstantinou G, Chronopoulos AT (2008) Implementation of dynamic loop scheduling in reconfigurable platforms. In: 2008 International Symposium on Industrial Embedded Systems, pp 11–18 Riakiotakis I, Papakonstantinou G, Chronopoulos AT (2008) Implementation of dynamic loop scheduling in reconfigurable platforms. In: 2008 International Symposium on Industrial Embedded Systems, pp 11–18
Metadaten
Titel
Improvement of workload balancing using parallel loop self-scheduling on Intel Xeon Phi
verfasst von
Chao-Tung Yang
Chao-Wei Huang
Shuo-Tsung Chen
Publikationsdatum
15.05.2017
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 11/2017
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-017-2068-9

Weitere Artikel der Ausgabe 11/2017

The Journal of Supercomputing 11/2017 Zur Ausgabe